-- Logs begin at Sat 2021-11-06 20:01:16 UTC, end at Sat 2021-11-06 22:31:59 UTC. -- Nov 06 20:35:52.087453 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 06 20:35:52.095368 ncdv-master-1 devstack@n-api.service[118605]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 6 20:35:52 2021] *** Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: nodename: ncdv-master-1 Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: machine: x86_64 Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: clock source: unix Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: pcre jit disabled Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: detected number of CPU cores: 4 Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: current working directory: / Nov 06 20:35:52.098497 ncdv-master-1 devstack@n-api.service[118605]: detected binary path: /usr/bin/uwsgi-core Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: your processes number limit is 47680 Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: your memory page size is 4096 bytes Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: detected max file descriptor number: 2048 Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: lock engine: pthread robust mutexes Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: thunder lock: enabled Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 06 20:35:52.100093 ncdv-master-1 devstack@n-api.service[118605]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 06 20:35:52.146882 ncdv-master-1 devstack@n-api.service[118605]: Python main interpreter initialized at 0x5561d9a979c0 Nov 06 20:35:52.146882 ncdv-master-1 devstack@n-api.service[118605]: python threads support enabled Nov 06 20:35:52.146882 ncdv-master-1 devstack@n-api.service[118605]: your server socket listen backlog is limited to 100 connections Nov 06 20:35:52.146882 ncdv-master-1 devstack@n-api.service[118605]: your mercy for graceful operations on workers is 90 seconds Nov 06 20:35:52.147235 ncdv-master-1 devstack@n-api.service[118605]: mapped 403077 bytes (393 KB) for 2 cores Nov 06 20:35:52.147235 ncdv-master-1 devstack@n-api.service[118605]: *** Operational MODE: preforking *** Nov 06 20:35:52.147486 ncdv-master-1 devstack@n-api.service[118605]: *** uWSGI is running in multiple interpreter mode *** Nov 06 20:35:52.147486 ncdv-master-1 devstack@n-api.service[118605]: spawned uWSGI master process (pid: 118605) Nov 06 20:35:52.147673 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 06 20:35:52.155254 ncdv-master-1 devstack@n-api.service[118605]: spawned uWSGI worker 1 (pid: 118606, cores: 1) Nov 06 20:35:52.155254 ncdv-master-1 devstack@n-api.service[118605]: spawned uWSGI worker 2 (pid: 118607, cores: 1) Nov 06 20:35:52.155254 ncdv-master-1 devstack@n-api.service[118605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 06 20:35:53.860498 ncdv-master-1 devstack@n-api.service[118607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:35:53.860498 ncdv-master-1 devstack@n-api.service[118607]: from cryptography.utils import int_from_bytes Nov 06 20:35:53.861170 ncdv-master-1 devstack@n-api.service[118607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:35:53.861170 ncdv-master-1 devstack@n-api.service[118607]: from cryptography.utils import int_from_bytes Nov 06 20:35:53.865707 ncdv-master-1 devstack@n-api.service[118606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:35:53.865707 ncdv-master-1 devstack@n-api.service[118606]: from cryptography.utils import int_from_bytes Nov 06 20:35:53.866243 ncdv-master-1 devstack@n-api.service[118606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:35:53.866243 ncdv-master-1 devstack@n-api.service[118606]: from cryptography.utils import int_from_bytes Nov 06 20:35:56.491630 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 06 20:35:56.492215 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 06 20:35:56.492374 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 06 20:35:56.492734 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 06 20:35:56.492983 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 06 20:35:56.493086 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 06 20:35:56.493438 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 06 20:35:56.493520 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.493666 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.493799 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 06 20:35:56.493982 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.494162 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 06 20:35:56.494296 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.494418 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 06 20:35:56.495137 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.495323 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.495443 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.495650 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.495750 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.495971 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496065 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496314 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496414 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496638 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496724 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.496949 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497059 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497270 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497375 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497582 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497667 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497880 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.497972 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498158 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498243 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498473 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498559 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498772 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.498865 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499088 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499183 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499392 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499483 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499700 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.499884 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.500015 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501041 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501176 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501176 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501394 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501478 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501556 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501690 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501775 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501881 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.501963 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502041 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502184 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502269 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502360 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502440 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502627 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502715 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.502941 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503030 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503250 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503398 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503567 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503713 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.503875 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504023 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504195 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504371 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504534 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504769 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.504922 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505076 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505241 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505388 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505555 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505680 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505870 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.505997 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506280 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506370 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506590 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506684 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506897 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.506996 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507207 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507309 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507524 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507631 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507818 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.507989 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508123 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508210 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508450 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508588 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508764 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.508860 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509060 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509147 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509361 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509456 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509606 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509694 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509907 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.509992 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.510805 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.510910 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511130 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511225 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511446 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511537 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511696 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511796 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.511939 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512029 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512345 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512440 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512651 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512748 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.512955 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513042 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513203 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513290 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513452 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513543 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513767 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.513863 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514086 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514173 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514395 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514539 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514694 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514780 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.514996 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515102 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515300 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515392 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515607 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515704 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.515912 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516012 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516213 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516312 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516543 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516628 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516861 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.516957 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517163 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517254 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517467 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517575 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517779 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.517890 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518098 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518184 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518401 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518489 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518714 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.518814 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519027 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519117 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519326 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519410 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519625 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519721 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.519926 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520012 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520238 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520357 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520600 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520689 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520899 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.520990 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521148 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521234 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521443 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521539 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521743 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.521830 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522053 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522139 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522353 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522447 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522646 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522736 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.522943 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523035 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523237 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523325 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523536 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523622 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523836 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.523931 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524135 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524222 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524457 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524546 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524758 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.524860 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525055 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525140 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525354 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525451 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525651 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525787 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.525977 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526065 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526282 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526366 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526585 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526681 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526884 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.526969 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527183 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527314 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527483 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527577 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527851 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.527950 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528093 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528188 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528417 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528526 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528718 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.528805 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529021 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529113 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529318 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529404 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529618 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529718 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.529927 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530012 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530226 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530325 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530527 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530622 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530836 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.530922 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531138 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531237 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531454 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531548 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531764 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.531851 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532072 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532160 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532410 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532498 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532713 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.532799 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533020 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533116 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533336 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533423 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533642 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533728 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.533948 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534035 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534251 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534338 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534554 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534718 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534858 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.534946 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535160 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535247 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535461 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535557 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535762 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.535848 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536059 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536146 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536393 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536499 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536712 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.536805 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.537019 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.537115 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.537325 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.537425 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.537628 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.537715 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.537953 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:35:56.538080 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538275 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538374 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538588 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538685 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538897 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.538992 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539207 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539303 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539528 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539624 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539833 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.539927 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540138 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540233 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540466 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540562 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540778 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.540881 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.541380 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.541478 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.541694 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.541787 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542002 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542109 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542309 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542408 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542619 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542720 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.542924 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543018 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543236 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543330 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543549 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543650 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543863 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.543962 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544166 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544268 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544496 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544581 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544817 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.544993 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545145 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545289 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545427 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545663 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545811 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.545959 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546101 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546245 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546381 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546566 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546718 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546812 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.546894 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547005 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547216 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547304 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547523 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547612 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547828 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.547922 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548156 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548250 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548492 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548590 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548804 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.548948 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549106 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549193 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549406 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549502 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549705 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.549792 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550011 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550097 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550312 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550406 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550624 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550710 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.550941 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551040 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551246 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551414 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551552 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551639 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551855 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.551951 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552157 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552243 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552487 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552588 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552786 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.552883 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553111 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553240 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553397 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553487 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553694 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553797 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.553999 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554100 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554305 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554404 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554601 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554690 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554905 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.554990 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555205 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555291 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555527 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555615 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555836 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.555923 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556141 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556228 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556485 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556576 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556791 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.556899 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.557630 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.557788 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.557957 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558178 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558280 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558470 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558566 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558822 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.558917 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559144 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559231 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559455 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559543 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559765 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.559853 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560083 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560168 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560419 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560510 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560720 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.560809 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561048 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561189 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561361 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561464 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561677 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561777 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.561975 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562063 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562284 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562380 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562582 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562674 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562883 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.562968 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563179 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563273 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563480 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563568 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563779 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.563866 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564078 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564181 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564407 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564506 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564708 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.564796 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565010 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565111 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565329 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565417 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565634 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565721 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.565937 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566025 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566239 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566327 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566541 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566628 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566884 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.566974 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567186 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567273 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567489 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567575 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567798 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.567886 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568101 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568194 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568430 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568523 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568741 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.568829 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569048 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569135 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569364 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569461 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569670 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569755 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.569982 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570069 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570283 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570382 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570598 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570685 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570903 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.570995 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571219 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571318 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571519 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571606 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571829 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.571929 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.572133 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.572230 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.572477 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.572567 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.573336 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.573446 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.573654 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.573751 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.573992 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574080 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574305 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574416 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574612 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574711 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.574917 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575013 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575224 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575310 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575528 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575621 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575832 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.575917 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576176 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576270 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576513 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576606 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576821 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.576908 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577138 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577228 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577443 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577532 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577757 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.577850 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578058 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578145 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578366 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578506 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578673 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578759 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.578990 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579086 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579291 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579383 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579599 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579685 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.579914 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580009 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580220 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580357 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580551 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580639 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580858 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.580957 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581158 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581252 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581464 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581551 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581768 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.581923 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582077 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582163 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582377 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582463 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582682 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582778 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.582979 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583064 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583287 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583381 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583589 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583678 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583886 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.583980 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584184 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584272 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584514 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584648 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584820 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.584906 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585123 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585209 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585428 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585525 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585738 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.585826 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586033 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586132 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586332 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586421 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586649 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586743 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.586952 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587116 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587251 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587338 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587550 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587636 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587847 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.587942 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588171 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588285 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588523 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588622 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588823 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.588919 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589126 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589353 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589448 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589527 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589729 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.589818 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590036 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590123 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590340 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590429 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590643 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590732 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.590948 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591041 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591258 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591345 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591561 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591650 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591866 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.591950 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592169 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592276 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592498 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592591 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592805 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.592892 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593121 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593218 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593424 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593511 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593729 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.593828 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594032 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594133 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594329 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594425 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594632 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594764 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.594938 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595033 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595246 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595491 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595587 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595815 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.595947 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.596143 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.596230 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.596520 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.596735 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.596875 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597067 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597212 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597383 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597559 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597706 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.597882 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598024 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598217 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598341 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598551 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598693 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598898 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.598994 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599219 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599306 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599539 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599625 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599844 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.599940 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600144 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600232 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600468 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600555 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600767 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.600854 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601069 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601154 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601370 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601455 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601669 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601766 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.601974 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602061 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602277 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602370 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602580 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602682 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602876 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.602969 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603181 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603270 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603477 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603574 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603792 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.603899 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604119 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604205 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604441 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604542 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604738 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.604871 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605036 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605124 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605340 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605426 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605644 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605749 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.605947 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606035 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606279 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606365 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606581 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606668 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606898 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.606984 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607197 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607294 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607515 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607610 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607814 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.607902 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608113 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608211 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608434 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608524 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608738 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.608827 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609042 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609141 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609336 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609422 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609640 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609726 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.609943 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610038 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610241 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610328 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610542 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610627 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610838 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.610929 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611138 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611235 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611439 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611534 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611735 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.611830 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612034 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612127 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612352 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612454 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612667 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612774 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.612955 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613044 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613252 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613337 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613545 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613631 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613845 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.613932 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614140 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614236 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614437 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614524 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614736 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.614829 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615037 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615168 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615332 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615419 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615639 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615745 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.615935 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616031 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616230 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616414 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616561 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616649 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616867 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.616962 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617165 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617258 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617461 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617547 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617765 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.617862 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618063 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618151 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618360 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618449 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618663 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618750 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.618965 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.619062 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.619265 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.619360 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620085 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620184 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620412 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620505 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620713 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.620801 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621012 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621107 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621314 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621400 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621614 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621715 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.621908 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622002 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622204 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622292 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622502 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622641 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622799 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.622886 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623095 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623180 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623396 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623495 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623698 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623785 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.623995 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624087 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624307 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624410 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624621 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624710 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.624921 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625056 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625224 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625314 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625527 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625631 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625865 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.625953 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626166 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626253 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626474 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626567 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626780 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.626867 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627084 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627172 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627388 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627474 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627688 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627774 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.627997 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628083 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628356 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628447 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628625 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628727 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.628922 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629009 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629218 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629304 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629523 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629618 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629825 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.629913 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630126 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630212 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630440 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630537 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630744 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.630830 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631054 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631141 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631355 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631453 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631656 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631743 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.631961 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632048 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632262 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632425 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632588 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632684 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632890 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.632979 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633193 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633280 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633494 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633587 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633797 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.633883 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634099 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634187 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634403 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634497 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634700 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.634789 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635004 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635173 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635362 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635451 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635665 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635758 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.635969 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636066 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636273 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636434 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636593 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636691 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636896 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.636985 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637194 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637283 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637497 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637592 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637793 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.637879 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638101 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638208 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638410 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638506 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638713 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.638800 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639092 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639180 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639397 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639488 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639701 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.639789 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640007 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640094 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640331 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640423 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640634 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640720 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.640947 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641032 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641261 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641364 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641565 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641660 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.641927 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642013 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642226 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642314 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642522 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642609 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642827 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.642921 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643144 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643233 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643443 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643528 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643738 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.643832 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644037 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644131 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644364 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644453 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644662 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644760 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.644960 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645046 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645281 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645369 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645583 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645695 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.645910 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646009 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646311 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646446 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646618 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646708 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.646918 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647010 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647233 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647319 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647549 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647645 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647866 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.647960 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648165 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648252 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648506 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648597 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648810 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.648899 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649128 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649215 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649444 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649533 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649748 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.649834 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650053 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650139 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650351 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650439 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650663 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.650769 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651001 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651102 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651305 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651393 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651620 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651705 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.651937 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652031 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652248 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652386 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652592 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652691 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.652937 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653038 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653256 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653365 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653553 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653641 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653849 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.653937 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654150 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654252 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654447 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654536 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654745 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.654848 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655057 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655147 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655353 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655441 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655654 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655739 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.655955 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656082 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656255 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656375 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656639 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656746 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.656934 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657024 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657238 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657324 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657531 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657617 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657837 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.657925 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658141 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658227 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658445 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658537 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658754 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.658848 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659052 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659140 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659367 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659472 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659665 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659758 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.659962 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660049 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660262 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660423 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660583 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660679 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660884 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.660971 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661187 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661311 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661485 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661579 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661811 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.661898 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662110 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662205 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662427 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662515 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662754 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.662842 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663078 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663167 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663385 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663481 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663715 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.663804 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664029 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664117 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664354 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664459 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664655 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664744 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.664959 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665055 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665258 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665347 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665562 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665666 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.665856 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.666214 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.666929 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667025 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667231 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667328 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667530 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667627 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667827 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.667915 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668130 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668225 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668451 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668540 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668752 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.668847 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669058 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669154 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669358 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669446 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669658 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669747 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.669956 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670047 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670255 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670341 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670557 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670654 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670857 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.670954 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671188 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671273 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671487 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671573 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671818 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.671907 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672120 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672206 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672462 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672554 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672776 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.672867 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673082 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673170 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673393 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673488 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673701 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.673792 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674013 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674109 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674323 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674420 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674632 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674728 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.674937 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675025 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675246 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675347 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675558 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675644 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675866 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.675959 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.676177 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.676397 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.676520 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.676720 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.676825 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677029 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677335 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677432 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677641 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677727 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.677951 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678039 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678259 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678354 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678565 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678696 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.678869 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679002 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679173 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679263 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679476 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679563 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679780 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.679865 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680089 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680184 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680431 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680522 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680760 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.680858 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681072 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681160 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681382 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681470 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681702 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.681833 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682061 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682159 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682384 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682490 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682701 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.682805 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683006 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683100 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683316 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683416 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683626 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683723 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.683933 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684028 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684238 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684367 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684570 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684665 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684877 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.684972 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685185 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685286 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685486 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685594 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685854 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.685944 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686091 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686266 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686384 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686487 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686689 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686837 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.686987 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687079 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687296 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687438 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687601 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687739 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.687902 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688040 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688199 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688418 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688564 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688731 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.688877 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.689044 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.689189 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.689374 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.689698 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.689784 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690008 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690096 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690321 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690407 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690636 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690734 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.690955 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691048 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691256 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691343 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691558 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691654 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691871 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.691965 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692174 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692267 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692502 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692647 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692813 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.692901 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693117 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693203 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693416 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693581 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693729 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.693817 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694033 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694122 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694332 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694551 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694640 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694890 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.694980 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.695203 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.695452 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.695541 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.695798 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.695883 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696119 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696216 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696441 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696531 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696759 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.696859 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.697059 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.697156 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.697360 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.697459 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698188 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698299 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698495 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698593 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698796 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.698891 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699094 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699189 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699400 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699502 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699701 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699793 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.699998 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700092 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700335 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700441 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700622 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700717 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.700926 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701019 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701230 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701323 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701528 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701617 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701846 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.701941 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702132 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702222 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702433 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702519 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702729 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.702821 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703028 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703119 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703326 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703414 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703626 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703720 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.703922 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704016 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704224 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704336 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704547 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704646 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704849 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.704943 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705145 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705231 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705447 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705543 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705743 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.705831 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706043 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706129 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706347 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706443 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706645 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706779 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.706954 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707042 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707254 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707386 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707557 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707646 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707861 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.707948 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708166 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708262 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708513 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708603 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708829 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.708917 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.709138 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.709349 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.709480 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.709722 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.709809 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710038 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710303 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710392 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710680 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710767 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.710987 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711072 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711290 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711379 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711592 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711679 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.711908 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712006 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712218 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712325 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712544 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712630 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712848 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.712952 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713153 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713590 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713590 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713755 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713838 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.713931 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714099 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714189 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714401 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714487 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714706 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.714801 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715014 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715141 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715322 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715446 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715630 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715727 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.715937 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716033 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716249 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716401 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716576 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716668 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716882 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.716970 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717186 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717287 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717490 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717586 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717796 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.717890 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718104 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718202 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718409 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718495 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718708 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.718795 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719036 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719133 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719349 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719437 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719652 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.719740 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720018 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720123 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720344 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720437 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720665 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720755 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.720983 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721074 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721290 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721377 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721603 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721696 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.721921 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722053 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722232 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722394 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722550 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722728 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.722891 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723053 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723169 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723372 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723503 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723673 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723831 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.723973 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724154 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724270 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724485 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724587 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724790 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.724910 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725092 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725219 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725400 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725536 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725728 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.725844 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726040 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726161 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726359 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726460 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726669 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726758 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.726988 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727077 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727296 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727386 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727616 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727704 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.727934 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.728021 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.728248 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.728351 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.728582 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.728670 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.729435 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.729653 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.729765 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.729951 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730072 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730264 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730379 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730574 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730701 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.730885 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731021 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731193 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731325 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731502 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731643 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731826 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.731953 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732151 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732267 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732480 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732600 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732803 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.732912 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733118 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733236 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733437 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733532 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733750 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.733837 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734060 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734157 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734386 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734473 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734694 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.734789 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735008 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735104 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735316 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735410 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735624 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735713 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.735939 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736036 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736251 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736417 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736598 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736686 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.736910 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737006 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737228 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737322 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737550 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737676 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737856 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.737943 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.738162 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.738251 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.738461 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.738556 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.738699 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 06 20:35:56.738827 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.739139 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.739455 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.739757 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:35:56.739998 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 06 20:35:56.856535 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_db.sqlalchemy.engines [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:56.857483 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_db.sqlalchemy.engines [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:56.935703 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.context [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=118607) load_cells /opt/stack/nova/nova/context.py:464}} Nov 06 20:35:56.939560 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.context [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=118606) load_cells /opt/stack/nova/nova/context.py:464}} Nov 06 20:35:56.939914 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_concurrency.lockutils [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:35:56.941514 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_concurrency.lockutils [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:35:56.942300 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_concurrency.lockutils [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:35:56.943719 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:35:56.944204 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_concurrency.lockutils [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:35:56.945332 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:35:56.946136 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:35:56.948191 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:35:56.956267 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_db.sqlalchemy.engines [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:56.959075 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_db.sqlalchemy.engines [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:56.964365 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_db.sqlalchemy.engines [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:56.968246 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_db.sqlalchemy.engines [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:57.217187 ncdv-master-1 devstack@n-api.service[118607]: DEBUG oslo_db.sqlalchemy.engines [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:57.223472 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_db.sqlalchemy.engines [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:35:57.559340 ncdv-master-1 devstack@n-api.service[118607]: WARNING keystonemiddleware.auth_token [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:35:57.560727 ncdv-master-1 devstack@n-api.service[118606]: WARNING keystonemiddleware.auth_token [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:35:57.565759 ncdv-master-1 devstack@n-api.service[118607]: WARNING keystonemiddleware.auth_token [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:35:57.567356 ncdv-master-1 devstack@n-api.service[118606]: WARNING keystonemiddleware.auth_token [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:35:57.909636 ncdv-master-1 devstack@n-api.service[118607]: WARNING keystonemiddleware.auth_token [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:35:57.914807 ncdv-master-1 devstack@n-api.service[118607]: WARNING keystonemiddleware.auth_token [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:35:57.918670 ncdv-master-1 devstack@n-api.service[118606]: WARNING keystonemiddleware.auth_token [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:35:57.920401 ncdv-master-1 devstack@n-api.service[118607]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561d9a979c0 pid: 118607 (default app) Nov 06 20:35:57.922460 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:35:57.923621 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Nov 06 20:35:57.923912 ncdv-master-1 devstack@n-api.service[118606]: WARNING keystonemiddleware.auth_token [None req-f9099044-7b46-4120-a708-839b670a9a4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:35:57.924030 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sat Nov 6 20:35:57 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:35:57.929009 ncdv-master-1 devstack@n-api.service[118606]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561d9a979c0 pid: 118606 (default app) Nov 06 20:37:19.711641 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:19.712733 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Nov 06 20:37:19.713154 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:20.149000 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-06cb0d5a-c131-41e3-95f5-9b8fcd32d31e admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:20.178034 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-06cb0d5a-c131-41e3-95f5-9b8fcd32d31e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457470 Nov 06 20:37:20.178762 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:37:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:22.565247 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:22.566232 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-1066422a-122b-4d7a-a4a9-fa0c4a265aad None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 06 20:37:22.566623 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:22.633727 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-86afe6d4-56c7-4404-ba2b-ca862a69265b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:22.652807 ncdv-master-1 devstack@n-api.service[118606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:37:22.652807 ncdv-master-1 devstack@n-api.service[118606]: warnings.warn(msg) Nov 06 20:37:22.683720 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-86afe6d4-56c7-4404-ba2b-ca862a69265b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109873 Nov 06 20:37:22.684588 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:22.908101 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-f53acc10-e39a-4dfe-b688-8ee2e7d9233e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:22.910817 ncdv-master-1 devstack@n-api.service[118607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:37:22.910817 ncdv-master-1 devstack@n-api.service[118607]: warnings.warn(msg) Nov 06 20:37:22.964226 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-f53acc10-e39a-4dfe-b688-8ee2e7d9233e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270636 Nov 06 20:37:22.965158 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Nov 6 20:37:22 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:37:25.380665 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-86afe6d4-56c7-4404-ba2b-ca862a69265b admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:25.381599 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-86afe6d4-56c7-4404-ba2b-ca862a69265b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Nov 06 20:37:25.382000 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:25.506731 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-c8119672-4dcf-4ee8-b7d6-acbfc5851488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "disk": 5, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:25.525805 ncdv-master-1 devstack@n-api.service[118607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:37:25.525805 ncdv-master-1 devstack@n-api.service[118607]: warnings.warn(msg) Nov 06 20:37:25.546874 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-c8119672-4dcf-4ee8-b7d6-acbfc5851488 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156024 Nov 06 20:37:25.548047 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:25.562034 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-91b4e735-0eda-43fd-982d-6f94a3a0bcd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:25.564250 ncdv-master-1 devstack@n-api.service[118606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:37:25.564250 ncdv-master-1 devstack@n-api.service[118606]: warnings.warn(msg) Nov 06 20:37:25.602859 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-91b4e735-0eda-43fd-982d-6f94a3a0bcd1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045210 Nov 06 20:37:25.604216 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Nov 6 20:37:25 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:28.141621 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-c8119672-4dcf-4ee8-b7d6-acbfc5851488 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:28.143324 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-c8119672-4dcf-4ee8-b7d6-acbfc5851488 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Nov 06 20:37:28.144187 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:28.228500 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-287ffd99-6dfb-4a99-a915-271869e37f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:28.248366 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-287ffd99-6dfb-4a99-a915-271869e37f28 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.096725 Nov 06 20:37:28.249503 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:28.262524 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-2b3b7aa4-24ea-4199-a6f2-d71282577246 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:28.318162 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-2b3b7aa4-24ea-4199-a6f2-d71282577246 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059833 Nov 06 20:37:28.331430 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Nov 6 20:37:28 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:31.082895 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-287ffd99-6dfb-4a99-a915-271869e37f28 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:31.084053 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-287ffd99-6dfb-4a99-a915-271869e37f28 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Nov 06 20:37:31.085554 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:31.170730 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-e0e8e271-d64d-46e5-9d8f-aaeb4a3ccc0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:31.191641 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-e0e8e271-d64d-46e5-9d8f-aaeb4a3ccc0b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099615 Nov 06 20:37:31.192194 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:31.205247 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-a025024b-ba70-4df9-8a28-9bed231fcb4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:31.229309 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-a025024b-ba70-4df9-8a28-9bed231fcb4a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027542 Nov 06 20:37:31.229882 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Nov 6 20:37:31 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:33.651147 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-e0e8e271-d64d-46e5-9d8f-aaeb4a3ccc0b admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:33.652238 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-e0e8e271-d64d-46e5-9d8f-aaeb4a3ccc0b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 06 20:37:33.657002 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:33.720336 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:33.740484 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079503 Nov 06 20:37:33.741045 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:37:33.753890 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-abb08621-0ac9-4d52-bb41-a504f2d0fdab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:33.778529 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-abb08621-0ac9-4d52-bb41-a504f2d0fdab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028759 Nov 06 20:37:33.779271 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Nov 6 20:37:33 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:36.171422 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:36.172429 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 06 20:37:36.173070 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:36.236726 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-ddc65762-6a81-4599-b5f8-6c0c6918afbf admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:36.260540 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-ddc65762-6a81-4599-b5f8-6c0c6918afbf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080447 Nov 06 20:37:36.261187 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:37:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:37:38.644580 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:38.645563 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-553f63e7-8f0f-4f64-8eaa-aef0ce1974a5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Nov 06 20:37:38.646158 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:38.710682 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-750cf22c-2bb5-4430-93ae-acfd7500442d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:38.745053 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-750cf22c-2bb5-4430-93ae-acfd7500442d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.091290 Nov 06 20:37:38.748373 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:38 2021] POST /compute/v2.1/flavors => generated 402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:38.758037 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-b0988bfd-9884-4349-b167-672338fd0a92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:38.782141 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-b0988bfd-9884-4349-b167-672338fd0a92 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027736 Nov 06 20:37:38.782799 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Nov 6 20:37:38 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:41.247477 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-750cf22c-2bb5-4430-93ae-acfd7500442d admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:41.248520 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-750cf22c-2bb5-4430-93ae-acfd7500442d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 06 20:37:41.248985 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:41.326700 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-693aca04-16c4-4969-ad43-e745a964e595 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:41.344388 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-693aca04-16c4-4969-ad43-e745a964e595 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088816 Nov 06 20:37:41.344940 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:37:41.357136 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-e5ab2222-75e9-4c62-8778-6fb70bcd1ff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:41.384170 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-e5ab2222-75e9-4c62-8778-6fb70bcd1ff3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030566 Nov 06 20:37:41.384786 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Nov 6 20:37:41 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:44.384685 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-693aca04-16c4-4969-ad43-e745a964e595 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:44.386402 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-693aca04-16c4-4969-ad43-e745a964e595 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002601 Nov 06 20:37:44.387286 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:44 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:44.452174 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0c1212d4-4230-44eb-b87e-5ef4e4e0cadc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "ram": 4096, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:44.470226 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0c1212d4-4230-44eb-b87e-5ef4e4e0cadc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076371 Nov 06 20:37:44.470768 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:44 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:44.483034 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-5aa9e3f7-cb91-46ed-a6ea-845ce27798bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:44.507667 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-5aa9e3f7-cb91-46ed-a6ea-845ce27798bd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028233 Nov 06 20:37:44.508229 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Nov 6 20:37:44 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:37:46.933005 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0c1212d4-4230-44eb-b87e-5ef4e4e0cadc admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:46.934004 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0c1212d4-4230-44eb-b87e-5ef4e4e0cadc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 06 20:37:46.934409 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:46.995266 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-4eb7caff-81f3-4d76-9ca9-264d45f6063d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "disk": 80, "swap": 0, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:47.012774 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-4eb7caff-81f3-4d76-9ca9-264d45f6063d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070985 Nov 06 20:37:47.013256 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:47.025560 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-b4787208-f518-4702-b271-877ef9b73a73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:47.047356 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-b4787208-f518-4702-b271-877ef9b73a73 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025437 Nov 06 20:37:47.047921 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Nov 6 20:37:47 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:37:49.485045 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-4eb7caff-81f3-4d76-9ca9-264d45f6063d admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:37:49.486782 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-4eb7caff-81f3-4d76-9ca9-264d45f6063d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Nov 06 20:37:49.487349 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:37:49.553336 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:49.573166 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079388 Nov 06 20:37:49.574039 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Nov 6 20:37:49 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:37:49.586358 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-7d7ed52f-5131-403c-a382-4af309f0eb93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:37:49.610164 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-7d7ed52f-5131-403c-a382-4af309f0eb93 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027404 Nov 06 20:37:49.624324 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Nov 6 20:37:49 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:38:32.985559 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:32.986623 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 06 20:38:32.987016 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:38:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:33.045861 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-8f132a19-c772-4f7b-8ce1-392b905f73ef admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:33.062249 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-8f132a19-c772-4f7b-8ce1-392b905f73ef admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068012 Nov 06 20:38:33.062768 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:38:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:38:34.684533 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:34.685520 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-827baa12-6286-49bb-8225-b7d3a41ea14c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 06 20:38:34.685916 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:34.931569 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-275fae09-0ec7-401e-8056-088043e17a16 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:34.937042 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.wsgi [None req-275fae09-0ec7-401e-8056-088043e17a16 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 06 20:38:34.937591 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-275fae09-0ec7-401e-8056-088043e17a16 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:34.938360 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-275fae09-0ec7-401e-8056-088043e17a16 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059148 Nov 06 20:38:34.938859 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:38:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:38:34.949175 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-706824fd-1ab9-482e-8b56-8f8e8cb9a6be admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:34.969548 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-706824fd-1ab9-482e-8b56-8f8e8cb9a6be admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023896 Nov 06 20:38:34.970102 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:38:34.991600 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-5771c3ef-63f5-4558-8259-f451d59c34e1 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:35.014005 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-5771c3ef-63f5-4558-8259-f451d59c34e1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026111 Nov 06 20:38:35.014528 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:38:35.025043 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-d5c299f5-a9bd-4175-a2e6-a2a9ef1a7988 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:35.030386 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.wsgi [None req-d5c299f5-a9bd-4175-a2e6-a2a9ef1a7988 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 06 20:38:35.030947 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-d5c299f5-a9bd-4175-a2e6-a2a9ef1a7988 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:35.031711 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-d5c299f5-a9bd-4175-a2e6-a2a9ef1a7988 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010834 Nov 06 20:38:35.032187 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:38:35 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 06 20:38:36.518420 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-5771c3ef-63f5-4558-8259-f451d59c34e1 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:36.519406 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-5771c3ef-63f5-4558-8259-f451d59c34e1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 06 20:38:36.519797 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:36.715669 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-e48522b8-729a-4e46-b2a7-b0f9f8c36759 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:36.721377 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.wsgi [None req-e48522b8-729a-4e46-b2a7-b0f9f8c36759 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 06 20:38:36.721936 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-e48522b8-729a-4e46-b2a7-b0f9f8c36759 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:36.722715 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-e48522b8-729a-4e46-b2a7-b0f9f8c36759 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058526 Nov 06 20:38:36.723210 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:38:36 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:38:36.733690 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-c4a84b96-8e59-4499-8324-6031e7815258 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:36.746969 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-c4a84b96-8e59-4499-8324-6031e7815258 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016801 Nov 06 20:38:36.747487 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:38:36.757459 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-ad9ed294-a22e-4f96-827a-6dcb87bbb17e admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:36.771837 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-ad9ed294-a22e-4f96-827a-6dcb87bbb17e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017810 Nov 06 20:38:36.772990 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:38:36.782704 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-80a20097-b8c5-4271-ad00-682fe1b20f5b admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:36.788491 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.wsgi [None req-80a20097-b8c5-4271-ad00-682fe1b20f5b admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 06 20:38:36.789299 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-80a20097-b8c5-4271-ad00-682fe1b20f5b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:36.789882 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-80a20097-b8c5-4271-ad00-682fe1b20f5b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010483 Nov 06 20:38:36.790487 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:38:36 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:38:38.264849 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-ad9ed294-a22e-4f96-827a-6dcb87bbb17e admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:38.265826 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-ad9ed294-a22e-4f96-827a-6dcb87bbb17e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Nov 06 20:38:38.266207 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:38.463093 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-06e6a314-2bea-4d89-93e1-b62e28e11f7d admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:38.468190 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.wsgi [None req-06e6a314-2bea-4d89-93e1-b62e28e11f7d admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 06 20:38:38.468764 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-06e6a314-2bea-4d89-93e1-b62e28e11f7d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:38.469525 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-06e6a314-2bea-4d89-93e1-b62e28e11f7d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057963 Nov 06 20:38:38.470016 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:38:38 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:38:38.479801 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-dd6cfaf3-4e00-4850-8f54-53c96507e41a admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:38.493200 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-dd6cfaf3-4e00-4850-8f54-53c96507e41a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016864 Nov 06 20:38:38.493703 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:38:38.503627 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:38.517004 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017188 Nov 06 20:38:38.517520 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:38:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:38:38.526968 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-cc5895e0-8bf7-40e8-9f70-ca8c42d89ca3 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:38.531833 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.wsgi [None req-cc5895e0-8bf7-40e8-9f70-ca8c42d89ca3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 06 20:38:38.532403 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-cc5895e0-8bf7-40e8-9f70-ca8c42d89ca3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:38:38.533156 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-cc5895e0-8bf7-40e8-9f70-ca8c42d89ca3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009635 Nov 06 20:38:38.533633 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:38:38 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:38:40.023422 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:40.024512 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 06 20:38:40.024897 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:40.223584 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-8b0ef0eb-9c6d-4ae4-ab28-03a8aa602c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:38:40.242881 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-8b0ef0eb-9c6d-4ae4-ab28-03a8aa602c43 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069719 Nov 06 20:38:40.243411 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Nov 6 20:38:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:38:41.738881 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:41.739882 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 06 20:38:41.740275 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:41.940167 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0c38ee71-9f12-4966-8dfa-361617dba596 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:38:41.958659 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0c38ee71-9f12-4966-8dfa-361617dba596 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069024 Nov 06 20:38:41.959135 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Nov 6 20:38:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:38:43.463588 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:43.464671 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 06 20:38:43.465056 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:43.661498 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-06f50f8f-bb13-41ad-a2f1-fb1ea6be59c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:38:43.681419 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-06f50f8f-bb13-41ad-a2f1-fb1ea6be59c4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071041 Nov 06 20:38:43.681918 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Nov 6 20:38:43 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:38:45.169364 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:45.170340 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Nov 06 20:38:45.170719 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:45.367196 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-f83ff7c3-ceca-4c6f-86a4-9d597675a2df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:38:45.384735 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-f83ff7c3-ceca-4c6f-86a4-9d597675a2df admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068361 Nov 06 20:38:45.385197 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Nov 6 20:38:45 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:38:46.873982 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:46.874975 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 06 20:38:46.875362 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:38:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:38:47.079547 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-f62e2c1c-8416-4951-ba70-7e683f5b2aad admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:38:47.098549 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-f62e2c1c-8416-4951-ba70-7e683f5b2aad admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070160 Nov 06 20:38:47.099071 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sat Nov 6 20:38:47 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:39:35.921714 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:35.922737 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-556b7bdb-e15c-49ac-bff6-9f3e97dacb52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Nov 06 20:39:35.923132 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Sat Nov 6 20:39:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:39:35.984122 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-46d93d9e-7032-43c9-be5e-6d8bbbf7c2b2 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:36.003207 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-46d93d9e-7032-43c9-be5e-6d8bbbf7c2b2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073455 Nov 06 20:39:36.003731 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:39:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:39:36.026182 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-a37b0710-9de7-4b0e-83b0-5a63a9143d72 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:36.033787 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-a37b0710-9de7-4b0e-83b0-5a63a9143d72 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011175 Nov 06 20:39:36.034299 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Nov 6 20:39:36 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:39:36.046160 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-6e204ef0-42a6-4d6a-8c05-8097676f4550 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:36.054061 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-6e204ef0-42a6-4d6a-8c05-8097676f4550 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Nov 06 20:39:36.054563 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Nov 6 20:39:36 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:39:36.065811 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-f7c25272-7d09-4ea1-b88c-cec88601ef74 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:36.073831 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-f7c25272-7d09-4ea1-b88c-cec88601ef74 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011386 Nov 06 20:39:36.074341 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Nov 6 20:39:36 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:39:36.085761 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:39:36.093219 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010792 Nov 06 20:39:36.093741 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Nov 6 20:39:36 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:40:58.713052 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-f04bddf3-dd28-401a-b922-19143c06e90e tempest-verify_tempest_config-254631321 tempest-verify_tempest_config-254631321-project] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:40:58.715074 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-f04bddf3-dd28-401a-b922-19143c06e90e tempest-verify_tempest_config-254631321 tempest-verify_tempest_config-254631321-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104390 Nov 06 20:40:58.715599 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Nov 6 20:40:58 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:44:53.568843 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:44:53.569844 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 06 20:44:53.570232 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:44:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:44:53.827769 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:44:53.829015 ncdv-master-1 devstack@n-api.service[118606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:44:53.829015 ncdv-master-1 devstack@n-api.service[118606]: warnings.warn(msg) Nov 06 20:44:53.830524 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:44:53.830954 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:44:53.831729 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:44:53.832685 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:44:53.871518 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-0a6106c4-74da-4e32-93e7-51c1a7b53647 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.153614 Nov 06 20:44:53.872083 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 35/71] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:44:53 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:44:55.361522 ncdv-master-1 devstack@n-api.service[118607]: DEBUG nova.api.openstack.wsgi [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] Calling method '>' {{(pid=118607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:44:55.362519 ncdv-master-1 devstack@n-api.service[118607]: INFO nova.api.openstack.requestlog [None req-0321dd28-57a5-4b4e-bada-83eb6b0b7457 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 06 20:44:55.362911 ncdv-master-1 devstack@n-api.service[118607]: [pid: 118607|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Nov 6 20:44:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:44:55.561765 ncdv-master-1 devstack@n-api.service[118606]: DEBUG nova.api.openstack.wsgi [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] Calling method '>' {{(pid=118606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:44:55.562909 ncdv-master-1 devstack@n-api.service[118606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:44:55.562909 ncdv-master-1 devstack@n-api.service[118606]: warnings.warn(msg) Nov 06 20:44:55.564503 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:44:55.564937 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:44:55.565734 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:44:55.566748 ncdv-master-1 devstack@n-api.service[118606]: DEBUG oslo_concurrency.lockutils [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:44:55.588903 ncdv-master-1 devstack@n-api.service[118606]: INFO nova.api.openstack.requestlog [None req-6114736d-8308-451a-88bc-9e030ade3c8c admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.078596 Nov 06 20:44:55.589433 ncdv-master-1 devstack@n-api.service[118606]: [pid: 118606|app: 0|req: 36/73] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:44:55 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:45:43.024758 ncdv-master-1 devstack@n-api.service[118605]: Sat Nov 6 20:45:43 2021 - graceful shutdown triggered... Nov 06 20:45:43.025311 ncdv-master-1 devstack@n-api.service[118606]: Gracefully killing worker 1 (pid: 118606)... Nov 06 20:45:43.024884 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 06 20:45:43.026169 ncdv-master-1 devstack@n-api.service[118607]: Gracefully killing worker 2 (pid: 118607)... Nov 06 20:45:44.025846 ncdv-master-1 devstack@n-api.service[118605]: worker 1 buried after 1 seconds Nov 06 20:45:44.025846 ncdv-master-1 devstack@n-api.service[118605]: worker 2 buried after 1 seconds Nov 06 20:45:44.025846 ncdv-master-1 devstack@n-api.service[118605]: goodbye to uWSGI. Nov 06 20:45:44.027380 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Nov 06 20:45:44.027948 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 06 20:45:44.030722 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 06 20:45:44.102889 ncdv-master-1 devstack@n-api.service[134816]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 6 20:45:44 2021] *** Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: nodename: ncdv-master-1 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: machine: x86_64 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: clock source: unix Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: pcre jit disabled Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: detected number of CPU cores: 4 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: current working directory: / Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: detected binary path: /usr/bin/uwsgi-core Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: your processes number limit is 47680 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: your memory page size is 4096 bytes Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: detected max file descriptor number: 2048 Nov 06 20:45:44.115705 ncdv-master-1 devstack@n-api.service[134816]: lock engine: pthread robust mutexes Nov 06 20:45:44.116768 ncdv-master-1 devstack@n-api.service[134816]: thunder lock: enabled Nov 06 20:45:44.116768 ncdv-master-1 devstack@n-api.service[134816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 06 20:45:44.116768 ncdv-master-1 devstack@n-api.service[134816]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 06 20:45:44.171252 ncdv-master-1 devstack@n-api.service[134816]: Python main interpreter initialized at 0x56030e6ca9c0 Nov 06 20:45:44.171252 ncdv-master-1 devstack@n-api.service[134816]: python threads support enabled Nov 06 20:45:44.171252 ncdv-master-1 devstack@n-api.service[134816]: your server socket listen backlog is limited to 100 connections Nov 06 20:45:44.171252 ncdv-master-1 devstack@n-api.service[134816]: your mercy for graceful operations on workers is 90 seconds Nov 06 20:45:44.171712 ncdv-master-1 devstack@n-api.service[134816]: mapped 403077 bytes (393 KB) for 2 cores Nov 06 20:45:44.171712 ncdv-master-1 devstack@n-api.service[134816]: *** Operational MODE: preforking *** Nov 06 20:45:44.171948 ncdv-master-1 devstack@n-api.service[134816]: *** uWSGI is running in multiple interpreter mode *** Nov 06 20:45:44.171948 ncdv-master-1 devstack@n-api.service[134816]: spawned uWSGI master process (pid: 134816) Nov 06 20:45:44.172159 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 06 20:45:44.176386 ncdv-master-1 devstack@n-api.service[134816]: spawned uWSGI worker 1 (pid: 134827, cores: 1) Nov 06 20:45:44.176386 ncdv-master-1 devstack@n-api.service[134816]: spawned uWSGI worker 2 (pid: 134828, cores: 1) Nov 06 20:45:44.176386 ncdv-master-1 devstack@n-api.service[134816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 06 20:45:46.105708 ncdv-master-1 devstack@n-api.service[134827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:45:46.105708 ncdv-master-1 devstack@n-api.service[134827]: from cryptography.utils import int_from_bytes Nov 06 20:45:46.106379 ncdv-master-1 devstack@n-api.service[134827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:45:46.106379 ncdv-master-1 devstack@n-api.service[134827]: from cryptography.utils import int_from_bytes Nov 06 20:45:46.115842 ncdv-master-1 devstack@n-api.service[134828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:45:46.115842 ncdv-master-1 devstack@n-api.service[134828]: from cryptography.utils import int_from_bytes Nov 06 20:45:46.116450 ncdv-master-1 devstack@n-api.service[134828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 06 20:45:46.116450 ncdv-master-1 devstack@n-api.service[134828]: from cryptography.utils import int_from_bytes Nov 06 20:45:48.714617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 06 20:45:48.715165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 06 20:45:48.715369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 06 20:45:48.715745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 06 20:45:48.716281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 06 20:45:48.716942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.717291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.717626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.717960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.718304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.718631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.718967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.719302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.719644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.719919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.720245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.720609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.720943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.721266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.721590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.721922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.722239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.722625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.723445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.723967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.725111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.725111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.725111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.725426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.725724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.726040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.726381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.726703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.727037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.727360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.727771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.728100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.728458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.728791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.729225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.729535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.729855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.730187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.730524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.731120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.731459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.731790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.732124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.732484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.732807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.733127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.733456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.733791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.734108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.734425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.734866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.735189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.735528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.735866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.736200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.736490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.736753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.737104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.737426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.737745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.738065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.738419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.738739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.739070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.739381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.739700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.740020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.740372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.740704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.741036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.741355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.741687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.742102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.742363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.742679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.743032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.743367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.743689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.744022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.744379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.744700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.745020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.745337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.745668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.746015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.746330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.746589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.746905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.747223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.747556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.747870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.748187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.748534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.748848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.749166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.749485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.749803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.750120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.750436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.750751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.751068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.751384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.751687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 06 20:45:48.752150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.752345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 06 20:45:48.752487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.752487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.752782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 06 20:45:48.752947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.753089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 06 20:45:48.753240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.753400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 06 20:45:48.753633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.753775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.754500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.754644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.754802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.754950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.755980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.756941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.757908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.758852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.759806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.760973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.761953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.762899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.763019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.763224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.763368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.763544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.763673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.763922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.764053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.764270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.764613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.764738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.764939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.765275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.765275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.765438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.765626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.765747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.765958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.766144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.766307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.766467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.766630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.766797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.766948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.767091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.767246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.767344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.767545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.767693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.767881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.768006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.768211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.768345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.768579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.768675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.768915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.769029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.769249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.769347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.770301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.770404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.770486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.770569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.770795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.770898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.771126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.771223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.771450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.771551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.771772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.771872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.772109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.772205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.772470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.772637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.772724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.772809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.772981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.773126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.773314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.773450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.773648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.773784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.773968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.774113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.774292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.774466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.774619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.774767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.774919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.775061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.775214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.775364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.775527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.775666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.775818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.776020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.776178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.776374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.776492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.776709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.776879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.777032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.777198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.777346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.777498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.777640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.777777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.777957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.778167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.778343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.778492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.778642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.778783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.778932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.779072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.779211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.779402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.779546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.779728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.779881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.780063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.780217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.780417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.780509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.780793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.780887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.781036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.781137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.781358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.781459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.781694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.781788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.782038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.782128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.782380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.782509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.782607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.782701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.782914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.783014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.783235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.783327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.783567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.783667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.783886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.783980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.784205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.784345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.784549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.784654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.784866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.784966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.785184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.785318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.785539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.785632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.785860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.785960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.786179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.786286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.786498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.786605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.786815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.786910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.787136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.787237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.787456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.787549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.787775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.787873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.788106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.788205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.788460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.788568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.788779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.788878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.789152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.789255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.789406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.789507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.789721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.789820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.790035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.790127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.790352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.790444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.790682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.791061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.791252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.791374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.791568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.791674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.791906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.792010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.792229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.792356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.792573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.792688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.792896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.793062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.793200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.793341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.793549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.793703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.793876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.794024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.794334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.794427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.794583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.796380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.796528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.796611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.796685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.796766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.796840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.796920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.796994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.797228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.797388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.797532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.797679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.797838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.797910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.798006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.798081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.798174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.798249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.798335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.798725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.798892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.799038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.799200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.799344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:45:48.799498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.799678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.799825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.799969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.800938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.801200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.801451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.801604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.801756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.801911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.802062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.802213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.802377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.802924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.803873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.804958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.805877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.806851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.807890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.808954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.809873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.810896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.811940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.812094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.812288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.812479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.813838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.814875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.815905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.816046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.816278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.817383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.817552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.817706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.817857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.818921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.819973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.820923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.821939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.822092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.822234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.822376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.822518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.822686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.823272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.823433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.823586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.823750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.823905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.824995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.825193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.825349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.825493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.825643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.825935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.826107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.826278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.826495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.826643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.826787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.827925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.828863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.829918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.830962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.831875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.832019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.832814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.833397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.833549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.833692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.833860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.834909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.835944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.836956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.837995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.838901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.839946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.840870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.841908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.842950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.843599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.843761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.843930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.844999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.845907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.846895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.847971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.848955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.849972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.850874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.851912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.852987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.853128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.853820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.853978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.854868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.855021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.855412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.855566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.855710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.855859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.856260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.856512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.856671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.856823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.857933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.858797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.859871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.860022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.860179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.860349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.867054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.867306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.867552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.867709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.867869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.868026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.868193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.868474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.868720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.868873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.869953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.870888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.871969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.877569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.878361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.878537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.878719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.879470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.879638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.879792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.879959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.879959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.880260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.880475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.880635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.880786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.880949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.881876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.882883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.883998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.884961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.885121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.885284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.885454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.885748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.885907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.886991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.887150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.887339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.887787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.887947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.888910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.889956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.890875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.891833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.892987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.893928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.894084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.894235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.894398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.894552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.895265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.895436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.895595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.895900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.896886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.897036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.897193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.897345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.897509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.897886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.898941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.899093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.899357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.899512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.899749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.899903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.900053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.900203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.900413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.900668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.900862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.901949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.902886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.903970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.904946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.905097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.905265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.905426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.905576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.905741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.906987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.907279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.907450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.907614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.907783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.908176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.908492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.908655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.908938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.909996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.910985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.911933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.912082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.912382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.912553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.912717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.912885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.913965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.914987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.915146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.915306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.915306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.915604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.916146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.916421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.916581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.916731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.916731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.917870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.918273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.918432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.918688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.918859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.919919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.920894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.921854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.922784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.923937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.924094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.924245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.924449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.924618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.924845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.925857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.926293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.926456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.926608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.926768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.926933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.927870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.928040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.928446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.928619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.928885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.929934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.930907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.931999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.932994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.933283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.933433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.933589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.933749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.933899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.934997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.935926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.936075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.936243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.936587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.936740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.936900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.937999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.938157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.938339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.938724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.938724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.939917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.940143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.940350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.940523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.940690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.940851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.941028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.941179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.941331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.941990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.942945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.943897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.944048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.944212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.944397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.944558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.944709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.945955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.946105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.946264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.946432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.946726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.946887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.947969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.948118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.948274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.948480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.948832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.949885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.950940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.951874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.952870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.953936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.954879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.955968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.956853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.957759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.957852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.957925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.958665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.959994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.960974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.961962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.962918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.963959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.964992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.965976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.966972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.967951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.968791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.969931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.970988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.971979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.972948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.973999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.974984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.975970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.976726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.977045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.977505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.977670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.977946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.978279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.978606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.978942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.979316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.979580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.979943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.980280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.980864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.981273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.981610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.981970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.982327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.982684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.982974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.983297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.983636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.983963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.984306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.984635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.984965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.985292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.985616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.986065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.986398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.986725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.987186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.987413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.987748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.988082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.988465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.988793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.989120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.989469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.989759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.990089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.990434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.990791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.991084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.991525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.991854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.993227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.993227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.993227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.993227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.994100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.994100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.994535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.994535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.995063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.995280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.995624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.995853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.996226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.996586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.996902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.997416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.997671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.997901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:48.998131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.998358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.998682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.998908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.999142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.999553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:48.999812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.000144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.000493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.000936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.001240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.001487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.001813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.002322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.002658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.003097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.003324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.003666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.004540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.004887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.005221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.005673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.005889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.006348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.006701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.007027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.007475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.007682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.008111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.008385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.008737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.009028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.009371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.009731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.010051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.010434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.010742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.011104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.011452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.011781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.012108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.012449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:45:49.012704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 06 20:45:49.036193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_db.sqlalchemy.engines [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.079166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.context [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134827) load_cells /opt/stack/nova/nova/context.py:464}} Nov 06 20:45:49.084042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:45:49.085684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:45:49.086532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:45:49.088675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:45:49.100929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.101962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.117687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.context [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134828) load_cells /opt/stack/nova/nova/context.py:464}} Nov 06 20:45:49.121986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:45:49.123595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:45:49.124467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:45:49.126692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:45:49.138185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_db.sqlalchemy.engines [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.140005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_db.sqlalchemy.engines [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.372955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.416930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_db.sqlalchemy.engines [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:45:49.695939 ncdv-master-1 devstack@n-api.service[134827]: WARNING keystonemiddleware.auth_token [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:45:49.702385 ncdv-master-1 devstack@n-api.service[134827]: WARNING keystonemiddleware.auth_token [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:45:49.751216 ncdv-master-1 devstack@n-api.service[134828]: WARNING keystonemiddleware.auth_token [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:45:49.758305 ncdv-master-1 devstack@n-api.service[134828]: WARNING keystonemiddleware.auth_token [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:45:50.047695 ncdv-master-1 devstack@n-api.service[134827]: WARNING keystonemiddleware.auth_token [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:45:50.053318 ncdv-master-1 devstack@n-api.service[134827]: WARNING keystonemiddleware.auth_token [None req-04355c8f-ee9b-4179-bd1c-ad72614ac690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:45:50.058651 ncdv-master-1 devstack@n-api.service[134827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56030e6ca9c0 pid: 134827 (default app) Nov 06 20:45:50.109123 ncdv-master-1 devstack@n-api.service[134828]: WARNING keystonemiddleware.auth_token [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 06 20:45:50.114831 ncdv-master-1 devstack@n-api.service[134828]: WARNING keystonemiddleware.auth_token [None req-2b467924-27f1-4326-a2b6-b91d23752db1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 06 20:45:50.120145 ncdv-master-1 devstack@n-api.service[134828]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56030e6ca9c0 pid: 134828 (default app) Nov 06 20:46:27.712638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '.version_select at 0x7f67179a43a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:27.718627 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:27.718627 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:27.726004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134827) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 06 20:46:27.727213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:27.727904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:27.760452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:27.761310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:27.775841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:27.776700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:27.783650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa320ded-f03d-4964-89b3-dfe13a90f1d9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.491235 Nov 06 20:46:27.784954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 20:46:26 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:28.053537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ad4c324-64c6-4561-be99-b908de8deb7e tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-714588689", "name": "tempest-test_aggregate-2023488478"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:28.091125 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:28.091125 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:28.092990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-3ad4c324-64c6-4561-be99-b908de8deb7e tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 6fcb7a35-d283-443e-9d3c-703bcf8d6b5c for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:46:28.231609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ad4c324-64c6-4561-be99-b908de8deb7e tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.433013 Nov 06 20:46:28.233896 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Nov 6 20:46:27 2021] POST /compute/v2.1/os-aggregates => generated 221 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:28.245285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c80303f1-3cbd-4b26-b0e0-1e1d7c53650c tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:28.248018 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:28.248018 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:28.272925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c80303f1-3cbd-4b26-b0e0-1e1d7c53650c tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.031052 Nov 06 20:46:28.274593 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:46:28 2021] GET /compute/v2.1/os-aggregates => generated 301 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:28.289607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e45af962-1c62-4b22-8389-4364dbf59c12 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:28.294401 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:28.294401 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:28.333147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45af962-1c62-4b22-8389-4364dbf59c12 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:28.333703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45af962-1c62-4b22-8389-4364dbf59c12 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:28.488010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:28.489853 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:28.489853 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:28.491630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:28.492086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:28.494332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:28.494793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:28.544036 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-958e2acf-b57c-4b5f-b8f8-40321e25ec34 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.619235 Nov 06 20:46:28.545196 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:46:27 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:29.726277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa9c9ae0-3673-4909-9eb2-f4cc114b99ca tempest-AZAdminNegativeTestJSON-568811626 tempest-AZAdminNegativeTestJSON-568811626-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:29.727652 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:29.727652 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:29.729096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa9c9ae0-3673-4909-9eb2-f4cc114b99ca tempest-AZAdminNegativeTestJSON-568811626 tempest-AZAdminNegativeTestJSON-568811626-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a058b945f4594b7b932d2ccf7c7d463d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea6de7a9a3f4e7b8c971ae9c4a21348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:29.730416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa9c9ae0-3673-4909-9eb2-f4cc114b99ca tempest-AZAdminNegativeTestJSON-568811626 tempest-AZAdminNegativeTestJSON-568811626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:29.731485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa9c9ae0-3673-4909-9eb2-f4cc114b99ca tempest-AZAdminNegativeTestJSON-568811626 tempest-AZAdminNegativeTestJSON-568811626-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.636010 Nov 06 20:46:29.738383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 20:46:29 2021] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:29.740642 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e45af962-1c62-4b22-8389-4364dbf59c12 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.458985 Nov 06 20:46:29.756228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3/6] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:46:28 2021] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:30.308934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ff3806b-8ed9-4095-a232-38e6727f3ca0 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-420692613", "id": 1596661856, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:30.346646 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:30.346646 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:30.417096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ff3806b-8ed9-4095-a232-38e6727f3ca0 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.664353 Nov 06 20:46:30.432769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4/7] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:29 2021] POST /compute/v2.1/flavors => generated 429 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:30.651218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-258969073", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "availability_zone": "tempest-test_az-714588689"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:30.683520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:30.683941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:30.684804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:30.685237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:30.754335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Calling method '.version_select at 0x7f6717072430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:30.755764 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:30.755764 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:30.774331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134828) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 06 20:46:30.775197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:30.776082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:30.832075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:30.832548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:30.870190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:30.872779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:30.894956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-875c83d5-37ae-413b-815a-0cad9457a237 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.037091 Nov 06 20:46:30.907846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 20:46:29 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:30.913211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a96d96bd-fe31-44bf-bf1c-82e5a4059261 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:30.914256 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:30.914256 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:30.947128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a96d96bd-fe31-44bf-bf1c-82e5a4059261 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1596661856" status: 202 len: 0 microversion: 2.1 time: 0.037348 Nov 06 20:46:30.948343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:30 2021] DELETE /compute/v2.1/flavors/1596661856 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:30.958191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf5fe0a5-f42d-407b-ae8c-a1e3bd3b1135 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:31.023244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf5fe0a5-f42d-407b-ae8c-a1e3bd3b1135 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068745 Nov 06 20:46:31.023846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:30 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:31.058641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a2d873e-d4ba-4fd9-b699-8f8f41e072e4 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-431084913", "id": 1407849631, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:31.063313 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:31.063313 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:31.115996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a2d873e-d4ba-4fd9-b699-8f8f41e072e4 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.075482 Nov 06 20:46:31.117035 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 7/11] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:31 2021] POST /compute/v2.1/flavors => generated 416 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:31.328136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:31.383271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2574d19-d199-4ed8-9663-a12e9bacb8ab tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-473525405", "id": 552475837, "os-flavor-access:is_public": "False"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:31.406769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2574d19-d199-4ed8-9663-a12e9bacb8ab tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.277818 Nov 06 20:46:31.415801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 8/12] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:31 2021] POST /compute/v2.1/flavors => generated 435 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:31.421792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3980fa5-94e0-46c3-b1ba-713f9b154b2e tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:31.460255 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3980fa5-94e0-46c3-b1ba-713f9b154b2e tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.042027 Nov 06 20:46:31.462166 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 9/13] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:31 2021] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:31.468688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d52193e-c74e-4f1f-b5bc-1833ad8fb591 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:31.470223 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:31.470223 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:31.716732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:31.717163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:31.718069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:31.718069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:31.718458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:31.744154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:31.744638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:31.753611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:31.754076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:31.807810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Getting quotas for project ceeb1e03e53b4607861fc4aaa59b056f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:31.818624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Getting quotas for user 8a0f12d189da4d6ab5573d3dcc0bafb6 and project ceeb1e03e53b4607861fc4aaa59b056f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:31.842885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:46:31.846982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:46:31.848844 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d52193e-c74e-4f1f-b5bc-1833ad8fb591 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/552475837/action" status: 200 len: 96 microversion: 2.1 time: 0.385355 Nov 06 20:46:31.853933 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 10/14] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:31 2021] POST /compute/v2.1/flavors/552475837/action => generated 96 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:46:31.868767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2f6a487-0484-4c13-a4d6-9ee7f87ca6db tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:31.919164 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2f6a487-0484-4c13-a4d6-9ee7f87ca6db tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1407849631" status: 202 len: 0 microversion: 2.1 time: 0.062931 Nov 06 20:46:31.929875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 11/15] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:31 2021] DELETE /compute/v2.1/flavors/1407849631 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:31.938654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5080a74d-9522-4dbc-a1ce-9b46dcb06c57 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:31.995954 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35bec099-9e3a-4c0c-a64e-132a5ae892c6 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561624 Nov 06 20:46:32.002861 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 5/16] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:46:32.014939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2977cab-0416-47ad-9d83-bc22588da5f2 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.101564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2977cab-0416-47ad-9d83-bc22588da5f2 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097128 Nov 06 20:46:32.115878 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 6/17] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:32.129044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c808dd80-4817-4da5-8cf7-9b63a60473ea tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.135152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c808dd80-4817-4da5-8cf7-9b63a60473ea tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:32.255394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c808dd80-4817-4da5-8cf7-9b63a60473ea tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:32.287641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c808dd80-4817-4da5-8cf7-9b63a60473ea tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1241 microversion: 2.1 time: 0.170058 Nov 06 20:46:32.298427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 7/18] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1241 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:32.303560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-528208fb-df11-4af6-acef-3f250293b71a tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1717750236", "id": 1023745685, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:32.305437 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:32.305437 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:32.330055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-528208fb-df11-4af6-acef-3f250293b71a tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.030156 Nov 06 20:46:32.333203 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 8/19] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:32 2021] POST /compute/v2.1/flavors => generated 429 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:32.347416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1153be9-5653-4071-b68c-5473bf741877 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.348626 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:32.348626 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:32.387337 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1153be9-5653-4071-b68c-5473bf741877 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1023745685" status: 202 len: 0 microversion: 2.1 time: 0.046256 Nov 06 20:46:32.388327 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:32 2021] DELETE /compute/v2.1/flavors/1023745685 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:32.397497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6f548ba-4b74-4e25-976e-ff915a08b1a7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.443311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6f548ba-4b74-4e25-976e-ff915a08b1a7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050734 Nov 06 20:46:32.446981 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 10/21] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:32.465282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-634d4bb0-99d1-43f3-8694-068849dd9676 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-991560550", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:32.496958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-634d4bb0-99d1-43f3-8694-068849dd9676 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.034999 Nov 06 20:46:32.499358 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 11/22] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:32 2021] POST /compute/v2.1/flavors => generated 506 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:32.511414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45731910-0cde-430b-9128-8c06d690a394 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.550910 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45731910-0cde-430b-9128-8c06d690a394 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/7860477e-204d-4ca3-a0f2-81c4a0ad63a5" status: 202 len: 0 microversion: 2.1 time: 0.044159 Nov 06 20:46:32.551573 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:46:32 2021] DELETE /compute/v2.1/flavors/7860477e-204d-4ca3-a0f2-81c4a0ad63a5 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:46:32.563786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6146b306-20cd-44b0-9899-508fd1153199 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.609411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6146b306-20cd-44b0-9899-508fd1153199 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052708 Nov 06 20:46:32.612193 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:32.631849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d61b114-39e7-43ad-919a-c003bb04cba3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1816186068", "id": "f325c720-0539-4a28-bb8e-ec524bd7419e", "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:32.662560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d61b114-39e7-43ad-919a-c003bb04cba3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035661 Nov 06 20:46:32.663840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 14/25] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:32 2021] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:32.677951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1a10ae4-2749-43af-a8bd-fd6a240a20b3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.686534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5080a74d-9522-4dbc-a1ce-9b46dcb06c57 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project e53c1b7c98e645bb8d20ef4bb9b13b35 combination. Nov 06 20:46:32.688977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5080a74d-9522-4dbc-a1ce-9b46dcb06c57 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project e53c1b7c98e645bb8d20ef4bb9b13b35 combination. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:32.691991 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5080a74d-9522-4dbc-a1ce-9b46dcb06c57 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/552475837/action" status: 409 len: 152 microversion: 2.1 time: 0.760437 Nov 06 20:46:32.693965 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 12/26] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:31 2021] POST /compute/v2.1/flavors/552475837/action => generated 152 bytes in 763 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:46:32.707112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bad6a4a1-b584-489c-99ab-e0cc1c38f5f0 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:32.715694 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1a10ae4-2749-43af-a8bd-fd6a240a20b3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/f325c720-0539-4a28-bb8e-ec524bd7419e" status: 202 len: 0 microversion: 2.1 time: 0.045342 Nov 06 20:46:32.716318 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:46:32 2021] DELETE /compute/v2.1/flavors/f325c720-0539-4a28-bb8e-ec524bd7419e => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:46:32.734574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4ff2100-21cf-4447-85db-9e430ad16f4b tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.739143 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:32.739143 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:32.769653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4ff2100-21cf-4447-85db-9e430ad16f4b tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047630 Nov 06 20:46:32.779695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:32.801619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72bda6ef-cb1e-42d2-a5d9-80b4cbdb1265 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-668896672", "id": 1053939980, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:32.832348 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72bda6ef-cb1e-42d2-a5d9-80b4cbdb1265 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035905 Nov 06 20:46:32.837884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 17/29] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:32 2021] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:32.852895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93d89e40-11c1-493e-bc78-1c96a6546fc3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:32.900751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93d89e40-11c1-493e-bc78-1c96a6546fc3 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1053939980" status: 200 len: 413 microversion: 2.1 time: 0.060311 Nov 06 20:46:32.907303 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 18/30] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/1053939980 => generated 413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:33.343501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bad6a4a1-b584-489c-99ab-e0cc1c38f5f0 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/552475837/action" status: 200 len: 21 microversion: 2.1 time: 0.643723 Nov 06 20:46:33.349980 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 13/31] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:32 2021] POST /compute/v2.1/flavors/552475837/action => generated 21 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:46:33.355138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87f121c1-f455-4530-bca0-25184308462b tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.356123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87f121c1-f455-4530-bca0-25184308462b tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:33.385990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-400470f1-bad5-4be6-8042-7f3ae28c2fa3 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.465905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-400470f1-bad5-4be6-8042-7f3ae28c2fa3 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.557699 Nov 06 20:46:33.466721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 19/32] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:32 2021] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:33.481773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a3f3b8e3-2f91-48e2-90b5-16899702ff81 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.515285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a3f3b8e3-2f91-48e2-90b5-16899702ff81 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/552475837" status: 202 len: 0 microversion: 2.1 time: 0.047239 Nov 06 20:46:33.516346 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 20/33] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:33 2021] DELETE /compute/v2.1/flavors/552475837 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:33.527050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a4c8e88-0cfd-49ee-86aa-ddc2d56d6240 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.593189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a4c8e88-0cfd-49ee-86aa-ddc2d56d6240 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1053939980" status: 202 len: 0 microversion: 2.1 time: 0.075700 Nov 06 20:46:33.597294 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 21/34] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:33 2021] DELETE /compute/v2.1/flavors/1053939980 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:33.603149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09f638f3-9adf-4dd0-b882-c6bbeb6daae4 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.629984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09f638f3-9adf-4dd0-b882-c6bbeb6daae4 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033956 Nov 06 20:46:33.631961 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 22/35] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:33 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:33.637361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77b3b424-95f7-4066-a9e0-2bf5afe7bff8 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:33.665794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77b3b424-95f7-4066-a9e0-2bf5afe7bff8 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032266 Nov 06 20:46:33.666575 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 23/36] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:33 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:33.934124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c2d11b5-1e66-4bf6-bca3-2f12c329295c tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-105322097", "id": 1293725353, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:33.964177 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c2d11b5-1e66-4bf6-bca3-2f12c329295c tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.294063 Nov 06 20:46:33.965637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 24/37] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:46:33 2021] POST /compute/v2.1/flavors => generated 448 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:33.980052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b77e72b7-2420-45dd-bc58-cb9be97777db tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1907803707", "id": 144294269, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.007003 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b77e72b7-2420-45dd-bc58-cb9be97777db tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.038254 Nov 06 20:46:34.008032 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 25/38] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:33 2021] POST /compute/v2.1/flavors => generated 435 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.019306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d7e00a0-8fae-4c33-b964-8cd803d28160 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2143396135", "id": 723660197, "os-flavor-access:is_public": "False"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.039211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d7e00a0-8fae-4c33-b964-8cd803d28160 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.023452 Nov 06 20:46:34.044272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 26/39] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors => generated 427 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.272023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87f121c1-f455-4530-bca0-25184308462b tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:34.292266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87f121c1-f455-4530-bca0-25184308462b tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1241 microversion: 2.1 time: 0.940972 Nov 06 20:46:34.294250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 14/40] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:33 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1241 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:34.299450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-446c12f2-8a8d-40ce-9caa-0e35dd710064 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.300421 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:34.300421 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:34.307663 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-446c12f2-8a8d-40ce-9caa-0e35dd710064 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 06 20:46:34.308447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-446c12f2-8a8d-40ce-9caa-0e35dd710064 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:34.309496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-446c12f2-8a8d-40ce-9caa-0e35dd710064 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/144294269/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.013795 Nov 06 20:46:34.310274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 15/41] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/144294269/os-flavor-access => generated 91 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:46:34.316349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13ec729b-429c-4eaa-ba5f-e665680151ee tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "723660197"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.337172 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-13ec729b-429c-4eaa-ba5f-e665680151ee tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] HTTP exception thrown: Flavor 723660197 could not be found. Nov 06 20:46:34.341939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13ec729b-429c-4eaa-ba5f-e665680151ee tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] Returning 400 to user: Flavor 723660197 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:34.343086 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13ec729b-429c-4eaa-ba5f-e665680151ee tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.031202 Nov 06 20:46:34.343944 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 16/42] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/servers => generated 80 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:46:34.357850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41b671f8-637b-454c-920d-6ad6a3649930 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.359034 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:34.359034 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:34.383854 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41b671f8-637b-454c-920d-6ad6a3649930 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/144294269" status: 202 len: 0 microversion: 2.1 time: 0.033234 Nov 06 20:46:34.388859 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 17/43] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:34 2021] DELETE /compute/v2.1/flavors/144294269 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:34.394861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c09c3ee4-c9d4-4536-a795-b77db858c898 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.417923 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c09c3ee4-c9d4-4536-a795-b77db858c898 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/723660197" status: 202 len: 0 microversion: 2.1 time: 0.027532 Nov 06 20:46:34.418801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 18/44] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:34 2021] DELETE /compute/v2.1/flavors/723660197 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:34.429482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c856dfd-3d6c-4b3d-921b-08673ace057f tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.454306 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c856dfd-3d6c-4b3d-921b-08673ace057f tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.034393 Nov 06 20:46:34.456052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 19/45] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:34.459150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16fd4b97-b2b7-4195-ba7e-f5b1e8b19b5a tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.461161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edf319b1-2486-4acf-8f58-d569eafc33d7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.470654 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16fd4b97-b2b7-4195-ba7e-f5b1e8b19b5a tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] 10.222.0.13 "GET /compute/v2.1/flavors/1293725353" status: 200 len: 448 microversion: 2.55 time: 0.425300 Nov 06 20:46:34.471850 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 27/46] 10.222.0.13 () {60 vars in 1198 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/1293725353 => generated 448 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:34.481864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5b1f7edc-fb66-462b-933a-c6f8d9f7aec3 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-601596337", "id": 225157543, "os-flavor-access:is_public": "False"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.496177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edf319b1-2486-4acf-8f58-d569eafc33d7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.038774 Nov 06 20:46:34.497306 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 20/47] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:34.502694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9525ffd4-54f8-4bfb-bac7-f6c366dd867b tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] Action: 'update', calling method: .version_select at 0x7f6717d693a0>, body: {"flavor": {"description": "new"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.516130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5b1f7edc-fb66-462b-933a-c6f8d9f7aec3 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.037495 Nov 06 20:46:34.517049 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:34.517049 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:34.523529 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 28/48] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors => generated 435 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.528965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-534ae3d7-dbd1-4a98-80d6-7fe4aa36a5df tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-191716251", "id": 1797894605, "os-flavor-access:is_public": "False"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.547979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9525ffd4-54f8-4bfb-bac7-f6c366dd867b tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1293725353" status: 200 len: 449 microversion: 2.55 time: 0.049388 Nov 06 20:46:34.548934 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 21/49] 10.222.0.13 () {62 vars in 1218 bytes} [Sat Nov 6 20:46:34 2021] PUT /compute/v2.1/flavors/1293725353 => generated 449 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:34.559832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-534ae3d7-dbd1-4a98-80d6-7fe4aa36a5df tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034703 Nov 06 20:46:34.560459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 29/50] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.574745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81df5151-fffb-47ca-9cd8-f7019584ed7a tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.601125 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81df5151-fffb-47ca-9cd8-f7019584ed7a tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.039586 Nov 06 20:46:34.633701 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 30/51] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:46:34.650904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa4bc80b-274e-410f-a937-4b2c8e2617cd tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1173876218", "id": 635772311, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.683936 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa4bc80b-274e-410f-a937-4b2c8e2617cd tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.049020 Nov 06 20:46:34.684966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 31/52] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors => generated 411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.692081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6dbc24f7-9f46-40cb-803a-9cced1426d61 tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.714117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6dbc24f7-9f46-40cb-803a-9cced1426d61 tempest-FlavorsV255TestJSON-1023839708 tempest-FlavorsV255TestJSON-1023839708-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3407 microversion: 2.55 time: 0.027578 Nov 06 20:46:34.714681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 32/53] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors => generated 3407 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:46:34.720889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-114dec3d-b789-431d-a029-a6693115866a tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.752778 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-114dec3d-b789-431d-a029-a6693115866a tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 842 microversion: 2.1 time: 0.034974 Nov 06 20:46:34.762885 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 33/54] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail?is_public=f => generated 842 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.767751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b81a6f6f-4d0b-4f28-a007-b3231c75156d tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.783101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f1cf1cc-fb3b-4c0f-ac47-f024f16016e0 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.785026 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:34.785026 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:34.786407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8f1cf1cc-fb3b-4c0f-ac47-f024f16016e0 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bf8ea153733243078669bcedb5f33d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c1b7c98e645bb8d20ef4bb9b13b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:34.787941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f1cf1cc-fb3b-4c0f-ac47-f024f16016e0 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:34.791478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f1cf1cc-fb3b-4c0f-ac47-f024f16016e0 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] 10.222.0.13 "POST /compute/v2.1/flavors/225157543/action" status: 403 len: 130 microversion: 2.1 time: 0.239573 Nov 06 20:46:34.793410 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 22/55] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors/225157543/action => generated 130 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:34.805200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eca3c1c7-9209-4b2d-a20e-0145dbb0afb1 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.821912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b81a6f6f-4d0b-4f28-a007-b3231c75156d tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1293725353" status: 202 len: 0 microversion: 2.55 time: 0.057605 Nov 06 20:46:34.822700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 34/56] 10.222.0.13 () {60 vars in 1201 bytes} [Sat Nov 6 20:46:34 2021] DELETE /compute/v2.1/flavors/1293725353 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:46:34.829904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01853be1-583b-42a8-9573-523928e374bf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.832463 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eca3c1c7-9209-4b2d-a20e-0145dbb0afb1 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 842 microversion: 2.1 time: 0.035983 Nov 06 20:46:34.840121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 23/57] 10.222.0.13 () {58 vars in 1176 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail?is_public=false => generated 842 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.846029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50bedd3d-a286-45d3-a677-44e316fd4dd1 tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.882316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01853be1-583b-42a8-9573-523928e374bf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/225157543" status: 202 len: 0 microversion: 2.1 time: 0.058566 Nov 06 20:46:34.883386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 35/58] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:34 2021] DELETE /compute/v2.1/flavors/225157543 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:34.888021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56343b9a-84df-41f8-b04d-7304eb34ab2d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.894051 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50bedd3d-a286-45d3-a677-44e316fd4dd1 tempest-FlavorsV255TestJSON-230133931 tempest-FlavorsV255TestJSON-230133931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5707 microversion: 2.55 time: 0.050335 Nov 06 20:46:34.896109 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 24/59] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail => generated 5707 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:46:34.902643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc9724ec-3c72-4c6a-b4a1-bda75841e40d tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.923247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56343b9a-84df-41f8-b04d-7304eb34ab2d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.038713 Nov 06 20:46:34.931966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 36/60] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:34.943042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb744532-bed8-4776-acd1-53c16cb2d138 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:34.961019 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc9724ec-3c72-4c6a-b4a1-bda75841e40d tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.063601 Nov 06 20:46:34.961610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 25/61] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:34.966652 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb744532-bed8-4776-acd1-53c16cb2d138 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.029413 Nov 06 20:46:34.979576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9589f093-05f9-44ce-8e59-8da3cb258bcf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1024948405", "id": 349111679, "os-flavor-access:is_public": "False"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:34.981837 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 37/62] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:34.989557 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:34.989557 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:34.999473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f75228e4-5f81-48f5-9d9e-d69c7c9dd87d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.026147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9589f093-05f9-44ce-8e59-8da3cb258bcf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.050324 Nov 06 20:46:35.028586 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 26/63] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:34 2021] POST /compute/v2.1/flavors => generated 436 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:35.043902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0b9f9c4-b25d-40bb-b5d8-60b99b0be440 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:35.066988 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f75228e4-5f81-48f5-9d9e-d69c7c9dd87d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.076318 Nov 06 20:46:35.070524 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 38/64] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Nov 6 20:46:34 2021] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:35.093922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a3b5687-fada-492d-9051-9eb924ca91c7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.135254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a3b5687-fada-492d-9051-9eb924ca91c7 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.053143 Nov 06 20:46:35.156871 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 39/65] 10.222.0.13 () {58 vars in 1174 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:35.171005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73c82c2b-135e-4406-9ed8-14fd421dfb48 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.231352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73c82c2b-135e-4406-9ed8-14fd421dfb48 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.073118 Nov 06 20:46:35.231945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 40/66] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:35.246933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95efdb3d-e323-4a0a-beda-0f47f36dd3b2 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.346826 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95efdb3d-e323-4a0a-beda-0f47f36dd3b2 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.103428 Nov 06 20:46:35.347663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 41/67] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:35.364793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.371593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:35.379697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:35.382377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:35.383701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:35.384325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:35.533073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:35.557370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0b9f9c4-b25d-40bb-b5d8-60b99b0be440 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/349111679/action" status: 200 len: 96 microversion: 2.1 time: 0.523670 Nov 06 20:46:35.560100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 27/68] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:35 2021] POST /compute/v2.1/flavors/349111679/action => generated 96 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:46:35.568372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de4a2820-6df7-4c9a-9dbc-207eb0aea594 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.571537 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e99b0817-de58-49fd-880d-97abee54d458 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1307 microversion: 2.1 time: 0.222487 Nov 06 20:46:35.576945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 42/69] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:35.608010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e537ae14-07b3-4574-a7d0-bc6f4b7a9cb6 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:35.614743 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:35.614743 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:35.615848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de4a2820-6df7-4c9a-9dbc-207eb0aea594 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/635772311" status: 202 len: 0 microversion: 2.1 time: 0.054080 Nov 06 20:46:35.617274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 28/70] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:35 2021] DELETE /compute/v2.1/flavors/635772311 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:35.618718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e537ae14-07b3-4574-a7d0-bc6f4b7a9cb6 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bf8ea153733243078669bcedb5f33d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53c1b7c98e645bb8d20ef4bb9b13b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:35.619672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e537ae14-07b3-4574-a7d0-bc6f4b7a9cb6 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:35.622356 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e537ae14-07b3-4574-a7d0-bc6f4b7a9cb6 tempest-FlavorsAccessNegativeTestJSON-1719829983 tempest-FlavorsAccessNegativeTestJSON-1719829983-project] 10.222.0.13 "POST /compute/v2.1/flavors/349111679/action" status: 403 len: 133 microversion: 2.1 time: 0.032489 Nov 06 20:46:35.625240 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 43/71] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:35 2021] POST /compute/v2.1/flavors/349111679/action => generated 133 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:35.630828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-373903e5-bef0-4240-b97d-b80f44f73f1f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.638441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-300a0068-3899-4378-b279-1f557621962b tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e53c1b7c98e645bb8d20ef4bb9b13b35"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:35.685059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-373903e5-bef0-4240-b97d-b80f44f73f1f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061933 Nov 06 20:46:35.687520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 29/72] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:35.699975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7a6abc4-5d7a-4b29-b7ef-01939856646f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.731940 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7a6abc4-5d7a-4b29-b7ef-01939856646f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1797894605" status: 202 len: 0 microversion: 2.1 time: 0.035301 Nov 06 20:46:35.732856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 30/73] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:35 2021] DELETE /compute/v2.1/flavors/1797894605 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:35.743174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31684258-9c88-4533-bdb1-8b7efc953f3d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.782020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31684258-9c88-4533-bdb1-8b7efc953f3d tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045205 Nov 06 20:46:35.784610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 31/74] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:35.809458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a310d4cb-5b0b-46ee-a068-461dc9c7e098 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1801922149", "id": 763439938, "os-flavor-access:is_public": "False"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:35.846945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a310d4cb-5b0b-46ee-a068-461dc9c7e098 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.046492 Nov 06 20:46:35.849012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 32/75] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:35 2021] POST /compute/v2.1/flavors => generated 412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:35.859880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e38ea57f-36eb-47d8-89a1-90fed67eb895 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:35.914549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e38ea57f-36eb-47d8-89a1-90fed67eb895 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056884 Nov 06 20:46:35.924681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 33/76] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:35.935162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f6a9839-ac24-4947-89e4-ac6d2b4e0062 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.003497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f6a9839-ac24-4947-89e4-ac6d2b4e0062 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073725 Nov 06 20:46:36.006337 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 34/77] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:35 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:36.021417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51938630-2178-456b-adc6-ce295143d001 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.061384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51938630-2178-456b-adc6-ce295143d001 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/763439938" status: 202 len: 0 microversion: 2.1 time: 0.043921 Nov 06 20:46:36.062542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 35/78] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:36 2021] DELETE /compute/v2.1/flavors/763439938 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:46:36.071627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f825913c-fbf6-4720-9bf9-446e44f05272 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.128716 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f825913c-fbf6-4720-9bf9-446e44f05272 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062121 Nov 06 20:46:36.131772 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 36/79] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:36 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:36.147986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8989ce78-df66-4e76-9deb-d163a1427b32 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1861984563", "id": 448032074, "os-flavor-access:is_public": "True"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:36.187977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8989ce78-df66-4e76-9deb-d163a1427b32 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.045848 Nov 06 20:46:36.189322 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 37/80] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:36 2021] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:36.200953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94470d63-9a4a-4870-8d2e-44cc4a8b7738 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.253883 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94470d63-9a4a-4870-8d2e-44cc4a8b7738 tempest-FlavorsAdminTestJSON-276405178 tempest-FlavorsAdminTestJSON-276405178-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.055133 Nov 06 20:46:36.254510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 38/81] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:36 2021] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:36.270552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c9c368e-695d-499c-884c-0162e14f7d78 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.302365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c9c368e-695d-499c-884c-0162e14f7d78 tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/448032074" status: 202 len: 0 microversion: 2.1 time: 0.036028 Nov 06 20:46:36.304979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 39/82] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:36 2021] DELETE /compute/v2.1/flavors/448032074 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:46:36.320113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-249a30bc-b586-4fd4-90bb-cf96b8c2b21f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.359944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-249a30bc-b586-4fd4-90bb-cf96b8c2b21f tempest-FlavorsAdminTestJSON-241137535 tempest-FlavorsAdminTestJSON-241137535-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050707 Nov 06 20:46:36.360895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:36 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:36.529435 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-300a0068-3899-4378-b279-1f557621962b tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/349111679/action" status: 200 len: 21 microversion: 2.1 time: 0.899130 Nov 06 20:46:36.539273 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 44/84] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:46:35 2021] POST /compute/v2.1/flavors/349111679/action => generated 21 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:46:36.550662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5abd6bc-7866-4805-b5ab-0576aafccfbf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.600153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.601039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:36.617416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:36.620047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5abd6bc-7866-4805-b5ab-0576aafccfbf tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/349111679" status: 202 len: 0 microversion: 2.1 time: 0.081931 Nov 06 20:46:36.622699 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 41/85] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:46:36 2021] DELETE /compute/v2.1/flavors/349111679 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:36.625776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:36.635536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:36.639983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:36.644150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74bc4369-fe99-47e2-8409-84c2e75de4fd tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:36.667852 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74bc4369-fe99-47e2-8409-84c2e75de4fd tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039607 Nov 06 20:46:36.679796 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 42/86] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:36 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:36.691607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6bf9c34-c930-4d2f-9330-2e0c08cb7a8e tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-51499697", "id": 1699296428, "os-flavor-access:is_public": "False"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:36.742648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6bf9c34-c930-4d2f-9330-2e0c08cb7a8e tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.061484 Nov 06 20:46:36.752787 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 43/87] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:36 2021] POST /compute/v2.1/flavors => generated 437 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:36.759146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c4ce698-fa06-432e-9477-7d1f821310c6 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "45cfec818e2c4702b955c1b51c0b048d"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:36.760341 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:36.760341 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:36.842435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:36.856332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc7e34d6-bd24-47a9-a419-ccbcadd08f00 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1295 microversion: 2.1 time: 0.265512 Nov 06 20:46:36.895262 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:36 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1295 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:37.881489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:37.882857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:37.900777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:37.901186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:37.920284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:37.920284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:37.999609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-0c4ce698-fa06-432e-9477-7d1f821310c6 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] HTTP exception thrown: Flavor access not found for 31 / 45cfec818e2c4702b955c1b51c0b048d combination. Nov 06 20:46:38.000267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c4ce698-fa06-432e-9477-7d1f821310c6 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Returning 404 to user: Flavor access not found for 31 / 45cfec818e2c4702b955c1b51c0b048d combination. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:38.001087 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c4ce698-fa06-432e-9477-7d1f821310c6 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1699296428/action" status: 404 len: 124 microversion: 2.1 time: 1.247036 Nov 06 20:46:38.009975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 44/89] 10.222.0.13 () {60 vars in 1199 bytes} [Sat Nov 6 20:46:36 2021] POST /compute/v2.1/flavors/1699296428/action => generated 124 bytes in 1256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:38.040129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3130fff-03b1-4d55-ac51-ded1efa8daa1 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:38.117957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3130fff-03b1-4d55-ac51-ded1efa8daa1 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1699296428" status: 202 len: 0 microversion: 2.1 time: 0.102120 Nov 06 20:46:38.121584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 45/90] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:46:38 2021] DELETE /compute/v2.1/flavors/1699296428 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:46:38.139512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8416d84-46fc-4094-bc41-abb88c74be27 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:38.219482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8416d84-46fc-4094-bc41-abb88c74be27 tempest-FlavorsAccessNegativeTestJSON-1435183746 tempest-FlavorsAccessNegativeTestJSON-1435183746-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092919 Nov 06 20:46:38.223693 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:38 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:38.955433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:38.965452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d369b590-6d2c-45e1-8606-cd631c2e4c97 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 1.094644 Nov 06 20:46:38.969923 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:37 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:39.360617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Action: 'update', calling method: .version_select at 0x7f6715f1db80>, body: {"quota_set": {"ram": "5120"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:39.364047 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:39.364047 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:39.552483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:39.552953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:39.554283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:39.554283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:39.788162 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-351a31df-9dde-4d78-9f32-d14d8d18b85c tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f" status: 200 len: 148 microversion: 2.57 time: 1.023579 Nov 06 20:46:39.798472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 47/93] 10.222.0.13 () {62 vars in 1302 bytes} [Sat Nov 6 20:46:38 2021] PUT /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f => generated 148 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:39.804863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Calling method '.version_select at 0x7f6716653310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:39.984763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:39.985967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:39.988823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:39.989375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:39.990094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:39.990537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:40.010193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:40.011530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:40.013493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:40.016342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:40.145472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7c447ff-7a19-423a-a512-1da7d8e369a5 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f/detail" status: 200 len: 463 microversion: 2.57 time: 0.347592 Nov 06 20:46:40.151035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 47/94] 10.222.0.13 () {60 vars in 1303 bytes} [Sat Nov 6 20:46:39 2021] GET /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f/detail => generated 463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:41.196890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Action: 'update', calling method: .version_select at 0x7f6716607d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:41.199184 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:41.199184 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:41.694791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:41.695389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:41.696693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:41.697302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:41.836595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:41.837062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:41.837908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:41.838347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:41.987833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22ecf5f4-0474-40cb-a445-0265c0db4e33 tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f?user_id=86b17239de5c455b9ac987cf6b8ae8b0" status: 200 len: 148 microversion: 2.57 time: 0.795393 Nov 06 20:46:42.000716 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 48/95] 10.222.0.13 () {62 vars in 1383 bytes} [Sat Nov 6 20:46:41 2021] PUT /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f?user_id=86b17239de5c455b9ac987cf6b8ae8b0 => generated 148 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:46:42.009004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af63be4c-fdf5-4cb9-ae56-472f03e8770d tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] Calling method '.version_select at 0x7f6716638790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:42.232647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:42.276578 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51dfa80e-a906-451c-bbce-5f1197bf82ed tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 2.295732 Nov 06 20:46:42.294818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 48/96] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:39 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:43.116447 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af63be4c-fdf5-4cb9-ae56-472f03e8770d tempest-QuotasAdminTestV257-41269375 tempest-QuotasAdminTestV257-41269375-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f?user_id=86b17239de5c455b9ac987cf6b8ae8b0" status: 200 len: 190 microversion: 2.57 time: 1.111041 Nov 06 20:46:43.119948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 49/97] 10.222.0.13 () {60 vars in 1363 bytes} [Sat Nov 6 20:46:42 2021] GET /compute/v2.1/os-quota-sets/fd79faf38d9d4450b1ff850e0c7b9b2f?user_id=86b17239de5c455b9ac987cf6b8ae8b0 => generated 190 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:46:43.300405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:43.301410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:43.321885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:43.322938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:43.324091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:43.325778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:44.526440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-089fd700-852c-4661-9558-c660869181a1 req-90991085-4bd8-46fe-89a5-fbb8009e6a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027b89bd-aab4-4348-9494-be85f3973773", "tag": "829a0bac-6a0e-4e3c-a257-5fbed5e24627"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:44.528029 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:44.528029 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:44.558446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-089fd700-852c-4661-9558-c660869181a1 req-90991085-4bd8-46fe-89a5-fbb8009e6a89 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:44.563129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-089fd700-852c-4661-9558-c660869181a1 req-90991085-4bd8-46fe-89a5-fbb8009e6a89 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:44.631190 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-089fd700-852c-4661-9558-c660869181a1 req-90991085-4bd8-46fe-89a5-fbb8009e6a89 service nova] Creating event network-changed:829a0bac-6a0e-4e3c-a257-5fbed5e24627 for instance 027b89bd-aab4-4348-9494-be85f3973773 on nch2-master-1 Nov 06 20:46:44.633138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-089fd700-852c-4661-9558-c660869181a1 req-90991085-4bd8-46fe-89a5-fbb8009e6a89 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:46:44.634766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:44.637844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:44.640665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:44.645419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:44.677201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.rpcapi [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 06 20:46:44.689584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] Releasing lock "compute-rpcapi-router" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:46:44.750660 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68a40018-83d0-4564-851f-c4d793e90bfa None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.987709 Nov 06 20:46:44.752344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 50/98] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:46:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:44.762962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:44.775042 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a14513a4-36c4-4d36-ab2d-7eb9bc239e80 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 1.479216 Nov 06 20:46:44.793786 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 49/99] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:43 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:45.802253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:45.803860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:45.815630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:45.823859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:45.825106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:45.825714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.275636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Calling method '.version_select at 0x7f6716699430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:46.276561 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:46.276561 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:46.279428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.280001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.324788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.325546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.344040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.355527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.367989 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f45d6eb-0d1c-4a86-a40c-3b494994901a tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.797273 Nov 06 20:46:46.371474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 51/100] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:45 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:46.386719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Calling method '.version_select at 0x7f6716699280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:46.396771 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:46.396771 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:46.398927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.399575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.464342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:46.477182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.480874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.481403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e72ca8dc-71ee-41af-87d2-0627e0de5ba7 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.677620 Nov 06 20:46:46.505094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 50/101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:45 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:46.621899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.622568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.646735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc705bd6-cd06-47e0-8d5c-3d97456daed0 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.269507 Nov 06 20:46:46.674139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 52/102] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Nov 6 20:46:46 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:46.680226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Calling method '.version_select at 0x7f6715d628b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:46.681148 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:46.681148 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:46.683196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.683929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.727364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.727364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.738777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.739632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.747165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23f957c5-e5fd-422a-8e7d-0012a1091f76 tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071129 Nov 06 20:46:46.748755 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 51/103] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:46 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:46.768196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Calling method '.version_select at 0x7f6716584af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:46.772663 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:46.772663 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:46.776956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.779458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.812191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:46.812952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:46.821294 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f30bce97-8279-4df4-92bd-3feb6e881e9c tempest-HypervisorAdminUnderV252Test-647799964 tempest-HypervisorAdminUnderV252Test-647799964-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.065523 Nov 06 20:46:46.822975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Nov 6 20:46:46 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:47.503115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:47.504908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:47.524366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:47.543607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:47.546287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:47.550950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:48.134881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:48.148799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-092fe8dc-bfcc-4857-ab8a-1122df467594 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.646290 Nov 06 20:46:48.149539 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 52/105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:47 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:49.167596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:49.168625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:49.180487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:49.180942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:49.181739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:49.182171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:49.485992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:49.496833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c96bae5a-7963-4a14-97c7-209e072302c0 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.333623 Nov 06 20:46:49.497836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 54/106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:49 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:49.762707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-530494957", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:49.868710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:50.198253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:50.198853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:50.199476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:50.200048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:50.200636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:50.218424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:50.221623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a5951fd-1e7a-42be-b977-3cdca9b41e7f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:50.222730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:50.223823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:50.225496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:50.234713 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a5951fd-1e7a-42be-b977-3cdca9b41e7f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.333133 Nov 06 20:46:50.236603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 55/107] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:46:49 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:50.254125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Getting quotas for project 06b236babc5d4b95a766210d9912b71e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:50.262684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Getting quotas for user a7e06c24860e4fd4ad0125f6b46809ea and project 06b236babc5d4b95a766210d9912b71e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:50.278580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:46:50.295096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:46:50.400440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7d40a8a-00e9-4ab0-8a5e-cc9df68c600f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081241 Nov 06 20:46:50.406416 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 53/108] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:46:50.411675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d17cdd17-d427-4127-b684-2497d9853be5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:50.412424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d17cdd17-d427-4127-b684-2497d9853be5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:50.481173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d17cdd17-d427-4127-b684-2497d9853be5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:50.488894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d17cdd17-d427-4127-b684-2497d9853be5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1221 microversion: 2.1 time: 0.081332 Nov 06 20:46:50.500214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 54/109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:50 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:50.518160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:50.519056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:50.527161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:50.528113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:50.529356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:50.530024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:50.636419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad118309-4b15-480f-98d2-4b6508fd7cd2 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1947486380", "id": 1494599763, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:50.638161 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:50.638161 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:50.684070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad118309-4b15-480f-98d2-4b6508fd7cd2 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.435900 Nov 06 20:46:50.687450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 56/110] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:50 2021] POST /compute/v2.1/flavors => generated 425 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:50.723603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcfd45ee-cfd6-46aa-b714-cd680a82f954 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:50.748423 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcfd45ee-cfd6-46aa-b714-cd680a82f954 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055232 Nov 06 20:46:50.749699 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 57/111] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Nov 6 20:46:50 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:46:50.765910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9490c46-ae8c-4c4f-a8be-bb0794f6aa07 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-888295101", "id": 41995773, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:50.794658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:50.804251 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9490c46-ae8c-4c4f-a8be-bb0794f6aa07 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.049441 Nov 06 20:46:50.804512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d2c7bf1-926f-4680-b889-35049ef75ae5 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.291665 Nov 06 20:46:50.804941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:50 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:50.812358 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 58/113] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:50 2021] POST /compute/v2.1/flavors => generated 418 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:50.824258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a5efef0-1ccd-45cc-9b7c-7224717fef61 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:50.843182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a5efef0-1ccd-45cc-9b7c-7224717fef61 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022467 Nov 06 20:46:50.844253 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 56/114] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Nov 6 20:46:50 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:46:50.854417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'create', calling method: .version_select at 0x7f6716653160>, body: {"keypair": {"name": "tempest-keypair-1085876697"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:50.925363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for project 3e0376f3231e49d495f1777d2f774450. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:50.935430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for user 34bc3358aaee478c9da0d68688f1a4ce and project 3e0376f3231e49d495f1777d2f774450. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:51.445074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for project 3e0376f3231e49d495f1777d2f774450. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:51.449339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for user 34bc3358aaee478c9da0d68688f1a4ce and project 3e0376f3231e49d495f1777d2f774450. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:51.464516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5955800b-ef70-4e78-a437-5e799717a126 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.613895 Nov 06 20:46:51.466147 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 59/115] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:46:50 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:51.507345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:51.508417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:51.597227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:51.606270 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1221 microversion: 2.1 time: 0.103208 Nov 06 20:46:51.610157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 57/116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:51 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:51.821666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:51.822294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:51.838345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:51.842107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:51.844187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:51.844952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:52.187325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:52.201056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b0a78e8-36d2-4e2d-97d9-5f74b201aa57 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.382490 Nov 06 20:46:52.203215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 60/117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:51 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:52.322100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:52.323229 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc281e54-c9dc-4622-bb3c-ad85b7771f08 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001316 Nov 06 20:46:52.329745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 58/118] 10.222.0.13 () {56 vars in 885 bytes} [Sat Nov 6 20:46:52 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Nov 06 20:46:52.633182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:52.633796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:52.662639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:52.663110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:52.663957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:52.664431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:52.944334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:52.954194 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d399a8a0-9665-4fe1-95fc-a61e1ea61253 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1281 microversion: 2.1 time: 0.331939 Nov 06 20:46:52.956137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 61/119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:52 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1281 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:46:53.219394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:53.220102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:53.248666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:53.250471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:53.251902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:53.252367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:53.605085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:53.619888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff2dc536-117f-4273-9c30-dd37f446a347 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.402777 Nov 06 20:46:53.619888 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 62/120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:53 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:53.670291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f384be6c-6e96-4300-83ef-340494f5a884 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Calling method '.version_select at 0x7f6715dc9dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:53.889251 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f384be6c-6e96-4300-83ef-340494f5a884 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 371 microversion: 2.1 time: 0.683541 Nov 06 20:46:53.891199 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 59/121] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:46:53 2021] GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 371 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:53.911433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f671650b430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:53.913209 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:53.913209 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:53.976613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:53.977298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:53.995411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:53.995979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:53.996867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:53.997311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:54.192162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:54.221152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55413413-8d4a-4602-9e16-d8199fc05d09 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1279 microversion: 2.1 time: 0.251696 Nov 06 20:46:54.222602 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:53 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:54.295999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:54.296493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:54.306201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:54.306758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:54.388018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcd6b30f-394a-4535-addb-80ce41cc0a93 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 328 microversion: 2.1 time: 0.489752 Nov 06 20:46:54.389012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 63/123] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:53 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 328 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:54.425250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1673999546", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "41995773", "adminPass": "***", "networks": [{"uuid": "30f7f650-50d0-446a-82d8-39753cfb0023"}], "security_groups": [{"name": "tempest-securitygroup--1942292788"}], "key_name": "tempest-keypair-1085876697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:54.483191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-723969485", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:54.581293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:54.682386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] validate_networks() for [('30f7f650-50d0-446a-82d8-39753cfb0023', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:55.245822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:55.246335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:55.246734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:55.247358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:55.248029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:55.258377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:55.258851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:55.259660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:55.260093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:55.277771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Getting quotas for project c4b8abb5c5234e3197eabc3f2ae9cffd. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:55.282188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Getting quotas for user 02a745015150420da98bdc97abda23c7 and project c4b8abb5c5234e3197eabc3f2ae9cffd. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:55.293857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:46:55.296172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:46:55.345245 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58a99187-0e06-491a-a4e0-9612e1cec167 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007443 Nov 06 20:46:55.350895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 61/124] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:46:55.565752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-416756319", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:55.649736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:55.989523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:55.989940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:55.990411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:55.990847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:55.991251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:56.004457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.004938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.005772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.006200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.010939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:56.011537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:56.012020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:56.012731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:56.013215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:56.023458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.024263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.024526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:56.025409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.025860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.028749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for user 3c769dfb3f0a44a59ee4ea3d7b88bbc7 and project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:56.041929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.utils [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] cores quota exceeded for 669e18a7cfcf4e06a41e8e5bc5296a77, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134828) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1167}} Nov 06 20:46:56.042930 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 06 20:46:56.043776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:56.045314 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e89843e6-7fbd-4081-890c-17784850edcc tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.693440 Nov 06 20:46:56.046387 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 62/125] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:55 2021] POST /compute/v2.1/servers => generated 111 bytes in 695 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:56.049965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for project 3e0376f3231e49d495f1777d2f774450. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:56.051774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:56.052877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:56.054442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for user 34bc3358aaee478c9da0d68688f1a4ce and project 3e0376f3231e49d495f1777d2f774450. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:56.062891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.063346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.064182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.064652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.072316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:46:56.075316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:46:56.133943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4fd6c09-2d1a-4ac1-a571-e61190a49882 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.712959 Nov 06 20:46:56.134802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 64/126] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:54 2021] POST /compute/v2.1/servers => generated 402 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:46:56.141453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:56.147245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:56.151308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.152202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.154149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.154937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.273072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:56.285833 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6b15ea3-6eb0-4fac-8bb1-9325720c7611 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.238115 Nov 06 20:46:56.286603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 63/127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:56 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:56.295966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:56.296612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:56.305438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.306870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.308336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.308768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.389428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:56.399945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8ef3be4-9dbe-4b92-8c80-f57c106dea45 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.263630 Nov 06 20:46:56.409681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 65/128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:56 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:56.418310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:56.423013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f6715cac280>, body: {"quota_set": {"cores": 20}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:56.424830 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:56.424830 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:56.431915 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d79b2da-0d6c-4160-80c1-f86df0cfc807 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1217 microversion: 2.1 time: 0.143081 Nov 06 20:46:56.433220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 64/129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:56 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:56.450241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83c75e2e-85fe-4a40-a796-c60cfdad96b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:56.451020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83c75e2e-85fe-4a40-a796-c60cfdad96b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:56.511754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83c75e2e-85fe-4a40-a796-c60cfdad96b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:56.521749 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83c75e2e-85fe-4a40-a796-c60cfdad96b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1261 microversion: 2.1 time: 0.075750 Nov 06 20:46:56.523201 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 65/130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:56 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:56.744125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.744621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.745433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:56.745942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:56.809485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be1c5199-8242-4f4e-9b3b-3da18da0c869 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 329 microversion: 2.1 time: 0.398382 Nov 06 20:46:56.810420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 66/131] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:56 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 329 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:56.822519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-129ce950-122d-4c6c-aaef-02a64cfd8ae7 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Calling method '.version_select at 0x7f6715d62b80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.095333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-129ce950-122d-4c6c-aaef-02a64cfd8ae7 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 371 microversion: 2.1 time: 0.277164 Nov 06 20:46:57.096557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 66/132] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:46:56 2021] GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:57.106793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f6715d33a60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:57.108897 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.108897 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:57.234321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0e8c649-4235-4711-8b97-6d8bab255fa7 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Calling method '.version_select at 0x7f67165589d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.235115 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.235115 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:57.236669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0e8c649-4235-4711-8b97-6d8bab255fa7 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1675ca8e0c7c4ab7b823c6017a1b42ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289eb2aab16b45b3a53b58ab1b7830cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.237361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0e8c649-4235-4711-8b97-6d8bab255fa7 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.238152 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0e8c649-4235-4711-8b97-6d8bab255fa7 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.188167 Nov 06 20:46:57.238662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 67/133] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:57.249449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-239faecf-b49b-4ddb-ae76-d08710d4a269 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Calling method '.version_select at 0x7f67166e3ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.250293 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.250293 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:57.252095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.252417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-239faecf-b49b-4ddb-ae76-d08710d4a269 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1675ca8e0c7c4ab7b823c6017a1b42ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289eb2aab16b45b3a53b58ab1b7830cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.252688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.253082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-239faecf-b49b-4ddb-ae76-d08710d4a269 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.254019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.254222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-239faecf-b49b-4ddb-ae76-d08710d4a269 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009002 Nov 06 20:46:57.254572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.255052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 68/134] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:57.266363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59369d4f-c7ac-47a9-81fe-643282e7fe85 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Calling method '.version_select at 0x7f67165588b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.267792 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.267792 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:57.269527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-59369d4f-c7ac-47a9-81fe-643282e7fe85 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1675ca8e0c7c4ab7b823c6017a1b42ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289eb2aab16b45b3a53b58ab1b7830cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.270614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59369d4f-c7ac-47a9-81fe-643282e7fe85 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.272752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59369d4f-c7ac-47a9-81fe-643282e7fe85 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010108 Nov 06 20:46:57.273892 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1178 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:57.315585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a827132c-b735-4eaf-b82a-09e337d82156 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 328 microversion: 2.1 time: 0.212458 Nov 06 20:46:57.316412 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 67/136] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:57 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:57.320875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.321481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:57.327180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.327814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.328941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.330339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.339275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Calling method '.version_select at 0x7f6715cacf70>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.343059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.343574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.358740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.359266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.371473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.372063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.378883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e1f0d2a-273a-4aa1-be3c-a7130ef1364e tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.097121 Nov 06 20:46:57.379449 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 70/137] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:57.388923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-738a781b-65ff-48d2-b9b8-6b4de77da275 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Calling method '.version_select at 0x7f6716558310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.389695 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.389695 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:57.392235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-738a781b-65ff-48d2-b9b8-6b4de77da275 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1675ca8e0c7c4ab7b823c6017a1b42ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289eb2aab16b45b3a53b58ab1b7830cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.395675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-738a781b-65ff-48d2-b9b8-6b4de77da275 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.396568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-738a781b-65ff-48d2-b9b8-6b4de77da275 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011090 Nov 06 20:46:57.397407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 71/138] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:57.406324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c46397e-ac8a-4de5-b8a4-04a2249c8729 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Calling method '.version_select at 0x7f6716503790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.409272 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7c46397e-ac8a-4de5-b8a4-04a2249c8729 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] HTTP exception thrown: Hypervisor with ID '0283ce42-2e36-4fde-ab7e-7869bacd56c5' could not be found. Nov 06 20:46:57.409827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c46397e-ac8a-4de5-b8a4-04a2249c8729 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Returning 404 to user: Hypervisor with ID '0283ce42-2e36-4fde-ab7e-7869bacd56c5' could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.410622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c46397e-ac8a-4de5-b8a4-04a2249c8729 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/0283ce42-2e36-4fde-ab7e-7869bacd56c5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.007833 Nov 06 20:46:57.411411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/0283ce42-2e36-4fde-ab7e-7869bacd56c5/uptime => generated 123 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:57.419831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.421158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:57.429569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.430226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.431798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.432234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.507484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.514907 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-014d1bc6-4483-425e-985b-7a42bc28d304 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.197360 Nov 06 20:46:57.515562 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 68/140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:57.519820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Calling method '.version_select at 0x7f6715f3aca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.520729 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.520729 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:57.522309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.522972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.537986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.538436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.549049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.549496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.555752 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16c49f54-e3c1-44e2-a162-1365f8b91f11 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039021 Nov 06 20:46:57.556390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 69/141] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:57.565760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1823214453", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:57.582272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.589914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75a549df-7107-4ac8-923a-7e6249b8f1e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.176576 Nov 06 20:46:57.590481 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:57.595545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.596974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:57.603140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.603638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.604571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.605000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.624068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:57.680211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.688312 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05981271-cebd-42f7-9fd6-91d0c5deda06 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1217 microversion: 2.1 time: 0.096566 Nov 06 20:46:57.689462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:57.693877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.694656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:57.702530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.703077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.703950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.704547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.781744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.789848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94433cb1-7f09-4494-a6dc-4bb88fe563be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1265 microversion: 2.1 time: 0.099340 Nov 06 20:46:57.790931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 75/144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:57.806244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c267f0a7-fa86-41dd-a915-1194cf9deab6 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Calling method '.version_select at 0x7f6716503ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.807029 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.807029 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:57.808342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c267f0a7-fa86-41dd-a915-1194cf9deab6 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1675ca8e0c7c4ab7b823c6017a1b42ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289eb2aab16b45b3a53b58ab1b7830cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:57.808986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c267f0a7-fa86-41dd-a915-1194cf9deab6 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.809798 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c267f0a7-fa86-41dd-a915-1194cf9deab6 tempest-HypervisorAdminNegativeTestJSON-2085431954 tempest-HypervisorAdminNegativeTestJSON-2085431954-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018139 Nov 06 20:46:57.810305 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 76/145] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:57.819683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-367e313e-a39b-4e8e-997d-092896a6e6e8 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Calling method '.version_select at 0x7f6715cac940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:57.821645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-367e313e-a39b-4e8e-997d-092896a6e6e8 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] HTTP exception thrown: Hypervisor with ID '12dd8f14-f9aa-4cce-b2f2-fb41cb081fa3' could not be found. Nov 06 20:46:57.822207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-367e313e-a39b-4e8e-997d-092896a6e6e8 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] Returning 404 to user: Hypervisor with ID '12dd8f14-f9aa-4cce-b2f2-fb41cb081fa3' could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.823308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-367e313e-a39b-4e8e-997d-092896a6e6e8 tempest-HypervisorAdminNegativeTestJSON-2079081487 tempest-HypervisorAdminNegativeTestJSON-2079081487-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/12dd8f14-f9aa-4cce-b2f2-fb41cb081fa3" status: 404 len: 123 microversion: 2.1 time: 0.006940 Nov 06 20:46:57.824035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 77/146] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Nov 6 20:46:57 2021] GET /compute/v2.1/os-hypervisors/12dd8f14-f9aa-4cce-b2f2-fb41cb081fa3 => generated 123 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:57.880406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:57.880833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:57.881309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:57.881913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:57.882323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:57.891083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.891552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.892450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:57.892888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:57.911981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:57.916262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for user 3c769dfb3f0a44a59ee4ea3d7b88bbc7 and project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:57.927465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.utils [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] instances quota exceeded for 669e18a7cfcf4e06a41e8e5bc5296a77, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134828) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1167}} Nov 06 20:46:57.928664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 06 20:46:57.929257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:57.930087 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33d01288-b867-4353-8273-5253197780f3 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.368611 Nov 06 20:46:57.930649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 70/147] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:57 2021] POST /compute/v2.1/servers => generated 119 bytes in 374 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:46:57.941336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f6715cace50>, body: {"quota_set": {"instances": 10}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:57.943144 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:57.943144 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:58.012398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.012848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.013656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.014095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.069430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcfc18ac-8507-43cd-bcc1-2f1a14f4e030 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 329 microversion: 2.1 time: 0.133827 Nov 06 20:46:58.070010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 78/148] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:57 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:58.081679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a40c79a2-1c34-4938-80e3-0b3361345add tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Calling method '.version_select at 0x7f6715ca1430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:58.283648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a40c79a2-1c34-4938-80e3-0b3361345add tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 371 microversion: 2.1 time: 0.206330 Nov 06 20:46:58.284493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 71/149] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:46:58 2021] GET /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:58.295512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f6716558a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:58.377866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.378318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.379128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.379621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.425987 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18119b1d-4cb7-4913-bdfe-0ad28b6c4b11 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 325 microversion: 2.1 time: 0.134437 Nov 06 20:46:58.426609 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 79/150] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:58 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 325 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:58.531886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:58.532872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:58.537389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-869864945", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:58.539068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.539538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.540362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.541038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.598657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:46:58.765878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:58.774697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b070538a-9899-4154-9757-46b4144a7070 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.246498 Nov 06 20:46:58.775388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 72/151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:58 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:58.780097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:58.780948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:58.787945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.788790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.789963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.790773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.895607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:46:58.898443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:46:58.899018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:46:58.900769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:46:58.901302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:46:58.932488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.933689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.935307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:58.936097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:58.970423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:46:58.975328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Getting quotas for user 3c769dfb3f0a44a59ee4ea3d7b88bbc7 and project 669e18a7cfcf4e06a41e8e5bc5296a77. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:46:58.988606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.utils [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] ram quota exceeded for 669e18a7cfcf4e06a41e8e5bc5296a77, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134827) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1167}} Nov 06 20:46:58.989395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 06 20:46:58.989986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:58.990829 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6dcce91-7776-423e-a59c-9c2a47e6e425 tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.457164 Nov 06 20:46:58.994525 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 80/152] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:46:58 2021] POST /compute/v2.1/servers => generated 110 bytes in 459 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:58.996758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:58.997367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:59.007895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.008381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.009228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.009665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.012110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:59.021540 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e72ea57-0888-446d-87b4-edb7298bd7f8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.244880 Nov 06 20:46:59.023153 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 73/153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:58 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:59.028241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:59.029943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:59.037451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.038198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.039544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.040161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.138962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:59.161012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-932e922c-8a5c-4a7c-baa5-ea85d9759cde tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1265 microversion: 2.1 time: 0.136314 Nov 06 20:46:59.161903 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 74/154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:59 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:59.195947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Action: 'update', calling method: .version_select at 0x7f6715d621f0>, body: {"quota_set": {"ram": 51200}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:59.200120 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:59.200120 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:46:59.265961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:59.275749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de04e0fb-a3cc-413f-9e57-d947c79f67f2 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1217 microversion: 2.1 time: 0.282612 Nov 06 20:46:59.279305 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 81/155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:58 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1217 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:46:59.473321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.473868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.474688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.475124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.527004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-491bfa06-08bf-4043-9b1a-7a742d4e81f7 req-e04cc9df-99b5-47ce-8c6b-19d1cd4d3736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027b89bd-aab4-4348-9494-be85f3973773", "name": "network-vif-plugged", "status": "completed", "tag": "829a0bac-6a0e-4e3c-a257-5fbed5e24627"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:59.529490 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:46:59.529490 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:46:59.529868 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0a4106c-6793-4c14-9489-0e30dcaaedb1 tempest-QuotasAdminNegativeTest-593881236 tempest-QuotasAdminNegativeTest-593881236-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 200 len: 329 microversion: 2.1 time: 0.363016 Nov 06 20:46:59.530451 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 75/156] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:59 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 329 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:46:59.538957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-491bfa06-08bf-4043-9b1a-7a742d4e81f7 req-e04cc9df-99b5-47ce-8c6b-19d1cd4d3736 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.539815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-491bfa06-08bf-4043-9b1a-7a742d4e81f7 req-e04cc9df-99b5-47ce-8c6b-19d1cd4d3736 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.542258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dad300b7-aae2-4e25-9b3c-40799d59b88e tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Action: 'update', calling method: .version_select at 0x7f6715d54280>, body: {"quota_set": {"ram": 0}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:46:59.546287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dad300b7-aae2-4e25-9b3c-40799d59b88e tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '3c769dfb3f0a44a59ee4ea3d7b88bbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e18a7cfcf4e06a41e8e5bc5296a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:59.547177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dad300b7-aae2-4e25-9b3c-40799d59b88e tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:46:59.548137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dad300b7-aae2-4e25-9b3c-40799d59b88e tempest-QuotasAdminNegativeTest-1849023884 tempest-QuotasAdminNegativeTest-1849023884-project] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77" status: 403 len: 116 microversion: 2.1 time: 0.010208 Nov 06 20:46:59.556340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 76/157] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:46:59 2021] PUT /compute/v2.1/os-quota-sets/669e18a7cfcf4e06a41e8e5bc5296a77 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:46:59.559832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-491bfa06-08bf-4043-9b1a-7a742d4e81f7 req-e04cc9df-99b5-47ce-8c6b-19d1cd4d3736 service nova] Creating event network-vif-plugged:829a0bac-6a0e-4e3c-a257-5fbed5e24627 for instance 027b89bd-aab4-4348-9494-be85f3973773 on nch2-master-1 Nov 06 20:46:59.565504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-491bfa06-08bf-4043-9b1a-7a742d4e81f7 req-e04cc9df-99b5-47ce-8c6b-19d1cd4d3736 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244562 Nov 06 20:46:59.566078 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 82/158] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:46:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:46:59.793309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:46:59.794225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:46:59.802581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.803581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.804623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:46:59.805151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:46:59.990682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:46:59.998709 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c1d47f8-4f9e-4d87-9db0-be7893c34165 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.210141 Nov 06 20:46:59.999283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 77/159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:46:59 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:00.040273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:00.041621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:00.050222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.051133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.052210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.052961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.180374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:00.181477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:00.187878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.188451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.189237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.189664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.273860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:00.285969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b2c2010-52a9-4f5b-b04e-9e571594941f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1265 microversion: 2.1 time: 0.110476 Nov 06 20:47:00.286629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 78/160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:00 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:00.287169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:00.293541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:00.294305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:00.301260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.301933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.302726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:00.303159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:00.305256 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0c6936d-fe0e-4d87-acbd-aaec23ed4aca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.268754 Nov 06 20:47:00.305858 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 83/161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:00 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:00.390509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:00.398718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8538086-710a-426a-9181-24db974f672a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1217 microversion: 2.1 time: 0.108835 Nov 06 20:47:00.399635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 79/162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:00 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:00.851718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Action: 'create', calling method: .version_select at 0x7f671650b8b0>, body: {"keypair": {"name": "tempest-keypair-585000129", "type": "ssh", "user_id": "b89b6d768ca642ebbba69b6969804448"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:00.870609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:00.876256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:01.015006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:01.015614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:01.021472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.022110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.023039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.023473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.166508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:01.175405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f2a8de1-7ffc-4ee2-a9da-ada9ebff8225 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1337 microversion: 2.1 time: 0.163971 Nov 06 20:47:01.176336 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 80/163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:01 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1337 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:01.194135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:01.198077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:01.211932 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7dde1f9a-175c-4c63-a8c5-26b6c89ad3c0 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.478882 Nov 06 20:47:01.212563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 84/164] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Nov 6 20:47:00 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 480 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:47:01.222979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Action: 'create', calling method: .version_select at 0x7f6715ca15e0>, body: {"keypair": {"name": "tempest-keypair-128057024", "type": "ssh", "user_id": "b89b6d768ca642ebbba69b6969804448"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:01.251575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:01.257091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:01.303390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:01.303999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:01.309876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.310959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.312133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.312775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.374931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:01.383724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f3ceed4-ec50-4d9e-9cd9-e0b995524cc6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1265 microversion: 2.1 time: 0.084217 Nov 06 20:47:01.384790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 85/165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:01 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:01.389104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:01.389894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:01.396394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.397045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.397823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.398257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.559403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:01.561910 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6036010e-acce-4f08-b0c9-545f41dce64e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.175927 Nov 06 20:47:01.563245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 86/166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:01 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:01.568591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:01.569340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:01.575847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.576558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.577812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:01.579120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:01.677715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:01.685831 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b715fc18-5e5c-43f3-a948-7498776ced51 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1217 microversion: 2.1 time: 0.120746 Nov 06 20:47:01.687627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 87/167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:01 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:01.777731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:01.781481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:01.796044 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40285b6c-47e5-47f1-addb-6adc518c7156 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.577338 Nov 06 20:47:01.797357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 81/168] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Nov 6 20:47:01 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 579 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:47:01.807287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e498c4c7-a423-49b8-88aa-df3f99332c97 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Calling method '.version_select at 0x7f6716f36f70>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:01.818367 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e498c4c7-a423-49b8-88aa-df3f99332c97 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-585000129?user_id=b89b6d768ca642ebbba69b6969804448" status: 200 len: 705 microversion: 2.10 time: 0.015319 Nov 06 20:47:01.822450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 88/169] 10.222.0.13 () {60 vars in 1336 bytes} [Sat Nov 6 20:47:01 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-585000129?user_id=b89b6d768ca642ebbba69b6969804448 => generated 705 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:47:01.832869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Action: 'create', calling method: .version_select at 0x7f6715ca1ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-683194414", "type": "ssh"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:01.856341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:01.863259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:02.131490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:02.135735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Getting quotas for user 1ba1d31b51f64f4e899fabf4aae32da5 and project 49e90de463c94dac887e0486af739b55. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:02.148901 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c0d20af-1b98-43f1-a95c-2bdb447aa687 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.10 time: 0.320776 Nov 06 20:47:02.149493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 82/170] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 20:47:01 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 322 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:47:02.160158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b18a0ab8-4847-42b8-9ece-e52dedb86bf9 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Calling method '.version_select at 0x7f6716699550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.163243 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-b18a0ab8-4847-42b8-9ece-e52dedb86bf9 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:47:02.171873 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-b18a0ab8-4847-42b8-9ece-e52dedb86bf9 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:47:02.179735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b18a0ab8-4847-42b8-9ece-e52dedb86bf9 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs?user_id=b89b6d768ca642ebbba69b6969804448" status: 200 len: 1112 microversion: 2.10 time: 0.023626 Nov 06 20:47:02.180331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 89/171] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Nov 6 20:47:02 2021] GET /compute/v2.1/os-keypairs?user_id=b89b6d768ca642ebbba69b6969804448 => generated 1112 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:02.191003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a84d7216-867f-4b49-b3d2-d240a9797824 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Calling method '.version_select at 0x7f6715d54280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.193046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.193651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:02.202647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.203257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.204146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.204627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.217196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a84d7216-867f-4b49-b3d2-d240a9797824 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-683194414" status: 204 len: 0 microversion: 2.10 time: 0.028691 Nov 06 20:47:02.218130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 83/172] 10.222.0.13 () {60 vars in 1321 bytes} [Sat Nov 6 20:47:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-683194414 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:47:02.226630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d6e5a04-aaf7-4c6d-bcc3-8fb295bae171 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Calling method '.version_select at 0x7f6715cdb280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.247354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d6e5a04-aaf7-4c6d-bcc3-8fb295bae171 tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128057024?user_id=b89b6d768ca642ebbba69b6969804448" status: 204 len: 0 microversion: 2.10 time: 0.024277 Nov 06 20:47:02.247929 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 84/173] 10.222.0.13 () {60 vars in 1339 bytes} [Sat Nov 6 20:47:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128057024?user_id=b89b6d768ca642ebbba69b6969804448 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 20:47:02.256812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36ce855b-f3bf-49ab-80f1-c150ec5ac26d tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] Calling method '.version_select at 0x7f6715cdbee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.279866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36ce855b-f3bf-49ab-80f1-c150ec5ac26d tempest-KeyPairsV210TestJSON-2050231451 tempest-KeyPairsV210TestJSON-2050231451-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585000129?user_id=b89b6d768ca642ebbba69b6969804448" status: 204 len: 0 microversion: 2.10 time: 0.027484 Nov 06 20:47:02.280838 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 85/174] 10.222.0.13 () {60 vars in 1339 bytes} [Sat Nov 6 20:47:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585000129?user_id=b89b6d768ca642ebbba69b6969804448 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 20:47:02.402633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.403677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:02.413703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.417850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.422326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.425295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.593889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:02.615058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17529202-b9e7-45fe-83a0-b02493ab6b1a tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1486 microversion: 2.1 time: 0.425418 Nov 06 20:47:02.616031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 90/175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:02 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:02.623930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.627940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:02.647979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.650259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.651294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.651907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.677404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:02.685537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-635e95e2-911c-4a0e-9709-c8dff49c9e31 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1313 microversion: 2.1 time: 0.287220 Nov 06 20:47:02.695050 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 86/176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:02 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:02.699247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:02.702146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:02.719625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.724539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:02.729000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:02.730968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.381953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:03.399818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6dbaaadc-b047-4594-bb18-a63ad1c9836a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.782306 Nov 06 20:47:03.400621 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 91/177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:02 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:03.408380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:03.409489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:03.419679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:03.420991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.421963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:03.423688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.555051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:03.581888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c46b4cc-bb3f-4ec4-b40d-01f72d281961 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1271 microversion: 2.1 time: 0.178237 Nov 06 20:47:03.583833 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 92/178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:03 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:03.590823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0be1915d-9f8b-4654-8b89-5595f70e0973 req-284efcf7-0231-4b8b-a603-425883ce36e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139cbe17-657f-439e-a940-bc1166cb7e25", "tag": "a41e7a85-586b-4ade-9a81-f07b08cb6c08"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:03.593621 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:03.593621 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:03.602326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0be1915d-9f8b-4654-8b89-5595f70e0973 req-284efcf7-0231-4b8b-a603-425883ce36e8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:03.603886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0be1915d-9f8b-4654-8b89-5595f70e0973 req-284efcf7-0231-4b8b-a603-425883ce36e8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.621127 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0be1915d-9f8b-4654-8b89-5595f70e0973 req-284efcf7-0231-4b8b-a603-425883ce36e8 service nova] Creating event network-changed:a41e7a85-586b-4ade-9a81-f07b08cb6c08 for instance 139cbe17-657f-439e-a940-bc1166cb7e25 on nch1-master-1 Nov 06 20:47:03.628011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0be1915d-9f8b-4654-8b89-5595f70e0973 req-284efcf7-0231-4b8b-a603-425883ce36e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042099 Nov 06 20:47:03.628766 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 93/179] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:03.705818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:03.707688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:03.717619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:03.718478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.720480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:03.721296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:03.878722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:03.886386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ade580a-8268-4853-998f-f4fb61138593 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1319 microversion: 2.1 time: 0.186908 Nov 06 20:47:03.887314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 94/180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:03 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:04.067191 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59199d67-3180-4b53-8c72-b9259a189a06 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1637 microversion: 2.1 time: 1.378345 Nov 06 20:47:04.068977 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 87/181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:02 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1637 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:04.091320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5d33648-6526-41a1-92af-6d68e5a91f85 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:04.094025 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:04.094025 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:04.111810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5d33648-6526-41a1-92af-6d68e5a91f85 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:04.112516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5d33648-6526-41a1-92af-6d68e5a91f85 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:04.422219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:04.423047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:04.434007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:04.434447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:04.440232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:04.443057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:04.620269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5d33648-6526-41a1-92af-6d68e5a91f85 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.538885 Nov 06 20:47:04.627061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 95/182] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:04 2021] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:04.629517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:04.632644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:04.640515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:04.641215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:04.642465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:04.643056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.001629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:05.009220 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22480322-f018-4f8b-a695-eee2fb449537 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.595542 Nov 06 20:47:05.009795 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:04 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:05.022658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c6fe4e5-e25a-4e2b-a005-56b95f95ed8a tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:05.026126 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.026126 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:05.088531 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c6fe4e5-e25a-4e2b-a005-56b95f95ed8a tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.070054 Nov 06 20:47:05.094544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 89/184] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:05 2021] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:05.111497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:05.112855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:05.121665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.123109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.124157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.124827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.144014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:05.158065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7a0e28b-cce7-4b35-9cff-bb7a66e9343a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.534146 Nov 06 20:47:05.170052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 96/185] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:04 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:05.182440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f012456-9711-4e51-91c9-c2bc88b5332f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1660446242"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.185180 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.185180 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:05.192253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-8f012456-9711-4e51-91c9-c2bc88b5332f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 78c19d54-7d19-4106-85c5-0c6293e5d2ab for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:05.274789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f012456-9711-4e51-91c9-c2bc88b5332f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.102189 Nov 06 20:47:05.279819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:05.282837 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 97/186] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:05.297512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2370e60f-c232-430b-8504-36023367b6e0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.299498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-074a7d0c-7bfb-4e3e-92c5-f247415585e6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1319 microversion: 2.1 time: 0.202814 Nov 06 20:47:05.300652 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 90/187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:05 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:05.302336 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.302336 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:05.331474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2370e60f-c232-430b-8504-36023367b6e0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.332133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2370e60f-c232-430b-8504-36023367b6e0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.564451 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2370e60f-c232-430b-8504-36023367b6e0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.279193 Nov 06 20:47:05.565012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 98/188] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:05.575406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-014defd7-3d62-4ac7-8ceb-4ba526ad5e35 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:05.576327 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.576327 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:05.602665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-014defd7-3d62-4ac7-8ceb-4ba526ad5e35 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.031276 Nov 06 20:47:05.603235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 91/189] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:47:05 2021] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:05.621734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2ad34d56-9511-4e4d-a24d-22941efa8ca1 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.626014 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.626014 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:05.648490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ad34d56-9511-4e4d-a24d-22941efa8ca1 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.649225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ad34d56-9511-4e4d-a24d-22941efa8ca1 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.803427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5679513b-d8cd-4ec4-9387-092ef51b7fe7 req-dacfa5f9-932c-4d71-aa0a-ae553aa4273d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e11138c-1070-426e-be89-3222cb59da6a", "tag": "ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.805488 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.805488 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:05.836730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2ad34d56-9511-4e4d-a24d-22941efa8ca1 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.225740 Nov 06 20:47:05.838270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5679513b-d8cd-4ec4-9387-092ef51b7fe7 req-dacfa5f9-932c-4d71-aa0a-ae553aa4273d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.838723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5679513b-d8cd-4ec4-9387-092ef51b7fe7 req-dacfa5f9-932c-4d71-aa0a-ae553aa4273d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.839474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 99/190] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:05.850121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-daa70e49-3561-4f98-b9dc-2e5e5098d68d tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:05.850888 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.850888 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:05.908970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5679513b-d8cd-4ec4-9387-092ef51b7fe7 req-dacfa5f9-932c-4d71-aa0a-ae553aa4273d service nova] Creating event network-changed:ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac for instance 1e11138c-1070-426e-be89-3222cb59da6a on nch1-master-1 Nov 06 20:47:05.915063 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-daa70e49-3561-4f98-b9dc-2e5e5098d68d tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.069433 Nov 06 20:47:05.915647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5679513b-d8cd-4ec4-9387-092ef51b7fe7 req-dacfa5f9-932c-4d71-aa0a-ae553aa4273d service nova] Acquired lock "compute-rpcapi-router" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:47:05.917077 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 100/191] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:05 2021] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:05.918471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.919191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.920754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:05.923121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:05.927188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07d83388-027a-401e-a9f0-0a021d66c63f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-206911404"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.928506 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.928506 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:05.933929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-07d83388-027a-401e-a9f0-0a021d66c63f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid a0eaf294-7a6a-49a7-a7dc-9570b477b495 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:05.935128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.rpcapi [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 06 20:47:05.936268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] Releasing lock "compute-rpcapi-router" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:47:05.971020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73d3d468-6ccf-49e5-8f81-c851a3363375 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263400 Nov 06 20:47:05.971688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 92/192] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:05.973801 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07d83388-027a-401e-a9f0-0a021d66c63f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050760 Nov 06 20:47:05.975314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 101/193] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:05.986864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1633acfd-27d1-492f-bb77-fe11c67c3c23 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:05.988485 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:05.988485 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:06.002317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1633acfd-27d1-492f-bb77-fe11c67c3c23 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.003460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1633acfd-27d1-492f-bb77-fe11c67c3c23 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.027685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:06.029579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:06.041602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.042711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.044590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.045087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.173771 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1633acfd-27d1-492f-bb77-fe11c67c3c23 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.190833 Nov 06 20:47:06.175386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 93/194] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:05 2021] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:06.181040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:06.182729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:06.191910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.193275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.195467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.196734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.783810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:06.795913 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8b466d0-9195-4312-a756-99697c9989aa tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.772715 Nov 06 20:47:06.808049 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 102/195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:06 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:06.815079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d100850-b14d-4f14-b7a0-9759a8d59083 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:06.816161 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:06.816161 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:06.831708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d100850-b14d-4f14-b7a0-9759a8d59083 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.022194 Nov 06 20:47:06.833617 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 103/196] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:47:06 2021] GET /compute/v2.1/os-aggregates => generated 244 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:06.840555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:06.841949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:06.852145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.852956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.854465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.855162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:06.878091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:06.888326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-898151b1-ff51-473e-97a0-b6371a26f824 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.711544 Nov 06 20:47:06.899971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 94/197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:06 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:06.913620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9d564b4-a32a-4d5b-9ab2-914a747932a9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:06.916785 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:06.916785 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:06.941542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9d564b4-a32a-4d5b-9ab2-914a747932a9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:06.942460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9d564b4-a32a-4d5b-9ab2-914a747932a9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.126740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9d564b4-a32a-4d5b-9ab2-914a747932a9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.221237 Nov 06 20:47:07.128330 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 95/198] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:06 2021] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.149509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04ff50ec-20d9-4551-8163-1ca52e150276 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:07.153346 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.153346 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:07.204865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:07.205350 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04ff50ec-20d9-4551-8163-1ca52e150276 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.067849 Nov 06 20:47:07.211650 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 96/199] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:07 2021] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:07.221931 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f12add3a-5ce7-4c4f-959c-81bc14e71aae tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.385339 Nov 06 20:47:07.231590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f7d5e4f-f0ab-4820-9d8b-601edb282d2f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1477605661"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.231590 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.231590 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:07.234770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-8f7d5e4f-f0ab-4820-9d8b-601edb282d2f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid ecb98cf3-3cd7-4364-bd73-7f82bcee1877 for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:07.238140 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 104/200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:06 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:07.281389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f7d5e4f-f0ab-4820-9d8b-601edb282d2f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064077 Nov 06 20:47:07.283037 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 97/201] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.293766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22d419c5-468b-419f-bd36-a54718bb886f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.299106 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.299106 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:07.319205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22d419c5-468b-419f-bd36-a54718bb886f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.322076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22d419c5-468b-419f-bd36-a54718bb886f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.333415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f3e5600f-b3c5-4711-b926-ae6dfab8c8f6 req-beec158d-dbee-4554-ade7-644cf3b0a303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbc8ec1-8c19-4586-a720-c08f62c147ba", "tag": "5935a02d-18df-4c4f-9301-484bbfd49bab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.339385 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.339385 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:07.384014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f3e5600f-b3c5-4711-b926-ae6dfab8c8f6 req-beec158d-dbee-4554-ade7-644cf3b0a303 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.384707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f3e5600f-b3c5-4711-b926-ae6dfab8c8f6 req-beec158d-dbee-4554-ade7-644cf3b0a303 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.414437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f3e5600f-b3c5-4711-b926-ae6dfab8c8f6 req-beec158d-dbee-4554-ade7-644cf3b0a303 service nova] Creating event network-changed:5935a02d-18df-4c4f-9301-484bbfd49bab for instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba on nch1-master-1 Nov 06 20:47:07.455605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f3e5600f-b3c5-4711-b926-ae6dfab8c8f6 req-beec158d-dbee-4554-ade7-644cf3b0a303 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100150 Nov 06 20:47:07.458492 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 98/202] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.532880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22d419c5-468b-419f-bd36-a54718bb886f tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.242650 Nov 06 20:47:07.544702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 105/203] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.549580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-573cada9-3bb3-4a45-82cc-b74a6d4f1efa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.550875 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.550875 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:07.561310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-573cada9-3bb3-4a45-82cc-b74a6d4f1efa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.561761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-573cada9-3bb3-4a45-82cc-b74a6d4f1efa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.741102 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-573cada9-3bb3-4a45-82cc-b74a6d4f1efa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.196357 Nov 06 20:47:07.741700 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 99/204] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.751975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be032bb7-23e9-4d12-93d4-19cc73f8a94d tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:07.752822 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.752822 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:07.782994 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be032bb7-23e9-4d12-93d4-19cc73f8a94d tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.034168 Nov 06 20:47:07.783840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 106/205] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:07 2021] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:07.798587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-393d5836-57f6-4f05-a4e9-ae8e7747db21 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-650134438"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.800190 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.800190 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:07.802058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-393d5836-57f6-4f05-a4e9-ae8e7747db21 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 40dc54ec-ee16-494e-901d-e021cb246cf6 for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:07.803534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7920f8e-ae30-453b-8376-a167e4a20e88 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676596405"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.805214 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.805214 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:07.811342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-c7920f8e-ae30-453b-8376-a167e4a20e88 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid d6c2de50-fc35-4dd2-b65f-5bd91cd01696 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:07.834571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-393d5836-57f6-4f05-a4e9-ae8e7747db21 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040419 Nov 06 20:47:07.837527 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 100/206] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.849142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7920f8e-ae30-453b-8376-a167e4a20e88 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052786 Nov 06 20:47:07.849750 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 107/207] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:07.850316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:07.851073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:07.859652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.860335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.860982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa21209c-1cad-4208-acfa-79f642ff02ce tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:07.862016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.862271 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:07.862271 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:07.862931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:07.885999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa21209c-1cad-4208-acfa-79f642ff02ce tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:07.886466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa21209c-1cad-4208-acfa-79f642ff02ce tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.022628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa21209c-1cad-4208-acfa-79f642ff02ce tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.165095 Nov 06 20:47:08.023246 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 108/208] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:07 2021] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.035618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9c1408a-4116-4265-8bec-822114b26142 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.036404 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.036404 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.062358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9c1408a-4116-4265-8bec-822114b26142 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.037836 Nov 06 20:47:08.063246 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 109/209] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:08 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:08.070815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.074547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:08.083380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:08.084522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.084983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.085812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.086245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.100865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c29970e0-8117-41c0-ac6e-9b15b5b11077 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.261023 Nov 06 20:47:08.101805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 101/210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:07 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:08.319323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:08.330334 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a55faaa-c28e-41e9-9fbd-2d1c0eaeab3a tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.263335 Nov 06 20:47:08.331511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 110/211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:08.337034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.338421 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.338421 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.347114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.347833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.356645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.358236 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.358236 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:08.361140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.362524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.363531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.364171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.378299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Aggregate 5 already has host nch1-master-1. Nov 06 20:47:08.378727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 409 to user: Aggregate 5 already has host nch1-master-1. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:08.379764 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70d7b573-6a09-4486-a6cf-03cf5a3fb174 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 409 len: 95 microversion: 2.1 time: 0.047019 Nov 06 20:47:08.380521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 111/212] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates/5/action => generated 95 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 06 20:47:08.392122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9918f0d-3d1c-47b8-95f9-500f830fa24b tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.393185 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.393185 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.400842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e9918f0d-3d1c-47b8-95f9-500f830fa24b tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 06 20:47:08.401153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed1df781-b1a7-4919-b5d0-ce3762340259 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.297268 Nov 06 20:47:08.401901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9918f0d-3d1c-47b8-95f9-500f830fa24b tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:08.402413 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 102/213] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-services => generated 947 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.403180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9918f0d-3d1c-47b8-95f9-500f830fa24b tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.015786 Nov 06 20:47:08.403885 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 112/214] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:08.407080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.407862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:08.411345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd8cc137-168b-41b8-8b70-9f60f139bf06 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.411619 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.411619 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.416212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.416791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.417456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.417887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.422799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8cc137-168b-41b8-8b70-9f60f139bf06 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.423352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8cc137-168b-41b8-8b70-9f60f139bf06 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.543779 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd8cc137-168b-41b8-8b70-9f60f139bf06 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.138579 Nov 06 20:47:08.544661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 113/215] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.550591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.552180 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.552180 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.554147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.554854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.555960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.556582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.590513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-835652fc-238c-4a96-bacc-7cff7bde791c tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.044839 Nov 06 20:47:08.591630 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 114/216] 10.222.0.13 () {58 vars in 1173 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.596172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2985c74a-9c7a-48a6-8b93-73a95f1c5e56 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.597134 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.597134 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.607248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2985c74a-9c7a-48a6-8b93-73a95f1c5e56 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 06 20:47:08.607843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2985c74a-9c7a-48a6-8b93-73a95f1c5e56 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:08.608697 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2985c74a-9c7a-48a6-8b93-73a95f1c5e56 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.015995 Nov 06 20:47:08.609425 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 115/217] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:08 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:08.618216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-52f6c742-2cd6-43ec-b175-f2185c9ae0c4 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.641465 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-52f6c742-2cd6-43ec-b175-f2185c9ae0c4 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.026542 Nov 06 20:47:08.642406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 116/218] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:08 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:08.646975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.648652 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.648652 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.650877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.650877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.651929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.651929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.679458 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc16649f-1e48-46cd-b191-21ba3f2f8450 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036192 Nov 06 20:47:08.680045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 117/219] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.684249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7853c36-6721-43ec-a80f-38dda5bc6d74 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1919822275", "name": "tempest-test_aggregate-801909359"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.702590 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.702590 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.703210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:08.703918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-d7853c36-6721-43ec-a80f-38dda5bc6d74 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 77adf86e-1b06-4fc6-9a5f-9380d702f44c for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:08.717786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f77a640c-7ed5-435b-85ea-caab15c85b52 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.312908 Nov 06 20:47:08.718826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 103/220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:08.725364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ff6aca0-0a21-45a4-9799-3b3a3aab1026 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-668607335"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.728463 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.728463 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:08.730987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-0ff6aca0-0a21-45a4-9799-3b3a3aab1026 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 35b34a64-755d-45ba-bfa8-5da956ce69ff for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:08.751836 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7853c36-6721-43ec-a80f-38dda5bc6d74 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.069840 Nov 06 20:47:08.759112 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 118/221] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.761215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecd0d8c0-e852-46c6-9385-55f4f5389846 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-498337486"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.765355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ff6aca0-0a21-45a4-9799-3b3a3aab1026 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045106 Nov 06 20:47:08.766808 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 104/222] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.768640 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.768640 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.771817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-ecd0d8c0-e852-46c6-9385-55f4f5389846 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Generated uuid 76584fdb-6d6c-4745-884b-3cfb1a979c78 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:08.776328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.777855 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.777855 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:08.781588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.782091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.783355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:08.784238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:08.799751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecd0d8c0-e852-46c6-9385-55f4f5389846 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.044768 Nov 06 20:47:08.807148 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 119/223] 10.222.0.13 () {62 vars in 1204 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates => generated 245 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:08.807148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c97e81b7-08ee-4737-b81b-8a7f83dfc327 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.807479 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.807479 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.825800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-127433de-2969-41cb-bfb5-a297e9610846 tempest-ServicesAdminTestJSON-547481457 tempest-ServicesAdminTestJSON-547481457-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.057676 Nov 06 20:47:08.826740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 105/224] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-services => generated 947 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:08.837168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c97e81b7-08ee-4737-b81b-8a7f83dfc327 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.033907 Nov 06 20:47:08.838429 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 120/225] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:08 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:08.843656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7364f212-e9f6-4926-9e29-d3f6345774a9 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2087222500"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:08.939534 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.939534 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.971204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7364f212-e9f6-4926-9e29-d3f6345774a9 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.131296 Nov 06 20:47:08.972810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 121/226] 10.222.0.13 () {62 vars in 1209 bytes} [Sat Nov 6 20:47:08 2021] PUT /compute/v2.1/os-aggregates/9 => generated 299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:08.978114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7555a64-9114-4c3a-aa67-b3d87a5bb2b2 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:08.978950 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:08.978950 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:08.987147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b7555a64-9114-4c3a-aa67-b3d87a5bb2b2 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 06 20:47:08.987742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7555a64-9114-4c3a-aa67-b3d87a5bb2b2 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:08.988579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7555a64-9114-4c3a-aa67-b3d87a5bb2b2 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.014977 Nov 06 20:47:08.993021 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 122/227] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:08.997872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13ba7929-d838-499e-bad5-4dbfe0c9ead0 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.009145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13ba7929-d838-499e-bad5-4dbfe0c9ead0 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.014808 Nov 06 20:47:09.010005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 123/228] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Nov 6 20:47:08 2021] GET /compute/v2.1/os-aggregates/9 => generated 299 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:09.015815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5b13ff7-754a-4bfb-ba79-07b7f9010af9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.016657 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.016657 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.028453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d5b13ff7-754a-4bfb-ba79-07b7f9010af9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 06 20:47:09.029071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5b13ff7-754a-4bfb-ba79-07b7f9010af9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:09.029876 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5b13ff7-754a-4bfb-ba79-07b7f9010af9 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.018971 Nov 06 20:47:09.032352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 124/229] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:09 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:09.040702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea46b0ae-4757-491a-931e-613594bd152f tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.041912 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.041912 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.051627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea46b0ae-4757-491a-931e-613594bd152f tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.052074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea46b0ae-4757-491a-931e-613594bd152f tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.175342 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea46b0ae-4757-491a-931e-613594bd152f tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 314 microversion: 2.41 time: 0.143345 Nov 06 20:47:09.176233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 125/230] 10.222.0.13 () {62 vars in 1231 bytes} [Sat Nov 6 20:47:09 2021] POST /compute/v2.1/os-aggregates/9/action => generated 314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:09.180557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f03e5825-f1d6-4bba-9016-86462c19ab36 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-952913142"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.181960 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.181960 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.183147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-f03e5825-f1d6-4bba-9016-86462c19ab36 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 81e4740c-7eb6-465a-a164-d55079ba8a7c for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:09.201199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5fd7db4-75f9-4df8-96ef-94271af01a30 tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.203154 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.203154 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:09.204086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f03e5825-f1d6-4bba-9016-86462c19ab36 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.026891 Nov 06 20:47:09.205368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e5fd7db4-75f9-4df8-96ef-94271af01a30 tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:09.206215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5fd7db4-75f9-4df8-96ef-94271af01a30 tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:09.207166 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5fd7db4-75f9-4df8-96ef-94271af01a30 tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.379183 Nov 06 20:47:09.210753 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 126/231] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:09 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.211228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 106/232] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Nov 6 20:47:08 2021] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:09.215418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.216125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:09.222635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.223084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.223874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.224342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.278771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00fe2820-ea69-4046-a1c6-f7417df658b8 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] Calling method '.version_select at 0x7f6715cdb3a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.479854 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00fe2820-ea69-4046-a1c6-f7417df658b8 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.267300 Nov 06 20:47:09.480566 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 107/233] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/os-networks => generated 3327 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:09.484878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:09.493068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ad16df0-5e54-4111-aff3-c5c4cb548e10 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.494521 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.494521 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:09.495892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-748a2758-0cf6-42e4-b4e0-1e2800d9657a tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.284063 Nov 06 20:47:09.496485 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 127/234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:09.505266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e118a6ed-0f55-4838-89b4-65e64fd1079e tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.505266 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.505266 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.505512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad16df0-5e54-4111-aff3-c5c4cb548e10 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.505512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad16df0-5e54-4111-aff3-c5c4cb548e10 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.509938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e118a6ed-0f55-4838-89b4-65e64fd1079e tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.011724 Nov 06 20:47:09.515681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 128/235] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.515681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-068656d7-6393-4559-b845-ee871fda2004 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.515681 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.515681 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.541277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-068656d7-6393-4559-b845-ee871fda2004 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.029688 Nov 06 20:47:09.542039 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 129/236] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:09 2021] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:09.550563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.551320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:09.558989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.559439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.560224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.560703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.633461 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ad16df0-5e54-4111-aff3-c5c4cb548e10 tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 299 microversion: 2.41 time: 0.151597 Nov 06 20:47:09.634174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 108/237] 10.222.0.13 () {62 vars in 1231 bytes} [Sat Nov 6 20:47:09 2021] POST /compute/v2.1/os-aggregates/9/action => generated 299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:09.645874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f87a9ff0-1677-401e-9e98-96ee7079eba7 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] Calling method '.version_select at 0x7f6715cdb940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.802536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:09.809741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f87a9ff0-1677-401e-9e98-96ee7079eba7 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks/1cd440a1-6c1d-4164-9378-c5efd9c6801b" status: 200 len: 652 microversion: 2.1 time: 0.167413 Nov 06 20:47:09.810514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 109/238] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/os-networks/1cd440a1-6c1d-4164-9378-c5efd9c6801b => generated 652 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.815087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a9f1a39-5f5e-4eaf-9d08-7e31713ba0a6 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.266150 Nov 06 20:47:09.815087 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 130/239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:09.819194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f7bb141-2d11-4e27-ab84-29662ca38c9d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1147847905"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.819575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3d0d3b6-55cf-42aa-95f1-f5ea5c94b15a tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:09.820539 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.820539 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.821182 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.821182 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:09.821717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-5f7bb141-2d11-4e27-ab84-29662ca38c9d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid ecccac1c-1026-44d7-a445-17cf54e1fbaa for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:09.849674 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f7bb141-2d11-4e27-ab84-29662ca38c9d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033735 Nov 06 20:47:09.850386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 131/240] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:09 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.855136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa155aba-6473-48f1-8d34-fae7377262fb tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.856133 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:09.856133 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:09.858271 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3d0d3b6-55cf-42aa-95f1-f5ea5c94b15a tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.042114 Nov 06 20:47:09.859415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 110/241] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:09 2021] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.875333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:09.876595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:09.885047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.885583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.887184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:09.887704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:09.887827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa155aba-6473-48f1-8d34-fae7377262fb tempest-AggregatesAdminTestV241-1157150322 tempest-AggregatesAdminTestV241-1157150322-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.035989 Nov 06 20:47:09.888570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 132/242] 10.222.0.13 () {60 vars in 1192 bytes} [Sat Nov 6 20:47:09 2021] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:09.898620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b89803a0-2908-4727-9664-a873dfbc6d42 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] Calling method '.version_select at 0x7f6715cac280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.069178 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b89803a0-2908-4727-9664-a873dfbc6d42 tempest-NetworksTest-760401467 tempest-NetworksTest-760401467-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.173281 Nov 06 20:47:10.070756 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 133/243] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/os-networks => generated 3327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:10.082668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1396255119"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.084227 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.084227 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.106616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.107337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.120515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.120971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.133856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1396255119 could not be found. Nov 06 20:47:10.134551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1396255119 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.136077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:10.136231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c2653c6-089c-4a23-8629-ec5c03cbdbfa tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.064371 Nov 06 20:47:10.136800 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 134/244] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:10.145388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cd3c1f0-520a-466b-a7a2-94b953f33826 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.145606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d778fa8-9efe-4f1a-954e-3c33116b9540 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.284909 Nov 06 20:47:10.146149 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.146149 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.146691 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 111/245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:09 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:10.151536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1962e118-04c3-4f22-ba2e-c7eec3cc50c7 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.152637 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.152637 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.163616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cd3c1f0-520a-466b-a7a2-94b953f33826 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.022469 Nov 06 20:47:10.164504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 135/246] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.180725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1962e118-04c3-4f22-ba2e-c7eec3cc50c7 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.032080 Nov 06 20:47:10.185685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 112/247] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.186632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b29ec482-950d-4423-80a6-17bf413880fa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.187475 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.187475 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.195429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea536513-4df0-41d2-a92e-5541d3711b66 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.197309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea536513-4df0-41d2-a92e-5541d3711b66 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.199661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea536513-4df0-41d2-a92e-5541d3711b66 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.012913 Nov 06 20:47:10.200607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 113/248] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:10.213779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5e617af-00a7-43e2-a473-f309178dc5e4 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.216246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5e617af-00a7-43e2-a473-f309178dc5e4 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.217796 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5e617af-00a7-43e2-a473-f309178dc5e4 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008848 Nov 06 20:47:10.218881 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 114/249] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:10.233121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-878006d3-01bf-418f-9904-2537709ed7fe tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-332297852"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.233323 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b29ec482-950d-4423-80a6-17bf413880fa tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.061176 Nov 06 20:47:10.235619 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.235619 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.235994 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 136/250] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 06 20:47:10.237101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-878006d3-01bf-418f-9904-2537709ed7fe tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:10.237942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-878006d3-01bf-418f-9904-2537709ed7fe tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.238929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-878006d3-01bf-418f-9904-2537709ed7fe tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012968 Nov 06 20:47:10.239630 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 115/251] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:10.247490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27b626db-2ca0-4070-9659-709cb0982e9c tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1552291387", "availability_zone": "tempest-test_az-1038119271"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.249156 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.249156 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.250493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-27b626db-2ca0-4070-9659-709cb0982e9c tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 39e21581-10cf-4746-87b2-31bcecab494c for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.256128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7dc96d80-3896-410a-bbd4-0f1737fe36d5 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-516733927"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.262996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-7dc96d80-3896-410a-bbd4-0f1737fe36d5 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid d5f2be9a-07a3-4dee-8b7c-43828596169f for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.292677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7dc96d80-3896-410a-bbd4-0f1737fe36d5 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045495 Nov 06 20:47:10.293856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 116/252] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.299513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27b626db-2ca0-4070-9659-709cb0982e9c tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.057015 Nov 06 20:47:10.305197 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 137/253] 10.222.0.13 () {60 vars in 1164 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.306306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17828f8e-68e2-4611-b8fa-09cc44eace70 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-516733927"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.307957 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.307957 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.309746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-17828f8e-68e2-4611-b8fa-09cc44eace70 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 3bb83fb2-6c63-481f-b9a6-e3a78a0ca39c for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.317259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40186be9-53cd-4193-a7e9-2e5bea08e2c5 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1552291387_new", "availability_zone": "tempest-test_az-1038119271_new"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.322109 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.322109 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.326737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-17828f8e-68e2-4611-b8fa-09cc44eace70 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-516733927 already exists. Nov 06 20:47:10.327568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17828f8e-68e2-4611-b8fa-09cc44eace70 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-516733927 already exists. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.328471 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17828f8e-68e2-4611-b8fa-09cc44eace70 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.027629 Nov 06 20:47:10.329537 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 117/254] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 110 bytes in 29 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:10.338346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20fe8a25-cb70-4475-a463-ecefc4413363 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.339489 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.339489 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.368345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20fe8a25-cb70-4475-a463-ecefc4413363 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.034381 Nov 06 20:47:10.369752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 118/255] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.382543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40186be9-53cd-4193-a7e9-2e5bea08e2c5 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.382962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e009bd51-de6f-46c8-9142-7a573630220e tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1460202191"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.383083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40186be9-53cd-4193-a7e9-2e5bea08e2c5 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.384468 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.384468 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.385956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-e009bd51-de6f-46c8-9142-7a573630220e tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 2ed9b46c-7e4c-4c8e-8b5d-9128477bc7b5 for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.426605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e009bd51-de6f-46c8-9142-7a573630220e tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052126 Nov 06 20:47:10.427996 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 119/256] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.439743 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40186be9-53cd-4193-a7e9-2e5bea08e2c5 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.133288 Nov 06 20:47:10.443365 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 138/257] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 20:47:10 2021] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.445640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd3b9d7d-3494-4198-9fff-3f36b1b4247f tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.446433 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.446433 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.447709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fd3b9d7d-3494-4198-9fff-3f36b1b4247f tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:10.448418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd3b9d7d-3494-4198-9fff-3f36b1b4247f tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.449379 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd3b9d7d-3494-4198-9fff-3f36b1b4247f tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.009252 Nov 06 20:47:10.449888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 120/258] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:47:10.457002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11e51042-e6b9-4d35-8a96-14dddf18f064 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.460288 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.460288 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.467450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-606755f1-18a3-48d9-8e08-e6fccb40d053 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.481614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11e51042-e6b9-4d35-8a96-14dddf18f064 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 555 microversion: 2.1 time: 0.033233 Nov 06 20:47:10.482603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 139/259] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/os-aggregates => generated 555 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.510237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-625a6a9e-079d-4ced-b3fb-b1f08e1607ba tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.516011 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.516011 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.524721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-606755f1-18a3-48d9-8e08-e6fccb40d053 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.070132 Nov 06 20:47:10.527931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 121/260] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.538642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.542375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:10.551023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.551692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.552709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.553318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.571179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-625a6a9e-079d-4ced-b3fb-b1f08e1607ba tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.077328 Nov 06 20:47:10.577349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 140/261] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.603837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-caeda750-99ac-42df-83b7-fa90ea1743d0 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.604603 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.604603 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.629142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-caeda750-99ac-42df-83b7-fa90ea1743d0 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 06 20:47:10.629887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-caeda750-99ac-42df-83b7-fa90ea1743d0 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.630718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-caeda750-99ac-42df-83b7-fa90ea1743d0 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052273 Nov 06 20:47:10.637752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 141/262] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:10.645509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99d4318a-5ef7-493d-8720-2ee96dd22c19 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-424699348"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.648131 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.648131 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.650556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-99d4318a-5ef7-493d-8720-2ee96dd22c19 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Generated uuid 26d5669a-1a65-4132-b33f-573bfe948a19 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.705651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99d4318a-5ef7-493d-8720-2ee96dd22c19 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065225 Nov 06 20:47:10.715758 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 142/263] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.732482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10713dc0-d9d8-499f-81a8-c6bc7dcd2aa3 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1388739738"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:10.735629 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.735629 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.738657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-10713dc0-d9d8-499f-81a8-c6bc7dcd2aa3 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 380fb91d-92bf-4a66-ab8b-390231e53367 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:10.770204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10713dc0-d9d8-499f-81a8-c6bc7dcd2aa3 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052825 Nov 06 20:47:10.775780 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 143/264] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:10 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.781018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45602541-bf1e-41f8-8d02-d1d839951b08 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.783245 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.783245 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.797944 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45602541-bf1e-41f8-8d02-d1d839951b08 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.024314 Nov 06 20:47:10.798259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:10.804134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 144/265] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/os-aggregates => generated 445 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:10.808750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecd8171e-4b2d-4691-953c-395b046a1afb tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.809507 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.809507 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:10.809854 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3503b2e3-4f35-4c07-b8b6-1d80b41f4f50 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.280539 Nov 06 20:47:10.810424 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 122/266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:10.814845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab75cac6-871d-46c6-a69d-d32aa5124cb0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.815642 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.815642 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.820667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecd8171e-4b2d-4691-953c-395b046a1afb tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:10.824421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecd8171e-4b2d-4691-953c-395b046a1afb tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:10.825565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecd8171e-4b2d-4691-953c-395b046a1afb tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025386 Nov 06 20:47:10.826381 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 145/267] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:10.840687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.841261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:10.857490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.863978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.866091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.866702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.880673 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab75cac6-871d-46c6-a69d-d32aa5124cb0 tempest-AggregatesAdminTestJSON-1271191040 tempest-AggregatesAdminTestJSON-1271191040-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.068890 Nov 06 20:47:10.881771 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 123/268] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.895866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6374c0f2-476d-4fcd-a504-a7d2e3b75474 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.897017 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:10.897017 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:10.941386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6374c0f2-476d-4fcd-a504-a7d2e3b75474 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.058061 Nov 06 20:47:10.943966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 124/269] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:10.955951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:10.960399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:10.971276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.972579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:10.976921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:10.979934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.028111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:47:11.243395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:11.253938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ac09960-5f3e-4ad0-b959-9ce7037f431b tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.426477 Nov 06 20:47:11.263417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 146/270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:10 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:11.275475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-558fcb0a-df62-4311-bc17-ae80112cb5fd tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:11.279353 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:11.279353 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:11.292657 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-558fcb0a-df62-4311-bc17-ae80112cb5fd tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 06 20:47:11.293273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-558fcb0a-df62-4311-bc17-ae80112cb5fd tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:11.302706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-558fcb0a-df62-4311-bc17-ae80112cb5fd tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046714 Nov 06 20:47:11.308350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 147/271] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:47:11 2021] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:11.317959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:11.318583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:11.335714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.336228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.337080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.338458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.559957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:11.569338 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f822fd9-656e-4b39-ae48-1f9a8a5b0e98 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.260886 Nov 06 20:47:11.570034 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 148/272] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:11 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:11.576161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1480ed79-640f-43c8-9922-a06cdcc8471c tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:11.577464 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:11.577464 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:11.579233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1480ed79-640f-43c8-9922-a06cdcc8471c tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:11.581097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1480ed79-640f-43c8-9922-a06cdcc8471c tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:11.582382 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1480ed79-640f-43c8-9922-a06cdcc8471c tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011216 Nov 06 20:47:11.584446 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 149/273] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:47:11 2021] GET /compute/v2.1/os-aggregates => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:11.596400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7197e2ba-ce98-47c0-8f7d-4a08061b599f req-d2ec8b86-6997-4abe-bd11-6b92ca076dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139cbe17-657f-439e-a940-bc1166cb7e25", "name": "network-vif-plugged", "status": "completed", "tag": "a41e7a85-586b-4ade-9a81-f07b08cb6c08"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:11.599492 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:11.599492 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:11.645346 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c479d142-a585-4f04-b4f4-f8e59b11ff68 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "DELETE /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 204 len: 0 microversion: 2.1 time: 0.699255 Nov 06 20:47:11.646071 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 125/274] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:47:10 2021] DELETE /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:11.648568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7197e2ba-ce98-47c0-8f7d-4a08061b599f req-d2ec8b86-6997-4abe-bd11-6b92ca076dfc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.650564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7197e2ba-ce98-47c0-8f7d-4a08061b599f req-d2ec8b86-6997-4abe-bd11-6b92ca076dfc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.651740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-055b7156-5fb3-4f8a-a1cc-be9a499ea767 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1663860401"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:11.653677 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:11.653677 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:11.655163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-055b7156-5fb3-4f8a-a1cc-be9a499ea767 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid d6d6bd86-8b95-4aea-b28c-f386fe96cc4d for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:11.680604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-055b7156-5fb3-4f8a-a1cc-be9a499ea767 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032980 Nov 06 20:47:11.682353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 126/275] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:11 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:11.691141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:11.692017 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7197e2ba-ce98-47c0-8f7d-4a08061b599f req-d2ec8b86-6997-4abe-bd11-6b92ca076dfc service nova] Creating event network-vif-plugged:a41e7a85-586b-4ade-9a81-f07b08cb6c08 for instance 139cbe17-657f-439e-a940-bc1166cb7e25 on nch1-master-1 Nov 06 20:47:11.692327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:11.701901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.702611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.704457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.705088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:11.706827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7197e2ba-ce98-47c0-8f7d-4a08061b599f req-d2ec8b86-6997-4abe-bd11-6b92ca076dfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120931 Nov 06 20:47:11.710422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 150/276] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:11.747165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c02c1fc6-eb41-4978-938c-2396b7086624 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:11.755434 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:11.755434 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:11.781305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c02c1fc6-eb41-4978-938c-2396b7086624 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:11.783980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c02c1fc6-eb41-4978-938c-2396b7086624 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.005562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c02c1fc6-eb41-4978-938c-2396b7086624 tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.291155 Nov 06 20:47:12.011486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 151/277] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:11 2021] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:12.011486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:12.017246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:12.032198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.034641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.037756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.038324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.076211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:12.085071 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b5b174e-68a7-442e-be9a-5f9b6641b9ce tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1471 microversion: 2.1 time: 0.400718 Nov 06 20:47:12.089498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 127/278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:11 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:12.101633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-382697c4-665d-40ac-89b2-5b95ce859b6a tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:12.106567 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:12.106567 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:12.110836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-382697c4-665d-40ac-89b2-5b95ce859b6a tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '56b92e9d2fe94eec827685501c1aee40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2402f23ee8b148c8a1df016ba10015d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:12.112083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-382697c4-665d-40ac-89b2-5b95ce859b6a tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:12.116376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-382697c4-665d-40ac-89b2-5b95ce859b6a tempest-AggregatesAdminNegativeTestJSON-62577195 tempest-AggregatesAdminNegativeTestJSON-62577195-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024985 Nov 06 20:47:12.122232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 128/279] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:12 2021] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:12.137540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4e322df-ceac-46e9-adea-f74d6b18faea tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:12.148433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4e322df-ceac-46e9-adea-f74d6b18faea tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.149258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4e322df-ceac-46e9-adea-f74d6b18faea tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.296512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:12.307448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dee3cdb1-685e-4b23-8acb-9ddb080eac63 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.299998 Nov 06 20:47:12.308661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 152/280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:12 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:12.314147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:12.314957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:12.325920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.326476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.327375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.327818 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4e322df-ceac-46e9-adea-f74d6b18faea tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.190300 Nov 06 20:47:12.327930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.331869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 129/281] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:12 2021] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:12.346157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f8686f1-ee19-4b8a-beb3-8bd106ded86b tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:12.347205 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:12.347205 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:12.395492 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f8686f1-ee19-4b8a-beb3-8bd106ded86b tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.059264 Nov 06 20:47:12.396625 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 130/282] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:12 2021] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:12.407825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-faa1c82c-5306-4c3b-9e20-ee38ebf0f25d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-894408036"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:12.409561 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:12.409561 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:12.411544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.aggregate [None req-faa1c82c-5306-4c3b-9e20-ee38ebf0f25d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Generated uuid 2bc8bf89-d1ec-4f8e-9087-dc0a5d81b5ac for aggregate {{(pid=134828) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 20:47:12.445167 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-faa1c82c-5306-4c3b-9e20-ee38ebf0f25d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043030 Nov 06 20:47:12.446061 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 131/283] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 20:47:12 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:12.465164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:12.467285 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:12.467285 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:12.484443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.485404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.495479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.495950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.525748 ncdv-master-1 devstack@n-api.service[134828]: ERROR nova.api.openstack.compute.aggregates [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 06 20:47:12.526482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 06 20:47:12.527093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:12.527988 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9cc33c92-be29-46a8-bbcf-7640baa38f8c tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.070619 Nov 06 20:47:12.528598 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 132/284] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 20:47:12 2021] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:12.538560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99af8282-19a5-4215-80c1-6cb3ba8aaf5d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:12.539466 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:12.539466 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:12.569543 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99af8282-19a5-4215-80c1-6cb3ba8aaf5d tempest-AggregatesAdminNegativeTestJSON-568137778 tempest-AggregatesAdminNegativeTestJSON-568137778-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.035530 Nov 06 20:47:12.570632 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 133/285] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:47:12 2021] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:47:12.587853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:12.588659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:12.599913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.600854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.601667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:12.602194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:12.631275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:12.642943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6037473-c762-491e-8d85-bb69191c0727 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.332937 Nov 06 20:47:12.645366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 153/286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:12 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:12.839776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:12.871281 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1dadaba-a941-4074-822c-7254580cc91f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.287468 Nov 06 20:47:12.897535 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 134/287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:12 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:13.105385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:13.105975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:13.117084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.117683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:13.118476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.118906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:13.325996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:13.326917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:13.335710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.339269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:13.340729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.341289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:13.571420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:13.581470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ea15c74-f773-4c7b-b9ee-121450337237 tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1471 microversion: 2.1 time: 0.477571 Nov 06 20:47:13.581851 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 154/288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:13 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:13.663611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:13.664524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:13.677153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.679054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:13.680474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:13.683240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.046604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:14.064124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b03a6893-ad4c-4825-8ddb-84044a4d97b3 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1321 microversion: 2.1 time: 0.741548 Nov 06 20:47:14.069282 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 135/289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:13 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:14.083155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-093062dd-6216-407e-96ba-706b763912cd req-dd857b62-2d69-446f-9642-9756a1078e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e11138c-1070-426e-be89-3222cb59da6a", "name": "network-vif-plugged", "status": "completed", "tag": "ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:14.088963 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:14.088963 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:14.108948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-093062dd-6216-407e-96ba-706b763912cd req-dd857b62-2d69-446f-9642-9756a1078e56 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:14.111535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-093062dd-6216-407e-96ba-706b763912cd req-dd857b62-2d69-446f-9642-9756a1078e56 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.139008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-093062dd-6216-407e-96ba-706b763912cd req-dd857b62-2d69-446f-9642-9756a1078e56 service nova] Creating event network-vif-plugged:ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac for instance 1e11138c-1070-426e-be89-3222cb59da6a on nch1-master-1 Nov 06 20:47:14.158322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-093062dd-6216-407e-96ba-706b763912cd req-dd857b62-2d69-446f-9642-9756a1078e56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087703 Nov 06 20:47:14.166541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 136/290] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:14.183246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:14.186971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:14.221488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:14.222934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.230098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:14.230544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.295991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:14.313806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c8e4258-12c7-41b9-97bc-e98e96ba2a49 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.654169 Nov 06 20:47:14.315683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 155/291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:13 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:14.599239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:14.600130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:14.612444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:14.613423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.615316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:14.616820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:14.701909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:14.711185 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9d80ae7-1a56-4554-acf2-9785e5c31c0e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.542992 Nov 06 20:47:14.732697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 137/292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:14 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:14.936034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f12d189da4d6ab5573d3dcc0bafb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb1e03e53b4607861fc4aaa59b056f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:14.945978 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6802ce1-fe5f-4964-9d60-72415a4ef7ee tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 200 len: 1471 microversion: 2.1 time: 0.349188 Nov 06 20:47:14.946745 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 156/293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:14 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:15.093091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:15.093935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:15.100016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:15.100573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:15.101378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:15.101837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:15.563823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7cbcf824-7a03-40b5-a212-73e830a345f5 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-151816342", "id": 161079321, "os-flavor-access:is_public": "False"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:15.566509 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:15.566509 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:15.594914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7cbcf824-7a03-40b5-a212-73e830a345f5 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.476072 Nov 06 20:47:15.596817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 157/294] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:15 2021] POST /compute/v2.1/flavors => generated 427 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:15.616080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1538e9fa-27a8-4b6e-a4cd-8f20b075d837 req-f22f57b3-482a-479b-b396-c16777b312ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027b89bd-aab4-4348-9494-be85f3973773", "name": "network-vif-deleted", "tag": "829a0bac-6a0e-4e3c-a257-5fbed5e24627"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:15.618134 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:15.618134 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:15.631241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1538e9fa-27a8-4b6e-a4cd-8f20b075d837 req-f22f57b3-482a-479b-b396-c16777b312ba service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:15.632558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1538e9fa-27a8-4b6e-a4cd-8f20b075d837 req-f22f57b3-482a-479b-b396-c16777b312ba service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:15.647770 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1538e9fa-27a8-4b6e-a4cd-8f20b075d837 req-f22f57b3-482a-479b-b396-c16777b312ba service nova] Creating event network-vif-deleted:829a0bac-6a0e-4e3c-a257-5fbed5e24627 for instance 027b89bd-aab4-4348-9494-be85f3973773 on nch2-master-1 Nov 06 20:47:15.656271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1538e9fa-27a8-4b6e-a4cd-8f20b075d837 req-f22f57b3-482a-479b-b396-c16777b312ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057677 Nov 06 20:47:15.657920 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 158/295] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:15.664187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:15.665253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:15.674228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:15.675499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:15.676691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:15.677219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:15.723770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:15.738120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4a2e641-2154-4303-b37d-dce40319838e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1471 microversion: 2.1 time: 0.646942 Nov 06 20:47:15.752446 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 138/296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:15 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1471 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:15.763108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84882ba0-08b0-45ca-b6f9-38a20887d6e6 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7a5b4c51dab547a691855a5c71f81e79"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:15.764592 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:15.764592 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:16.206194 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84882ba0-08b0-45ca-b6f9-38a20887d6e6 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/161079321/action" status: 200 len: 96 microversion: 2.1 time: 0.464712 Nov 06 20:47:16.208892 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 139/297] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:47:15 2021] POST /compute/v2.1/flavors/161079321/action => generated 96 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:16.223801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:16.225017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:16.228941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:16.236180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:16.236909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:16.237855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:16.238227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a9ad132-24b2-4f90-986e-e277ee022690 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1313 microversion: 2.1 time: 0.578847 Nov 06 20:47:16.239060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 159/298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:15 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:16.240089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:16.432557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64e65d70-0c07-48a8-a04f-d9a9153ab8bd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:16.433129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64e65d70-0c07-48a8-a04f-d9a9153ab8bd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] [instance: 15d83165-7cc8-4d12-ae9b-d4ae04aecea8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:16.447673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-64e65d70-0c07-48a8-a04f-d9a9153ab8bd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] HTTP exception thrown: Instance 15d83165-7cc8-4d12-ae9b-d4ae04aecea8 could not be found. Nov 06 20:47:16.450145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64e65d70-0c07-48a8-a04f-d9a9153ab8bd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Returning 404 to user: Instance 15d83165-7cc8-4d12-ae9b-d4ae04aecea8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:16.451775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64e65d70-0c07-48a8-a04f-d9a9153ab8bd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/15d83165-7cc8-4d12-ae9b-d4ae04aecea8/action" status: 404 len: 111 microversion: 2.1 time: 0.211461 Nov 06 20:47:16.454462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 160/299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:16 2021] POST /compute/v2.1/servers/15d83165-7cc8-4d12-ae9b-d4ae04aecea8/action => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:16.474221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:16.487061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aaab701c-1d5f-4a7e-a382-e42b49ed6ee4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.272688 Nov 06 20:47:16.487998 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 140/300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:16 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:16.506597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:16.507112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] [instance: 027b89bd-aab4-4348-9494-be85f3973773] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:16.518211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:16.519294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:16.520882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:16.521332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:16.568708 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] HTTP exception thrown: Instance 027b89bd-aab4-4348-9494-be85f3973773 could not be found. Nov 06 20:47:16.569724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] Returning 404 to user: Instance 027b89bd-aab4-4348-9494-be85f3973773 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:16.574883 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bf5dace-3c5f-4156-a4b9-b48d5478158d tempest-AggregatesAdminTestJSON-3322213 tempest-AggregatesAdminTestJSON-3322213-project] 10.222.0.13 "GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773" status: 404 len: 111 microversion: 2.1 time: 0.067931 Nov 06 20:47:16.575982 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 141/301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:16 2021] GET /compute/v2.1/servers/027b89bd-aab4-4348-9494-be85f3973773 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:16.713708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Action: 'update', calling method: .version_select at 0x7f6715cacf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:16.715394 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:16.715394 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:17.071275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b3830cd-4bf3-4249-b8a4-3b606cd5df6a tempest-FlavorsAccessTestJSON-209388335 tempest-FlavorsAccessTestJSON-209388335-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:17.179116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b3830cd-4bf3-4249-b8a4-3b606cd5df6a tempest-FlavorsAccessTestJSON-209388335 tempest-FlavorsAccessTestJSON-209388335-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6231 microversion: 2.1 time: 0.587112 Nov 06 20:47:17.180080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 142/302] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:47:16 2021] GET /compute/v2.1/flavors/detail => generated 6231 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:17.192955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2061247786", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:17.324926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:47:17.622003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:17.623258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:17.631340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:17.632994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:17.778418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0183aedc-aee1-452d-bccd-f8057061b877 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db" status: 200 len: 240 microversion: 2.36 time: 1.322619 Nov 06 20:47:17.786685 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 161/303] 10.222.0.13 () {62 vars in 1302 bytes} [Sat Nov 6 20:47:16 2021] PUT /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db => generated 240 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:17.797520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1dab60f0-10ca-4289-a2a0-23b8b0c169b0 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7a5b4c51dab547a691855a5c71f81e79"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:17.800671 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:17.800671 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:18.225467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1dab60f0-10ca-4289-a2a0-23b8b0c169b0 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/161079321/action" status: 200 len: 21 microversion: 2.1 time: 0.436109 Nov 06 20:47:18.232687 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 162/304] 10.222.0.13 () {60 vars in 1196 bytes} [Sat Nov 6 20:47:17 2021] POST /compute/v2.1/flavors/161079321/action => generated 21 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:18.250845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:18.252025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:18.259714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:18.263660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:18.264771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:18.268586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:18.745932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:47:18.746471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:47:18.747027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:47:18.747663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:47:18.748354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:47:18.771549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:18.773364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:18.776417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:18.777097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:18.818474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Getting quotas for project 06b236babc5d4b95a766210d9912b71e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:18.828348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Getting quotas for user a7e06c24860e4fd4ad0125f6b46809ea and project 06b236babc5d4b95a766210d9912b71e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:18.857419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:47:18.871073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:47:18.998467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb629e81-7801-4115-b01c-438c52032a8e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817003 Nov 06 20:47:18.999481 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 143/305] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:47:19.008313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cd877ead-58c0-47ec-a16c-d502430f2e0e req-89fcda65-5e48-431a-a629-702f088be68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbc8ec1-8c19-4586-a720-c08f62c147ba", "name": "network-vif-plugged", "status": "completed", "tag": "5935a02d-18df-4c4f-9301-484bbfd49bab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:19.012205 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:19.012205 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:19.032616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cd877ead-58c0-47ec-a16c-d502430f2e0e req-89fcda65-5e48-431a-a629-702f088be68e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.036965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cd877ead-58c0-47ec-a16c-d502430f2e0e req-89fcda65-5e48-431a-a629-702f088be68e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:19.075706 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cd877ead-58c0-47ec-a16c-d502430f2e0e req-89fcda65-5e48-431a-a629-702f088be68e service nova] Creating event network-vif-plugged:5935a02d-18df-4c4f-9301-484bbfd49bab for instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba on nch1-master-1 Nov 06 20:47:19.087390 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cd877ead-58c0-47ec-a16c-d502430f2e0e req-89fcda65-5e48-431a-a629-702f088be68e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086409 Nov 06 20:47:19.091794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 144/306] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:19.103264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:19.106846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:19.137879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.142853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:19.143942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.144634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:19.272998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:19.285904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21102f41-19fe-4f16-bbc2-047d4be8e98f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1463 microversion: 2.1 time: 1.051967 Nov 06 20:47:19.286808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 163/307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:18 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1463 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:19.297777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Calling method '.version_select at 0x7f6715caca60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:19.758360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:19.770373 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b170313-3b00-462a-83a7-3a1f8587c553 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1387 microversion: 2.1 time: 0.673901 Nov 06 20:47:19.770942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 145/308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:19 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1387 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:19.783289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b512fc1-f1ad-4286-bafc-547b160fb9ae tempest-FlavorsAccessTestJSON-209388335 tempest-FlavorsAccessTestJSON-209388335-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:19.822156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b512fc1-f1ad-4286-bafc-547b160fb9ae tempest-FlavorsAccessTestJSON-209388335 tempest-FlavorsAccessTestJSON-209388335-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.046457 Nov 06 20:47:19.823245 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 146/309] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:47:19 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:19.839934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:19.841021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:19.856052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.857162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:19.858194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.860361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:19.993807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:19.996873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.000144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.000960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.023484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:20.037696 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36b53292-7b03-4d01-ad7a-78f5f771f3ff tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1226 microversion: 2.1 time: 0.213171 Nov 06 20:47:20.038275 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 147/310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:19 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1226 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:20.059907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5200dbea-0213-4a16-a206-5760ddb0916e tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db/detail" status: 200 len: 672 microversion: 2.36 time: 0.771496 Nov 06 20:47:20.061722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 164/311] 10.222.0.13 () {60 vars in 1303 bytes} [Sat Nov 6 20:47:19 2021] GET /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db/detail => generated 672 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:20.413876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Calling method '.version_select at 0x7f6715db0ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.452010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.452589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.503361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.510699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.539367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.542285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.543265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.544117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.544590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.551134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-efb60ac0-613c-4024-9195-1aed0dbc39c9 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/c4b8abb5c5234e3197eabc3f2ae9cffd?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318" status: 200 len: 694 microversion: 2.1 time: 0.494285 Nov 06 20:47:20.553495 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 148/312] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/os-simple-tenant-usage/c4b8abb5c5234e3197eabc3f2ae9cffd?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318 => generated 694 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:20.561404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1ab2e3a-a09b-4039-b36c-5fd8f51fd3cd tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.563462 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:20.563462 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:20.609337 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1ab2e3a-a09b-4039-b36c-5fd8f51fd3cd tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/161079321" status: 202 len: 0 microversion: 2.1 time: 0.051007 Nov 06 20:47:20.611394 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 149/313] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:47:20 2021] DELETE /compute/v2.1/flavors/161079321 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:20.622080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '.version_select at 0x7f6715b15ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.645892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.647046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.652775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70f37449-b331-471b-944b-fe75a147122d tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.589673 Nov 06 20:47:20.660553 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 165/314] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:20.668328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.679032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5458e374-ad7d-438f-b125-d782f3a08c86 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.682041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.711283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe9adffd-587e-46c3-8480-1cede59dee31 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/c4b8abb5c5234e3197eabc3f2ae9cffd?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318" status: 200 len: 690 microversion: 2.1 time: 0.097693 Nov 06 20:47:20.712796 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 150/315] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/os-simple-tenant-usage/c4b8abb5c5234e3197eabc3f2ae9cffd?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318 => generated 690 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:20.721922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.733795 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5458e374-ad7d-438f-b125-d782f3a08c86 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.070878 Nov 06 20:47:20.734969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 166/316] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:20.736807 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:20.736807 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:20.739319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.741923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.747113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.750300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.760224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Action: 'update', calling method: .version_select at 0x7f6715cacc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:20.774088 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:20.774088 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:20.827454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a3b5199-d89e-415b-b10d-93f4ddf45556 tempest-AZAdminV2TestJSON-424403244 tempest-AZAdminV2TestJSON-424403244-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.113171 Nov 06 20:47:20.829769 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 151/317] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:20.837544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Calling method '.version_select at 0x7f6715b15af0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:20.839283 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:20.839283 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:20.847143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.848589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.880790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.881272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.888625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.889170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.891438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:20.892077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:20.976851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5bf69ff1-4790-4ac5-a759-4e7a45441ea5 tempest-TenantUsagesTestJSON-1801137894 tempest-TenantUsagesTestJSON-1801137894-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318&detailed=1" status: 200 len: 2092 microversion: 2.1 time: 0.145213 Nov 06 20:47:20.989276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 152/318] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Nov 6 20:47:20 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-05T20%3A47%3A19.296318&end=2021-11-07T20%3A47%3A19.296318&detailed=1 => generated 2092 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:20.994976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1202c5ce-2e74-4a68-89b7-07b18715a4ca tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1291808601", "id": 1567072954, "os-flavor-access:is_public": "False"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:20.996874 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:20.996874 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:21.025055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.025531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.027513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.027958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.076118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1202c5ce-2e74-4a68-89b7-07b18715a4ca tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.083763 Nov 06 20:47:21.079165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 153/319] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:20 2021] POST /compute/v2.1/flavors => generated 431 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:21.092750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:21.094208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:21.114073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.115757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.118921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.120467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.179253 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fab54ea0-c8c5-4004-b409-76a96d3143eb tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db?user_id=49e4ddcc988648b7b0ae01de11bb6d72" status: 200 len: 240 microversion: 2.36 time: 0.442490 Nov 06 20:47:21.191895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 167/320] 10.222.0.13 () {62 vars in 1383 bytes} [Sat Nov 6 20:47:20 2021] PUT /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db?user_id=49e4ddcc988648b7b0ae01de11bb6d72 => generated 240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:21.199848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:21.200640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:21.210735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.211196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.211998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.212477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.273516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:47:21.533401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:21.548441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f811e249-e1a3-41c9-9a54-555f472ff488 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1585 microversion: 2.1 time: 0.466480 Nov 06 20:47:21.565846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 154/321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:21 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1585 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:21.581989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:21.584596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:21.604581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.605925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-241dc4f0-db79-409a-82c0-00c49626aec8 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 204 len: 0 microversion: 2.1 time: 0.410725 Nov 06 20:47:21.606493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.607264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 168/322] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:47:21 2021] DELETE /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:21.609039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:21.610507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:21.614399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7665a0d1-74c4-4e41-9e47-2ed2e75fdabf tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:21.615223 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:21.615223 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:21.661796 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7665a0d1-74c4-4e41-9e47-2ed2e75fdabf tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1567072954/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.043014 Nov 06 20:47:21.667958 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 169/323] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Nov 6 20:47:21 2021] GET /compute/v2.1/flavors/1567072954/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:21.682486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce073aad-9352-4e06-9edc-92cb2a87c0f2 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] Calling method '.version_select at 0x7f6715c02af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:21.756726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:21.764127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-556e6654-9468-4ba0-ac88-b7a3dfb95145 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1280 microversion: 2.1 time: 0.196921 Nov 06 20:47:21.766060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 155/324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:21 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:22.003904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8abdde12-7564-4991-9056-89758640069f tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Action: 'create', calling method: .version_select at 0x7f6715ad6af0>, body: {"pool": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:22.119215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce073aad-9352-4e06-9edc-92cb2a87c0f2 tempest-QuotasAdminTestV236-1395244879 tempest-QuotasAdminTestV236-1395244879-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db?user_id=49e4ddcc988648b7b0ae01de11bb6d72" status: 200 len: 282 microversion: 2.36 time: 0.449004 Nov 06 20:47:22.119822 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 170/325] 10.222.0.13 () {60 vars in 1363 bytes} [Sat Nov 6 20:47:21 2021] GET /compute/v2.1/os-quota-sets/1adcd855f45840c1b834c655c72820db?user_id=49e4ddcc988648b7b0ae01de11bb6d72 => generated 282 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:22.136058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:22.141554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:22.152133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:22.152713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:22.153916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:22.154873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:22.423862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-252da19d-0056-4722-8682-d9298b6a5621 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302721 Nov 06 20:47:22.426443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 171/326] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:47:22 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:22.445520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:22.450004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:22.469584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:22.471690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:22.474083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:22.476145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:23.383793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:23.392838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0cdd798d-9719-47b7-b801-9da4ccf6740f tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1469 microversion: 2.1 time: 0.965764 Nov 06 20:47:23.405103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 172/327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:22 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1469 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:23.410798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64e19b73-0a95-4f3c-9149-808311f88e05 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:23.411792 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:23.411792 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:23.447223 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64e19b73-0a95-4f3c-9149-808311f88e05 tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1567072954" status: 202 len: 0 microversion: 2.1 time: 0.040603 Nov 06 20:47:23.450932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 173/328] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:47:23 2021] DELETE /compute/v2.1/flavors/1567072954 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:23.712100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Calling method '.version_select at 0x7f6715b47790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:23.714077 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:23.714077 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:23.717875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:23.722240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:23.725768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:23.727616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:23.770046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b95c3d3-f828-4910-bfa6-1d1c1f5570bf tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.317392 Nov 06 20:47:23.780266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 174/329] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:47:23 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:23.787983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:23.788726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:23.796246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:23.796894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:23.797784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:23.798437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:24.662302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:24.696765 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf1eafca-1718-49d5-9895-fe23cbfbc1f9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 0.913073 Nov 06 20:47:24.698276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 175/330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:23 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:24.707669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09c18b88-8364-4da0-9321-53aa5c33f97f tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:24.742576 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09c18b88-8364-4da0-9321-53aa5c33f97f tempest-FlavorsAccessTestJSON-1363374731 tempest-FlavorsAccessTestJSON-1363374731-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.042507 Nov 06 20:47:24.743170 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 176/331] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:47:24 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:25.014186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fc6a67d-5bfc-4185-a2e8-f8c93d5e1e9e tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Calling method '.version_select at 0x7f6715ba99d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:25.015049 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:25.015049 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:25.016417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0fc6a67d-5bfc-4185-a2e8-f8c93d5e1e9e tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:25.017067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fc6a67d-5bfc-4185-a2e8-f8c93d5e1e9e tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:25.017875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0fc6a67d-5bfc-4185-a2e8-f8c93d5e1e9e tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.270528 Nov 06 20:47:25.021356 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 177/332] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:47:24 2021] GET /compute/v2.1/os-hosts => generated 109 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:25.033086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:25.033744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:25.046180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.046626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.047977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.048715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.547312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a745015150420da98bdc97abda23c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b8abb5c5234e3197eabc3f2ae9cffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:25.558053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e0d638c-47e2-4046-bf16-ad4cb6503add tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 200 len: 1427 microversion: 2.1 time: 0.533726 Nov 06 20:47:25.560174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 178/333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:25 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 1427 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:25.581876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:25.587402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:25.606326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.613426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.614559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.618727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.745114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7929176-c2cd-4f0c-8e42-c899167845f7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 14 microversion: 2.1 time: 0.169719 Nov 06 20:47:25.746999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 179/334] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:25 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:25.763077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7c50b99f-0662-45d4-baf2-9ddfeb386717 req-0289c964-3bc5-454e-b40f-a5e42eab5a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbc8ec1-8c19-4586-a720-c08f62c147ba", "tag": "5935a02d-18df-4c4f-9301-484bbfd49bab"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:25.764953 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:25.764953 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:25.793380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7c50b99f-0662-45d4-baf2-9ddfeb386717 req-0289c964-3bc5-454e-b40f-a5e42eab5a92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.800047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7c50b99f-0662-45d4-baf2-9ddfeb386717 req-0289c964-3bc5-454e-b40f-a5e42eab5a92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.831974 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7c50b99f-0662-45d4-baf2-9ddfeb386717 req-0289c964-3bc5-454e-b40f-a5e42eab5a92 service nova] Creating event network-changed:5935a02d-18df-4c4f-9301-484bbfd49bab for instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba on nch1-master-1 Nov 06 20:47:25.843267 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7c50b99f-0662-45d4-baf2-9ddfeb386717 req-0289c964-3bc5-454e-b40f-a5e42eab5a92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094326 Nov 06 20:47:25.849652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 180/335] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:25.855868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-383000de-2531-4130-84bf-226dfef5a9df tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Calling method '.version_select at 0x7f6715cac430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:25.856768 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:25.856768 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:25.857949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-383000de-2531-4130-84bf-226dfef5a9df tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:25.858590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-383000de-2531-4130-84bf-226dfef5a9df tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:25.859948 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-383000de-2531-4130-84bf-226dfef5a9df tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.008654 Nov 06 20:47:25.882315 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 181/336] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Nov 6 20:47:25 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:25.886610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-da1d5e8e-95ac-4185-a1d1-592cc2d95d48 req-a9339748-8fd0-43f1-b713-894d665c4cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e11138c-1070-426e-be89-3222cb59da6a", "name": "network-vif-deleted", "tag": "ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:25.888164 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:25.888164 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:25.924577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-da1d5e8e-95ac-4185-a1d1-592cc2d95d48 req-a9339748-8fd0-43f1-b713-894d665c4cec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.925030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-da1d5e8e-95ac-4185-a1d1-592cc2d95d48 req-a9339748-8fd0-43f1-b713-894d665c4cec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.947675 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-da1d5e8e-95ac-4185-a1d1-592cc2d95d48 req-a9339748-8fd0-43f1-b713-894d665c4cec service nova] Creating event network-vif-deleted:ac9d12a2-ae2d-43d7-9b74-b7dc01b352ac for instance 1e11138c-1070-426e-be89-3222cb59da6a on nch1-master-1 Nov 06 20:47:25.953773 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-da1d5e8e-95ac-4185-a1d1-592cc2d95d48 req-a9339748-8fd0-43f1-b713-894d665c4cec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070745 Nov 06 20:47:25.955286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 182/337] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:25.965409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:25.966977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:25.976796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.979154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:25.980841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:25.984733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:27.056446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:27.066119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7512422b-75ee-4c29-8f39-1beb34d22318 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 1.109097 Nov 06 20:47:27.066692 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 183/338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:25 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:27.072337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39d18525-8ea0-40a0-b221-d050e7c7a669 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Calling method '.version_select at 0x7f6715ab4c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.094093 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:27.094093 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:27.113407 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-39d18525-8ea0-40a0-b221-d050e7c7a669 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 06 20:47:27.114199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39d18525-8ea0-40a0-b221-d050e7c7a669 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.115035 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-39d18525-8ea0-40a0-b221-d050e7c7a669 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.046166 Nov 06 20:47:27.115950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 184/339] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:27.120520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.121125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] [instance: 1e11138c-1070-426e-be89-3222cb59da6a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:27.137055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:27.137501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:27.138532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:27.138997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:27.164208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] HTTP exception thrown: Instance 1e11138c-1070-426e-be89-3222cb59da6a could not be found. Nov 06 20:47:27.164827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] Returning 404 to user: Instance 1e11138c-1070-426e-be89-3222cb59da6a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.165917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c87194c-581c-4034-b3a6-8bb630832a15 tempest-TenantUsagesTestJSON-2047490786 tempest-TenantUsagesTestJSON-2047490786-project] 10.222.0.13 "GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a" status: 404 len: 111 microversion: 2.1 time: 0.048946 Nov 06 20:47:27.171549 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 185/340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/servers/1e11138c-1070-426e-be89-3222cb59da6a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:27.184585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.185670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:27.198178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:27.198890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:27.199837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:27.200444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:27.271705 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7c2a032-dcbd-452d-bcfe-500e5c1234c2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 14 microversion: 2.1 time: 0.098427 Nov 06 20:47:27.274909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 186/341] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:27 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:27.279188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d259f38b-456d-4c6d-940c-3894622e320b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Calling method '.version_select at 0x7f6716558e50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.280269 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:27.280269 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:27.281820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d259f38b-456d-4c6d-940c-3894622e320b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:27.282736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d259f38b-456d-4c6d-940c-3894622e320b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.283689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d259f38b-456d-4c6d-940c-3894622e320b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.009964 Nov 06 20:47:27.284548 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 187/342] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:27.296134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eccaeafa-6ed3-4c54-a3c6-ef0029fa5021 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Calling method '.version_select at 0x7f6715ad0af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.306551 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-eccaeafa-6ed3-4c54-a3c6-ef0029fa5021 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 06 20:47:27.307226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eccaeafa-6ed3-4c54-a3c6-ef0029fa5021 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.308875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eccaeafa-6ed3-4c54-a3c6-ef0029fa5021 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018639 Nov 06 20:47:27.317769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 188/343] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:47:27.326235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acff920e-f722-48ff-a46b-9c757edb8f18 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Calling method '.version_select at 0x7f6715adbee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.328857 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:shutdown failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:27.328857 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:27.330844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-acff920e-f722-48ff-a46b-9c757edb8f18 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:27.332367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acff920e-f722-48ff-a46b-9c757edb8f18 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.334633 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acff920e-f722-48ff-a46b-9c757edb8f18 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015413 Nov 06 20:47:27.335594 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 189/344] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:27.348996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60a79502-6c35-463b-b808-7d73df9c4577 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Calling method '.version_select at 0x7f6715cac430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.360999 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-60a79502-6c35-463b-b808-7d73df9c4577 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 06 20:47:27.361667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60a79502-6c35-463b-b808-7d73df9c4577 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.362709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60a79502-6c35-463b-b808-7d73df9c4577 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019905 Nov 06 20:47:27.363505 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 190/345] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:27.375685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02e154de-9e58-4e76-96dc-2c3503484196 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Calling method '.version_select at 0x7f6715adba60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.376906 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:start failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:27.376906 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:27.378094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02e154de-9e58-4e76-96dc-2c3503484196 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:27.379474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02e154de-9e58-4e76-96dc-2c3503484196 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.380924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02e154de-9e58-4e76-96dc-2c3503484196 tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010995 Nov 06 20:47:27.381751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 191/346] 10.222.0.13 () {58 vars in 1193 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:27.402648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-967b2d32-2f12-4452-8d9d-a48a9456553a tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Calling method '.version_select at 0x7f6715ad0b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:27.417431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-967b2d32-2f12-4452-8d9d-a48a9456553a tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 06 20:47:27.418794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-967b2d32-2f12-4452-8d9d-a48a9456553a tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.420039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-967b2d32-2f12-4452-8d9d-a48a9456553a tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.031814 Nov 06 20:47:27.425908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 192/347] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:27.432818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37443bb4-fef1-4b52-a6dc-2550e06f9b9b tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Action: 'update', calling method: .version_select at 0x7f6715ad00d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.434580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37443bb4-fef1-4b52-a6dc-2550e06f9b9b tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.435653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37443bb4-fef1-4b52-a6dc-2550e06f9b9b tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.007859 Nov 06 20:47:27.442566 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 193/348] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Nov 6 20:47:27 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:27.449422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c813d156-a0b9-4eea-89b1-9ed1282c4069 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Action: 'update', calling method: .version_select at 0x7f6715c02280>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.451162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c813d156-a0b9-4eea-89b1-9ed1282c4069 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.452539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c813d156-a0b9-4eea-89b1-9ed1282c4069 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.008760 Nov 06 20:47:27.458991 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 194/349] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Nov 6 20:47:27 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:27.465787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0d7471f-be15-40d5-8c6c-cd1b23b6226b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Action: 'update', calling method: .version_select at 0x7f6715adb310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.467554 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:27.467554 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:27.470215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0d7471f-be15-40d5-8c6c-cd1b23b6226b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '092b777b82cb466094e57fc2b8d84cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb39045cce52449c88dbeb59fc35ce63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:27.471449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0d7471f-be15-40d5-8c6c-cd1b23b6226b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.475167 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0d7471f-be15-40d5-8c6c-cd1b23b6226b tempest-HostsAdminNegativeTestJSON-1805434100 tempest-HostsAdminNegativeTestJSON-1805434100-project] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.013909 Nov 06 20:47:27.476286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 195/350] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Nov 6 20:47:27 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:27.490863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15800e4c-11b4-4771-a53f-b75c3ff8a365 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Action: 'update', calling method: .version_select at 0x7f6715c8dee0>, body: {"status": null, "maintenance_mode": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.492626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15800e4c-11b4-4771-a53f-b75c3ff8a365 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.493940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15800e4c-11b4-4771-a53f-b75c3ff8a365 tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010067 Nov 06 20:47:27.494709 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 196/351] 10.222.0.13 () {60 vars in 1189 bytes} [Sat Nov 6 20:47:27 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:27.513149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f8387cf-7552-43e7-804c-25af3db95e4f tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Action: 'update', calling method: .version_select at 0x7f6715aa3430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:27.518430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.hosts [None req-0f8387cf-7552-43e7-804c-25af3db95e4f tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Enabling host nonexistent_hostname. Nov 06 20:47:27.533777 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0f8387cf-7552-43e7-804c-25af3db95e4f tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 06 20:47:27.536319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f8387cf-7552-43e7-804c-25af3db95e4f tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:27.537772 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f8387cf-7552-43e7-804c-25af3db95e4f tempest-HostsAdminNegativeTestJSON-645559135 tempest-HostsAdminNegativeTestJSON-645559135-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035218 Nov 06 20:47:27.538949 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 197/352] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:47:27 2021] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:47:27.659616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8abdde12-7564-4991-9056-89758640069f tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.891588 Nov 06 20:47:27.660685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 156/353] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:47:21 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:27.672114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b88e9af-18a9-4b84-90db-5cd950f516bc tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715adb0d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:28.051000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3692189f-2291-44b8-b373-cb0dd745239b req-719cba1b-c5b1-46ca-adb6-bf924f034b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "189c6532-c954-47ae-8295-c24d79449f70", "tag": "5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:28.053540 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:28.053540 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:28.077432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3692189f-2291-44b8-b373-cb0dd745239b req-719cba1b-c5b1-46ca-adb6-bf924f034b45 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:28.078817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3692189f-2291-44b8-b373-cb0dd745239b req-719cba1b-c5b1-46ca-adb6-bf924f034b45 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:28.091922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3692189f-2291-44b8-b373-cb0dd745239b req-719cba1b-c5b1-46ca-adb6-bf924f034b45 service nova] Creating event network-changed:5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71 for instance 189c6532-c954-47ae-8295-c24d79449f70 on nch2-master-1 Nov 06 20:47:28.096712 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b88e9af-18a9-4b84-90db-5cd950f516bc tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/219ab94e-5700-4d85-afb5-7aa7d95a192f" status: 200 len: 142 microversion: 2.1 time: 0.429114 Nov 06 20:47:28.100661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3692189f-2291-44b8-b373-cb0dd745239b req-719cba1b-c5b1-46ca-adb6-bf924f034b45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055400 Nov 06 20:47:28.101529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 157/354] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:28.106406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 198/355] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:27 2021] GET /compute/v2.1/os-floating-ips/219ab94e-5700-4d85-afb5-7aa7d95a192f => generated 142 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:28.108024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:28.108773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:28.116080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:28.116916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:28.118048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:28.118652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:28.131188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e65887f-00ac-478c-be83-b03efb4498a1 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715b47dc0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:28.885693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e65887f-00ac-478c-be83-b03efb4498a1 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.766843 Nov 06 20:47:28.886574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 199/356] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:47:28 2021] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:28.891468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:28.892618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:28.899589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:28.900036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:28.901105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:28.901694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:28.968275 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d11a11a-1352-4356-a20e-e3300afe4556 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 14 microversion: 2.1 time: 0.080428 Nov 06 20:47:28.970786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 200/357] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:28 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:28.977041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e170830-c148-4fde-b742-2a98743e849c tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715b47a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:28.998867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:29.007639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c4bb589-9b61-448f-b1ce-ed759f28c18c tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 0.904785 Nov 06 20:47:29.009108 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 158/358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:28 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:29.501979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-423942269", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:29.596194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:47:29.924678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:47:29.925099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:47:29.925564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:47:29.925965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:47:29.926372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:47:29.940020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:29.942364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:29.944615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:29.945241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:29.996981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Getting quotas for project d5634bafe48248a4af8fa00164acddd4. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:30.007389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Getting quotas for user 1f4c02e3d7ce4ef883dd4774ef64fcdb and project d5634bafe48248a4af8fa00164acddd4. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:30.028838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:47:30.031966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:47:30.113661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fbbda571-37b5-4bfe-839b-d33cf8e5ac2e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103238 Nov 06 20:47:30.114523 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 159/359] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:47:30.134770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:30.142386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:30.160127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:30.160625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:30.162119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:30.162721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:30.267104 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93b464fb-b802-4daf-b370-0fa312bdce9d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 14 microversion: 2.1 time: 0.151180 Nov 06 20:47:30.270345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 160/360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:30 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:30.275998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:30.277013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:30.285983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:30.286814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:30.288036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:30.288859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:30.438835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e170830-c148-4fde-b742-2a98743e849c tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/219ab94e-5700-4d85-afb5-7aa7d95a192f" status: 202 len: 0 microversion: 2.1 time: 1.466687 Nov 06 20:47:30.439968 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 201/361] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:47:28 2021] DELETE /compute/v2.1/os-floating-ips/219ab94e-5700-4d85-afb5-7aa7d95a192f => generated 0 bytes in 1469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:30.445223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95b35967-5510-4452-8147-79b119186c90 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:30.446160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-95b35967-5510-4452-8147-79b119186c90 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:30.548075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-95b35967-5510-4452-8147-79b119186c90 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:30.556133 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95b35967-5510-4452-8147-79b119186c90 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1219 microversion: 2.1 time: 0.114864 Nov 06 20:47:30.559646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 202/362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:30 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:30.572422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9542a2e-8efb-464b-8035-021af8a95736 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Action: 'create', calling method: .version_select at 0x7f6715ada790>, body: {"pool": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:30.663310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:30.678574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c85aad8-c116-48fc-bf80-46214ce608e5 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 0.406628 Nov 06 20:47:30.688892 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 161/363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:30 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:31.718192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce885f38-380b-4ef2-930e-61904a127b18 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] Action: 'create', calling method: .version_select at 0x7f6715a09160>, body: {"security_group": {"name": "tempest-securitygroup-1162439016", "description": "tempest-description-2144584237"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:32.316835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9542a2e-8efb-464b-8035-021af8a95736 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.755567 Nov 06 20:47:32.326479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 203/364] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:47:30 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:32.332789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:32.334271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:32.345785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.346722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.348319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.348776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.404858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2caaf475-a0f9-4281-89ac-12ec9e5c6522 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 14 microversion: 2.1 time: 0.076418 Nov 06 20:47:32.406529 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 204/365] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:32 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:32.413807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:32.415578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:32.428022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.428656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.429456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.430008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.461592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce885f38-380b-4ef2-930e-61904a127b18 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.222197 Nov 06 20:47:32.469480 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 162/366] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:47:31 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:32.539449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:32.547830 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1c38ec2-9425-4f76-969e-3afee8ebe1b0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1277 microversion: 2.1 time: 0.139417 Nov 06 20:47:32.548996 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 205/367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:32 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:32.553960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:32.554733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:32.562188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.563009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.564157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:32.564766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:32.690616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9263d10c-834c-43a0-9faf-461c95e90874 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-489629657", "ram": 512, "vcpus": 1, "disk": 10, "id": 640255185, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:32.692442 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:32.692442 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:32.710039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9263d10c-834c-43a0-9faf-461c95e90874 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.238273 Nov 06 20:47:32.711128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 163/368] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:32 2021] POST /compute/v2.1/flavors => generated 412 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:32.722720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7eef78ee-af21-4e1e-8b53-abb47c82fd14 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715adbee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:33.159264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:33.173997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a521d32-7b8d-4246-8fe6-2983a57260e9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 0.623732 Nov 06 20:47:33.175085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 206/369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:32 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:33.180038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fcd8e20-9ba6-41be-bafb-5259a4b39c0c tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] Action: 'create', calling method: .version_select at 0x7f6716558820>, body: {"security_group": {"name": "tempest-securitygroup-718995772", "description": "tempest-description-25675093"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:33.663478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fcd8e20-9ba6-41be-bafb-5259a4b39c0c tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.486979 Nov 06 20:47:33.664078 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 207/370] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:47:33 2021] POST /compute/v2.1/os-security-groups => generated 218 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:33.892004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66de0688-a758-4b1a-a86b-33d0892c33ce tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:33.901528 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-66de0688-a758-4b1a-a86b-33d0892c33ce tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] HTTP exception thrown: Flavor 640255185 has no extra specs with key hw:cpu_thread_policy. Nov 06 20:47:33.902104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66de0688-a758-4b1a-a86b-33d0892c33ce tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Returning 404 to user: Flavor 640255185 has no extra specs with key hw:cpu_thread_policy. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:33.902914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66de0688-a758-4b1a-a86b-33d0892c33ce tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] 10.222.0.13 "GET /compute/v2.1/flavors/640255185/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.237927 Nov 06 20:47:33.903460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 208/371] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:47:33 2021] GET /compute/v2.1/flavors/640255185/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:33.967334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-386dea1b-47a3-4618-b125-ee1f75f2ede0 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:33.968083 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:33.968083 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:33.971415 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-386dea1b-47a3-4618-b125-ee1f75f2ede0 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 06 20:47:33.972031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-386dea1b-47a3-4618-b125-ee1f75f2ede0 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:33.972809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-386dea1b-47a3-4618-b125-ee1f75f2ede0 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818 tempest-InstanceUsageAuditLogNegativeTestJSON-1014123818-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.068464 Nov 06 20:47:33.973521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 209/372] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Nov 6 20:47:33 2021] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:47:33.977561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7676f50a-8d9b-448e-811f-9115d4660585 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715ab4040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:34.019835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7676f50a-8d9b-448e-811f-9115d4660585 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a" status: 200 len: 637 microversion: 2.1 time: 0.045525 Nov 06 20:47:34.020409 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 210/373] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:47:33 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a => generated 637 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:34.025531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8b94c5b8-0edd-453b-bd6d-211953399b31 req-47c51771-67fd-4b4f-94b1-23e666a44bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189c6532-c954-47ae-8295-c24d79449f70", "name": "network-vif-plugged", "status": "completed", "tag": "5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:34.027739 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:34.027739 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:34.035288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b94c5b8-0edd-453b-bd6d-211953399b31 req-47c51771-67fd-4b4f-94b1-23e666a44bad service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:34.035733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b94c5b8-0edd-453b-bd6d-211953399b31 req-47c51771-67fd-4b4f-94b1-23e666a44bad service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:34.046425 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8b94c5b8-0edd-453b-bd6d-211953399b31 req-47c51771-67fd-4b4f-94b1-23e666a44bad service nova] Creating event network-vif-plugged:5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71 for instance 189c6532-c954-47ae-8295-c24d79449f70 on nch2-master-1 Nov 06 20:47:34.053917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8b94c5b8-0edd-453b-bd6d-211953399b31 req-47c51771-67fd-4b4f-94b1-23e666a44bad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Nov 06 20:47:34.054727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 211/374] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:34.062830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:34.063836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:34.069990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:34.070440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:34.071223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:34.071835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:34.125893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a52afed-4776-474c-8bef-d32ebae2e6a2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 8206 microversion: 2.1 time: 0.067212 Nov 06 20:47:34.126555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 212/375] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:34 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 8206 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:34.134495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:34.135317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:34.142805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:34.143459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:34.144242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:34.144997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:34.357243 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7eef78ee-af21-4e1e-8b53-abb47c82fd14 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46" status: 202 len: 0 microversion: 2.1 time: 1.644904 Nov 06 20:47:34.357894 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 164/376] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:47:32 2021] DELETE /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46 => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:34.463294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4994d10-759f-40da-a794-916ff07d239e tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] Action: 'create', calling method: .version_select at 0x7f6715a7d790>, body: {"security_group": {"name": "tempest-securitygroup-230440152", "description": "tempest-description-1652642341"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:34.471035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:34.479399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08575bbe-e9c1-463f-ac99-83b5b7078e7d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.348682 Nov 06 20:47:34.479960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 213/377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:34 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:34.488900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6eaf21c1-416f-4866-be4c-8e04ce6ed11a tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:34.488900 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:34.488900 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:34.488900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6eaf21c1-416f-4866-be4c-8e04ce6ed11a tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c9cd83b3cd9d44ef827d868d235a9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8b36dd869e4678bcedaad6604f402c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:34.489247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6eaf21c1-416f-4866-be4c-8e04ce6ed11a tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:34.489247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6eaf21c1-416f-4866-be4c-8e04ce6ed11a tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] 10.222.0.13 "POST /compute/v2.1/flavors/640255185/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.007712 Nov 06 20:47:34.489247 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 214/378] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:47:34 2021] POST /compute/v2.1/flavors/640255185/os-extra_specs => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:34.615312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f664439c-03d8-45c0-bbdc-076117f0b443 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:34.616064 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:34.616064 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:34.617660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f664439c-03d8-45c0-bbdc-076117f0b443 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cbee26fd49eb48649ff69b18ec0e629e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8098feecee49b3adea30256797749d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:34.618295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f664439c-03d8-45c0-bbdc-076117f0b443 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:34.619100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f664439c-03d8-45c0-bbdc-076117f0b443 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.129178 Nov 06 20:47:34.619604 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 215/379] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 20:47:34 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 130 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:34.627402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41fed9e6-131c-45fb-8fd2-86cab2d500fe tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715ab43a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:34.679945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-41fed9e6-131c-45fb-8fd2-86cab2d500fe tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:34.684614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-41fed9e6-131c-45fb-8fd2-86cab2d500fe tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:35.010866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4994d10-759f-40da-a794-916ff07d239e tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.651685 Nov 06 20:47:35.011525 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 165/380] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:47:34 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:35.023908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.024683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:35.032602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.033078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.034016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.034536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.052275 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41fed9e6-131c-45fb-8fd2-86cab2d500fe tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.428935 Nov 06 20:47:35.052894 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 216/381] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:34 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:35.057532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd155b1e-c1fb-48c9-ac5e-0229baf5a747 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715a2a4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.167678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-dd155b1e-c1fb-48c9-ac5e-0229baf5a747 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 86377075-a9fd-48b9-b721-4206c7763a46 could not be found", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:47:35.168407 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-dd155b1e-c1fb-48c9-ac5e-0229baf5a747 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] HTTP exception thrown: Floating IP not found for ID 86377075-a9fd-48b9-b721-4206c7763a46 Nov 06 20:47:35.168997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd155b1e-c1fb-48c9-ac5e-0229baf5a747 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Returning 404 to user: Floating IP not found for ID 86377075-a9fd-48b9-b721-4206c7763a46 {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:35.169880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd155b1e-c1fb-48c9-ac5e-0229baf5a747 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46" status: 404 len: 111 microversion: 2.1 time: 0.115899 Nov 06 20:47:35.170444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 217/382] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:35 2021] GET /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:35.179547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3ce0e9b-8e1a-459c-a130-0cda25c383ed tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:35.209066 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3ce0e9b-8e1a-459c-a130-0cda25c383ed tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/640255185/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037176 Nov 06 20:47:35.210971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 218/383] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:47:35 2021] POST /compute/v2.1/flavors/640255185/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:35.214891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ea0fd36b-87d5-4704-8269-2cd5e757ced7 req-9dd4dca0-df59-4208-b96e-b4d59a039960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114dde74-d608-4edc-b28c-b83571a79bfe", "tag": "3acd6bd9-b880-40d3-9112-f7b5871fef1e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:35.216551 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:35.216551 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:35.225030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea0fd36b-87d5-4704-8269-2cd5e757ced7 req-9dd4dca0-df59-4208-b96e-b4d59a039960 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.225693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea0fd36b-87d5-4704-8269-2cd5e757ced7 req-9dd4dca0-df59-4208-b96e-b4d59a039960 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.236367 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ea0fd36b-87d5-4704-8269-2cd5e757ced7 req-9dd4dca0-df59-4208-b96e-b4d59a039960 service nova] Creating event network-changed:3acd6bd9-b880-40d3-9112-f7b5871fef1e for instance 114dde74-d608-4edc-b28c-b83571a79bfe on nch2-master-1 Nov 06 20:47:35.241515 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ea0fd36b-87d5-4704-8269-2cd5e757ced7 req-9dd4dca0-df59-4208-b96e-b4d59a039960 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030301 Nov 06 20:47:35.242171 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 219/384] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:35.247294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aed6e675-7c2f-4e2c-9c92-f7042f00539c tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.248100 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:35.248100 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:35.250011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aed6e675-7c2f-4e2c-9c92-f7042f00539c tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cbee26fd49eb48649ff69b18ec0e629e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8098feecee49b3adea30256797749d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:35.250679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aed6e675-7c2f-4e2c-9c92-f7042f00539c tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:35.251508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aed6e675-7c2f-4e2c-9c92-f7042f00539c tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687 tempest-InstanceUsageAuditLogNegativeTestJSON-1241614687-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-06 20:47:34" status: 403 len: 128 microversion: 2.1 time: 0.008166 Nov 06 20:47:35.252213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 220/385] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:47:35 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-06%2020%3A47%3A34 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:35.256715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1aa97467-eec0-4c65-9c7b-77f854961b9f tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] Action: 'create', calling method: .version_select at 0x7f6715adb4c0>, body: {"security_group": {"name": "tempest-securitygroup-1739485203", "description": "tempest-description-1395442373"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:35.295909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:35.308314 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14600e5e-6788-475f-8fc8-b6db635568e6 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1322 microversion: 2.1 time: 0.288025 Nov 06 20:47:35.319431 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 166/386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:35 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:35.321196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9fd37b0-8de0-49bf-bc09-de05f7a8e770 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715e88940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.510618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1aa97467-eec0-4c65-9c7b-77f854961b9f tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.257155 Nov 06 20:47:35.511339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 221/387] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:47:35 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:35.522078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:35.524596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:35.548126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.548930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.550047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.550680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.602818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-209e4b30-2a01-4ccc-8815-d8820e11e124 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 16400 microversion: 2.1 time: 0.089897 Nov 06 20:47:35.603816 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 222/388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:35 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 16400 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:35.610535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5bc6b34-d8f5-47a8-992b-71286f586049 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Calling method '.version_select at 0x7f6715ab4940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.673063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-c5bc6b34-d8f5-47a8-992b-71286f586049 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 86377075-a9fd-48b9-b721-4206c7763a46 could not be found", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:47:35.673948 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c5bc6b34-d8f5-47a8-992b-71286f586049 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] HTTP exception thrown: Floating IP not found for ID 86377075-a9fd-48b9-b721-4206c7763a46 Nov 06 20:47:35.674728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5bc6b34-d8f5-47a8-992b-71286f586049 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] Returning 404 to user: Floating IP not found for ID 86377075-a9fd-48b9-b721-4206c7763a46 {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:35.675712 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5bc6b34-d8f5-47a8-992b-71286f586049 tempest-FloatingIPsTestJSON-232864468 tempest-FloatingIPsTestJSON-232864468-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46" status: 404 len: 111 microversion: 2.1 time: 0.070492 Nov 06 20:47:35.676837 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 223/389] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:47:35 2021] DELETE /compute/v2.1/os-floating-ips/86377075-a9fd-48b9-b721-4206c7763a46 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:35.686075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-414ef784-64dc-4c9a-a032-211321bc98bc tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.688473 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:35.688473 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:35.690031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-414ef784-64dc-4c9a-a032-211321bc98bc tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c9cd83b3cd9d44ef827d868d235a9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8b36dd869e4678bcedaad6604f402c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:35.690669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-414ef784-64dc-4c9a-a032-211321bc98bc tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:35.691669 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-414ef784-64dc-4c9a-a032-211321bc98bc tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] 10.222.0.13 "DELETE /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012583 Nov 06 20:47:35.693121 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 224/390] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:47:35 2021] DELETE /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:35.698331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:35.699438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:35.706356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.707059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.708062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:35.708825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:35.766988 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9fd37b0-8de0-49bf-bc09-de05f7a8e770 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "DELETE /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.456809 Nov 06 20:47:35.768178 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 167/391] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Nov 6 20:47:35 2021] DELETE /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_version => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:35.774013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b6af46a-54bf-43b8-bab5-87d14a50f9db tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] Calling method '.version_select at 0x7f6715a09280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:36.031323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:36.039698 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-498257f6-0dde-4790-8aeb-ed92dba19c29 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.345376 Nov 06 20:47:36.050894 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 225/392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:35 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:36.059261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2147e961-840b-404b-a177-372f9be46ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.061255 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:36.061255 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:36.084653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2147e961-840b-404b-a177-372f9be46ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/640255185/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041992 Nov 06 20:47:36.085505 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 226/393] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:47:36 2021] POST /compute/v2.1/flavors/640255185/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:36.090133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-863772e3-685f-4cba-b8eb-fb407db7e44b tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715c02430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:36.136074 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-863772e3-685f-4cba-b8eb-fb407db7e44b tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.049507 Nov 06 20:47:36.137037 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 227/394] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:36 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 37 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:36.141827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2526d7c-2342-4df0-b40a-19f8f3007695 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.143554 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:36.143554 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:36.144148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d2526d7c-2342-4df0-b40a-19f8f3007695 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c9cd83b3cd9d44ef827d868d235a9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8b36dd869e4678bcedaad6604f402c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:36.144895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2526d7c-2342-4df0-b40a-19f8f3007695 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:36.145767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2526d7c-2342-4df0-b40a-19f8f3007695 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450 tempest-FlavorsExtraSpecsNegativeTestJSON-2067113450-project] 10.222.0.13 "PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007790 Nov 06 20:47:36.146657 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 228/395] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:47:36 2021] PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:36.152846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53b6df6c-dfca-4d75-a651-c513067a3ed1 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715a2a670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.210846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-53b6df6c-dfca-4d75-a651-c513067a3ed1 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:36.214996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-53b6df6c-dfca-4d75-a651-c513067a3ed1 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:36.591940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53b6df6c-dfca-4d75-a651-c513067a3ed1 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.444155 Nov 06 20:47:36.592826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 229/396] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:36 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:36.598708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbda763d-63c8-45f7-834d-9a41a33e6fef tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:36.600528 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:36.600528 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:36.609217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-fbda763d-63c8-45f7-834d-9a41a33e6fef tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] HTTP exception thrown: Flavor 640255185 has no extra specs with key hw:cpu_thread_policy. Nov 06 20:47:36.610149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbda763d-63c8-45f7-834d-9a41a33e6fef tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Returning 404 to user: Flavor 640255185 has no extra specs with key hw:cpu_thread_policy. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:36.611260 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbda763d-63c8-45f7-834d-9a41a33e6fef tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/640255185/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.016177 Nov 06 20:47:36.612423 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 230/397] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 20:47:36 2021] DELETE /compute/v2.1/flavors/640255185/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:36.620657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:36.621356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:36.627435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.628135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:36.629094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.629681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:36.800847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:36.809273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-981f3d6d-2bdd-4a63-bf60-5318011d0e67 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1472 microversion: 2.1 time: 0.195271 Nov 06 20:47:36.813233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 231/398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:36 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:36.825260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-786e3789-47e3-430a-8d4a-7e22f9de8322 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715adae50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:36.876012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-786e3789-47e3-430a-8d4a-7e22f9de8322 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.055230 Nov 06 20:47:36.877010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 232/399] 10.222.0.13 () {58 vars in 1289 bytes} [Sat Nov 6 20:47:36 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_distro => generated 33 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:36.884243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.885306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:36.894288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.895082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:36.896239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.896707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:36.937910 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4feb4a38-a00c-45b6-ada9-4762a0b8fcc5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 16400 microversion: 2.1 time: 0.058803 Nov 06 20:47:36.939691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 233/400] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:36 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 16400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:36.945079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-547e1b85-c6af-42c5-940b-389dfd1957ba tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.946398 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:36.946398 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:36.947528 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-547e1b85-c6af-42c5-940b-389dfd1957ba tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 06 20:47:36.948075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-547e1b85-c6af-42c5-940b-389dfd1957ba tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:36.949356 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-547e1b85-c6af-42c5-940b-389dfd1957ba tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.008695 Nov 06 20:47:36.949765 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 234/401] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:47:36 2021] PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes => generated 73 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:47:36.958723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:36.959368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:36.967220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.967672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:36.968569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:36.969054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:37.030632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lazy-loading 'flavor' on Instance uuid 189c6532-c954-47ae-8295-c24d79449f70 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:47:37.153843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8fb47ae4-503f-41a3-99e1-7dca56e016cd tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70/action" status: 202 len: 0 microversion: 2.1 time: 0.202601 Nov 06 20:47:37.154411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 235/402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:36 2021] POST /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:37.175429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d4500f2-7c57-41df-af2c-f3f0e2a29d3e tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715a31670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:37.242139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2d4500f2-7c57-41df-af2c-f3f0e2a29d3e tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:37.246542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2d4500f2-7c57-41df-af2c-f3f0e2a29d3e tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:37.568148 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d4500f2-7c57-41df-af2c-f3f0e2a29d3e tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.412433 Nov 06 20:47:37.568915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 236/403] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:37 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:37.573366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d9ad256-b344-43e0-b9b8-1e94c69c214f tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:37.574532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d9ad256-b344-43e0-b9b8-1e94c69c214f tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:37.575336 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d9ad256-b344-43e0-b9b8-1e94c69c214f tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.005649 Nov 06 20:47:37.575866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 237/404] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:47:37 2021] PUT /compute/v2.1/flavors/640255185/os-extra_specs/hw:numa_nodes => generated 117 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:37.588126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:37.589521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:37.601061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b6af46a-54bf-43b8-bab5-87d14a50f9db tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8311 microversion: 2.1 time: 1.831573 Nov 06 20:47:37.601730 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 168/405] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Nov 6 20:47:35 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8311 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:37.606749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:37.607630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:37.611839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:37.612307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:37.613316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:37.614069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:37.619271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:37.619959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:37.621281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:37.622034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:37.833721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:37.841952 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecf9d6ca-df9c-4ea0-a4dd-eb4d08e9ae42 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.260560 Nov 06 20:47:37.848917 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 238/406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:37 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:37.848917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0b6dcb2-9098-4777-989a-60d74fc4074b tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715ada040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:37.899366 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0b6dcb2-9098-4777-989a-60d74fc4074b tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.054615 Nov 06 20:47:37.904478 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 239/407] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:37 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:37.909091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bca7faa-22d4-4ce6-b8eb-1af70416b94b tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:37.910000 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:37.910000 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:37.934511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4bca7faa-22d4-4ce6-b8eb-1af70416b94b tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/640255185" status: 202 len: 0 microversion: 2.1 time: 0.032773 Nov 06 20:47:37.939234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 240/408] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:47:37 2021] DELETE /compute/v2.1/flavors/640255185 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:37.946014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9eff069-f0f5-4e1c-8599-48ef26d36b4d tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] Calling method '.version_select at 0x7f6715b47f70>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:38.014596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9de67b1-9407-488b-9b2d-75c32a1737cf tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1631 microversion: 2.1 time: 0.411586 Nov 06 20:47:38.021269 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 169/409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:37 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1631 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:38.032118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b9653199-0128-403a-a930-023e11f5fd07 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715a093a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:38.123532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b9653199-0128-403a-a930-023e11f5fd07 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:38.128099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b9653199-0128-403a-a930-023e11f5fd07 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:38.333050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9eff069-f0f5-4e1c-8599-48ef26d36b4d tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.392696 Nov 06 20:47:38.333986 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 241/410] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Nov 6 20:47:37 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:38.344326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ddb48c90-3ad4-4199-8a0c-21c8b006d1eb tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:38.373660 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ddb48c90-3ad4-4199-8a0c-21c8b006d1eb tempest-FlavorsExtraSpecsNegativeTestJSON-435535151 tempest-FlavorsExtraSpecsNegativeTestJSON-435535151-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.038207 Nov 06 20:47:38.376811 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 242/411] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:47:38 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:38.392365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:38.393209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:38.409630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:38.410138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:38.410875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:38.411310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:38.458367 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16e1aaea-32d7-4f86-b399-d2503d3dc650 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 16400 microversion: 2.1 time: 0.079392 Nov 06 20:47:38.464045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 243/412] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:38 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 16400 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:38.466333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b9653199-0128-403a-a930-023e11f5fd07 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.443128 Nov 06 20:47:38.466924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 170/413] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:38 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:38.471415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d65987b1-f2dd-4f35-bc54-3efaf6e68a60 tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] Calling method '.version_select at 0x7f6715aa3280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:38.475647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9436e4b2-62dc-4741-bf17-0c604a71a76a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715a063a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:38.539306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9436e4b2-62dc-4741-bf17-0c604a71a76a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:38.544734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9436e4b2-62dc-4741-bf17-0c604a71a76a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:38.724547 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d65987b1-f2dd-4f35-bc54-3efaf6e68a60 tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/8973f841-07d0-4a2f-b2e6-7842d07193d3" status: 202 len: 0 microversion: 2.1 time: 0.258736 Nov 06 20:47:38.725520 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 244/414] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:47:38 2021] DELETE /compute/v2.1/os-security-groups/8973f841-07d0-4a2f-b2e6-7842d07193d3 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:38.734262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1256073a-9b1c-4457-bf49-3c11592996ad tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] Calling method '.version_select at 0x7f671596d5e0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:39.054299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1256073a-9b1c-4457-bf49-3c11592996ad tempest-SecurityGroupsTestAdminJSON-280716016 tempest-SecurityGroupsTestAdminJSON-280716016-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f2337b85-8662-47f9-ada5-084e1616c3fc" status: 202 len: 0 microversion: 2.1 time: 0.319431 Nov 06 20:47:39.055523 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 245/415] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:47:38 2021] DELETE /compute/v2.1/os-security-groups/f2337b85-8662-47f9-ada5-084e1616c3fc => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:39.061860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:39.062701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:39.092250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:39.092822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:39.097399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:39.098058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:39.256443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9436e4b2-62dc-4741-bf17-0c604a71a76a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.784382 Nov 06 20:47:39.261119 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 171/416] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:38 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 64 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:39.267804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:39.268678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:39.284901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:39.288926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:39.289926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:39.290863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:39.826174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:39.833509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0a732b2-48f8-41fd-bee5-fd3959f79920 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.776572 Nov 06 20:47:39.834074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 246/417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:39 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:39.849501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e41b084b-b5bc-44b9-a3b3-a652ffccb432 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] Calling method '.version_select at 0x7f6715977310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:39.943546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76a9389d-0179-4e94-a38c-0c8839d6ac84 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1614 microversion: 2.1 time: 0.681228 Nov 06 20:47:39.944112 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 172/418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:39 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1614 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:39.957122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e5d9974-047c-4cde-b972-a697314dae45 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715a683a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:40.013765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e5d9974-047c-4cde-b972-a697314dae45 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.060215 Nov 06 20:47:40.014323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 173/419] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:39 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 64 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:40.024315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.029798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:40.039358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.044985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:40.046019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.047271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:40.133790 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4b58bcb-9c7b-45da-940b-773abe657af5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.112911 Nov 06 20:47:40.136488 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 174/420] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:40 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:40.232903 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e41b084b-b5bc-44b9-a3b3-a652ffccb432 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a3f699a4-2040-41c6-885c-94ebc528b158" status: 202 len: 0 microversion: 2.1 time: 0.397681 Nov 06 20:47:40.233486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 247/421] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:47:39 2021] DELETE /compute/v2.1/os-security-groups/a3f699a4-2040-41c6-885c-94ebc528b158 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:40.240371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.241142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:40.271627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.272080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:40.272981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.273413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:40.357349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39154795-c668-4c92-88de-301ba4d776ad tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f6715a09dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:40.462469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] HTTP exception thrown: Cannot 'migrate' instance 189c6532-c954-47ae-8295-c24d79449f70 while it is in vm_state suspended Nov 06 20:47:40.463274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Returning 409 to user: Cannot 'migrate' instance 189c6532-c954-47ae-8295-c24d79449f70 while it is in vm_state suspended {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:40.464274 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60d69eae-7244-4411-8e9f-ec23274f89a9 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70/action" status: 409 len: 148 microversion: 2.1 time: 0.229646 Nov 06 20:47:40.465084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 248/422] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:40 2021] POST /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70/action => generated 148 bytes in 231 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:40.478025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a049558e-1138-4d8a-b94c-af6b9851d906 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f6715977dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.528451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39154795-c668-4c92-88de-301ba4d776ad tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557" status: 200 len: 371 microversion: 2.1 time: 0.389693 Nov 06 20:47:40.529147 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 175/423] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:47:40 2021] GET /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:40.533588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56163cfb-661f-4895-8f1d-e4317fb9fb63 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] Calling method '.version_select at 0x7f6715a7dee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:40.549491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a049558e-1138-4d8a-b94c-af6b9851d906 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:40.553963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a049558e-1138-4d8a-b94c-af6b9851d906 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:40.753791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56163cfb-661f-4895-8f1d-e4317fb9fb63 tempest-SecurityGroupsTestAdminJSON-1894370614 tempest-SecurityGroupsTestAdminJSON-1894370614-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6b102b8e-d1f6-404f-b3bb-138ad96f08d1" status: 202 len: 0 microversion: 2.1 time: 0.223706 Nov 06 20:47:40.754356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 176/424] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:47:40 2021] DELETE /compute/v2.1/os-security-groups/6b102b8e-d1f6-404f-b3bb-138ad96f08d1 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:40.759305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5844428d-6508-46ff-a320-47fd487d04d6 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.760637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5844428d-6508-46ff-a320-47fd487d04d6 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:40.761679 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5844428d-6508-46ff-a320-47fd487d04d6 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25/action" status: 400 len: 144 microversion: 2.1 time: 0.005900 Nov 06 20:47:40.768441 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 177/425] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:40 2021] POST /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:40.773504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Action: 'update', calling method: .version_select at 0x7f67159fa3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.775350 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:40.775350 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:40.956623 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a049558e-1138-4d8a-b94c-af6b9851d906 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483024 Nov 06 20:47:40.957963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 249/426] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:40 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:40.964728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5073307d-33db-4b88-8632-d3e7aa3a1dc4 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:40.966667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5073307d-33db-4b88-8632-d3e7aa3a1dc4 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:40.967681 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5073307d-33db-4b88-8632-d3e7aa3a1dc4 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25/action" status: 400 len: 120 microversion: 2.1 time: 0.008608 Nov 06 20:47:40.968543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 250/427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:40 2021] POST /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25/action => generated 120 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:40.979153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:40.980323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:40.988223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.988700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:40.989500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:40.990102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.185081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.185541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.189893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.190604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.244780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:41.255261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-932817ca-8e6a-4fb1-a36e-b106acd92d69 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.280981 Nov 06 20:47:41.255893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 251/428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:40 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:41.280093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cdff039a-e8ed-45a5-86fd-2a878e76a9e9 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update', calling method: .version_select at 0x7f6715aa3790>, body: {"meta": {"os_version": "alt"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:41.280228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbe3cceb-86c1-4dbc-bcda-9082ed056d9c tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557" status: 200 len: 328 microversion: 2.1 time: 0.510622 Nov 06 20:47:41.281740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 178/429] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:47:40 2021] PUT /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557 => generated 328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:41.286672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e07f4e34-2a04-4d0f-b88d-4fdd50ad2da0 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:41.287584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e07f4e34-2a04-4d0f-b88d-4fdd50ad2da0 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Failed to fetch instance by id 999 {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 20:47:41.288162 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e07f4e34-2a04-4d0f-b88d-4fdd50ad2da0 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 06 20:47:41.288752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e07f4e34-2a04-4d0f-b88d-4fdd50ad2da0 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:41.289545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e07f4e34-2a04-4d0f-b88d-4fdd50ad2da0 tempest-ServersAdminNegativeTestJSON-695836506 tempest-ServersAdminNegativeTestJSON-695836506-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.006677 Nov 06 20:47:41.290587 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 179/430] 10.222.0.13 () {60 vars in 1178 bytes} [Sat Nov 6 20:47:41 2021] POST /compute/v2.1/servers/999/action => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:47:41.298169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:41.299373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:41.308656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.309113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.313440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.313900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.383501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-cdff039a-e8ed-45a5-86fd-2a878e76a9e9 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:41.386892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6186cc44-ae26-4459-8fc3-92df8d77a3fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.094871 Nov 06 20:47:41.390693 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 180/431] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:41 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:41.393218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-cdff039a-e8ed-45a5-86fd-2a878e76a9e9 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:41.397630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-909d72cd-648e-48f8-9cca-8f03c04736ee tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:41.398873 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:41.398873 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:41.445033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-909d72cd-648e-48f8-9cca-8f03c04736ee tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557" status: 202 len: 0 microversion: 2.1 time: 0.055604 Nov 06 20:47:41.450484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 181/432] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:47:41 2021] DELETE /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:47:41.464802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:41.466012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:41.481382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.482009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.483243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.484272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.510146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:47:41.616484 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ac7c0d5-cf5e-4073-bd59-66d76cf33c1b tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "DELETE /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 204 len: 0 microversion: 2.1 time: 0.164318 Nov 06 20:47:41.620343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 182/433] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:47:41 2021] DELETE /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:41.627723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-941dbba1-fa73-405d-878e-a857f6715c64 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f67159b9820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:41.889171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cdff039a-e8ed-45a5-86fd-2a878e76a9e9 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.621852 Nov 06 20:47:41.894544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 252/434] 10.222.0.13 () {60 vars in 1312 bytes} [Sat Nov 6 20:47:41 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata/os_version => generated 31 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:41.907563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e5646f53-563c-4128-8835-f9e0589e47d1 req-5c8547f7-ff91-48ad-afc7-1eb0c0d17787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114dde74-d608-4edc-b28c-b83571a79bfe", "name": "network-vif-plugged", "status": "completed", "tag": "3acd6bd9-b880-40d3-9112-f7b5871fef1e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:41.909790 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:41.909790 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:41.917867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e5646f53-563c-4128-8835-f9e0589e47d1 req-5c8547f7-ff91-48ad-afc7-1eb0c0d17787 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.918321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e5646f53-563c-4128-8835-f9e0589e47d1 req-5c8547f7-ff91-48ad-afc7-1eb0c0d17787 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.929274 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e5646f53-563c-4128-8835-f9e0589e47d1 req-5c8547f7-ff91-48ad-afc7-1eb0c0d17787 service nova] Creating event network-vif-plugged:3acd6bd9-b880-40d3-9112-f7b5871fef1e for instance 114dde74-d608-4edc-b28c-b83571a79bfe on nch2-master-1 Nov 06 20:47:41.935509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e5646f53-563c-4128-8835-f9e0589e47d1 req-5c8547f7-ff91-48ad-afc7-1eb0c0d17787 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039105 Nov 06 20:47:41.936342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 253/435] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:41.959187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:41.960897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:41.969814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.970560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:41.971547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:41.972212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:42.021858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-941dbba1-fa73-405d-878e-a857f6715c64 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557" status: 200 len: 371 microversion: 2.1 time: 0.399825 Nov 06 20:47:42.023258 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 183/436] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:47:41 2021] GET /compute/v2.1/os-quota-sets/68f1b02d11ab40ba9790190aad210557 => generated 371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:42.031900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1047716-d4cd-425b-be7e-92b1c9ae7e7a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715a09790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:42.086511 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1047716-d4cd-425b-be7e-92b1c9ae7e7a tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.061049 Nov 06 20:47:42.087416 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 184/437] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:42 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 58 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:42.097346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00e31d66-ea77-4fa6-9e07-3504824d2296 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'update_all', calling method: .version_select at 0x7f67159fae50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:42.161046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-00e31d66-ea77-4fa6-9e07-3504824d2296 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:42.166015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-00e31d66-ea77-4fa6-9e07-3504824d2296 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:42.200005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:42.208510 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02edab0b-654b-409c-a044-bad2c1c18f6e tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1469 microversion: 2.1 time: 0.266797 Nov 06 20:47:42.210035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 254/438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:41 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:42.272394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:42.272937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:42.279361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:42.279973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:42.281021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:42.281588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:42.443617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:42.451061 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b5c6166-e7a1-4da2-9dfa-48b2abd30f03 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.182927 Nov 06 20:47:42.451659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 255/439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:42 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:42.456337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c117eeed-fc4a-4ff0-a23e-2f966cca8ddc tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f6715900ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:42.553484 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00e31d66-ea77-4fa6-9e07-3504824d2296 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.459818 Nov 06 20:47:42.554074 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 185/440] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:47:42 2021] PUT /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 61 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:42.561620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:42.563450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:42.570518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:42.571299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:42.572156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:42.572688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:42.619870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa20f9aa-b19f-423f-833e-3af09cd77c71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.061942 Nov 06 20:47:42.621028 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 186/441] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:42 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:42.631531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f02b300-35ce-44de-86c7-f1aeb31ea3bf tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Action: 'create', calling method: .version_select at 0x7f671596d9d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:42.706004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6f02b300-35ce-44de-86c7-f1aeb31ea3bf tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:42.713440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6f02b300-35ce-44de-86c7-f1aeb31ea3bf tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Getting quotas for user 4000dab7a4ec4dd79e6014e188c20dc7 and project f9b326bb723242adb4602dee4a30e654. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:42.934894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c117eeed-fc4a-4ff0-a23e-2f966cca8ddc tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.481885 Nov 06 20:47:42.935619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 256/442] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:47:42 2021] GET /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4/defaults => generated 371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:43.079215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f02b300-35ce-44de-86c7-f1aeb31ea3bf tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "POST /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.455911 Nov 06 20:47:43.079940 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 187/443] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Nov 6 20:47:42 2021] POST /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 85 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:43.089096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7061eef8-3d7c-41ba-861a-cdbc05e3b700 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] Calling method '.version_select at 0x7f6715a31700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:43.135958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7061eef8-3d7c-41ba-861a-cdbc05e3b700 tempest-ImagesMetadataTestJSON-1721862558 tempest-ImagesMetadataTestJSON-1721862558-project] 10.222.0.13 "GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.050848 Nov 06 20:47:43.137011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 257/444] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:47:43 2021] GET /compute/v2.1/images/7307d518-59bf-4dd1-9fc8-7ebb7c26f62a/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:47:43.226725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:43.227455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:43.233717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.234174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.234962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.235395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.385580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:43.393764 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6bacd4f-a9c9-4a17-a33d-bdaa67e52bd8 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1469 microversion: 2.1 time: 0.171273 Nov 06 20:47:43.394470 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 188/445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:43 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:43.467624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:43.469506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:43.475988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.476557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.477485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.478006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.631102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Action: 'update', calling method: .version_select at 0x7f67159cc5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:43.633129 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:43.633129 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:43.656268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:43.667260 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc4dfdff-80a4-4c49-bc56-bdde5747d1e8 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1319 microversion: 2.1 time: 0.202944 Nov 06 20:47:43.677677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 258/446] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:43 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:43.685706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:43.692149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:43.702941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.707424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.708571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:43.709893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:43.770828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29cbffa1-d9e8-4153-9dfa-2576dedccdd7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.090883 Nov 06 20:47:43.772569 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 259/447] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:43 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:44.040740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.041999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.043656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.044788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.157852 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9dce0a5-781e-43d6-9a72-410a92d73686 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33" status: 200 len: 328 microversion: 2.1 time: 0.530292 Nov 06 20:47:44.159810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 189/448] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:47:43 2021] PUT /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33 => generated 328 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:44.172766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f6715aa3280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:44.412702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:44.413190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:44.423367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.423828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.429348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.430344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.585159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:44.595037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dab0fadb-b260-44e0-9de3-1dc49c85e00f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 200 len: 1427 microversion: 2.1 time: 0.187132 Nov 06 20:47:44.608722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 190/449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:44 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:44.622455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-865b6029-f2f8-4b17-999d-80257b530039 req-5c3accb7-46bf-4132-88bb-97277ad79e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189c6532-c954-47ae-8295-c24d79449f70", "name": "network-vif-deleted", "tag": "5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:44.624430 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:44.624430 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:44.646639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-865b6029-f2f8-4b17-999d-80257b530039 req-5c3accb7-46bf-4132-88bb-97277ad79e39 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.650227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-865b6029-f2f8-4b17-999d-80257b530039 req-5c3accb7-46bf-4132-88bb-97277ad79e39 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.680696 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-865b6029-f2f8-4b17-999d-80257b530039 req-5c3accb7-46bf-4132-88bb-97277ad79e39 service nova] Creating event network-vif-deleted:5dfbbf18-e5bd-4e78-9a36-0f50e3bb4c71 for instance 189c6532-c954-47ae-8295-c24d79449f70 on nch2-master-1 Nov 06 20:47:44.694892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-865b6029-f2f8-4b17-999d-80257b530039 req-5c3accb7-46bf-4132-88bb-97277ad79e39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082053 Nov 06 20:47:44.695814 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 191/450] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:44.712357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:44.716599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:44.731882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.736076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.737165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.739273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.887272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.887940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.888964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.889482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.922182 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e42a6bc5-764f-415c-9a54-3f962d6cc1b9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33/detail" status: 200 len: 916 microversion: 2.1 time: 0.747629 Nov 06 20:47:44.922182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 260/451] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:47:44 2021] GET /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33/detail => generated 916 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:44.944430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:44.955834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84df0f62-f4cc-43da-b05c-18070eda0439 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1468 microversion: 2.1 time: 0.254124 Nov 06 20:47:44.956960 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 192/452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:44 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1468 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:44.978100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:44.983503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:44.996669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.997259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:44.998222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:44.998877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.078385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1229ec2a-a388-4f79-bf70-13f2cab5bd07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.118481 Nov 06 20:47:45.083112 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 193/453] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:44 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:45.406980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-563fe20b-3c80-4c59-af0a-f0a7633a6d71 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1595285593", "id": 1087534696, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:45.408660 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:45.408660 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:45.428517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:45.429604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:45.449780 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-563fe20b-3c80-4c59-af0a-f0a7633a6d71 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.533271 Nov 06 20:47:45.450400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.450995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.451974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.452563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.453418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 261/454] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:47:44 2021] POST /compute/v2.1/flavors => generated 468 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:45.508219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:47:45.730553 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03d2642f-161a-4179-b78a-7dd5ec11c14f tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 204 len: 0 microversion: 2.1 time: 0.645713 Nov 06 20:47:45.731354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 194/455] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:47:45 2021] DELETE /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:45.738711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Action: 'update', calling method: .version_select at 0x7f6715ad6160>, body: {"quota_set": {"ram": "2048"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:45.744895 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:45.744895 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:45.879711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a88d627-6e13-49ed-9be1-55ff7909a278 tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:45.894879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a88d627-6e13-49ed-9be1-55ff7909a278 tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] 10.222.0.13 "GET /compute/v2.1/flavors/1087534696" status: 200 len: 468 microversion: 2.61 time: 0.436976 Nov 06 20:47:45.895700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 262/456] 10.222.0.13 () {60 vars in 1198 bytes} [Sat Nov 6 20:47:45 2021] GET /compute/v2.1/flavors/1087534696 => generated 468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:45.899970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:45.901341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 189c6532-c954-47ae-8295-c24d79449f70] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:45.909121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.909795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.910834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.911484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.939023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] HTTP exception thrown: Instance 189c6532-c954-47ae-8295-c24d79449f70 could not be found. Nov 06 20:47:45.941536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Returning 404 to user: Instance 189c6532-c954-47ae-8295-c24d79449f70 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:45.942552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe6d0c12-c886-4737-b268-4a462469e39f tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70" status: 404 len: 111 microversion: 2.1 time: 0.045932 Nov 06 20:47:45.946586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 263/457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:45 2021] GET /compute/v2.1/servers/189c6532-c954-47ae-8295-c24d79449f70 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:45.953162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:45.954065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:45.960745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.961564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:45.962839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:45.963622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.178574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:46.185905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e0890d1-bb7e-4f5a-86e4-d1c9b992c52e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1474 microversion: 2.1 time: 0.238130 Nov 06 20:47:46.186505 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 264/458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:45 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:46.209704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82723acb-0f1d-4cb4-9c0e-04b6af937c42 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] Action: 'update', calling method: .version_select at 0x7f6717d643a0>, body: {"flavor": {"description": "new"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:46.228348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.228824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.229762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.230208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.249287 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:46.249287 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:46.302470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82723acb-0f1d-4cb4-9c0e-04b6af937c42 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1087534696" status: 200 len: 469 microversion: 2.61 time: 0.103288 Nov 06 20:47:46.304507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.305288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.305715 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 265/459] 10.222.0.13 () {62 vars in 1218 bytes} [Sat Nov 6 20:47:46 2021] PUT /compute/v2.1/flavors/1087534696 => generated 469 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:46.306721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.307406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.316382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.316382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:46.339281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.340594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.343357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.346619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.409058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:47:46.422301 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0d805b6-d241-4f0f-a931-93911dcf3da9 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33?user_id=2a0fbde53e8e462cb41e05a1d0a64f70" status: 200 len: 328 microversion: 2.1 time: 0.689361 Nov 06 20:47:46.423280 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 195/460] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 20:47:45 2021] PUT /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33?user_id=2a0fbde53e8e462cb41e05a1d0a64f70 => generated 328 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:46.429650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:46.431043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:46.438567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.439308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.440389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.441603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.534076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d23aacf3-b5ff-493d-927a-9fdf31f50eec tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.109184 Nov 06 20:47:46.537991 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 196/461] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:46 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:46.540972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b4f4710-20df-4ac7-b060-91b3bc2451ce tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.582368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b4f4710-20df-4ac7-b060-91b3bc2451ce tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.045262 Nov 06 20:47:46.595021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 197/462] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 20:47:46 2021] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:46.595021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a66e4c39-1721-4477-81d7-b413f06eac3d tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f6715a09040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.642012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e784e852-b014-4fc2-aecd-fe11511b79ca tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "DELETE /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 204 len: 0 microversion: 2.1 time: 0.334811 Nov 06 20:47:46.642658 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 266/463] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:47:46 2021] DELETE /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:46.651958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e09941a-ab78-48ea-a6a8-f16a303e1b50 tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.678485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e09941a-ab78-48ea-a6a8-f16a303e1b50 tempest-FlavorsV261TestJSON-1427454880 tempest-FlavorsV261TestJSON-1427454880-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.031078 Nov 06 20:47:46.679417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 267/464] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Nov 6 20:47:46 2021] GET /compute/v2.1/flavors => generated 3680 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:46.822944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Action: 'update', calling method: .version_select at 0x7f6715ada0d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:46.824308 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:46.824308 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:46.825793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.826249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.835998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.836732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.846327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] HTTP exception thrown: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. Nov 06 20:47:46.848891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Returning 404 to user: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:46.850597 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e4975d3-6db6-46fb-8e07-b9db34fab520 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82" status: 404 len: 110 microversion: 2.53 time: 0.170185 Nov 06 20:47:46.857788 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 268/465] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Nov 6 20:47:46 2021] PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 => generated 110 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:46.881127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.882454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:46.897742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a66e4c39-1721-4477-81d7-b413f06eac3d tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33?user_id=2a0fbde53e8e462cb41e05a1d0a64f70" status: 200 len: 370 microversion: 2.1 time: 0.313102 Nov 06 20:47:46.898811 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 198/466] 10.222.0.13 () {58 vars in 1322 bytes} [Sat Nov 6 20:47:46 2021] GET /compute/v2.1/os-quota-sets/3e5b5e65c1cf4adcb6597ed17f967c33?user_id=2a0fbde53e8e462cb41e05a1d0a64f70 => generated 370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:46.907735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.908727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.909721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.910243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.917660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea9a6a32-9c1d-4c7f-9487-487417ace32b tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:46.919194 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:46.919194 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:46.943813 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea9a6a32-9c1d-4c7f-9487-487417ace32b tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1087534696" status: 202 len: 0 microversion: 2.61 time: 0.043702 Nov 06 20:47:46.945941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 199/467] 10.222.0.13 () {60 vars in 1201 bytes} [Sat Nov 6 20:47:46 2021] DELETE /compute/v2.1/flavors/1087534696 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:47:46.951918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Action: 'update', calling method: .version_select at 0x7f67159b9c10>, body: {"status": "disabled"} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:46.954317 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:46.954317 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:46.956981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.957857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.967293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:46.968468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:46.979398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] HTTP exception thrown: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. Nov 06 20:47:46.980107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Returning 404 to user: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:46.981740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5596b30-b887-4689-ab2a-36dd12bb3dc3 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82" status: 404 len: 110 microversion: 2.53 time: 0.033833 Nov 06 20:47:46.984510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 200/468] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Nov 6 20:47:46 2021] PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:46.990199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbf9e305-d964-40d1-beb7-a88a04c80d63 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.021111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbf9e305-d964-40d1-beb7-a88a04c80d63 tempest-FlavorsV261TestJSON-1357757024 tempest-FlavorsV261TestJSON-1357757024-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.036906 Nov 06 20:47:47.022438 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 201/469] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 20:47:46 2021] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:47.027275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Action: 'update', calling method: .version_select at 0x7f6715a06280>, body: {"status": "enabled"} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:47.031776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.032240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.039180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.039953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.045699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] HTTP exception thrown: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. Nov 06 20:47:47.046355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Returning 404 to user: Service e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:47.047606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4251a125-e92f-4f11-8fe6-03842a87cce2 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82" status: 404 len: 110 microversion: 2.53 time: 0.023821 Nov 06 20:47:47.059600 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 202/470] 10.222.0.13 () {62 vars in 1308 bytes} [Sat Nov 6 20:47:47 2021] PUT /compute/v2.1/os-services/e3e8b9ac-3b73-41ae-b0f2-2928052b9a82 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:47.068873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.070047 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:47.070047 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:47.075100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.075591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.076738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.077752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.116570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0cdcf91-6dc2-4add-b6ee-b5b4c5c62b2d tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.055770 Nov 06 20:47:47.124469 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 203/471] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:47.142155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.144498 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:47.144498 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:47.146087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.148561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.164008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.165713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.237602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87835bf6-c623-404d-a2d1-e06a5d24b757 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.102674 Nov 06 20:47:47.245988 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 204/472] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:47.305150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:47.319553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a20261e-73c8-476e-a90c-e134e39c5cd4 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1477 microversion: 2.1 time: 0.460233 Nov 06 20:47:47.320410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 269/473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:46 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:47.325245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.330607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:47.346086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.347029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.348841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.361630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.721295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b6176c1-3140-427a-8b80-4ea31384db52 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] Calling method '.version_select at 0x7f67159b9e50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.721961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:47.732951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e465196a-8f9a-4010-bf12-97d837d68f49 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1474 microversion: 2.1 time: 0.410863 Nov 06 20:47:47.733808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 270/474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1474 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:47.753332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.754714 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:47.754714 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:47.756337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.756805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.757635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.758076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.787275 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b6176c1-3140-427a-8b80-4ea31384db52 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] 10.222.0.13 "GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c" status: 200 len: 784 microversion: 2.1 time: 0.544777 Nov 06 20:47:47.788098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 205/475] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c => generated 784 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:47.793326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:47.794518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:47.805275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.806016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.807336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:47.808004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:47.851306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ed37f017-0792-4917-8f98-bcff9e18a7c9 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.112884 Nov 06 20:47:47.852440 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 271/476] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:47.862732 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de7b69a8-d9d3-4dda-9b2a-69eb2b0f67ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.073276 Nov 06 20:47:47.863372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 206/477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:47 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:47.878648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c3b18ab-e1a6-4cfa-b503-29f3e10f1f57 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Calling method '.version_select at 0x7f6715977b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:47.883322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83425c51-4853-4f90-8523-4e11cba06d37 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] Calling method '.version_select at 0x7f67159b9700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.002756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83425c51-4853-4f90-8523-4e11cba06d37 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] 10.222.0.13 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.134817 Nov 06 20:47:48.004890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 207/478] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/images => generated 445 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:48.018084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.019777 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:48.019777 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:48.022381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.023118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.024551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.025241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.055562 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73c0c30f-c860-4741-9632-4be11d38761e tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.042584 Nov 06 20:47:48.056522 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 208/479] 10.222.0.13 () {60 vars in 1236 bytes} [Sat Nov 6 20:47:48 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:48.068803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78fa82dd-0d70-4d16-8042-be34f2311a10 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] Calling method '.version_select at 0x7f6715adb040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.135364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78fa82dd-0d70-4d16-8042-be34f2311a10 tempest-ListImagesTestJSON-1924988836 tempest-ListImagesTestJSON-1924988836-project] 10.222.0.13 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.070893 Nov 06 20:47:48.146999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 209/480] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:47:48 2021] GET /compute/v2.1/images/detail => generated 787 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:48.159558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.161309 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:48.161309 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:48.162582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.171702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.172798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.173259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.242563 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1aabb25-7605-479a-9014-326dc4cc6b98 tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.094168 Nov 06 20:47:48.254312 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 210/481] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Nov 6 20:47:48 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:47:48.261216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.262692 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:48.262692 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:48.264725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.265372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.266216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.266662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.301919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c3b18ab-e1a6-4cfa-b503-29f3e10f1f57 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.448353 Nov 06 20:47:48.303565 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 272/482] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:47:47 2021] GET /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4/defaults => generated 371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:48.313831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Action: 'update', calling method: .version_select at 0x7f6715a51550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:48.318928 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:48.318928 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:48.339124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8152fda0-eef3-4afa-a80d-a1401b9db26f tempest-ServicesAdminNegativeV253TestJSON-904503347 tempest-ServicesAdminNegativeV253TestJSON-904503347-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.081889 Nov 06 20:47:48.348253 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 211/483] 10.222.0.13 () {60 vars in 1238 bytes} [Sat Nov 6 20:47:48 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:48.355791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:48.356772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:48.381692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.382144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.382970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.383413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.584368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.584809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:48.589477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:48.590136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.018078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18647271-6cc7-4a49-bc87-2c096275c4ba tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4" status: 200 len: 329 microversion: 2.1 time: 0.708569 Nov 06 20:47:49.018718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 273/484] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Nov 6 20:47:48 2021] PUT /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4 => generated 329 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:47:49.225246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:49.237400 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4d91169-b0bc-46c8-a389-f26233ed7d95 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1477 microversion: 2.1 time: 0.887492 Nov 06 20:47:49.237984 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 212/485] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:48 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1477 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:49.251738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:49.252595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:49.265088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.266086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.269290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.270144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.288237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3b0d439-8be1-498c-9fea-f118443f78ab tempest-ServicesAdminNegativeV253TestJSON-172150946 tempest-ServicesAdminNegativeV253TestJSON-172150946-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:49.289641 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:49.289641 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:49.291614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b3b0d439-8be1-498c-9fea-f118443f78ab tempest-ServicesAdminNegativeV253TestJSON-172150946 tempest-ServicesAdminNegativeV253TestJSON-172150946-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4399d40598b6424a847e63e727c520f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097eb1f654f84e5e8bcded027845e18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:49.292469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3b0d439-8be1-498c-9fea-f118443f78ab tempest-ServicesAdminNegativeV253TestJSON-172150946 tempest-ServicesAdminNegativeV253TestJSON-172150946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:49.293781 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3b0d439-8be1-498c-9fea-f118443f78ab tempest-ServicesAdminNegativeV253TestJSON-172150946 tempest-ServicesAdminNegativeV253TestJSON-172150946-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.274132 Nov 06 20:47:49.302579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 274/486] 10.222.0.13 () {60 vars in 1177 bytes} [Sat Nov 6 20:47:49 2021] GET /compute/v2.1/os-services => generated 112 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:47:49.320341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:49.323712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:49.348022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.348511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.351455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.351850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.355681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.356142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.356660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lazy-loading 'fault' on Instance uuid 114dde74-d608-4edc-b28c-b83571a79bfe {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:47:49.422404 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c905fd87-44eb-4f67-9244-ff504283b797 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.117031 Nov 06 20:47:49.424402 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 275/487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:49 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:49.433666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1a63ef15-078b-4a6d-a211-6e96a61e0009 req-5749fcf8-9d05-4c91-aa2b-eaad2a298005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114dde74-d608-4edc-b28c-b83571a79bfe", "name": "network-vif-deleted", "tag": "3acd6bd9-b880-40d3-9112-f7b5871fef1e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:49.438239 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:49.438239 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:49.454863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1a63ef15-078b-4a6d-a211-6e96a61e0009 req-5749fcf8-9d05-4c91-aa2b-eaad2a298005 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:49.457725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1a63ef15-078b-4a6d-a211-6e96a61e0009 req-5749fcf8-9d05-4c91-aa2b-eaad2a298005 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:49.486764 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1a63ef15-078b-4a6d-a211-6e96a61e0009 req-5749fcf8-9d05-4c91-aa2b-eaad2a298005 service nova] Creating event network-vif-deleted:3acd6bd9-b880-40d3-9112-f7b5871fef1e for instance 114dde74-d608-4edc-b28c-b83571a79bfe on nch2-master-1 Nov 06 20:47:49.494594 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1a63ef15-078b-4a6d-a211-6e96a61e0009 req-5749fcf8-9d05-4c91-aa2b-eaad2a298005 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067995 Nov 06 20:47:49.496194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 276/488] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:49.502453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Action: 'update', calling method: .version_select at 0x7f671596db80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:49.509470 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:49.509470 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:49.524366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:49.544330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68aed6de-c763-481b-b008-cb342b07aa86 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 200 len: 1309 microversion: 2.1 time: 0.300829 Nov 06 20:47:49.546968 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 213/489] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:49 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:50.073211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.074186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.076470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.077715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.256595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:50.258527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:50.303372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.304414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.314212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.316221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.398879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.405266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.405974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lazy-loading 'fault' on Instance uuid 139cbe17-657f-439e-a940-bc1166cb7e25 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:47:50.585349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c24860e4fd4ad0125f6b46809ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b236babc5d4b95a766210d9912b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:50.597467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ba14a75-c195-4eee-a517-6168a1d82818 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 200 len: 1311 microversion: 2.1 time: 0.345594 Nov 06 20:47:50.599101 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 214/490] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:50 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:50.613936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:50.615525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:50.630851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.636279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.639212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.642038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.731788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6302e8e1-9a61-4082-a7a1-b313d6b006fc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.129689 Nov 06 20:47:50.735699 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 215/491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:50 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:50.746506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:50.750280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:50.764983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.765883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.766900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:50.767504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:50.791508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92b9737d-57b4-40ca-92b4-16681ed41463 tempest-QuotasAdminTestJSON-509490117 tempest-QuotasAdminTestJSON-509490117-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4" status: 200 len: 329 microversion: 2.1 time: 1.293816 Nov 06 20:47:50.792773 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 277/492] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Nov 6 20:47:49 2021] PUT /compute/v2.1/os-quota-sets/ca712c4e105a417b944218e5b39b51f4 => generated 329 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:50.807167 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. Nov 06 20:47:50.807940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:50.808995 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e52f8dc3-069a-4d1b-b7e6-0bb4cf3528a0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 404 len: 111 microversion: 2.1 time: 0.071849 Nov 06 20:47:50.810036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 216/493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:50 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:51.148934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1614971336", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:51.252912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:47:51.549501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6c8dc848-f7d1-4869-8073-5311ef19e390 req-faed0500-7a43-4bc5-8d20-7b12a7be1dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139cbe17-657f-439e-a940-bc1166cb7e25", "name": "network-vif-deleted", "tag": "a41e7a85-586b-4ade-9a81-f07b08cb6c08"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:51.550047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:47:51.550047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:47:51.550540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:47:51.550960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:47:51.551075 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:51.551075 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:47:51.551372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:47:51.564242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.564747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.565561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.566169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.582140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6c8dc848-f7d1-4869-8073-5311ef19e390 req-faed0500-7a43-4bc5-8d20-7b12a7be1dc7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.607547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6c8dc848-f7d1-4869-8073-5311ef19e390 req-faed0500-7a43-4bc5-8d20-7b12a7be1dc7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.627042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Getting quotas for project d5634bafe48248a4af8fa00164acddd4. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:51.637674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Getting quotas for user 1f4c02e3d7ce4ef883dd4774ef64fcdb and project d5634bafe48248a4af8fa00164acddd4. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:51.639139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6c8dc848-f7d1-4869-8073-5311ef19e390 req-faed0500-7a43-4bc5-8d20-7b12a7be1dc7 service nova] Creating event network-vif-deleted:a41e7a85-586b-4ade-9a81-f07b08cb6c08 for instance 139cbe17-657f-439e-a940-bc1166cb7e25 on nch1-master-1 Nov 06 20:47:51.667615 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6c8dc848-f7d1-4869-8073-5311ef19e390 req-faed0500-7a43-4bc5-8d20-7b12a7be1dc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121909 Nov 06 20:47:51.672393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 217/494] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:51.676324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:47:51.682015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:51.683022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:47:51.694591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] [instance: 139cbe17-657f-439e-a940-bc1166cb7e25] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:51.705353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.705803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.709037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.711198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.743516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] HTTP exception thrown: Instance 139cbe17-657f-439e-a940-bc1166cb7e25 could not be found. Nov 06 20:47:51.744122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] Returning 404 to user: Instance 139cbe17-657f-439e-a940-bc1166cb7e25 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:47:51.745029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b969ca53-5806-4e26-a85b-2de0035877a9 tempest-ServersAdminNegativeTestJSON-1413707804 tempest-ServersAdminNegativeTestJSON-1413707804-project] 10.222.0.13 "GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25" status: 404 len: 111 microversion: 2.1 time: 0.070737 Nov 06 20:47:51.745587 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 218/495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:51 2021] GET /compute/v2.1/servers/139cbe17-657f-439e-a940-bc1166cb7e25 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:47:51.767182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:51.783387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dadf58d7-060e-4603-b28e-84da6fcbfff4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637226 Nov 06 20:47:51.791792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:51.796713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 278/496] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:47:51.814133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.821796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.825574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:51.825720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc6b552f-7cf9-4a24-bf02-dbb64ccf192e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:51.826382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:51.828010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc6b552f-7cf9-4a24-bf02-dbb64ccf192e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:51.914165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb80bd0b-1a24-4dc5-973e-c7d8a36a4860 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.167347 Nov 06 20:47:51.915826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 219/497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:51 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:52.038771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc6b552f-7cf9-4a24-bf02-dbb64ccf192e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:52.061236 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc6b552f-7cf9-4a24-bf02-dbb64ccf192e tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1220 microversion: 2.1 time: 0.245585 Nov 06 20:47:52.066297 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 279/498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:51 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:52.879698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a5c36df-8fde-4b0d-b67b-47c0271d5960 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Action: 'create', calling method: .version_select at 0x7f6715956d30>, body: {"pool": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:52.926678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:52.928652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:52.935649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:52.937024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:52.938165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:52.938805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:52.982549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d31bcbd2-2417-4419-9df5-a69fcb39acbc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.059372 Nov 06 20:47:52.985832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 280/499] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:52 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:47:53.084327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:53.085095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:53.114083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:53.114548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:53.115358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:53.124602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:53.329189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:53.341273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2a52c30-d209-4db9-a50e-fdcf1020934d tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1272 microversion: 2.1 time: 0.261710 Nov 06 20:47:53.352093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 281/500] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:53 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:53.995807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:53.997586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:54.017331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:54.018190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:54.019070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:54.019571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:54.086688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a928ee94-6b68-479a-a8ba-bdf1cbc45b07 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.095530 Nov 06 20:47:54.090586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 282/501] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:53 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:47:54.360004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:54.360876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:54.393662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:54.394588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:54.396455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:54.398916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:54.590118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:54.601695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79c5058e-bb49-47be-8e67-d04c5aabe31f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1278 microversion: 2.1 time: 0.246014 Nov 06 20:47:54.616688 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 283/502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:54 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:47:55.167967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:55.173005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:55.220158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:55.220637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:55.226081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:55.226704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:55.355070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11e21750-dd40-4d8c-b17a-a4a615c01c27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.257667 Nov 06 20:47:55.360343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 284/503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:55 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:55.620487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:55.621769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:55.636206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:55.638748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:55.642368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:55.644022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:56.111431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:56.119813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e9e188e-4947-4ee3-8f35-763621fef36a tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1320 microversion: 2.1 time: 0.504351 Nov 06 20:47:56.129056 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 285/504] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:55 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1320 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:56.540868 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a5c36df-8fde-4b0d-b67b-47c0271d5960 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.040110 Nov 06 20:47:56.555831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 220/505] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:47:52 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:56.566718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:56.575146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:56.603640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:56.605275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:56.606246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:56.606923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:56.669643 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2511f41-b638-425c-9a58-649493b15359 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.110913 Nov 06 20:47:56.672918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 221/506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:56 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:56.691935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e5aeb05-a03a-4841-9085-a3c43aa4c596 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Action: 'create', calling method: .version_select at 0x7f671596d550>, body: {"pool": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:56.798441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d805c15b-9fc6-4e93-8491-2f7cc6df0a8e tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715b47af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1189020544", "description": "tempest-description-1260856207"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:57.557091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d805c15b-9fc6-4e93-8491-2f7cc6df0a8e tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.426577 Nov 06 20:47:57.558038 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 286/507] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:47:56 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:57.986275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-575739618", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:58.084654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:47:58.438408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:47:58.438981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:47:58.439572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:47:58.440507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:47:58.440965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:47:58.456787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:58.457334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:58.459964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:58.460694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:58.483260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Getting quotas for project 5034d2c321a9410cbfd113598b06173f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:47:58.490369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Getting quotas for user e4c5b072659a43db91bcb4e99998d60c and project 5034d2c321a9410cbfd113598b06173f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:47:58.506876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:47:58.509118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:47:58.570510 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e5b6ee6-19dc-43ee-ac6f-388f02129b79 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011054 Nov 06 20:47:58.571618 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 287/508] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:47:58.582726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:58.583559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:58.591273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:58.592794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:58.594222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:58.594811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:58.840272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:58.847797 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-233e93cf-0a83-4d8b-8c09-05b38bec6f0f tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1320 microversion: 2.1 time: 0.274714 Nov 06 20:47:58.848454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 288/509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:58 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:58.853192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-63740479-7f28-46e2-a91d-c938f93e632c req-15c23584-0305-41cb-9fd1-c850f7c52bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d510789-3888-4dfa-a372-e034f2162082", "tag": "4430c80b-9df8-41de-afcd-6cd98ae2452c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:58.855114 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:47:58.855114 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:47:58.862870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-63740479-7f28-46e2-a91d-c938f93e632c req-15c23584-0305-41cb-9fd1-c850f7c52bef service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:58.863524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-63740479-7f28-46e2-a91d-c938f93e632c req-15c23584-0305-41cb-9fd1-c850f7c52bef service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:58.878467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-63740479-7f28-46e2-a91d-c938f93e632c req-15c23584-0305-41cb-9fd1-c850f7c52bef service nova] Creating event network-changed:4430c80b-9df8-41de-afcd-6cd98ae2452c for instance 3d510789-3888-4dfa-a372-e034f2162082 on nch2-master-1 Nov 06 20:47:58.885217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-63740479-7f28-46e2-a91d-c938f93e632c req-15c23584-0305-41cb-9fd1-c850f7c52bef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035351 Nov 06 20:47:58.897578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 289/510] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:47:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:58.904725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae1de921-9c27-4568-a2fc-f0d4e77e51f8 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f67158c2670>, body: {"security_group_rule": {"parent_group_id": "efd14d4a-7c87-4f6b-bda5-5f3967679d83", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:59.348551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e5aeb05-a03a-4841-9085-a3c43aa4c596 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.670661 Nov 06 20:47:59.349262 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 222/511] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:47:56 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:59.354576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:59.355951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:59.362660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:59.363130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:59.363897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:59.364356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:59.406237 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1035de46-dbce-4b13-ac65-9d85dc85af1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.055511 Nov 06 20:47:59.410156 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 223/512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:47:59 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:47:59.438877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae1de921-9c27-4568-a2fc-f0d4e77e51f8 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.539919 Nov 06 20:47:59.439469 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 290/513] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:47:58 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:47:59.658546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8eb2f8e4-5a63-468d-986e-38b42ca35ac4 tempest-TenantUsagesNegativeTestJSON-82974681 tempest-TenantUsagesNegativeTestJSON-82974681-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-05T20%3A47%3A58.223779&end=2021-11-07T20%3A47%3A58.223779" status: 404 len: 112 microversion: - time: 0.250155 Nov 06 20:47:59.659282 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 224/514] 10.222.0.13 () {58 vars in 1315 bytes} [Sat Nov 6 20:47:59 2021] GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-05T20%3A47%3A58.223779&end=2021-11-07T20%3A47%3A58.223779 => generated 112 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 06 20:47:59.673891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:47:59.675129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:47:59.688685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1420277048", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:59.694113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:59.694574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:59.695420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:47:59.695867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:47:59.756032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:47:59.773495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:47:59.783866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4b6f07c-f85d-4c9b-9648-83660b92e2c4 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1288 microversion: 2.1 time: 0.118420 Nov 06 20:47:59.784875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 225/515] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:47:59 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:47:59.839132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1311752205", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:47:59.901042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:00.037319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:00.037843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:00.038416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:00.038917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:00.039533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:00.050502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.050946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:00.051752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.052181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:00.071135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Getting quotas for project dd3507687d2944a88c2d5567473ec458. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:00.075556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Getting quotas for user a09f231ee24f4f798c0a5d6e84be4d8d and project dd3507687d2944a88c2d5567473ec458. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:00.089335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:00.092581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:00.143858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b6e58822-0fbc-45b8-90b7-33e205de7a22 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702246 Nov 06 20:48:00.146556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 291/516] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:00.153083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a36f5c3c-6540-465f-af40-eeb9366e3525 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Action: 'create', calling method: .version_select at 0x7f67158a3e50>, body: {"pool": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:00.158174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:00.158600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:00.159346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:00.159760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:00.160173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:00.177785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.178519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:00.179494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.180041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:00.217026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:00.222012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:00.235256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:00.238637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:00.297375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46cf5bf1-421e-447b-a039-c02d527d73d3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510409 Nov 06 20:48:00.303342 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 226/517] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:47:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:00.303783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-411ee21c-8a50-4d9a-bfcc-9de948bd46b7 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715ad61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1042364830", "description": "tempest-description-662457995"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:00.877687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-411ee21c-8a50-4d9a-bfcc-9de948bd46b7 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.578099 Nov 06 20:48:00.879472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 227/518] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:00 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:00.884144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4571e3c0-3619-4d46-a797-64593bd09fae tempest-TenantUsagesNegativeTestJSON-82974681 tempest-TenantUsagesNegativeTestJSON-82974681-project-admin] Calling method '.version_select at 0x7f67159c0310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:00.894769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4571e3c0-3619-4d46-a797-64593bd09fae tempest-TenantUsagesNegativeTestJSON-82974681 tempest-TenantUsagesNegativeTestJSON-82974681-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 06 20:48:00.905343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4571e3c0-3619-4d46-a797-64593bd09fae tempest-TenantUsagesNegativeTestJSON-82974681 tempest-TenantUsagesNegativeTestJSON-82974681-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:00.911203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4571e3c0-3619-4d46-a797-64593bd09fae tempest-TenantUsagesNegativeTestJSON-82974681 tempest-TenantUsagesNegativeTestJSON-82974681-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/533480f72a304a22ad7498621fc8010f?start=2021-11-07T20%3A47%3A58.223779&end=2021-11-05T20%3A47%3A58.223779" status: 400 len: 111 microversion: 2.1 time: 0.029171 Nov 06 20:48:00.912882 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 228/519] 10.222.0.13 () {58 vars in 1411 bytes} [Sat Nov 6 20:48:00 2021] GET /compute/v2.1/os-simple-tenant-usage/533480f72a304a22ad7498621fc8010f?start=2021-11-07T20%3A47%3A58.223779&end=2021-11-05T20%3A47%3A58.223779 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:00.923146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:00.932131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:00.943697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.944867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:00.945818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:00.946403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.209650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:01.218616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb281a29-ce4c-4e8d-9445-e0f4868c3a15 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1320 microversion: 2.1 time: 0.304458 Nov 06 20:48:01.219221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 229/520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:00 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:01.240521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:01.241286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:01.258900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.259676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.262052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.263010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.426672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:01.439583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a942fcf-fd2a-45dc-8769-820b07f37b87 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1269 microversion: 2.1 time: 0.211631 Nov 06 20:48:01.440724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 230/521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:01 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:01.455682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:01.457075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:01.472502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.473292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.475323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.475939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.612915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:01.623018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17d10501-b990-41b7-a4f4-9a2fe393edaa tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1269 microversion: 2.1 time: 0.180345 Nov 06 20:48:01.624400 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 231/522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:01 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:01.629346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:01.630465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:01.642490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.643318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.645830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.651066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.731235 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f900334-9fc8-4876-9f81-7d4d5f166dc7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.105226 Nov 06 20:48:01.731834 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 232/523] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:01 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:01.739251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:01.744217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:01.794133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.795045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:01.797302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:01.799194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:02.262399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:02.271516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8e3b92d-67d6-4621-9d34-0712370ccbb2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1318 microversion: 2.1 time: 0.537314 Nov 06 20:48:02.272358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 233/524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:01 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:02.286855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b6a7fd3-9326-4994-b2a3-5faab92ef1bb tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715b15940>, body: {"security_group_rule": {"parent_group_id": "1aa177fe-eee2-41c4-8abf-95669caad244", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:02.798092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a36f5c3c-6540-465f-af40-eeb9366e3525 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.650091 Nov 06 20:48:02.813234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b6a7fd3-9326-4994-b2a3-5faab92ef1bb tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.527082 Nov 06 20:48:02.813234 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 234/525] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:02 2021] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:02.814464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 292/526] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:48:00 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:02.820404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c30e3fba-1fc5-458f-b7d6-003d16e02863 req-0ae588ab-1363-45c2-810e-c9bcba997590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a6a890-f3f4-4404-9605-4ed65f87e384", "tag": "3a09f6cc-b34c-4184-8c37-b32dc96fa02a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:02.821967 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:02.821967 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:02.829671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c30e3fba-1fc5-458f-b7d6-003d16e02863 req-0ae588ab-1363-45c2-810e-c9bcba997590 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:02.830115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c30e3fba-1fc5-458f-b7d6-003d16e02863 req-0ae588ab-1363-45c2-810e-c9bcba997590 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:02.841434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c30e3fba-1fc5-458f-b7d6-003d16e02863 req-0ae588ab-1363-45c2-810e-c9bcba997590 service nova] Creating event network-changed:3a09f6cc-b34c-4184-8c37-b32dc96fa02a for instance 74a6a890-f3f4-4404-9605-4ed65f87e384 on nch2-master-1 Nov 06 20:48:02.847002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c30e3fba-1fc5-458f-b7d6-003d16e02863 req-0ae588ab-1363-45c2-810e-c9bcba997590 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030150 Nov 06 20:48:02.848115 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 293/527] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:02.853064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:02.853752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:02.860954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:02.861462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:02.871180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:02.871823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:02.916368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0aa9c760-9d29-4f02-ad93-9758fdde4d9b tempest-TenantUsagesNegativeTestJSON-928335823 tempest-TenantUsagesNegativeTestJSON-928335823-project] Calling method '.version_select at 0x7f671596d040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:02.918232 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:02.918232 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:02.919340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0aa9c760-9d29-4f02-ad93-9758fdde4d9b tempest-TenantUsagesNegativeTestJSON-928335823 tempest-TenantUsagesNegativeTestJSON-928335823-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fe9d728c2c4f40bca46424540207310a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533480f72a304a22ad7498621fc8010f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:02.920007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0aa9c760-9d29-4f02-ad93-9758fdde4d9b tempest-TenantUsagesNegativeTestJSON-928335823 tempest-TenantUsagesNegativeTestJSON-928335823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:02.920905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0aa9c760-9d29-4f02-ad93-9758fdde4d9b tempest-TenantUsagesNegativeTestJSON-928335823 tempest-TenantUsagesNegativeTestJSON-928335823-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-05T20%3A47%3A58.223779&end=2021-11-07T20%3A47%3A58.223779&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.112681 Nov 06 20:48:02.921428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 235/528] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Nov 6 20:48:02 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-05T20%3A47%3A58.223779&end=2021-11-07T20%3A47%3A58.223779&detailed=1 => generated 123 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:02.929021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:02.929760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:02.936188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:02.937030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:02.938041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:02.938691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.004855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:03.026349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a9f1ee0-2473-4bfe-a762-4cadb9aef7b5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1275 microversion: 2.1 time: 0.102765 Nov 06 20:48:03.027536 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 236/529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:02 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:03.032755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:03.033569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:03.039766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.040803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.041942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.042612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.054245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:03.062448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e000837d-e61a-4e83-8fb5-e84a360e8499 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1320 microversion: 2.1 time: 0.213161 Nov 06 20:48:03.065405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 294/530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:02 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:03.071906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:03.073902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:03.082207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.083185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.084356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.085093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.138727 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48157479-118e-4aa1-81a4-6802214ead41 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.072052 Nov 06 20:48:03.144080 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 295/531] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:03 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:03.163631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74896db9-4694-47bc-bbf4-90d89b6dedbc tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Action: 'create', calling method: .version_select at 0x7f671591baf0>, body: {"pool": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:03.403448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:03.411378 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ea2a07e-3464-40c2-9561-450e978c0f6a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1317 microversion: 2.1 time: 0.382471 Nov 06 20:48:03.418224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 237/532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:03 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:03.423357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0b82082-39d4-4fd2-950c-fa85b5904dc6 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715956700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1388672138", "description": "tempest-description-82172939"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:03.885302 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0b82082-39d4-4fd2-950c-fa85b5904dc6 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.465883 Nov 06 20:48:03.886087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 238/533] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:03 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:03.893397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:03.894176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:03.902447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.903752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:03.905401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:03.905996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:04.365238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:04.372781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2948979-4683-4ccb-96fd-982055997908 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1318 microversion: 2.1 time: 0.485226 Nov 06 20:48:04.373972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 239/534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:03 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:04.378608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b05ed516-3db7-4e58-b673-f19a73ac4f65 req-50e52191-175c-4aae-bf2d-94f62c985a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d510789-3888-4dfa-a372-e034f2162082", "name": "network-vif-plugged", "status": "completed", "tag": "4430c80b-9df8-41de-afcd-6cd98ae2452c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:04.383225 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:04.383225 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:04.394953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b05ed516-3db7-4e58-b673-f19a73ac4f65 req-50e52191-175c-4aae-bf2d-94f62c985a2b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:04.395309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b05ed516-3db7-4e58-b673-f19a73ac4f65 req-50e52191-175c-4aae-bf2d-94f62c985a2b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:04.407161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b05ed516-3db7-4e58-b673-f19a73ac4f65 req-50e52191-175c-4aae-bf2d-94f62c985a2b service nova] Creating event network-vif-plugged:4430c80b-9df8-41de-afcd-6cd98ae2452c for instance 3d510789-3888-4dfa-a372-e034f2162082 on nch2-master-1 Nov 06 20:48:04.412867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b05ed516-3db7-4e58-b673-f19a73ac4f65 req-50e52191-175c-4aae-bf2d-94f62c985a2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 Nov 06 20:48:04.413508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 240/535] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:04.426204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94fe03b5-511c-43e9-9009-7c9a0c7b1952 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f67159c0280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-291418563", "description": "tempest-description-1213723590"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:04.962739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94fe03b5-511c-43e9-9009-7c9a0c7b1952 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.547755 Nov 06 20:48:04.964372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 241/536] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:04 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:04.971440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:04.972407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:04.981178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:04.981854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:04.982916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:04.983645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:05.613189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:05.621283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9387497-3465-49dc-8306-4cf94284b66b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.655705 Nov 06 20:48:05.621909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 242/537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:04 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:05.627613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:05.629033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:05.635061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:05.635510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:05.636322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:05.636794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.023291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:06.079127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ad38971-38b4-4c4e-a530-bb1f6c792efb tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1320 microversion: 2.1 time: 0.447963 Nov 06 20:48:06.080809 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 243/538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:05 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:06.099982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:06.108183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:06.125955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.126413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.128061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.129015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.176939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f74917f-e292-4fb0-a4ff-a1e4b602ec8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.091439 Nov 06 20:48:06.178931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 244/539] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:06 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:06.196872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:06.200516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:06.219844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.220514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.221468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.222088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.582504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74896db9-4694-47bc-bbf4-90d89b6dedbc tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.436763 Nov 06 20:48:06.583102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 296/540] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:48:03 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:06.588195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:06.596081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d557d575-748d-4651-8248-0560caa851c4 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715a31dc0>, body: {"security_group_rule": {"parent_group_id": "518c9d84-9425-491f-9511-7743b4311145", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "fd6c91be-587c-43e8-b773-4d8c31d13fba"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:06.600649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7e68896-559f-43db-b55c-b92dad75b20f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1317 microversion: 2.1 time: 0.420220 Nov 06 20:48:06.601441 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 245/541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:06 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:06.607633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-42c5010f-f695-4de9-9f91-32ee5e1b3ab9 req-419dd586-d281-4e55-87c6-b4c6c24b1c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5b22e4-35d2-4939-98cb-aa65cd77afbc", "tag": "a735dd25-7d8c-46d8-89ad-ff913abce138"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:06.609222 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:06.609222 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:06.617287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42c5010f-f695-4de9-9f91-32ee5e1b3ab9 req-419dd586-d281-4e55-87c6-b4c6c24b1c39 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.617922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42c5010f-f695-4de9-9f91-32ee5e1b3ab9 req-419dd586-d281-4e55-87c6-b4c6c24b1c39 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.628797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-42c5010f-f695-4de9-9f91-32ee5e1b3ab9 req-419dd586-d281-4e55-87c6-b4c6c24b1c39 service nova] Creating event network-changed:a735dd25-7d8c-46d8-89ad-ff913abce138 for instance 8b5b22e4-35d2-4939-98cb-aa65cd77afbc on nch1-master-1 Nov 06 20:48:06.635726 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-42c5010f-f695-4de9-9f91-32ee5e1b3ab9 req-419dd586-d281-4e55-87c6-b4c6c24b1c39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Nov 06 20:48:06.636747 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 246/542] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:06.642940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:06.643634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:06.660738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.661318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.662194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:06.662948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:06.982172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:06.991553 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fbe8f5e3-2f35-4a84-a231-5b2043a4e64d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1318 microversion: 2.1 time: 0.353426 Nov 06 20:48:06.992465 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 247/543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:06 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:06.999822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6a328aeb-1146-4b5b-87a3-90984ee1d1e3 req-5226d18f-fb7b-4c7c-9c02-dd6965a0067e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:07.001995 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:07.001995 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:07.010207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a328aeb-1146-4b5b-87a3-90984ee1d1e3 req-5226d18f-fb7b-4c7c-9c02-dd6965a0067e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.010916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a328aeb-1146-4b5b-87a3-90984ee1d1e3 req-5226d18f-fb7b-4c7c-9c02-dd6965a0067e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.022989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6a328aeb-1146-4b5b-87a3-90984ee1d1e3 req-5226d18f-fb7b-4c7c-9c02-dd6965a0067e service nova] Creating event network-changed:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:48:07.028439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6a328aeb-1146-4b5b-87a3-90984ee1d1e3 req-5226d18f-fb7b-4c7c-9c02-dd6965a0067e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034423 Nov 06 20:48:07.029666 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 248/544] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:07.034864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87956c1e-271a-49b4-a39a-959efa420733 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f6715adb160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:07.500725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87956c1e-271a-49b4-a39a-959efa420733 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/1cd5e81f-5a6f-421a-bed4-3ea037b05ca1" status: 200 len: 142 microversion: 2.1 time: 0.468884 Nov 06 20:48:07.517031 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 249/545] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:48:07 2021] GET /compute/v2.1/os-floating-ips/1cd5e81f-5a6f-421a-bed4-3ea037b05ca1 => generated 142 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:07.523756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:07.530331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d557d575-748d-4651-8248-0560caa851c4 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.945846 Nov 06 20:48:07.530822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:07.531602 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 297/546] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:06 2021] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:07.536054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:07.536984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:07.545002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.546132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.547119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.547625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.547757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.548355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.549157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.549596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.905627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:07.912024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:07.914471 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d41377e-9f72-4749-a5ac-ff68ec9a52d5 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1470 microversion: 2.1 time: 0.381557 Nov 06 20:48:07.918813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 298/547] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:07 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:07.921703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:07.922761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:07.928804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.929531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.930506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.931123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.932115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b265c12-583f-44cb-9e75-d124e57623c0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.411884 Nov 06 20:48:07.932728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 250/548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:07 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:07.937245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-60333477-636f-4354-8491-a4eb299bc2fb req-f06631df-9c35-4bce-9229-aadc727aa1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a6a890-f3f4-4404-9605-4ed65f87e384", "name": "network-vif-plugged", "status": "completed", "tag": "3a09f6cc-b34c-4184-8c37-b32dc96fa02a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:07.939271 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:07.939271 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:07.946820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60333477-636f-4354-8491-a4eb299bc2fb req-f06631df-9c35-4bce-9229-aadc727aa1bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:07.947588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60333477-636f-4354-8491-a4eb299bc2fb req-f06631df-9c35-4bce-9229-aadc727aa1bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:07.961919 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-60333477-636f-4354-8491-a4eb299bc2fb req-f06631df-9c35-4bce-9229-aadc727aa1bb service nova] Creating event network-vif-plugged:3a09f6cc-b34c-4184-8c37-b32dc96fa02a for instance 74a6a890-f3f4-4404-9605-4ed65f87e384 on nch2-master-1 Nov 06 20:48:07.968827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-60333477-636f-4354-8491-a4eb299bc2fb req-f06631df-9c35-4bce-9229-aadc727aa1bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Nov 06 20:48:07.969931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 251/549] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:07.986243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b85d479-ca06-4aef-b9f5-10f1d83ab1b0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.068252 Nov 06 20:48:07.987493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 299/550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:07 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:07.993119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7b31c71-ea93-4a6a-8f25-2326564c4f2b tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f671591b700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-905814020", "description": "tempest-description-1030281549"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:07.995074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22a3020a-7dab-404f-b0ae-ec12c8eabb3c tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f67158ab0d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:08.893539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7b31c71-ea93-4a6a-8f25-2326564c4f2b tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.904147 Nov 06 20:48:08.894707 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 300/551] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:07 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:08.899890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:08.901033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:08.908566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:08.910008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:08.910807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:08.911244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.211931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:09.219997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2a027f4-f87b-43be-9f26-08d7ea89eac4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1317 microversion: 2.1 time: 0.323905 Nov 06 20:48:09.220968 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 301/552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:08 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:09.225651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:09.226845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:09.234101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.234802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.235801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.236246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.343734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19b1535c-113d-470e-b0ed-ead921239c21 tempest-DeleteServersAdminTestJSON-924419547 tempest-DeleteServersAdminTestJSON-924419547-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082/action" status: 202 len: 0 microversion: 2.1 time: 0.121384 Nov 06 20:48:09.345653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 302/553] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:09 2021] POST /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:09.353060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:09.353969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:09.362798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.363481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.364495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.365079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.774172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:09.783060 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3db4309-3fe1-404c-bf84-b97f57207672 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1318 microversion: 2.1 time: 0.436222 Nov 06 20:48:09.783922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 303/554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:09 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:09.788657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-444cdcc2-915e-4d10-8567-e2af727a4a02 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f671591bca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-542289896", "description": "tempest-description-2146094126"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:09.936386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22a3020a-7dab-404f-b0ae-ec12c8eabb3c tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/1cd5e81f-5a6f-421a-bed4-3ea037b05ca1" status: 202 len: 0 microversion: 2.1 time: 1.964470 Nov 06 20:48:09.944111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 252/555] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:48:07 2021] DELETE /compute/v2.1/os-floating-ips/1cd5e81f-5a6f-421a-bed4-3ea037b05ca1 => generated 0 bytes in 1971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:09.952252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:09.953657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:09.964034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.964589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:09.966191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:09.966885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.220763 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-444cdcc2-915e-4d10-8567-e2af727a4a02 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.434804 Nov 06 20:48:10.221287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 304/556] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:09 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:10.227068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:10.228043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:10.235389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:10.236093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.237700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:10.238138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.291427 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3838ac98-8c4a-4ce8-91cf-761daa3ade3a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.069103 Nov 06 20:48:10.292276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 305/557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:10 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:10.297835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:10.298620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:10.305761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:10.306144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.306956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:10.307522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.346238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:10.346692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:10.347138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lazy-loading 'fault' on Instance uuid 3d510789-3888-4dfa-a372-e034f2162082 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:48:10.365063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:10.372134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d106d22b-d705-46c2-8bb4-638b210ce9ab tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.424978 Nov 06 20:48:10.373499 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 253/558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:09 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:10.386283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a35e9c9-66e8-4dd2-b5ba-9674a2a168ae tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f67159b9280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:10.933517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a35e9c9-66e8-4dd2-b5ba-9674a2a168ae tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.550687 Nov 06 20:48:10.934296 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 254/559] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Nov 6 20:48:10 2021] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:10.939534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-090186d8-de19-42e0-a768-451ca9d85bab tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715900700>, body: {"security_group_rule": {"parent_group_id": "c1783191-2f8e-400d-8966-cd26f61b17a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a6331fa8-3c62-493f-a87c-26b39a07fe28"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:10.991794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:10.999958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a77dda6-d85e-4b6e-ba0d-66a86790766c tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1453 microversion: 2.1 time: 0.706699 Nov 06 20:48:11.000555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 306/560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:10 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1453 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:11.005085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:11.005597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:11.011248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.011693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.012507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.012938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.357851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:11.365804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2aa42685-96b7-4e14-9aea-afeb0cb0b803 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1317 microversion: 2.1 time: 0.364249 Nov 06 20:48:11.366931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 307/561] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:11 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:11.380145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:11.381086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:11.391154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.392316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.393336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.394134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.516354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-090186d8-de19-42e0-a768-451ca9d85bab tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.581075 Nov 06 20:48:11.524190 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 255/562] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:10 2021] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:11.529918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9fabc707-a238-4806-a01e-2158cb692cec tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f6715956f70>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:11.765363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:11.772753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e25d0087-3bd3-4774-afb6-4525f13c8b48 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1468 microversion: 2.1 time: 0.404604 Nov 06 20:48:11.773324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 308/563] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:11 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:11.777543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:11.778032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:11.785765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.786304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.788000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.788318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.822054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:48:11.878352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9fabc707-a238-4806-a01e-2158cb692cec tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.351448 Nov 06 20:48:11.879888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 256/564] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:48:11 2021] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:11.885854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:11.887658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:11.905547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.906015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.906808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.907253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.917362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5767a5cc-a191-4610-b0fe-f7b7f6190e02 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 204 len: 0 microversion: 2.1 time: 0.141663 Nov 06 20:48:11.920438 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 309/565] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:11 2021] DELETE /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:48:11.926928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:11.927630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:11.935270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.936322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.938153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:11.938588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:11.965170 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c0e5499-df9b-479d-a440-3422d6aeff2b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.083663 Nov 06 20:48:11.967969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 257/566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:11 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:11.973622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10096094-e721-4818-a138-2f2859dda2e7 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715956dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:12.286771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:12.295762 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-211ad578-7eec-4e4b-9ab8-ceecdea8384d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.373542 Nov 06 20:48:12.305441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 310/567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:11 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:12.310028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-772d293d-2fd1-48ff-8be1-8c80d5c2ce49 req-d7745dd4-4057-4d5a-b5e5-21a17407f1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5b22e4-35d2-4939-98cb-aa65cd77afbc", "name": "network-vif-plugged", "status": "completed", "tag": "a735dd25-7d8c-46d8-89ad-ff913abce138"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:12.311608 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:12.311608 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:12.320097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-772d293d-2fd1-48ff-8be1-8c80d5c2ce49 req-d7745dd4-4057-4d5a-b5e5-21a17407f1d9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.320571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-772d293d-2fd1-48ff-8be1-8c80d5c2ce49 req-d7745dd4-4057-4d5a-b5e5-21a17407f1d9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.332278 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-772d293d-2fd1-48ff-8be1-8c80d5c2ce49 req-d7745dd4-4057-4d5a-b5e5-21a17407f1d9 service nova] Creating event network-vif-plugged:a735dd25-7d8c-46d8-89ad-ff913abce138 for instance 8b5b22e4-35d2-4939-98cb-aa65cd77afbc on nch1-master-1 Nov 06 20:48:12.337751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-772d293d-2fd1-48ff-8be1-8c80d5c2ce49 req-d7745dd4-4057-4d5a-b5e5-21a17407f1d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Nov 06 20:48:12.338654 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 311/568] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:12.551320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1528101896", "block_migration": true, "disk_over_commit": false}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:12.553739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:12.554395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10096094-e721-4818-a138-2f2859dda2e7 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a6331fa8-3c62-493f-a87c-26b39a07fe28" status: 202 len: 0 microversion: 2.1 time: 0.584630 Nov 06 20:48:12.558286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 258/569] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:11 2021] DELETE /compute/v2.1/os-security-groups/a6331fa8-3c62-493f-a87c-26b39a07fe28 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:12.561408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.562491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.563305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.564027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.564418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e01abeb-5b7d-431c-bb3b-c8674f977816 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f67158dc430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:12.638028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lazy-loading 'flavor' on Instance uuid 74a6a890-f3f4-4404-9605-4ed65f87e384 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:48:12.650715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Going to try to live migrate instance to tempest-host-1528101896 {{(pid=134827) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:48:12.659202 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] HTTP exception thrown: Compute host tempest-host-1528101896 could not be found. Nov 06 20:48:12.659805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Returning 400 to user: Compute host tempest-host-1528101896 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:12.660766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f099f140-240f-457b-9595-ef937132d755 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384/action" status: 400 len: 100 microversion: 2.1 time: 0.320991 Nov 06 20:48:12.661971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 312/570] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Nov 6 20:48:12 2021] POST /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384/action => generated 100 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:12.665970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:12.666987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:12.673082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.673532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.674312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.674775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.707888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:12.708635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:12.709084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lazy-loading 'fault' on Instance uuid 3d510789-3888-4dfa-a372-e034f2162082 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:48:13.286654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4c02e3d7ce4ef883dd4774ef64fcdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5634bafe48248a4af8fa00164acddd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:13.295563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4525b7ee-de5d-4be1-83f7-8a2d87b030b2 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 200 len: 1459 microversion: 2.1 time: 0.632751 Nov 06 20:48:13.305320 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 313/571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:12 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 1459 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:13.305320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:13.305320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:13.309721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:13.310185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:13.312632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:13.313008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:13.666049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:13.674899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35dbdac3-15aa-4010-ad0c-2a71025f86a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1317 microversion: 2.1 time: 0.377417 Nov 06 20:48:13.675486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 314/572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:13 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:13.684893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-029e59eb-c1a4-472f-963d-aff871731105 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715b47c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:13.898254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-029e59eb-c1a4-472f-963d-aff871731105 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/c1783191-2f8e-400d-8966-cd26f61b17a7" status: 200 len: 247 microversion: 2.1 time: 0.216870 Nov 06 20:48:13.899047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 315/573] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:48:13 2021] GET /compute/v2.1/os-security-groups/c1783191-2f8e-400d-8966-cd26f61b17a7 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:13.904252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:13.905338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:13.916873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:13.917512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:13.918464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:13.919050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.379645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:14.394019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ebbb9db-feec-4c2d-8b0b-0c406e0f1eb9 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1468 microversion: 2.1 time: 0.492953 Nov 06 20:48:14.395341 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 316/574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:13 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1468 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:14.408961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:14.410393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:14.435898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.436280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.437183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.437624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.494504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22e772e2-05b4-4087-992b-34baecead287 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.097011 Nov 06 20:48:14.497256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 317/575] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:14 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:14.503027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e01abeb-5b7d-431c-bb3b-c8674f977816 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7673ffb9-ecf2-4e82-a530-87c302dbf75a" status: 202 len: 0 microversion: 2.1 time: 1.943467 Nov 06 20:48:14.504141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 259/576] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:48:12 2021] DELETE /compute/v2.1/os-floating-ips/7673ffb9-ecf2-4e82-a530-87c302dbf75a => generated 0 bytes in 1945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:14.508935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:14.509146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3e3bc92-ab0f-41e4-9492-dce381005d62 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715956ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-967298834", "description": "tempest-description-1377708136"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:14.509648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:14.516224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.519368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.520213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.520686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.845871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:14.854472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee3a78e0-adad-4abd-993f-c14c9a5b9844 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.355814 Nov 06 20:48:14.869935 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 318/577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:14 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:14.881208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:14.882232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:14.887936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.888900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.889938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.890535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.907518 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. Nov 06 20:48:14.908387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:14.910418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4da86f6a-dbaf-4670-8776-6b81105f10a7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 404 len: 111 microversion: 2.1 time: 0.038441 Nov 06 20:48:14.911349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 319/578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:14 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:14.916887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4a82814d-d5e0-4c92-a25c-8675a1b3815e req-51074e70-0956-4f2c-9951-7404af4fc743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d510789-3888-4dfa-a372-e034f2162082", "name": "network-vif-deleted", "tag": "4430c80b-9df8-41de-afcd-6cd98ae2452c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:14.919096 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:14.919096 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:14.931803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4a82814d-d5e0-4c92-a25c-8675a1b3815e req-51074e70-0956-4f2c-9951-7404af4fc743 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.932505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4a82814d-d5e0-4c92-a25c-8675a1b3815e req-51074e70-0956-4f2c-9951-7404af4fc743 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.934021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3e3bc92-ab0f-41e4-9492-dce381005d62 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.428638 Nov 06 20:48:14.934986 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 260/579] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:14 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:14.945890 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4a82814d-d5e0-4c92-a25c-8675a1b3815e req-51074e70-0956-4f2c-9951-7404af4fc743 service nova] Creating event network-vif-deleted:4430c80b-9df8-41de-afcd-6cd98ae2452c for instance 3d510789-3888-4dfa-a372-e034f2162082 on nch2-master-1 Nov 06 20:48:14.948186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-de1bbcc9-5c49-4088-a465-15e4324c0312 req-774b744d-9e54-4217-b701-f98121d6c95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-plugged", "status": "completed", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:14.950014 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:14.950014 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:14.953480 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4a82814d-d5e0-4c92-a25c-8675a1b3815e req-51074e70-0956-4f2c-9951-7404af4fc743 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040596 Nov 06 20:48:14.955564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 320/580] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:14.961638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd93667c-517c-4b4e-8f0f-a92e23477dce tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f6715ab43a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:14.963510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-de1bbcc9-5c49-4088-a465-15e4324c0312 req-774b744d-9e54-4217-b701-f98121d6c95f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:14.963978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-de1bbcc9-5c49-4088-a465-15e4324c0312 req-774b744d-9e54-4217-b701-f98121d6c95f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:14.979056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-de1bbcc9-5c49-4088-a465-15e4324c0312 req-774b744d-9e54-4217-b701-f98121d6c95f service nova] Creating event network-vif-plugged:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:48:14.985184 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-de1bbcc9-5c49-4088-a465-15e4324c0312 req-774b744d-9e54-4217-b701-f98121d6c95f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048462 Nov 06 20:48:14.985788 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 261/581] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:14.990863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-982290285", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:15.063248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:15.758050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:15.759388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:15.760075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:15.760854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:15.763026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:15.783874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:15.784978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:15.786477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:15.787407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:15.816269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Getting quotas for project 5034d2c321a9410cbfd113598b06173f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:15.821103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Getting quotas for user e4c5b072659a43db91bcb4e99998d60c and project 5034d2c321a9410cbfd113598b06173f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:15.837025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:15.840963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:15.912387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3f0028f-231a-44e3-8bcb-5cda6c7d912d tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925206 Nov 06 20:48:15.914175 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 262/582] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:15.923240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:15.924237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:15.942045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:15.942739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:15.943786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:15.944463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.357994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:16.367275 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f6fc5d5-08c0-4bfa-bba2-19b3514ef35f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1466 microversion: 2.1 time: 0.451251 Nov 06 20:48:16.368041 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 263/583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:15 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1466 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:16.373865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:16.374362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:16.399931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.402070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.405975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.405975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.440832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd93667c-517c-4b4e-8f0f-a92e23477dce tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/d67a5061-01ce-46eb-8db1-aab618d483ae" status: 202 len: 0 microversion: 2.1 time: 1.483815 Nov 06 20:48:16.441433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 321/584] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:48:14 2021] DELETE /compute/v2.1/os-floating-ips/d67a5061-01ce-46eb-8db1-aab618d483ae => generated 0 bytes in 1485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:16.442305 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. Nov 06 20:48:16.442907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:16.443737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6af5688-7a77-4730-add8-ac6f13d33ef7 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 404 len: 111 microversion: 2.1 time: 0.074680 Nov 06 20:48:16.444839 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 264/585] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:16 2021] DELETE /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:16.449604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:16.449750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccff6762-1488-4b26-946c-cfc7c5cb1eec tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f67157e20d0>, body: {"security_group_rule": {"parent_group_id": "53d34aee-f5b8-463b-bffc-e687ca4b3b3b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:16.450153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:16.456156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.456639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.458296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.458743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.515372 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8ada266-259e-48fb-bee2-ad47047b7c8f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.069292 Nov 06 20:48:16.516700 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 265/586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:16 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:16.528096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:16.529621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:16.552147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.553232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.554543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.555215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.769894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccff6762-1488-4b26-946c-cfc7c5cb1eec tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.326945 Nov 06 20:48:16.771623 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 322/587] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:16 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:16.776631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:16.777871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:16.811876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.812358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.817729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:16.818715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:16.849393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:16.857839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6107dd58-cc1a-4d21-9ab4-05ae535899b2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1317 microversion: 2.1 time: 0.339348 Nov 06 20:48:16.858418 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 266/588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:16 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:16.989521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:17.005237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1ad2906-3ab5-4403-851f-9c42a5f652f8 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1270 microversion: 2.1 time: 0.232157 Nov 06 20:48:17.006002 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 323/589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:16 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:17.050746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-40904273", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "70df8f7c-e170-4849-829e-02a0385fa7a0"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:17.138089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] validate_networks() for [('70df8f7c-e170-4849-829e-02a0385fa7a0', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:17.244185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:17.244838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:17.251250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:17.251705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:17.252544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:17.252985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:17.965622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4574c88b-2434-44f7-826d-39593e94512c tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1617 microversion: 2.1 time: 0.957110 Nov 06 20:48:17.967696 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 324/590] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:17 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1617 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:17.975931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-361013c1-8867-4c29-a7bc-6b7c1e3d7fb3 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] Calling method '.version_select at 0x7f671591b940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:18.309608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:18.311466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:18.311968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:18.312436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:18.312853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:18.329231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:18.329931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:18.330933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:18.334641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:18.360930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Getting quotas for project e7a2501529c1496e839dda964a1d9f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:18.365348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Getting quotas for user 865f95e00cdd4725a1edba328836388f and project e7a2501529c1496e839dda964a1d9f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:18.378400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:18.381194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:18.437115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63b6193b-91ed-4d87-ae90-496cb4d69a6b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577632 Nov 06 20:48:18.440233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 267/591] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:18.445558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:18.446710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 3d510789-3888-4dfa-a372-e034f2162082] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:18.460231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:18.461470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:18.462492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:18.463181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:18.488542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. Nov 06 20:48:18.489166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 3d510789-3888-4dfa-a372-e034f2162082 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:18.490424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-080edfc7-3463-417d-903d-70ff289e20f4 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082" status: 404 len: 111 microversion: 2.1 time: 0.048380 Nov 06 20:48:18.493811 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 268/592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:18 2021] GET /compute/v2.1/servers/3d510789-3888-4dfa-a372-e034f2162082 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:18.505459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8af9c21f-8ca3-4fb3-8907-e9d26fc4c5e2 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Action: 'create', calling method: .version_select at 0x7f6715956b80>, body: {"security_group_rule": {"parent_group_id": "53d34aee-f5b8-463b-bffc-e687ca4b3b3b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:19.269754 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8af9c21f-8ca3-4fb3-8907-e9d26fc4c5e2 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.774765 Nov 06 20:48:19.271049 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 269/593] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:18 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:19.279163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:19.281801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:19.290192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.290912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.292130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.293059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.386462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c619aec-70bd-4ae6-84c8-4046235bad8d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.112864 Nov 06 20:48:19.393916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 270/594] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:19 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:19.412625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:19.417510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:19.431584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.435736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.437325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.439548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.819025 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-361013c1-8867-4c29-a7bc-6b7c1e3d7fb3 tempest-FloatingIPDetailsTestJSON-1214108657 tempest-FloatingIPDetailsTestJSON-1214108657-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/71312e66-99ec-41fd-ae55-c5c22ef12ef4" status: 202 len: 0 microversion: 2.1 time: 1.849509 Nov 06 20:48:19.820057 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 325/595] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:48:17 2021] DELETE /compute/v2.1/os-floating-ips/71312e66-99ec-41fd-ae55-c5c22ef12ef4 => generated 0 bytes in 1852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:19.827677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: .version_select at 0x7f6715900dc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1673060834", "policies": ["affinity"]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:19.862225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:19.869188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:19.907390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:19.921483 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4444ab7c-2896-4329-8c57-5d88263504ae tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1467 microversion: 2.1 time: 0.523956 Nov 06 20:48:19.924609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 271/596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:19 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1467 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:19.930593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:19.931486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:19.938294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:19.939781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.941006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.941891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.943076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:19.943329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.957485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38fbaa9a-aa69-47c5-938e-5b131666436e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.135038 Nov 06 20:48:19.958727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 326/597] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Nov 6 20:48:19 2021] POST /compute/v2.1/os-server-groups => generated 188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:19.974072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:19.975823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:19.983388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.984090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:19.985221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:19.985661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.088963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:20.097867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4b1e3a5-27af-4e83-88d0-b1fccfd80bee tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1280 microversion: 2.1 time: 0.137844 Nov 06 20:48:20.098434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 327/598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:19 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:20.115400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:20.116054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:20.124268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.125362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.126559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.127189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.159428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. Nov 06 20:48:20.160331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:20.162792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b70793a-d981-4aa5-9dd8-82bb2ba8a7f0 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 404 len: 111 microversion: 2.1 time: 0.062042 Nov 06 20:48:20.164872 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 328/599] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:20 2021] DELETE /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:20.170037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7fb57bc-53f1-48c0-af63-d68dc5c7795d tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715b47820>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:20.274891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:20.284009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07ba4301-b648-4260-b5d6-f3655b9db7bd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.357634 Nov 06 20:48:20.284714 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 272/600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:19 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:20.289659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2f032579-6f3c-4955-8fe9-622b747321f8 req-64bab8ae-f07a-44f5-b1da-9f9888aaa327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa227b45-dcfe-4d1f-b286-7ad2e5008629", "tag": "465b7232-73a2-4392-8305-3e95d157ffbe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:20.291864 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:20.291864 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:20.298971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2f032579-6f3c-4955-8fe9-622b747321f8 req-64bab8ae-f07a-44f5-b1da-9f9888aaa327 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.299419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2f032579-6f3c-4955-8fe9-622b747321f8 req-64bab8ae-f07a-44f5-b1da-9f9888aaa327 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.308689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7fb57bc-53f1-48c0-af63-d68dc5c7795d tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/53d34aee-f5b8-463b-bffc-e687ca4b3b3b" status: 200 len: 664 microversion: 2.1 time: 0.142280 Nov 06 20:48:20.310592 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 329/601] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:48:20 2021] GET /compute/v2.1/os-security-groups/53d34aee-f5b8-463b-bffc-e687ca4b3b3b => generated 664 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:20.311692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2f032579-6f3c-4955-8fe9-622b747321f8 req-64bab8ae-f07a-44f5-b1da-9f9888aaa327 service nova] Creating event network-changed:465b7232-73a2-4392-8305-3e95d157ffbe for instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 on nch2-master-1 Nov 06 20:48:20.316128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-460452615", "metadata": {"image_type": "test"}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:20.317919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:20.319252 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2f032579-6f3c-4955-8fe9-622b747321f8 req-64bab8ae-f07a-44f5-b1da-9f9888aaa327 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031863 Nov 06 20:48:20.320967 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 273/602] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:20.326920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.327593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1977026624", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "580f7e6b-4796-4b73-95a4-ba911765cb63"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:20.327825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.328914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.329579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.379921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Getting quotas for project dd3507687d2944a88c2d5567473ec458. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:20.384561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Getting quotas for user a09f231ee24f4f798c0a5d6e84be4d8d and project dd3507687d2944a88c2d5567473ec458. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:20.393212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:20.665372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa86925b-e378-460c-8bd6-8794c81145a8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "POST /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec/action" status: 202 len: 0 microversion: 2.1 time: 0.352825 Nov 06 20:48:20.666353 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 330/603] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:20 2021] POST /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:48:20.672873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:20.673487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] [instance: 114dde74-d608-4edc-b28c-b83571a79bfe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:20.680689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.681172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.682085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:20.682592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:20.700937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] HTTP exception thrown: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. Nov 06 20:48:20.701639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] Returning 404 to user: Instance 114dde74-d608-4edc-b28c-b83571a79bfe could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:20.702555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ee27f15-8eb5-4796-8385-a43a1bca0b95 tempest-DeleteServersAdminTestJSON-1690716972 tempest-DeleteServersAdminTestJSON-1690716972-project] 10.222.0.13 "GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe" status: 404 len: 111 microversion: 2.1 time: 0.035278 Nov 06 20:48:20.704023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 331/604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:20 2021] GET /compute/v2.1/servers/114dde74-d608-4edc-b28c-b83571a79bfe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:20.708704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8f80a91-0a25-4978-8978-e8d8d103eb74 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f671586a160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:21.173555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:21.174209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:21.174682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:21.175515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:21.176427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:21.204500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.204929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.205922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.206606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.217343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8f80a91-0a25-4978-8978-e8d8d103eb74 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/7dea3b92-862c-4a84-aea7-e79ad36c2cf9" status: 202 len: 0 microversion: 2.1 time: 0.512761 Nov 06 20:48:21.218245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 332/605] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Nov 6 20:48:20 2021] DELETE /compute/v2.1/os-security-group-rules/7dea3b92-862c-4a84-aea7-e79ad36c2cf9 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:21.222842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:21.224006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:21.226134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:21.230330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:21.240035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.240522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.241498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.242087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.250615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 2 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:21.253697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:21.316041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75e5caeb-fd1a-4f4f-806a-8e4308ca3cf9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.095474 Nov 06 20:48:21.317808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 333/606] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:21 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:21.323327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97c06923-7186-4099-8c12-2f0f882c6464 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157d13a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:21.345892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=134828) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Nov 06 20:48:21.391709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97c06923-7186-4099-8c12-2f0f882c6464 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.072361 Nov 06 20:48:21.392307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 334/607] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:21 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:21.401981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:21.403068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:21.407401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:21.412451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.413210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.414434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.415347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.420722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:21.485229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:21.491887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:21.512603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:21.581732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:21.587450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:21.650269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:21.656372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:21.700432 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-644c7587-d8c0-4cd8-8651-3be098c21f61 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.377752 Nov 06 20:48:21.704271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 274/608] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:20 2021] POST /compute/v2.1/servers => generated 32 bytes in 1380 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 06 20:48:21.708485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8e7acd0-6000-4065-a832-82926bc6a992 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715a7dd30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:21.828953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:21.879003 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c1b6af8-1e2d-45a1-aebf-5454a8b1181b tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.445032 Nov 06 20:48:21.893127 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 335/609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:21 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:21.912546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:21.916865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:21.937071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.939004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:21.949080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:21.949925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.155682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8e7acd0-6000-4065-a832-82926bc6a992 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/53d34aee-f5b8-463b-bffc-e687ca4b3b3b" status: 202 len: 0 microversion: 2.1 time: 0.452911 Nov 06 20:48:22.159499 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 275/610] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:21 2021] DELETE /compute/v2.1/os-security-groups/53d34aee-f5b8-463b-bffc-e687ca4b3b3b => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:22.164068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:22.180984 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:22.180984 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:22.182231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:22.183643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Searching by: {'deleted': False, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:48:22.218619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.220733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.223920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.225328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.393406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:22.401189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9f941e2-a15f-47d8-94c2-5c236579bf80 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.506317 Nov 06 20:48:22.416818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 336/611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:21 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:22.427492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f67157dbd30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:22.464795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 20:48:22.468231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a6331fa8-3c62-493f-a87c-26b39a07fe28 does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:48:22.471007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Neutron security group a6331fa8-3c62-493f-a87c-26b39a07fe28 not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:48:22.471707 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] HTTP exception thrown: Security group a6331fa8-3c62-493f-a87c-26b39a07fe28 does not exist Nov 06 20:48:22.471707 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-c3cee36d-e43f-469f-b8b3-115fb3d124b4'] Nov 06 20:48:22.473943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Returning 404 to user: Security group a6331fa8-3c62-493f-a87c-26b39a07fe28 does not exist Nov 06 20:48:22.473943 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-c3cee36d-e43f-469f-b8b3-115fb3d124b4'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:22.484725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f965b8a2-6d50-4813-9f99-6a75bdc3e028 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a6331fa8-3c62-493f-a87c-26b39a07fe28" status: 404 len: 194 microversion: 2.1 time: 0.066185 Nov 06 20:48:22.485307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 337/612] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:22 2021] DELETE /compute/v2.1/os-security-groups/a6331fa8-3c62-493f-a87c-26b39a07fe28 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:22.501360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:22.504802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:22.533173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.534745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.550003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.550467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.660856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be185cac-3a65-4afd-a1fc-3d599a1c5df7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.168817 Nov 06 20:48:22.666450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 338/613] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:22 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:22.679765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85cc74bd-bc44-466c-9b8c-e121919d751f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157d1040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:22.702571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11db2fd4-d218-402d-b035-4d4736e97c8c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.541930 Nov 06 20:48:22.708565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 276/614] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 20:48:22 2021] GET /compute/v2.1/servers => generated 1004 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:22.708565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed61de35-a921-4131-9950-d7451a0e6ec1 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715c53f70>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:22.776925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85cc74bd-bc44-466c-9b8c-e121919d751f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.108290 Nov 06 20:48:22.779754 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 339/615] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:22 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:22.792680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-fbce7bc1-59dc-4e28-8245-908f12bc70d0 req-2eb8ed2b-9dae-4dc6-a0f1-38fed80e2f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:22.796658 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:22.796658 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:22.821596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-fbce7bc1-59dc-4e28-8245-908f12bc70d0 req-2eb8ed2b-9dae-4dc6-a0f1-38fed80e2f7c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.823095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-fbce7bc1-59dc-4e28-8245-908f12bc70d0 req-2eb8ed2b-9dae-4dc6-a0f1-38fed80e2f7c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.843620 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-fbce7bc1-59dc-4e28-8245-908f12bc70d0 req-2eb8ed2b-9dae-4dc6-a0f1-38fed80e2f7c service nova] Creating event network-changed:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:48:22.849872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-fbce7bc1-59dc-4e28-8245-908f12bc70d0 req-2eb8ed2b-9dae-4dc6-a0f1-38fed80e2f7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068530 Nov 06 20:48:22.851521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 340/616] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:22.859247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:22.861000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:22.908389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.910455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:22.911536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:22.914439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:23.026994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:23.038391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f57dbaa-0c3a-4440-b82a-d1c29f53a8ad tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1215 microversion: 2.1 time: 0.185277 Nov 06 20:48:23.039581 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 341/617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:22 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:23.044988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:23.046021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:23.053955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:23.054409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:23.055422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:23.056323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:23.239513 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed61de35-a921-4131-9950-d7451a0e6ec1 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c1783191-2f8e-400d-8966-cd26f61b17a7" status: 202 len: 0 microversion: 2.1 time: 0.534607 Nov 06 20:48:23.247134 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 277/618] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:22 2021] DELETE /compute/v2.1/os-security-groups/c1783191-2f8e-400d-8966-cd26f61b17a7 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:23.252780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c07b4a84-3031-4202-9d7b-e0b5c18cec91 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715900b80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:23.438083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:23.446101 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce755c9d-aa99-4d34-ba90-e3b885fb12ac tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.405006 Nov 06 20:48:23.451379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 342/619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:23 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:23.463329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:23.464320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:23.483006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:23.483464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:23.496113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:23.498652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:23.979047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:23.990494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a3539a1-f207-4038-acd4-d51fd503d798 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.536766 Nov 06 20:48:23.991186 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 343/620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:23 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:24.006931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:24.008710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:24.017437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.017873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.018964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.019553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.071681 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7332a24-67be-4671-be54-575a7f9ce721 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.068903 Nov 06 20:48:24.080944 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 344/621] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:24 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:24.089006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4672adc-b8c6-476f-9c47-a380aa4091b6 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157d1ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:24.160510 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4672adc-b8c6-476f-9c47-a380aa4091b6 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.078125 Nov 06 20:48:24.161318 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 345/622] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:24 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:24.168014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:24.169454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:24.177924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.178606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.179775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.180411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.342441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c07b4a84-3031-4202-9d7b-e0b5c18cec91 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/fd6c91be-587c-43e8-b773-4d8c31d13fba" status: 202 len: 0 microversion: 2.1 time: 1.093544 Nov 06 20:48:24.343397 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 278/623] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:23 2021] DELETE /compute/v2.1/os-security-groups/fd6c91be-587c-43e8-b773-4d8c31d13fba => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:24.366273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67ec5a0f-72e2-4b75-aeb8-25ddaca0446e tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715a09820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:24.403918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:24.411466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df8864a1-ef4a-4eb0-98bf-e02337cae1a1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1279 microversion: 2.1 time: 0.248274 Nov 06 20:48:24.412040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 346/624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:24 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:24.472276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:24.473706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:24.487377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.488860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.489887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:24.490621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:24.972379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:24.980617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-937d0b38-5a25-4bcd-ab62-18f24e6c8498 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.516763 Nov 06 20:48:24.981276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 347/625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:24 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:25.008577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:25.009469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:25.016257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:25.017139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:25.018336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:25.018952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:25.166545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67ec5a0f-72e2-4b75-aeb8-25ddaca0446e tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/518c9d84-9425-491f-9511-7743b4311145" status: 202 len: 0 microversion: 2.1 time: 0.812507 Nov 06 20:48:25.169266 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 279/626] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:24 2021] DELETE /compute/v2.1/os-security-groups/518c9d84-9425-491f-9511-7743b4311145 => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:25.175281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:25.176242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:25.187438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:25.187894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:25.188737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:25.189177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:25.274631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05301399-c4c2-477b-b1f7-a8455e43c4a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 24574 microversion: 2.1 time: 0.103501 Nov 06 20:48:25.275715 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 280/627] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:25 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 24574 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:25.283606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17ad185b-35ee-4acc-bab3-db89f116471b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67159b9e50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:25.358355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17ad185b-35ee-4acc-bab3-db89f116471b tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.080439 Nov 06 20:48:25.360655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 281/628] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:25 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:25.367749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-750e0548-5f45-46b9-adea-c64ea4361d6d tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f6715adbee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:25.943058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:25.964739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c52120b6-429c-495a-87e9-eb95ab033fc1 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.959207 Nov 06 20:48:25.975514 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 348/629] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:25 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:25.987558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:25.989354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:26.004138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.004743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.005579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.005994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.111314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:26.119073 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a11872a-01bd-427b-a498-7dbb98309607 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1277 microversion: 2.1 time: 0.141765 Nov 06 20:48:26.119645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 349/630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:25 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:26.308768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-750e0548-5f45-46b9-adea-c64ea4361d6d tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/1aa177fe-eee2-41c4-8abf-95669caad244" status: 202 len: 0 microversion: 2.1 time: 0.946812 Nov 06 20:48:26.312542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 282/631] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:25 2021] DELETE /compute/v2.1/os-security-groups/1aa177fe-eee2-41c4-8abf-95669caad244 => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:26.319568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:26.320315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:26.335308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.335843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.336681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.337116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.338405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33e2f20d-96e0-4084-ac22-5c39f773298c tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-491117084", "ram": 512, "vcpus": 1, "disk": 10, "id": 951028839, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:26.340519 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:26.340519 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:26.375729 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33e2f20d-96e0-4084-ac22-5c39f773298c tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.254821 Nov 06 20:48:26.380698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 350/632] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:26 2021] POST /compute/v2.1/flavors => generated 412 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:26.387688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:26.388757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:26.401723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.402182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.403257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:26.404288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:26.498013 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b14c875-bd93-4421-b354-455d4bf449ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.115239 Nov 06 20:48:26.499287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 351/633] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:26 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:26.505720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ccc05ed-4c9b-4a4f-a9bc-4455e11b94e1 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] Calling method '.version_select at 0x7f67157bfe50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:26.864537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:26.870618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd2b3cd3-50b4-472f-bc12-77695e2573b5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.556165 Nov 06 20:48:26.875078 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 283/634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:26 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:26.879817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22238c72-8a94-4510-a0eb-9fb00d93824f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67159b9dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:26.948763 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22238c72-8a94-4510-a0eb-9fb00d93824f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.072330 Nov 06 20:48:26.949846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 284/635] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:26 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:26.954778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98876fe6-0318-45b5-99b1-c689b800a4fa tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:26.956176 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:26.956176 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:27.014532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98876fe6-0318-45b5-99b1-c689b800a4fa tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063015 Nov 06 20:48:27.015304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 285/636] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:48:26 2021] POST /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:27.030239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:27.037096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:27.044332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ccc05ed-4c9b-4a4f-a9bc-4455e11b94e1 tempest-SecurityGroupRulesTestJSON-1022299764 tempest-SecurityGroupRulesTestJSON-1022299764-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/efd14d4a-7c87-4f6b-bda5-5f3967679d83" status: 202 len: 0 microversion: 2.1 time: 0.543255 Nov 06 20:48:27.045340 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 352/637] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:26 2021] DELETE /compute/v2.1/os-security-groups/efd14d4a-7c87-4f6b-bda5-5f3967679d83 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:27.062287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.062981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.063972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.064612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.384952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fdff45f-1d85-401e-96d4-51faf2f5002f tempest-FlavorsExtraSpecsTestJSON-19378103 tempest-FlavorsExtraSpecsTestJSON-19378103-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:27.407108 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fdff45f-1d85-401e-96d4-51faf2f5002f tempest-FlavorsExtraSpecsTestJSON-19378103 tempest-FlavorsExtraSpecsTestJSON-19378103-project] 10.222.0.13 "GET /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.360665 Nov 06 20:48:27.411537 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 353/638] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Nov 6 20:48:27 2021] GET /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:27.424441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:27.425197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:27.445365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.445840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.446663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.452026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.753891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:27.762135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b45725c8-e063-415a-9a50-f05a97d7c1a3 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.740752 Nov 06 20:48:27.772641 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 286/639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:27 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:27.777656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4963ba5a-7684-404c-81ba-20d84de13c3f tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:27.779725 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:27.779725 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:27.830105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4963ba5a-7684-404c-81ba-20d84de13c3f tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054871 Nov 06 20:48:27.837552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 287/640] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:48:27 2021] POST /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:27.852321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:27.853663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:27.870210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.871391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.872494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:27.873143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:27.937853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27e2a500-d3b5-470f-811a-b540e092bbd8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.098659 Nov 06 20:48:27.939192 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 288/641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:27 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:27.944418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27d5c79e-b5ea-4353-ad4f-8248f7f0fbd9 tempest-FlavorsExtraSpecsTestJSON-19378103 tempest-FlavorsExtraSpecsTestJSON-19378103-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:27.986808 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27d5c79e-b5ea-4353-ad4f-8248f7f0fbd9 tempest-FlavorsExtraSpecsTestJSON-19378103 tempest-FlavorsExtraSpecsTestJSON-19378103-project] 10.222.0.13 "GET /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046108 Nov 06 20:48:27.993783 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 289/642] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 20:48:27 2021] GET /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:27.995131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.006442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:28.023610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.024631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.025513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.025878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.143045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:28.151860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4cabc63-b981-44e0-a3c4-a8e7da98a350 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.739044 Nov 06 20:48:28.164756 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 354/643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:27 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:28.170665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4d84eb9-cba6-4821-90ed-e2cf75e287d4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157bf700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.260504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4d84eb9-cba6-4821-90ed-e2cf75e287d4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.094081 Nov 06 20:48:28.261656 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 355/644] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:28.266906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ea7b8b7-6977-42a5-86ff-469e7fef28da tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:28.274147 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.274147 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.316225 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ea7b8b7-6977-42a5-86ff-469e7fef28da tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053233 Nov 06 20:48:28.316845 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 356/645] 10.222.0.13 () {60 vars in 1220 bytes} [Sat Nov 6 20:48:28 2021] POST /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:28.325961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c275c83-ac48-4d28-bdcc-8f4d5d8f3e65 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.334817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c275c83-ac48-4d28-bdcc-8f4d5d8f3e65 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012732 Nov 06 20:48:28.339792 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 357/646] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:48:28.345642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7de8a07e-52ee-4cb4-9840-651ecc8e1912 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:28.351021 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.351021 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.402608 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7de8a07e-52ee-4cb4-9840-651ecc8e1912 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.061275 Nov 06 20:48:28.407875 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 358/647] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Nov 6 20:48:28 2021] PUT /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes => generated 22 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:28.413439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-cd4fbb33-d729-4c58-a9de-52f4376fc915 req-6e5bedd6-defc-46e2-994d-b6a84f8ed9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa227b45-dcfe-4d1f-b286-7ad2e5008629", "name": "network-vif-plugged", "status": "completed", "tag": "465b7232-73a2-4392-8305-3e95d157ffbe"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:28.415347 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.415347 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.426163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cd4fbb33-d729-4c58-a9de-52f4376fc915 req-6e5bedd6-defc-46e2-994d-b6a84f8ed9a7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.426985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cd4fbb33-d729-4c58-a9de-52f4376fc915 req-6e5bedd6-defc-46e2-994d-b6a84f8ed9a7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.454414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-cd4fbb33-d729-4c58-a9de-52f4376fc915 req-6e5bedd6-defc-46e2-994d-b6a84f8ed9a7 service nova] Creating event network-vif-plugged:465b7232-73a2-4392-8305-3e95d157ffbe for instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 on nch2-master-1 Nov 06 20:48:28.473929 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-cd4fbb33-d729-4c58-a9de-52f4376fc915 req-6e5bedd6-defc-46e2-994d-b6a84f8ed9a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063972 Nov 06 20:48:28.475362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 359/648] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:28.494079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90bb43ef-e7d9-4b7f-a749-8e4914dced04 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.532734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:28.537504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90bb43ef-e7d9-4b7f-a749-8e4914dced04 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058961 Nov 06 20:48:28.541297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fcfaa688-cfb4-45f8-8302-502154c64f48 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.550974 Nov 06 20:48:28.543419 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 360/649] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/flavors/951028839/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:28.546578 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 290/650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:27 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:28.563804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-318c5c75-971e-40b9-a8fb-9f8548074338 req-924d543b-7d9f-48ed-ab5f-a2f21bac751e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c", "tag": "b2d30164-6f5c-42b2-8599-18365256a9bc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:28.574424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebd835d5-af91-41f6-a933-130dc2643fd2 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.576711 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.576711 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:28.577607 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.577607 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.599518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-318c5c75-971e-40b9-a8fb-9f8548074338 req-924d543b-7d9f-48ed-ab5f-a2f21bac751e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.600108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-318c5c75-971e-40b9-a8fb-9f8548074338 req-924d543b-7d9f-48ed-ab5f-a2f21bac751e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.619592 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-318c5c75-971e-40b9-a8fb-9f8548074338 req-924d543b-7d9f-48ed-ab5f-a2f21bac751e service nova] Creating event network-changed:b2d30164-6f5c-42b2-8599-18365256a9bc for instance e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c on nch1-master-1 Nov 06 20:48:28.630342 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-318c5c75-971e-40b9-a8fb-9f8548074338 req-924d543b-7d9f-48ed-ab5f-a2f21bac751e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082170 Nov 06 20:48:28.631396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 361/651] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:28.673352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebd835d5-af91-41f6-a933-130dc2643fd2 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.124090 Nov 06 20:48:28.674186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 291/652] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:48:28 2021] DELETE /compute/v2.1/flavors/951028839/os-extra_specs/hw:numa_nodes => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:48:28.686271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4511a4d5-906e-41f4-a821-0a6711efa856 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.687462 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.687462 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.724479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4511a4d5-906e-41f4-a821-0a6711efa856 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/951028839/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.044667 Nov 06 20:48:28.727890 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 362/653] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:48:28 2021] DELETE /compute/v2.1/flavors/951028839/os-extra_specs/hw:cpu_policy => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 20:48:28.738062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab0949c8-1554-4aae-8ac4-833979725c1a tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.758694 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab0949c8-1554-4aae-8ac4-833979725c1a tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/951028839/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028412 Nov 06 20:48:28.765768 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 292/654] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/flavors/951028839/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:28.771742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1a76937-956e-4d7e-8922-afdeb943727a tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.772650 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.772650 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.799488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:28.800383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1a76937-956e-4d7e-8922-afdeb943727a tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/951028839" status: 202 len: 0 microversion: 2.1 time: 0.034079 Nov 06 20:48:28.801379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 363/655] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:48:28 2021] DELETE /compute/v2.1/flavors/951028839 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:48:28.811479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:28.829140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-398421bb-3f2b-4a69-ba11-ab0381f8e89b req-727b29a3-bcf3-426e-9c78-c7317105f41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a83ee6-c727-41e1-bd07-5b04fa793f3c", "tag": "bc2d32ba-7e3c-4416-a06d-11173ab3a5d6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:28.836355 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:28.836355 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:28.842304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.843082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.845517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.846168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.861769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-398421bb-3f2b-4a69-ba11-ab0381f8e89b req-727b29a3-bcf3-426e-9c78-c7317105f41c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:28.862947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-398421bb-3f2b-4a69-ba11-ab0381f8e89b req-727b29a3-bcf3-426e-9c78-c7317105f41c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:28.887548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-398421bb-3f2b-4a69-ba11-ab0381f8e89b req-727b29a3-bcf3-426e-9c78-c7317105f41c service nova] Creating event network-changed:bc2d32ba-7e3c-4416-a06d-11173ab3a5d6 for instance 55a83ee6-c727-41e1-bd07-5b04fa793f3c on nch1-master-1 Nov 06 20:48:28.906444 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-398421bb-3f2b-4a69-ba11-ab0381f8e89b req-727b29a3-bcf3-426e-9c78-c7317105f41c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092596 Nov 06 20:48:28.912572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 364/656] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:28.930872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba2bcc16-8e5d-494b-aecb-80f9732d8b77 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:29.001392 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba2bcc16-8e5d-494b-aecb-80f9732d8b77 tempest-FlavorsExtraSpecsTestJSON-565801730 tempest-FlavorsExtraSpecsTestJSON-565801730-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.086235 Nov 06 20:48:29.052821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 365/657] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:29.065024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:29.069576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:29.103245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.103702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.109306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.110947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.199111 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-67efb466-45f4-4001-8689-e937a362c939 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.134841 Nov 06 20:48:29.204741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 366/658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:29 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:29.210005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:29.210911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:29.228458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.229163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.230219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.230846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.538488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:29.547230 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-65291ba4-0dee-4681-9ae3-c7187db92c9f tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 0.759804 Nov 06 20:48:29.553993 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 293/659] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:28 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:48:29.563785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-339b52f9-879a-4354-970b-911c09f4406d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715750280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:29.630260 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-339b52f9-879a-4354-970b-911c09f4406d tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.075014 Nov 06 20:48:29.631406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 294/660] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:29 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:29.645811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:29.646650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:29.653920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.654643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.655600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:29.656187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:29.938352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:29.947020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5556e68-b058-4f1d-ac14-c129ac41e4d2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.740786 Nov 06 20:48:29.949681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 367/661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:29 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:30.222519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:30.224507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:30.237441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.239598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.240857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.241309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.254806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:30.268971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a734d27-aace-4867-9c0e-1022dd93f6a9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.636375 Nov 06 20:48:30.269552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 295/662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:29 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:30.328745 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f1bae28-5eb3-4b19-acd9-0d2481030597 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.107009 Nov 06 20:48:30.329833 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 368/663] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:30 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:30.541672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-617f4419-ef88-4fb8-b7e6-b4e1bf402039 req-ce64951e-2461-4537-86a1-d1c0e871bf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-plugged", "status": "completed", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:30.543829 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:30.543829 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:30.561183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-617f4419-ef88-4fb8-b7e6-b4e1bf402039 req-ce64951e-2461-4537-86a1-d1c0e871bf94 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.561974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-617f4419-ef88-4fb8-b7e6-b4e1bf402039 req-ce64951e-2461-4537-86a1-d1c0e871bf94 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.571389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:30.572496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:30.587592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-617f4419-ef88-4fb8-b7e6-b4e1bf402039 req-ce64951e-2461-4537-86a1-d1c0e871bf94 service nova] Creating event network-vif-plugged:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:48:30.592976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.593690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.593827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-617f4419-ef88-4fb8-b7e6-b4e1bf402039 req-ce64951e-2461-4537-86a1-d1c0e871bf94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057889 Nov 06 20:48:30.595024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.596496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.602619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 296/664] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:30.644153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b87dc5ce-06f0-4ba9-bd73-6c09e0ce53bd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671574c670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:30.743557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b87dc5ce-06f0-4ba9-bd73-6c09e0ce53bd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.102532 Nov 06 20:48:30.745461 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 297/665] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:30 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:30.968181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:30.969325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:30.979879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.980441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:30.989862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:30.990400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:31.602759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:31.622169 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba5cd6ad-3cfa-485a-b65b-4178addedb62 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1318 microversion: 2.1 time: 1.054935 Nov 06 20:48:31.633174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 369/666] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:30 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1318 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:48:31.644108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:31.645468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:31.661590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:31.677662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:31.681414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b302043b-429d-402a-8bcf-b4f3d2c7d7eb tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.717336 Nov 06 20:48:31.682160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:31.684724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 298/667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:30 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:31.692692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:31.692692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:31.704807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:31.706323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:31.729255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:31.735063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:31.736184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:31.744756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:31.819447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94da02a0-1eec-42ba-b19c-c10b56a5ad44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.132482 Nov 06 20:48:31.820577 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 299/668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:31 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:31.826664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7512af02-94b0-46af-9dad-c0b33e88d0f4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157965e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:31.903098 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7512af02-94b0-46af-9dad-c0b33e88d0f4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.081036 Nov 06 20:48:31.910166 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 300/669] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:31 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:32.149916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:32.158211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87b5de1b-4a8a-46d7-a656-d1dfb73eefd6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.523619 Nov 06 20:48:32.167922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 370/670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:31 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:32.625969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5d53ff92-4032-4f4e-9196-f93e9b2d254f req-5243a772-1b0d-47fe-8f1a-45062c9cc1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:32.628133 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:32.628133 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:32.639299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d53ff92-4032-4f4e-9196-f93e9b2d254f req-5243a772-1b0d-47fe-8f1a-45062c9cc1a6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:32.639665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:32.640386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:32.640828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d53ff92-4032-4f4e-9196-f93e9b2d254f req-5243a772-1b0d-47fe-8f1a-45062c9cc1a6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:32.655331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:32.655331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:32.658102 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5d53ff92-4032-4f4e-9196-f93e9b2d254f req-5243a772-1b0d-47fe-8f1a-45062c9cc1a6 service nova] Creating event network-vif-plugged:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:48:32.660045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:32.661768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:32.663910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5d53ff92-4032-4f4e-9196-f93e9b2d254f req-5243a772-1b0d-47fe-8f1a-45062c9cc1a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041556 Nov 06 20:48:32.665727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 301/671] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:32.703994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:32.713107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:32.756700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:32.757309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:32.759601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:32.761753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.132477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:33.140708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-845b7fd1-9c52-4371-8b4f-68a26f0d3fdf tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1467 microversion: 2.1 time: 0.505619 Nov 06 20:48:33.143995 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 371/672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:32 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:48:33.164393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:33.173821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:33.185404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.193028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.197082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.197689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.270034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:33.277352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d17f980-3c84-49b6-aa9d-900a79700a3f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.577934 Nov 06 20:48:33.291948 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 302/673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:32 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:33.307685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b66a7a69-7864-4dee-a07a-48eb6fd11923 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67159560d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:33.314288 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bea771d5-d656-4229-8945-082af1a16013 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.168711 Nov 06 20:48:33.314931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 372/674] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:33 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:33.320637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:33.321256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:33.356346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.364573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.365440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.379140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.380317 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b66a7a69-7864-4dee-a07a-48eb6fd11923 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.085126 Nov 06 20:48:33.385382 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 303/675] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:33 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:33.400813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:33.401718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:33.421406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.423051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.426144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.426908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.445490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lazy-loading 'flavor' on Instance uuid aa227b45-dcfe-4d1f-b286-7ad2e5008629 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:48:33.695683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e88b3f2a-1445-4aed-bb20-ddf6eafa8183 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629/action" status: 202 len: 0 microversion: 2.1 time: 0.378975 Nov 06 20:48:33.704755 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 373/676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:33 2021] POST /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:33.727347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:33.730799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:33.761294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.783172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.784336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:33.784961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:33.829963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:33.838795 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4f162dc-b508-4d4a-be48-f10aea7dc5aa tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1322 microversion: 2.1 time: 0.452357 Nov 06 20:48:33.841498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 304/677] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:33 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:34.478749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5d71f4d-3d6c-4cfb-9b39-b7298ba784b9 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f671596dc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1912899855", "description": "tempest-description-1444224935"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:34.589273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:34.602693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9af931f-0d6d-4479-b1a2-4127e625ec44 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1475 microversion: 2.1 time: 0.894395 Nov 06 20:48:34.619959 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 374/678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:33 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1475 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:34.630845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:34.636666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:34.645118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:34.645866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:34.646865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:34.647466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:34.834157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5d71f4d-3d6c-4cfb-9b39-b7298ba784b9 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.892250 Nov 06 20:48:34.836503 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 305/679] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:33 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:34.841941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:34.843277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:34.858901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:34.859736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:34.867662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:34.878307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:34.956825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d5d0a08-f8c8-49a3-9e5d-4412887e88fe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.118797 Nov 06 20:48:34.961693 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 306/680] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:34 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:34.969777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-052bb5b3-fd0c-4cc4-83f8-4583bbb84701 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a09160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:35.015985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:35.034609 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5568a328-f42b-43a9-85fa-d9d5fca6e5ed tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.410601 Nov 06 20:48:35.036063 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 375/681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:34 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:35.043040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37d9bf7f-78ff-4f8a-b9e6-eaf4a5e63966 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67158d6a60>, body: {"security_group_rule": {"parent_group_id": "f6b2cbe6-97bc-46e8-835e-9db2204350d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:35.071234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-052bb5b3-fd0c-4cc4-83f8-4583bbb84701 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.107387 Nov 06 20:48:35.072403 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 307/682] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:34 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:35.084679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:35.086343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:35.095915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:35.097712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:35.099433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:35.100264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:35.477159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:35.486339 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f7e2039-8eec-434a-b29b-bf33138c24d6 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1519 microversion: 2.1 time: 0.411745 Nov 06 20:48:35.489338 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 308/683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:35 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1519 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:35.503813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37d9bf7f-78ff-4f8a-b9e6-eaf4a5e63966 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.465813 Nov 06 20:48:35.504463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 376/684] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:35 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:35.516934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9f99d04-9505-46ef-9676-8639715ca4b3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'create', calling method: .version_select at 0x7f6715adbca0>, body: {"pool": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:35.781024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f67159b9ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:35.781024 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:35.781024 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:35.781024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:35.781024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:35.781412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:35.781412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:35.886057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a118b494-ea0f-4baf-981a-7fa63dea6dc8 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.394821 Nov 06 20:48:35.887094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 309/685] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:48:35 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:35.898786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd4f0958-e732-4fb0-bee7-9c289c35eb1f tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67157374c0>, body: {"security_group_rule": {"parent_group_id": "f6b2cbe6-97bc-46e8-835e-9db2204350d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:36.036910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-dd4f0958-e732-4fb0-bee7-9c289c35eb1f tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: This rule already exists in group f6b2cbe6-97bc-46e8-835e-9db2204350d8 Nov 06 20:48:36.037748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd4f0958-e732-4fb0-bee7-9c289c35eb1f tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: This rule already exists in group f6b2cbe6-97bc-46e8-835e-9db2204350d8 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:36.039354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd4f0958-e732-4fb0-bee7-9c289c35eb1f tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.149801 Nov 06 20:48:36.040858 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 310/686] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:35 2021] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:36.047955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:36.049608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:36.066184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.069896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.075056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.075798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.375801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:36.384178 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25702850-7bf8-47c5-b661-23e7450d4dd2 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1458 microversion: 2.1 time: 0.342041 Nov 06 20:48:36.384775 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 311/687] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:36 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1458 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:36.402728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f6715a680d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:36.405308 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:36.405308 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:36.406860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.417836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.423492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.424309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.475476 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0b21d4b-da38-454a-ac2c-ef10c36ff5ae tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.089639 Nov 06 20:48:36.476366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 312/688] 10.222.0.13 () {58 vars in 1138 bytes} [Sat Nov 6 20:48:36 2021] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:36.486699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:36.488784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:36.502092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.508822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.509922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.510576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.587819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc918552-c527-49ce-beb8-54aff2640e45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.110011 Nov 06 20:48:36.588866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 313/689] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:36 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:36.598075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06999676-0020-4f96-a0a5-761f9aaffc68 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f67159b9a60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:36.859690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06999676-0020-4f96-a0a5-761f9aaffc68 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/6a151f67-46fa-40ff-b05c-6083c1442c71" status: 202 len: 0 microversion: 2.1 time: 0.269261 Nov 06 20:48:36.860760 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 314/690] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Nov 6 20:48:36 2021] DELETE /compute/v2.1/os-security-group-rules/6a151f67-46fa-40ff-b05c-6083c1442c71 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:36.885577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:36.886564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:36.903716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.904262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:36.905195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:36.905700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:37.281772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:37.295738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b322fd5-813e-41c2-b185-81b19525fc96 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.420856 Nov 06 20:48:37.301101 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 315/691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:36 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:37.317404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c13a3699-0fb7-472d-9b83-f377df1d0a05 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671570a3a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:37.401815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c13a3699-0fb7-472d-9b83-f377df1d0a05 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.097581 Nov 06 20:48:37.402678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 316/692] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:37 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:37.411030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:37.418432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:37.450851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:37.454251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:37.457319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:37.458038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.067356 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9f99d04-9505-46ef-9676-8639715ca4b3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.555583 Nov 06 20:48:38.068405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 377/693] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:48:35 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:38.073228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f671586a700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:38.078146 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:38.078146 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:38.084084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.089514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.090683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.092421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.177767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75428de5-33ef-4440-a19b-abfab46f1920 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.108039 Nov 06 20:48:38.182676 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 378/694] 10.222.0.13 () {58 vars in 1144 bytes} [Sat Nov 6 20:48:38 2021] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:48:38.193714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-438f83a0-586e-444e-a2ac-1792cd9fb374 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67157d1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-739140074", "description": "tempest-description-238648447"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:38.345303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a555546e-f7e4-4243-ac20-f8cea23a7d02 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1609 microversion: 2.1 time: 0.940514 Nov 06 20:48:38.345827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 317/695] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:37 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1609 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:38.354723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:38.357330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:38.366306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.367140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.368161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.369893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.442623 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-725dcfdd-770d-4554-95df-071b8cc146c1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.095134 Nov 06 20:48:38.447328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 318/696] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:38 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:38.458028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f67156f24c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:38.459825 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:38.459825 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:38.465155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.468674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.470739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.472714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.542829 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66a8877d-89e9-4196-9dd2-83be0615b473 tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.094136 Nov 06 20:48:38.547786 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 319/697] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:48:38 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:38.556143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-438f83a0-586e-444e-a2ac-1792cd9fb374 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.371898 Nov 06 20:48:38.557062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 379/698] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:38 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:38.562365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:38.563218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:38.573441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-706619412", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "70df8f7c-e170-4849-829e-02a0385fa7a0"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:38.591571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.593249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.594163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.594829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.704559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] validate_networks() for [('70df8f7c-e170-4849-829e-02a0385fa7a0', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:38.870579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:38.892729 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83db2be3-b7db-487d-8035-5fa73b5a0136 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.334388 Nov 06 20:48:38.896369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 380/699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:38 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:38.911009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:38.913458 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:38.913458 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:38.915615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.917012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.918014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:38.918927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:38.955201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9774e85b-abdc-43f1-860d-a2671f09237e tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057610 Nov 06 20:48:38.965523 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 381/700] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:48:38 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:38.981184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c1cd579-8dbb-4415-95f0-1066ed216129 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157db550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.075422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c1cd579-8dbb-4415-95f0-1066ed216129 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.107357 Nov 06 20:48:39.076383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 382/701] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:38 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:39.080815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f6715ada790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.082940 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:39.082940 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:39.085500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.086158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.087173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.087824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.147558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-231673b0-2fcc-492f-bf02-0396476c362f tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.069990 Nov 06 20:48:39.151400 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 383/702] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:48:39 2021] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:39.158199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72406a1a-6e9a-4695-9faf-dcb567659c23 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f671586a160>, body: {"security_group_rule": {"parent_group_id": "63e403da-384b-420f-9224-b01b83aba48a", "ip_protocol": "tcp", "from_port": 1697361879, "to_port": 22}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:39.257205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-72406a1a-6e9a-4695-9faf-dcb567659c23 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Invalid port range 1697361879:22. Former value cannot be greater than the later Nov 06 20:48:39.258470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72406a1a-6e9a-4695-9faf-dcb567659c23 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: Invalid port range 1697361879:22. Former value cannot be greater than the later {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:39.259616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72406a1a-6e9a-4695-9faf-dcb567659c23 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.106986 Nov 06 20:48:39.261000 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 384/703] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:39 2021] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:39.347301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-220b734e-36a7-4801-8cb8-a838ca560fef tempest-FloatingIPDetailsNegativeTestJSON-1745245366 tempest-FloatingIPDetailsNegativeTestJSON-1745245366-project] Calling method '.version_select at 0x7f67157dbb80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.376570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:39.377095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:39.377506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:39.377966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:39.378376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:39.400861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.404437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.405136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.407559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.423502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-220b734e-36a7-4801-8cb8-a838ca560fef tempest-FloatingIPDetailsNegativeTestJSON-1745245366 tempest-FloatingIPDetailsNegativeTestJSON-1745245366-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 72f1d52a-d945-48b4-b544-6571c4d7b880 could not be found", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:48:39.424445 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-220b734e-36a7-4801-8cb8-a838ca560fef tempest-FloatingIPDetailsNegativeTestJSON-1745245366 tempest-FloatingIPDetailsNegativeTestJSON-1745245366-project] HTTP exception thrown: Floating IP not found for ID 72f1d52a-d945-48b4-b544-6571c4d7b880 Nov 06 20:48:39.425154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-220b734e-36a7-4801-8cb8-a838ca560fef tempest-FloatingIPDetailsNegativeTestJSON-1745245366 tempest-FloatingIPDetailsNegativeTestJSON-1745245366-project] Returning 404 to user: Floating IP not found for ID 72f1d52a-d945-48b4-b544-6571c4d7b880 {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:39.426900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-220b734e-36a7-4801-8cb8-a838ca560fef tempest-FloatingIPDetailsNegativeTestJSON-1745245366 tempest-FloatingIPDetailsNegativeTestJSON-1745245366-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/72f1d52a-d945-48b4-b544-6571c4d7b880" status: 404 len: 111 microversion: 2.1 time: 0.164750 Nov 06 20:48:39.428588 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 385/704] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:48:39 2021] GET /compute/v2.1/os-floating-ips/72f1d52a-d945-48b4-b544-6571c4d7b880 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:39.457975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:39.460243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:39.461290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Getting quotas for project e7a2501529c1496e839dda964a1d9f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:39.470115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Getting quotas for user 865f95e00cdd4725a1edba328836388f and project e7a2501529c1496e839dda964a1d9f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:39.477444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.481723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.482931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.483623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.496830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:39.499895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:39.549509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Lazy-loading 'flavor' on Instance uuid aa227b45-dcfe-4d1f-b286-7ad2e5008629 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:48:39.606942 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 while it is in vm_state suspended Nov 06 20:48:39.608188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 while it is in vm_state suspended {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:39.609231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-67c5b5cf-90dc-491a-a340-452e32c842c9 tempest-LiveMigrationNegativeTest-1235541136 tempest-LiveMigrationNegativeTest-1235541136-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629/action" status: 409 len: 155 microversion: 2.1 time: 0.179353 Nov 06 20:48:39.609820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 386/705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:39 2021] POST /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629/action => generated 155 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:39.615508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75e06377-df60-4b71-9754-cea13f5620ad tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066282 Nov 06 20:48:39.616437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 320/706] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:39.618713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f671577eb80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.620162 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:39.620162 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:39.621862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cca439b-18e4-49ca-95fe-d8026e49728d tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f6715796670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1521297347", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:39.622254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.622782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.623853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.625773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-0cca439b-18e4-49ca-95fe-d8026e49728d tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Security group id should be uuid Nov 06 20:48:39.631270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.632229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cca439b-18e4-49ca-95fe-d8026e49728d tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: Security group id should be uuid {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:39.636564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cca439b-18e4-49ca-95fe-d8026e49728d tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017802 Nov 06 20:48:39.638115 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 321/707] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:39 2021] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:48:39.650504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:39.651781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:39.668443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.669213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.672232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.672827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.685168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b94fe7e-e089-461a-a52b-e9ad7ccc99cd tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.074098 Nov 06 20:48:39.686697 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 387/708] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:48:39 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:39.693689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.695077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:39.704438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.705079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.706278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:39.706874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:39.764560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:48:39.774689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b1e1083-9746-456d-8b58-75b620aca672 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.132535 Nov 06 20:48:39.774689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 322/709] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:39 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:39.799314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c15e4ec-7ccc-4902-85d2-2745a689b730 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:39.806166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c15e4ec-7ccc-4902-85d2-2745a689b730 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:39.909617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73719de5-1494-4e14-bd3c-edc04d5cc103 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 204 len: 0 microversion: 2.1 time: 0.219880 Nov 06 20:48:39.912700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 388/710] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:39 2021] DELETE /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:48:39.922835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82e8a2b3-6ecd-412a-a55c-6e92398eb34e tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f671586aca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1251260530", "description": "tempest-description-1344164555"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:39.995683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4c15e4ec-7ccc-4902-85d2-2745a689b730 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:40.006986 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c15e4ec-7ccc-4902-85d2-2745a689b730 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1223 microversion: 2.1 time: 0.229697 Nov 06 20:48:40.008616 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 323/711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:39 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1223 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:40.017663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f67159b9dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:40.019881 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:40.019881 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:40.041415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.049956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.088105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.088590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.177871 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf3bfefe-d2be-4866-bdfa-8b0458af42eb tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.167882 Nov 06 20:48:40.182791 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 324/712] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:48:40 2021] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:40.191548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5c40d60a-b582-4cfa-acb4-2b6c96f981d4 req-5848bf8c-b99a-4857-9085-f88b96265887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c", "name": "network-vif-plugged", "status": "completed", "tag": "b2d30164-6f5c-42b2-8599-18365256a9bc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:40.193170 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:40.193170 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:40.207965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5c40d60a-b582-4cfa-acb4-2b6c96f981d4 req-5848bf8c-b99a-4857-9085-f88b96265887 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.208449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5c40d60a-b582-4cfa-acb4-2b6c96f981d4 req-5848bf8c-b99a-4857-9085-f88b96265887 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.238477 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5c40d60a-b582-4cfa-acb4-2b6c96f981d4 req-5848bf8c-b99a-4857-9085-f88b96265887 service nova] Creating event network-vif-plugged:b2d30164-6f5c-42b2-8599-18365256a9bc for instance e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c on nch1-master-1 Nov 06 20:48:40.244087 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5c40d60a-b582-4cfa-acb4-2b6c96f981d4 req-5848bf8c-b99a-4857-9085-f88b96265887 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060020 Nov 06 20:48:40.245347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 325/713] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:40.252165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:40.253390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:40.260052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.260545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.261448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.262425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.327231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82e8a2b3-6ecd-412a-a55c-6e92398eb34e tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.414095 Nov 06 20:48:40.327965 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 389/714] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:39 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:40.332962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:40.336936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:40.352755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.359648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.360885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.364006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.780646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:40.791907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:40.797959 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b29428e1-bc9d-4375-9792-c76f303ee49b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.551375 Nov 06 20:48:40.798842 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 326/715] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:40 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:40.804603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36631ad2-e699-4698-95b0-e972bac8accf tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a09430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:40.818521 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bae637bf-1589-46ca-91ef-17c9f111bb33 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1464 microversion: 2.1 time: 0.486902 Nov 06 20:48:40.820430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 390/716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:40 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1464 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:40.839191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Calling method '.version_select at 0x7f67157bf1f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:40.844322 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:40.844322 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:40.856486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.862962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.882454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36631ad2-e699-4698-95b0-e972bac8accf tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.081645 Nov 06 20:48:40.883244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 327/717] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:40 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:40.889319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4ade969-99e8-4a7e-9cbb-4f21834b5058 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67159b93a0>, body: {"security_group_rule": {"parent_group_id": "3c76a14c-cb1f-4956-b7b1-e57233348e2f", "ip_protocol": "tempest-999-1416898636", "from_port": 22, "to_port": 22}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:40.895969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.896506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.933457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ec1d649-3dac-4108-b66e-f1b26616135d tempest-HostsAdminTestJSON-2109188019 tempest-HostsAdminTestJSON-2109188019-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.110600 Nov 06 20:48:40.943393 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 391/718] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:48:40 2021] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:40.949626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:40.950698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:40.961232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.961674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.963843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e4ade969-99e8-4a7e-9cbb-4f21834b5058 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Invalid IP protocol tempest-999-1416898636. Nov 06 20:48:40.964496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4ade969-99e8-4a7e-9cbb-4f21834b5058 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: Invalid IP protocol tempest-999-1416898636. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:40.964927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:40.965488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:40.965693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4ade969-99e8-4a7e-9cbb-4f21834b5058 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.081018 Nov 06 20:48:40.966851 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 328/719] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:40 2021] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:48:40.978116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-672edf39-9946-4ff4-8e1d-7c6716d40de2 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f6715ad61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-862953135", "description": "tempest-description-1363992977"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:41.038556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b3dca96-e468-4d82-8ac9-63860309b41c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.094135 Nov 06 20:48:41.039245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 392/720] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:40 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:41.044902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:41.046270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:41.053828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:41.054310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:41.055195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:41.060617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:41.281716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:41.282161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-672edf39-9946-4ff4-8e1d-7c6716d40de2 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.306132 Nov 06 20:48:41.284485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 329/721] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:40 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:41.294094 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd3643eb-4ced-423f-919e-ba470bc68b4c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1275 microversion: 2.1 time: 0.253263 Nov 06 20:48:41.299091 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 393/722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:41 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:41.303182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-feafbbae-4872-4233-be85-12216a3b17d3 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f6715737280>, body: {"security_group_rule": {"parent_group_id": "47b3e09e-fcba-40fa-99f5-1fe8fe714665", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:41.441122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-feafbbae-4872-4233-be85-12216a3b17d3 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 06 20:48:41.441906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-feafbbae-4872-4233-be85-12216a3b17d3 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:41.442936 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-feafbbae-4872-4233-be85-12216a3b17d3 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.152653 Nov 06 20:48:41.443898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 330/723] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:41 2021] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:41.453726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-291c4c2b-6c65-4316-99f0-b2f4b2ea1ede tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67157dbf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1988838871", "description": "tempest-description-1949311733"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:41.818339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:41.819995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:41.835184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:41.835899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:41.843422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:41.848691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:42.148818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-291c4c2b-6c65-4316-99f0-b2f4b2ea1ede tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.699352 Nov 06 20:48:42.149448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 394/724] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:48:41 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:42.161794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:42.162656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:42.193760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:42.199193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:42.205101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:42.206988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:42.710722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:42.729994 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8c66c9e-d825-4966-aa6d-f542e3c0c9ac tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.906238 Nov 06 20:48:42.732928 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 331/725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:41 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:48:42.763932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7badec06-340e-40f0-8007-a38f315e7f16 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a094c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:42.785392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:42.795002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90bfbfe2-2373-48ca-8e43-9ed71b540292 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 200 len: 1464 microversion: 2.1 time: 0.637593 Nov 06 20:48:42.795152 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 395/726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:42 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 1464 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:42.816069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:42.817443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:42.841948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:42.842821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:42.846125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:42.846587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:42.859005 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7badec06-340e-40f0-8007-a38f315e7f16 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.112161 Nov 06 20:48:42.866675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 332/727] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:42 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:42.873531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-97545d19-5deb-44b3-aaf4-221ec686addd tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f6715750e50>, body: {"security_group_rule": {"parent_group_id": "f94b21e3-0fe2-4c5b-a05b-652424b6f9f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 961901635}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:42.971086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7b801f1-be21-4e66-a137-cce67aa113d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.174595 Nov 06 20:48:42.973590 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 396/728] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:42 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:42.990470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:42.997753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:43.034271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.036312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:43.036929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.037383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:43.138888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:43.156248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-97545d19-5deb-44b3-aaf4-221ec686addd tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Invalid port range 22:961901635. Valid TCP ports should be between 1-65535 Nov 06 20:48:43.157916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-97545d19-5deb-44b3-aaf4-221ec686addd tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 400 to user: Invalid port range 22:961901635. Valid TCP ports should be between 1-65535 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:43.159010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-97545d19-5deb-44b3-aaf4-221ec686addd tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.289679 Nov 06 20:48:43.159753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 333/729] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:42 2021] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:43.165746 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-767de457-d008-4b22-884c-660bcf0758d3 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1281 microversion: 2.1 time: 0.186139 Nov 06 20:48:43.166667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 397/730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:42 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:43.174002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Action: 'create', calling method: .version_select at 0x7f67157db040>, body: {"security_group_rule": {"parent_group_id": "745b2d5f-b15e-4c07-b4bb-130bc7239848", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:43.179774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4962833a-7f69-4c44-8741-e7f7605371c0 req-c857d4a5-a27f-4afd-a98a-d0cb8d56b188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a83ee6-c727-41e1-bd07-5b04fa793f3c", "name": "network-vif-plugged", "status": "completed", "tag": "bc2d32ba-7e3c-4416-a06d-11173ab3a5d6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:43.182974 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:43.182974 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:43.204613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4962833a-7f69-4c44-8741-e7f7605371c0 req-c857d4a5-a27f-4afd-a98a-d0cb8d56b188 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.214356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4962833a-7f69-4c44-8741-e7f7605371c0 req-c857d4a5-a27f-4afd-a98a-d0cb8d56b188 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:43.252176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 745b2d5f-b15e-4c07-b4bb-130bc7239848 does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:48:43.252806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Neutron security group 745b2d5f-b15e-4c07-b4bb-130bc7239848 not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:48:43.253527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Security group 745b2d5f-b15e-4c07-b4bb-130bc7239848 does not exist Nov 06 20:48:43.253527 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-85feaf36-3974-4e05-8e4e-90ed8f457c58'] Nov 06 20:48:43.256156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 404 to user: Security group 745b2d5f-b15e-4c07-b4bb-130bc7239848 does not exist Nov 06 20:48:43.256156 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-85feaf36-3974-4e05-8e4e-90ed8f457c58'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:43.256156 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e13c5af8-0972-4f43-bda7-1854fde64dcc tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.087473 Nov 06 20:48:43.256156 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 398/731] 10.222.0.13 () {60 vars in 1194 bytes} [Sat Nov 6 20:48:43 2021] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:43.269218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f6715ab43a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:43.329035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4962833a-7f69-4c44-8741-e7f7605371c0 req-c857d4a5-a27f-4afd-a98a-d0cb8d56b188 service nova] Creating event network-vif-plugged:bc2d32ba-7e3c-4416-a06d-11173ab3a5d6 for instance 55a83ee6-c727-41e1-bd07-5b04fa793f3c on nch1-master-1 Nov 06 20:48:43.377124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4962833a-7f69-4c44-8741-e7f7605371c0 req-c857d4a5-a27f-4afd-a98a-d0cb8d56b188 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215949 Nov 06 20:48:43.406956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 334/732] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:43.523913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-31b40522-95a7-4986-868b-bc29fd4e9c57 req-32a6a14a-1215-4c3e-b4d2-01ac73073ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa227b45-dcfe-4d1f-b286-7ad2e5008629", "name": "network-vif-deleted", "tag": "465b7232-73a2-4392-8305-3e95d157ffbe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:43.525430 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:43.525430 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:43.547862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-31b40522-95a7-4986-868b-bc29fd4e9c57 req-32a6a14a-1215-4c3e-b4d2-01ac73073ed7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.552947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-31b40522-95a7-4986-868b-bc29fd4e9c57 req-32a6a14a-1215-4c3e-b4d2-01ac73073ed7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:43.620716 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-31b40522-95a7-4986-868b-bc29fd4e9c57 req-32a6a14a-1215-4c3e-b4d2-01ac73073ed7 service nova] Creating event network-vif-deleted:465b7232-73a2-4392-8305-3e95d157ffbe for instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 on nch2-master-1 Nov 06 20:48:43.667964 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-31b40522-95a7-4986-868b-bc29fd4e9c57 req-32a6a14a-1215-4c3e-b4d2-01ac73073ed7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144749 Nov 06 20:48:43.673080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 335/733] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:43.705442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f1ec4a69-0c22-4941-a430-c26250cdc16e does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:48:43.706318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Neutron security group rule f1ec4a69-0c22-4941-a430-c26250cdc16e not found {{(pid=134827) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 06 20:48:43.707154 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] HTTP exception thrown: Security group rule f1ec4a69-0c22-4941-a430-c26250cdc16e does not exist Nov 06 20:48:43.707154 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-410b3795-a29d-4f53-a242-ec392e4319e3'] Nov 06 20:48:43.707979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Returning 404 to user: Security group rule f1ec4a69-0c22-4941-a430-c26250cdc16e does not exist Nov 06 20:48:43.707979 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-410b3795-a29d-4f53-a242-ec392e4319e3'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:43.709172 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd92af29-d0cd-45e9-a1ad-90acb3b424d6 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/f1ec4a69-0c22-4941-a430-c26250cdc16e" status: 404 len: 199 microversion: 2.1 time: 0.448008 Nov 06 20:48:43.715891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 399/734] 10.222.0.13 () {58 vars in 1286 bytes} [Sat Nov 6 20:48:43 2021] DELETE /compute/v2.1/os-security-group-rules/f1ec4a69-0c22-4941-a430-c26250cdc16e => generated 199 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:43.720762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38c6a8cd-b855-47fa-8a33-b360494cd661 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f6715796c10>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:43.751117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:43.752681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:43.766850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.773112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:43.774094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:43.774628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.315437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:44.331096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3f24b6e-8428-473b-a141-edd4ca7a782e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1319 microversion: 2.1 time: 0.583444 Nov 06 20:48:44.336946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 400/735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:43 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:48:44.363148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:44.363770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: aa227b45-dcfe-4d1f-b286-7ad2e5008629] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:44.376618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.383774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.385096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.385919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.410962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] HTTP exception thrown: Instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 could not be found. Nov 06 20:48:44.417250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Returning 404 to user: Instance aa227b45-dcfe-4d1f-b286-7ad2e5008629 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:44.423805 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-908ae5e8-fdae-4118-b16c-f35b0fdfdc3e tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629" status: 404 len: 111 microversion: 2.1 time: 0.075737 Nov 06 20:48:44.425032 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 401/736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:44 2021] GET /compute/v2.1/servers/aa227b45-dcfe-4d1f-b286-7ad2e5008629 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:44.435292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b16cc734-cee3-46ff-abcf-eafb32602a6f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671586a700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:44.521461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b16cc734-cee3-46ff-abcf-eafb32602a6f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.094954 Nov 06 20:48:44.526940 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 402/737] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:44 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:44.527135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:44.534483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:44.544739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.545195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.546013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.546445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.666089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94f8ff99-c988-4c8c-be3d-20a2928003af tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.142284 Nov 06 20:48:44.666805 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 403/738] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:44 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:44.686459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:44.687194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:44.709440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.709901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.710701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.710817 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38c6a8cd-b855-47fa-8a33-b360494cd661 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f94b21e3-0fe2-4c5b-a05b-652424b6f9f3" status: 202 len: 0 microversion: 2.1 time: 0.994256 Nov 06 20:48:44.711242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.714238 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 336/739] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:43 2021] DELETE /compute/v2.1/os-security-groups/f94b21e3-0fe2-4c5b-a05b-652424b6f9f3 => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:48:44.717132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:44.718061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:44.740416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.741030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.741848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:44.742872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:44.797041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:48:44.990525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0791b341-d382-4813-8145-4939d2fe1448 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 204 len: 0 microversion: 2.1 time: 0.277296 Nov 06 20:48:44.991115 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 337/740] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:44 2021] DELETE /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:48:45.014391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ac1e283-5b9e-4b98-b3a0-6e92e5d4f6d8 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f6715750d30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:45.440712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:45.453058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f28aaf51-58c1-4f73-a66c-eaf33392b153 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 0.780061 Nov 06 20:48:45.467607 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 404/741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:44 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:45.472658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:45.473444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:45.499082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:45.499726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:45.500835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:45.501286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.101653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:46.130370 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b880fcd9-f26f-4e4a-a8c1-32b070f24290 tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1474 microversion: 2.1 time: 0.668765 Nov 06 20:48:46.132043 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 405/742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:45 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1474 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:46.137911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:46.143810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:46.154552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.155334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.156502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.157166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.177370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ac1e283-5b9e-4b98-b3a0-6e92e5d4f6d8 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/47b3e09e-fcba-40fa-99f5-1fe8fe714665" status: 202 len: 0 microversion: 2.1 time: 1.183142 Nov 06 20:48:46.178722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 338/743] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:44 2021] DELETE /compute/v2.1/os-security-groups/47b3e09e-fcba-40fa-99f5-1fe8fe714665 => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:46.194473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1ece455-cb61-4c0f-bc22-d0ffe6b5a96a tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715adb3a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:46.281430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1ece455-cb61-4c0f-bc22-d0ffe6b5a96a tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.096817 Nov 06 20:48:46.285524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 339/744] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:46 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:46.296800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:46.297328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:46.327936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.336179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.339992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.347800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.450058 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25283f76-1f7a-4d32-9d56-c02bde690a50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.159240 Nov 06 20:48:46.457038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 340/745] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:46 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:46.463032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-089835eb-4948-4b2d-9df1-5c7e4853029f req-88da4be7-34a6-4259-a409-452e30977cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9", "tag": "6d26848c-1778-44c0-bace-52e4edf6e3ce"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:46.465263 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:46.465263 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:46.498355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-089835eb-4948-4b2d-9df1-5c7e4853029f req-88da4be7-34a6-4259-a409-452e30977cb3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.498803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-089835eb-4948-4b2d-9df1-5c7e4853029f req-88da4be7-34a6-4259-a409-452e30977cb3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.523965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-089835eb-4948-4b2d-9df1-5c7e4853029f req-88da4be7-34a6-4259-a409-452e30977cb3 service nova] Creating event network-changed:6d26848c-1778-44c0-bace-52e4edf6e3ce for instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 on nch2-master-1 Nov 06 20:48:46.532540 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-089835eb-4948-4b2d-9df1-5c7e4853029f req-88da4be7-34a6-4259-a409-452e30977cb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073361 Nov 06 20:48:46.534589 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 341/746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:46.545640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fed48bf7-8535-421e-a088-8347c34feadb tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f67156c3160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:46.799290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:46.815138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cc62770-19a4-47e3-adfb-16871ed57cf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1468 microversion: 2.1 time: 0.681550 Nov 06 20:48:46.820353 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 406/747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:46 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1468 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:46.833545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:46.836939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:46.856378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.857803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:46.859093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:46.871006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:47.426227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fed48bf7-8535-421e-a088-8347c34feadb tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3c76a14c-cb1f-4956-b7b1-e57233348e2f" status: 202 len: 0 microversion: 2.1 time: 0.889864 Nov 06 20:48:47.427219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 342/748] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:46 2021] DELETE /compute/v2.1/os-security-groups/3c76a14c-cb1f-4956-b7b1-e57233348e2f => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:47.433723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:47.435094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:47.456600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:47.457563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:47.458823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:47.459451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:47.597015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:47.633311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da07ee08-5329-4239-a4fa-ddf44af679cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 0.811096 Nov 06 20:48:47.648699 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 407/749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:46 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:47.667457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:47.668645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:47.677691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:47.678139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:47.680214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:47.680703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:47.943103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c5b072659a43db91bcb4e99998d60c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5034d2c321a9410cbfd113598b06173f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:47.955311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61b3a8af-becf-43e9-8d52-a7053604435b tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 200 len: 1432 microversion: 2.1 time: 0.302213 Nov 06 20:48:47.958028 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 408/750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:47 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 1432 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:47.987397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c1ae7fd-e0f7-4ce1-8dc4-f438eb0f4da7 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67158a3430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:48.082877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c1ae7fd-e0f7-4ce1-8dc4-f438eb0f4da7 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.113631 Nov 06 20:48:48.084533 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 409/751] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:47 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:48.097006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68c4ec41-eb15-48da-bbf3-0b8397bc1568 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f67157d1280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:48.788888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:48.797909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-caf408e3-05f6-4241-b46e-805a352bd033 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 200 len: 1469 microversion: 2.1 time: 1.369380 Nov 06 20:48:48.805966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 343/752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:47 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 1469 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:48.819820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:48.821147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:48.827640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:48.831936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:48.833830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:48.834614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:48.921352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94184ec1-e45e-4fda-8df0-775eb860694d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.113188 Nov 06 20:48:48.923110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 344/753] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:48 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:48.940483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7cda5d2d-42fe-4e07-9958-8920651b89cf req-a2f70222-acf7-40ea-b53e-465f9a6568a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a6a890-f3f4-4404-9605-4ed65f87e384", "name": "network-vif-deleted", "tag": "3a09f6cc-b34c-4184-8c37-b32dc96fa02a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:48.942491 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:48.942491 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:48.983345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7cda5d2d-42fe-4e07-9958-8920651b89cf req-a2f70222-acf7-40ea-b53e-465f9a6568a4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:48.984021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7cda5d2d-42fe-4e07-9958-8920651b89cf req-a2f70222-acf7-40ea-b53e-465f9a6568a4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.013570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7cda5d2d-42fe-4e07-9958-8920651b89cf req-a2f70222-acf7-40ea-b53e-465f9a6568a4 service nova] Creating event network-vif-deleted:3a09f6cc-b34c-4184-8c37-b32dc96fa02a for instance 74a6a890-f3f4-4404-9605-4ed65f87e384 on nch2-master-1 Nov 06 20:48:49.030329 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7cda5d2d-42fe-4e07-9958-8920651b89cf req-a2f70222-acf7-40ea-b53e-465f9a6568a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105236 Nov 06 20:48:49.033781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 345/754] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:49.045245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:49.046499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:49.065831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.067594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.070450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.071121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.442780 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68c4ec41-eb15-48da-bbf3-0b8397bc1568 tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/63e403da-384b-420f-9224-b01b83aba48a" status: 202 len: 0 microversion: 2.1 time: 1.356766 Nov 06 20:48:49.444224 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 410/755] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:48 2021] DELETE /compute/v2.1/os-security-groups/63e403da-384b-420f-9224-b01b83aba48a => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:49.449994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:49.455445 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:49.455445 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:49.466825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:49.468129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Searching by: {'reservation_id': 'r-qrl0rwi3', 'deleted': False, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:48:49.480046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.480836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.483787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.484530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.670949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:49.685485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 20:48:49.701684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60e4a3fb-236d-4b5b-921b-da4b1746d2f5 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 0.664766 Nov 06 20:48:49.704523 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 346/756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:49 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:49.727849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:49.732802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] [instance: 74a6a890-f3f4-4404-9605-4ed65f87e384] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:49.756752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.760048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.761608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:49.763815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:49.799231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] HTTP exception thrown: Instance 74a6a890-f3f4-4404-9605-4ed65f87e384 could not be found. Nov 06 20:48:49.800562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] Returning 404 to user: Instance 74a6a890-f3f4-4404-9605-4ed65f87e384 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:49.801828 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f796234-0a56-4a2d-ac2d-4810fc64b4dd tempest-LiveMigrationNegativeTest-447510497 tempest-LiveMigrationNegativeTest-447510497-project] 10.222.0.13 "GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384" status: 404 len: 111 microversion: 2.1 time: 0.095702 Nov 06 20:48:49.802647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 347/757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:49 2021] GET /compute/v2.1/servers/74a6a890-f3f4-4404-9605-4ed65f87e384 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:48:49.842309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-271c24da-3bf2-4257-8d30-0cec39cf7770 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67158de550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:49.992032 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-271c24da-3bf2-4257-8d30-0cec39cf7770 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.187764 Nov 06 20:48:49.993443 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 348/758] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:49 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:50.003074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a186afc3-8308-40a8-9b74-cc587d37db0b tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] Calling method '.version_select at 0x7f67156c3280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:50.094021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:50.133960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:50.134973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:50.906156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a186afc3-8308-40a8-9b74-cc587d37db0b tempest-SecurityGroupRulesNegativeTestJSON-284452652 tempest-SecurityGroupRulesNegativeTestJSON-284452652-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f6b2cbe6-97bc-46e8-835e-9db2204350d8" status: 202 len: 0 microversion: 2.1 time: 0.911375 Nov 06 20:48:50.907303 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 349/759] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:48:49 2021] DELETE /compute/v2.1/os-security-groups/f6b2cbe6-97bc-46e8-835e-9db2204350d8 => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:48:50.912046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:50.913122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:50.933399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:50.937696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:50.939805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:50.940274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.003209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-834982dd-8d51-4f4c-a77e-58a4336a0860 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-qrl0rwi3" status: 200 len: 2930 microversion: 2.1 time: 1.557683 Nov 06 20:48:51.014836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 411/760] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Nov 6 20:48:49 2021] GET /compute/v2.1/servers/detail?reservation_id=r-qrl0rwi3 => generated 2930 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:51.020791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eef97774-b663-4c1e-b10c-8f94c363a7a8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.112146 Nov 06 20:48:51.021828 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 350/761] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:50 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:51.025177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.025920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:51.029573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7232e93-8849-46b2-977e-346af6635ed7 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67156c8a60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.056196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.058516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.062884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.062884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.116353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7232e93-8849-46b2-977e-346af6635ed7 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.091869 Nov 06 20:48:51.123056 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 351/762] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:51 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:51.129108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0cf8828-afdd-4fe4-bb31-c27158cf1866 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.146308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.server_groups [None req-f0cf8828-afdd-4fe4-bb31-c27158cf1866 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Querying cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) for 2 instances {{(pid=134828) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 06 20:48:51.147531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cf8828-afdd-4fe4-bb31-c27158cf1866 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.148140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0cf8828-afdd-4fe4-bb31-c27158cf1866 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.194616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0cf8828-afdd-4fe4-bb31-c27158cf1866 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/580f7e6b-4796-4b73-95a4-ba911765cb63" status: 200 len: 266 microversion: 2.1 time: 0.070061 Nov 06 20:48:51.201799 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 352/763] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:48:51 2021] GET /compute/v2.1/os-server-groups/580f7e6b-4796-4b73-95a4-ba911765cb63 => generated 266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:51.208471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.209908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:51.216955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.217714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.218702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.219364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.343977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:51.351747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-107a3d63-9a29-4ab6-b9cf-81c840a1807c tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 0.335096 Nov 06 20:48:51.364829 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 412/764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:51 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:51.471303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f17f4365-adc3-4590-bfe1-c9333e85cdcf tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 200 len: 1619 microversion: 2.1 time: 0.268035 Nov 06 20:48:51.473041 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 353/765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:51 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 1619 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:51.491723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.492223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:51.500708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.501166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.501971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:51.502409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:51.633693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-917010ab-78b5-443d-acc9-224d921101c9 tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.267417 Nov 06 20:48:51.635422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 413/766] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Nov 6 20:48:51 2021] DELETE /compute/v2.1/images/ => generated 112 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 06 20:48:51.646144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26ce3743-1335-4d50-bced-6328a5df64bb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Calling method '.version_select at 0x7f671586a8b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.758912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-26ce3743-1335-4d50-bced-6328a5df64bb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] HTTP exception thrown: Image not found. Nov 06 20:48:51.759629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26ce3743-1335-4d50-bced-6328a5df64bb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:51.761386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26ce3743-1335-4d50-bced-6328a5df64bb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.119614 Nov 06 20:48:51.762159 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 414/767] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Nov 6 20:48:51 2021] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:51.772730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfaadb05-6650-48b4-8d6f-e47caaaa323e tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Calling method '.version_select at 0x7f671572a9d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.812421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-dfaadb05-6650-48b4-8d6f-e47caaaa323e tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] HTTP exception thrown: Image not found. Nov 06 20:48:51.813137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfaadb05-6650-48b4-8d6f-e47caaaa323e tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:51.814232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dfaadb05-6650-48b4-8d6f-e47caaaa323e tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/c7bac1db-2a70-4c06-8ac2-10b0f5e65b6j" status: 404 len: 62 microversion: 2.1 time: 0.045177 Nov 06 20:48:51.815045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 415/768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:51 2021] DELETE /compute/v2.1/images/c7bac1db-2a70-4c06-8ac2-10b0f5e65b6j => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:51.831046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90aeab46-e781-4ea6-a30c-8e899a8e84cb tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 200 len: 1620 microversion: 2.1 time: 0.342906 Nov 06 20:48:51.833639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97d4b4ae-9947-44b8-aa9d-568865d0d0ae tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Calling method '.version_select at 0x7f671586a700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.843674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 354/769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:51 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 1620 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:51.870284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-97d4b4ae-9947-44b8-aa9d-568865d0d0ae tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] HTTP exception thrown: Image not found. Nov 06 20:48:51.873354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: .version_select at 0x7f6715737c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2077137413", "policies": ["anti-affinity"]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:51.876719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97d4b4ae-9947-44b8-aa9d-568865d0d0ae tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:51.879997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97d4b4ae-9947-44b8-aa9d-568865d0d0ae tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/c005a2cb-097e-46a0-971a-4eb4fa183d2c1" status: 404 len: 62 microversion: 2.1 time: 0.057205 Nov 06 20:48:51.880644 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 416/770] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:48:51 2021] DELETE /compute/v2.1/images/c005a2cb-097e-46a0-971a-4eb4fa183d2c1 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:51.920235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-134103a8-e4b5-4e6c-aa98-6e21c7f88e48 tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Calling method '.version_select at 0x7f67157db4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:51.930174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:51.995605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:52.004347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-134103a8-e4b5-4e6c-aa98-6e21c7f88e48 tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] HTTP exception thrown: Image not found. Nov 06 20:48:52.004965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-134103a8-e4b5-4e6c-aa98-6e21c7f88e48 tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:52.005856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-134103a8-e4b5-4e6c-aa98-6e21c7f88e48 tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/tempest-invalid-1591775614" status: 404 len: 62 microversion: 2.1 time: 0.119585 Nov 06 20:48:52.006393 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 417/771] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Nov 6 20:48:51 2021] DELETE /compute/v2.1/images/tempest-invalid-1591775614 => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:52.021472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d31df92-6fe9-4343-82f1-8513c5f6d5cb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Calling method '.version_select at 0x7f67158d6ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:52.092408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0d31df92-6fe9-4343-82f1-8513c5f6d5cb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] HTTP exception thrown: Image not found. Nov 06 20:48:52.093014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d31df92-6fe9-4343-82f1-8513c5f6d5cb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:52.093853 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d31df92-6fe9-4343-82f1-8513c5f6d5cb tempest-ImagesDeleteNegativeTestJSON-112606854 tempest-ImagesDeleteNegativeTestJSON-112606854-project] 10.222.0.13 "DELETE /compute/v2.1/images/6d7b0d24-bf2d-4e94-bfb3-b31920e24fa7" status: 404 len: 62 microversion: 2.1 time: 0.079731 Nov 06 20:48:52.094396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 418/772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:52 2021] DELETE /compute/v2.1/images/6d7b0d24-bf2d-4e94-bfb3-b31920e24fa7 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:48:52.101465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:52.107869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:52.128785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:52.129238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:52.132002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:52.132699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:52.186349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:52.191712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:52.213110 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4dae5e5a-6375-4728-85af-891f6cc31886 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.345897 Nov 06 20:48:52.213719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 355/773] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Nov 6 20:48:51 2021] POST /compute/v2.1/os-server-groups => generated 193 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:52.231236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06663c0f-1d08-4141-87ae-df3f93b0c8e0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a680d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:52.257402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0cfb32dc-a4f1-45a5-a721-69751cba5364 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.161349 Nov 06 20:48:52.258038 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 419/774] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:52 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:52.353760 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06663c0f-1d08-4141-87ae-df3f93b0c8e0 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1423 microversion: 2.1 time: 0.138404 Nov 06 20:48:52.354607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 356/775] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:52 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:52.370880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:52.371587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:52.383201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:52.387887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:52.396863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:52.397686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:52.485968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1642154872", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c37076d6-62ee-44e5-893d-29c8be670b50"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:52.595256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:53.533193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:53.566018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-428bf980-50e4-4513-b250-bc3136d35f71 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 1.200444 Nov 06 20:48:53.569228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 420/776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:52 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:53.595498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:53.599336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:53.609120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:53.609905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:53.611481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:53.612204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:53.674649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9f4f819-cdd8-4dcf-85a3-4ef66efd5d5e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.101066 Nov 06 20:48:53.676860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 421/777] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:53 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:53.693099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d796fad6-7d6e-4c06-953e-142f88df04a6 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157dba60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:53.714245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:53.714700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:53.715185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:53.715601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:53.716022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:53.753378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:53.754140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:53.755662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:53.756417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:53.801308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d796fad6-7d6e-4c06-953e-142f88df04a6 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1432 microversion: 2.1 time: 0.115020 Nov 06 20:48:53.802028 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 422/778] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:53 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1432 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:53.802345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:53.809259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:53.823460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33e78f52-acad-4bba-9d70-1d98a4c41ac5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715769790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:53.831276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 2 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:53.835564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:53.905834 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33e78f52-acad-4bba-9d70-1d98a4c41ac5 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 200 len: 1432 microversion: 2.1 time: 0.093165 Nov 06 20:48:53.908018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 423/779] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:53 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 1432 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:53.934820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-df8d5433-4b5c-4483-ba24-d34e1645205e req-88b1fcdb-465e-4737-bfbb-83f02d927467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9", "name": "network-vif-plugged", "status": "completed", "tag": "6d26848c-1778-44c0-bace-52e4edf6e3ce"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:53.939700 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:53.939700 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:53.957442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df8d5433-4b5c-4483-ba24-d34e1645205e req-88b1fcdb-465e-4737-bfbb-83f02d927467 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:53.957883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df8d5433-4b5c-4483-ba24-d34e1645205e req-88b1fcdb-465e-4737-bfbb-83f02d927467 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:53.959928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:53.965676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:53.974410 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-df8d5433-4b5c-4483-ba24-d34e1645205e req-88b1fcdb-465e-4737-bfbb-83f02d927467 service nova] Creating event network-vif-plugged:6d26848c-1778-44c0-bace-52e4edf6e3ce for instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 on nch2-master-1 Nov 06 20:48:53.984645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-df8d5433-4b5c-4483-ba24-d34e1645205e req-88b1fcdb-465e-4737-bfbb-83f02d927467 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075260 Nov 06 20:48:53.985609 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 424/780] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:53.993511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:53.994281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:54.021830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.023046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.026372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.027447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.034354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:54.060628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:54.085325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=076b774b-c0f3-48be-81d9-19eb22ea5180,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:54.164018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:54.169717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:54.250612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:54.255064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'server_group_members'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:54.346148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b0e9da5-3d13-4e00-9201-9bcf7a7e78bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.864406 Nov 06 20:48:54.350174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 357/781] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:52 2021] POST /compute/v2.1/servers => generated 32 bytes in 1866 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 06 20:48:54.352571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:54.358422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:54.362378 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:54.362378 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:48:54.363459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:54.364271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Searching by: {'deleted': False, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:48:54.372194 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca0b9342-ef35-4183-8849-0b7496ca2ba8 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1480 microversion: 2.1 time: 0.385432 Nov 06 20:48:54.377326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 425/782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:53 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1480 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:54.384381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.384864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.385738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.386232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.421486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 20:48:54.456151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a616faff-a5ac-42f1-9369-10bb494bc49f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.104295 Nov 06 20:48:54.462611 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 358/783] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 20:48:54 2021] GET /compute/v2.1/servers => generated 1666 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:54.468380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bebb9b9-1dd0-4f78-bffe-48f458042af5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:54.469072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bebb9b9-1dd0-4f78-bffe-48f458042af5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:54.534600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bebb9b9-1dd0-4f78-bffe-48f458042af5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:54.550763 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bebb9b9-1dd0-4f78-bffe-48f458042af5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1219 microversion: 2.1 time: 0.086154 Nov 06 20:48:54.566144 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 426/784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:54 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:54.588783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:54.589466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:54.597319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.597771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.599176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.599660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.688120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:54.689324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:54.709387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.718532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.722564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:54.723216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:54.785105 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af5e9baa-862c-4016-ae25-24e55e75b330 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.098484 Nov 06 20:48:54.786842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 427/785] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:54 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:54.804212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:54.811816 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6ec5621-38fa-49c0-9c32-0ddd8ea11fe1 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1323 microversion: 2.1 time: 0.227332 Nov 06 20:48:54.813471 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 359/786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:54 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:55.395515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.396803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:55.405471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.406316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.407386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.408140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.567119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:55.578781 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f82f2fd9-458c-4d1e-beea-2136143f57e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1467 microversion: 2.1 time: 0.186902 Nov 06 20:48:55.579004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.579004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:55.580452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 428/787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:55 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1467 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:55.590762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.591345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.592498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.593175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.601781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9f1f2d1-843e-448c-a335-e04df8d480ba tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67155f0af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.685027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9f1f2d1-843e-448c-a335-e04df8d480ba tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c" status: 200 len: 784 microversion: 2.1 time: 0.090952 Nov 06 20:48:55.685832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 429/788] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:55 2021] GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c => generated 784 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:55.705422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-430883d9-441b-4fec-b4ae-75aec9702a1c tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.720064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:55.726533 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-430883d9-441b-4fec-b4ae-75aec9702a1c tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032360 Nov 06 20:48:55.729492 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e357a320-0562-4a20-a6a0-96207f0ba51b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1271 microversion: 2.1 time: 0.154681 Nov 06 20:48:55.732595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 360/789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:55 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:55.740993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 430/790] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:48:55 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:55.744431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f848076-f7e4-4b24-b6d7-d66533e63a36 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715656670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.800345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:55.801454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:55.814383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.815050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.815639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.816070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.875922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04883367-86b3-4eb4-a3ac-c037acc4780e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.075684 Nov 06 20:48:55.879508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 361/791] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:55 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:48:55.895803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:55.896649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:55.935760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.936543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:55.937880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:55.938476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:56.317955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:56.325304 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-caf2bc25-78cd-4a4b-b3c5-4ba282b3e7fc tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 200 len: 1519 microversion: 2.1 time: 0.444386 Nov 06 20:48:56.325869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 362/792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:55 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:56.343465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: .version_select at 0x7f6717bd4dc0>, body: {"addFloatingIp": {"address": "172.35.0.174"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:56.345070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:56.358942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:56.361559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:56.364574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:56.366488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:56.451491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Acquired lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:48:56.948171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f848076-f7e4-4b24-b6d7-d66533e63a36 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "DELETE /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 204 len: 0 microversion: 2.1 time: 1.211185 Nov 06 20:48:56.952895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 431/793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:55 2021] DELETE /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:48:57.292787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d7f8982-8e70-4d93-aa8e-53e93ef01f41 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f6715656700>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:57.322526 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7d7f8982-8e70-4d93-aa8e-53e93ef01f41 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Nov 06 20:48:57.325565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d7f8982-8e70-4d93-aa8e-53e93ef01f41 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:57.327126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d7f8982-8e70-4d93-aa8e-53e93ef01f41 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.375394 Nov 06 20:48:57.335169 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 432/794] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:48:56 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:48:57.348492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:57.350169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:57.371835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:57.372341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:57.373194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:57.373586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:57.490282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:48:57.501291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e444ed5-21a0-46a9-a4d2-f5db3ecbd2dd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1277 microversion: 2.1 time: 0.164186 Nov 06 20:48:57.513224 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 433/795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:48:57 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:48:57.519046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:57.520598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:57.528093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:57.528891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:57.529916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:57.530579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:57.634788 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02b7c84e-d3d7-4a3d-a51f-9c5cd00138ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.117252 Nov 06 20:48:57.634788 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 434/796] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:57 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:48:57.645860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-366e022a-d07f-4964-b82a-01aee25bb081 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671576b430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:48:57.675312 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-366e022a-d07f-4964-b82a-01aee25bb081 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] HTTP exception thrown: Image not found. Nov 06 20:48:57.676338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-366e022a-d07f-4964-b82a-01aee25bb081 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:57.677488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-366e022a-d07f-4964-b82a-01aee25bb081 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 404 len: 62 microversion: 2.1 time: 0.041911 Nov 06 20:48:57.678035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 435/797] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:48:57 2021] GET /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:48:58.081149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2010741420", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:58.154323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:48:59.054505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:48:59.054928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:48:59.055578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:48:59.055992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:48:59.056733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:48:59.067224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:59.068219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:59.069144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:59.069673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:59.088028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:59.093182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for user 3ffff819b4c04c92a90993dcd4fa39c9 and project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:59.105068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:48:59.108197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:48:59.172241 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d458903d-e97c-488f-87eb-84d950bb40e0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491689 Nov 06 20:48:59.173424 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 436/798] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:48:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:48:59.179395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f6715656310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1918395853", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:59.225502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:48:59.236010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:48:59.261041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 06 20:48:59.262433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:48:59.264229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89029842-46e7-4964-aec4-d938043b50f8 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.088834 Nov 06 20:48:59.265782 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 437/799] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Nov 6 20:48:59 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:48:59.273006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ed55b57a-6fab-460d-8d96-074bf67355c6 req-f95fdadf-4f48-423a-894e-5f6c098b88ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-unplugged", "status": "completed", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:59.274828 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:48:59.274828 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:48:59.285366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed55b57a-6fab-460d-8d96-074bf67355c6 req-f95fdadf-4f48-423a-894e-5f6c098b88ee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:59.287142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed55b57a-6fab-460d-8d96-074bf67355c6 req-f95fdadf-4f48-423a-894e-5f6c098b88ee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:59.306246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ed55b57a-6fab-460d-8d96-074bf67355c6 req-f95fdadf-4f48-423a-894e-5f6c098b88ee service nova] Creating event network-vif-unplugged:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:48:59.315872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ed55b57a-6fab-460d-8d96-074bf67355c6 req-f95fdadf-4f48-423a-894e-5f6c098b88ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048512 Nov 06 20:48:59.316920 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 438/800] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:48:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:48:59.325543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-497213796"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:48:59.327814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:48:59.338060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:59.338683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:59.340313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:48:59.340976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:48:59.965328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f94d064e-fd1c-4db4-affd-1f62f8365cbd tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "POST /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec/action" status: 202 len: 0 microversion: 2.1 time: 0.633759 Nov 06 20:48:59.966091 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 439/801] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:59 2021] POST /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:49:00.109729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f6715ada4c0>, body: {"keypair": {"name": "tempest-keypair-1214280692"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:00.159663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:00.169051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:00.643015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:00.656135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:00.698677 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1adb300-9f83-43b4-8761-693201b5470e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.725588 Nov 06 20:49:00.700120 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 440/802] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:48:59 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:00.706753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:00.707735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:00.718515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:00.719348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:00.720725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:00.721361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:01.476090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Building network info cache for instance {{(pid=134828) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:02.325751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:02.340070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bda37c83-deca-430a-9283-0f7eb2b6108f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 1.637556 Nov 06 20:49:02.352552 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 441/803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:00 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:02.367681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:02.368740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:02.388244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:02.388706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:02.389735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:02.390329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:02.464888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96ab4b10-611f-4b40-b6b6-29a943547957 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.109777 Nov 06 20:49:02.465526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 442/804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:02 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:02.472742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:02.475599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:02.500629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:02.503896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:02.504894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:02.505342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:03.106694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:03.121784 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1096f9d2-b506-4f8a-ab2f-397aa38b545f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.654764 Nov 06 20:49:03.129236 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 443/805] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:02 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:03.134053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f6715c69940>, body: {"keypair": {"name": "tempest-keypair-230258912"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:03.175705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:03.180861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:03.457637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:03.463112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:03.480870 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8ea87f3-ac50-49d0-b129-c5bb9f43de44 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.350292 Nov 06 20:49:03.482155 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 444/806] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:03 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:03.487234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-886ebcce-f1ba-4181-ab80-e0da088091dc tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157e2f70>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:03.553879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-886ebcce-f1ba-4181-ab80-e0da088091dc tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.069729 Nov 06 20:49:03.554571 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 445/807] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:03 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:03.559660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-826c0daa-f7c8-48d7-8ced-473e4e1cd1e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f671576b310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:03.567802 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-826c0daa-f7c8-48d7-8ced-473e4e1cd1e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1214280692" status: 200 len: 691 microversion: 2.1 time: 0.011400 Nov 06 20:49:03.574510 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 446/808] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:49:03 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1214280692 => generated 691 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:03.597835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c9e88615-d0a5-41e5-a0d9-e89010062291 req-ce79f760-5100-40fa-b440-fb2b7ad1d55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:03.602625 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:03.602625 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:03.614526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c9e88615-d0a5-41e5-a0d9-e89010062291 req-ce79f760-5100-40fa-b440-fb2b7ad1d55d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:03.615440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c9e88615-d0a5-41e5-a0d9-e89010062291 req-ce79f760-5100-40fa-b440-fb2b7ad1d55d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:03.651435 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c9e88615-d0a5-41e5-a0d9-e89010062291 req-ce79f760-5100-40fa-b440-fb2b7ad1d55d service nova] Creating event network-changed:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:49:03.658208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c9e88615-d0a5-41e5-a0d9-e89010062291 req-ce79f760-5100-40fa-b440-fb2b7ad1d55d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087983 Nov 06 20:49:03.666353 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 447/809] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:03.675312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:03.676835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:03.685276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:03.685873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:03.687057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:03.687996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.019272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Updating instance_info_cache with network_info: [{"id": "9eaa17aa-8d51-4952-ae6c-ed188e592373", "address": "fa:16:3e:d6:ae:8f", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9eaa17aa-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:04.042684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Releasing lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:49:04.044086 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43f67d28-1f6b-4311-8b2d-d907f6669462 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action" status: 202 len: 0 microversion: 2.1 time: 7.706458 Nov 06 20:49:04.046502 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 363/810] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:48:56 2021] POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action => generated 0 bytes in 7709 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 06 20:49:04.054131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:04.056939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:04.068693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.070068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.071153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.072064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.130431 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57b978de-a1e0-4292-9b52-b954d05b4b01 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.082528 Nov 06 20:49:04.131358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 364/811] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:04 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:04.143128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f67159ccb80>, body: {"keypair": {"name": "tempest-keypair-230258912"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:04.166157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:04.168315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:04.172344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:04.180937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9dbc7421-483f-4eb5-930a-a69e4c0400b7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.509867 Nov 06 20:49:04.181630 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 448/812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:03 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:04.196422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6964124d-fc5d-45ce-a4ba-53168ed1e5f7 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f671576b820>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:04.222542 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6964124d-fc5d-45ce-a4ba-53168ed1e5f7 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214280692" status: 202 len: 0 microversion: 2.1 time: 0.037345 Nov 06 20:49:04.229534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 449/813] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 20:49:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214280692 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:04.229534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: .version_select at 0x7f6717bd2dc0>, body: {"addFloatingIp": {"address": "172.35.0.174"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:04.231893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:04.245332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.247189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.247969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.248670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.436045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Acquired lock "refresh_cache-f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:49:04.500609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Key pair 'tempest-keypair-230258912' already exists. Nov 06 20:49:04.501409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 409 to user: Key pair 'tempest-keypair-230258912' already exists. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:04.504265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5baa673a-691b-4549-9b41-e1c8f3d4cb5d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.371561 Nov 06 20:49:04.506996 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 365/814] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:04 2021] POST /compute/v2.1/os-keypairs => generated 104 bytes in 375 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:04.517204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:04.519864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:04.530288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.531576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:04.533519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:04.534487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:05.029001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:05.045176 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58a780b1-d17d-478a-bccc-a2c51ca8b873 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.534652 Nov 06 20:49:05.046341 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 366/815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:04 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:05.050977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f6715737790>, body: {"keypair": {"name": "tempest-keypair-811611912"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:05.088145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:05.098961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:05.259154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:05.266015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:05.283117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e1b939f-2692-4d97-aa0e-e0a34d6542e4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.235508 Nov 06 20:49:05.284065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 367/816] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:05 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:05.291460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25f00db6-64dc-45a4-b49b-70f45a6c94da tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Calling method '.version_select at 0x7f671564fdc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:05.311216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25f00db6-64dc-45a4-b49b-70f45a6c94da tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230258912" status: 202 len: 0 microversion: 2.1 time: 0.025906 Nov 06 20:49:05.312393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 368/817] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:49:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230258912 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:05.316923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e40a93a6-f8cc-42ad-abe6-ce1b7c897665 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67156c8430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:05.377925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e40a93a6-f8cc-42ad-abe6-ce1b7c897665 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.064072 Nov 06 20:49:05.378543 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 369/818] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:05 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:05.439166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'create', calling method: .version_select at 0x7f67156c8b80>, body: {"keypair": {"name": "tempest-keypair-702371140"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:05.458425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for project 1a00b3392ff344cca1531a676e30616a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:05.462929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for user 817bcf8d2d284d21b41235651d678871 and project 1a00b3392ff344cca1531a676e30616a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:05.741785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for project 1a00b3392ff344cca1531a676e30616a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:05.747119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for user 817bcf8d2d284d21b41235651d678871 and project 1a00b3392ff344cca1531a676e30616a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:05.762425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8ee7689-ed73-441f-8ee0-0b774e8c3b00 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.382725 Nov 06 20:49:05.763371 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 370/819] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:05 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:05.767610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6aed5d95-3860-48fc-b35a-f8f2f68bcf87 req-c78c94ec-71ba-4d59-a3b9-d3fae3b5cae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:05.769365 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:05.769365 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:05.777483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6aed5d95-3860-48fc-b35a-f8f2f68bcf87 req-c78c94ec-71ba-4d59-a3b9-d3fae3b5cae3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:05.778006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6aed5d95-3860-48fc-b35a-f8f2f68bcf87 req-c78c94ec-71ba-4d59-a3b9-d3fae3b5cae3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:05.792956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6aed5d95-3860-48fc-b35a-f8f2f68bcf87 req-c78c94ec-71ba-4d59-a3b9-d3fae3b5cae3 service nova] Creating event network-changed:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch2-master-1 Nov 06 20:49:05.799342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6aed5d95-3860-48fc-b35a-f8f2f68bcf87 req-c78c94ec-71ba-4d59-a3b9-d3fae3b5cae3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034437 Nov 06 20:49:05.800232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 371/820] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:05.815142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:05.816514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:05.822973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:05.823428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:05.825007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:05.825448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:05.876217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f47431c-1796-4332-8307-6c96e33606b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.071491 Nov 06 20:49:05.876217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 372/821] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:05 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:05.879922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:05.880669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:05.890862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:05.892732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:05.894299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:05.895183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:06.294781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:06.304195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c8bf7fa-3c43-46f1-8749-7cf42769ce88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.427974 Nov 06 20:49:06.318289 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 373/822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:05 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:06.325942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50dadf58-111c-49f6-b6aa-1a03c5698fea tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f67157373a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:06.357360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50dadf58-111c-49f6-b6aa-1a03c5698fea tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811611912" status: 202 len: 0 microversion: 2.1 time: 0.037626 Nov 06 20:49:06.361098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 374/823] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:49:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811611912 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:06.375400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51f7d810-dd74-4411-bc8e-3b8b36641399 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f67156c3820>, body: {"keypair": {"name": ""}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:06.379847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51f7d810-dd74-4411-bc8e-3b8b36641399 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:06.380970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51f7d810-dd74-4411-bc8e-3b8b36641399 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015574 Nov 06 20:49:06.391098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 375/824] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:06 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:49:06.397194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076b774b-c0f3-48be-81d9-19eb22ea5180", "tag": "54ace632-cbd6-43aa-8893-e4b61c4f9be1"}, {"name": "network-changed", "server_uuid": "b8595966-9481-4f67-ae11-9c01c69e4c9f", "tag": "ceb2b1ae-458d-4e31-95da-03e6fc97edec"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:06.399144 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:06.399144 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:06.411511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:06.412642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:06.428745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] Creating event network-changed:54ace632-cbd6-43aa-8893-e4b61c4f9be1 for instance 076b774b-c0f3-48be-81d9-19eb22ea5180 on nch2-master-1 Nov 06 20:49:06.429658 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] Creating event network-changed:ceb2b1ae-458d-4e31-95da-03e6fc97edec for instance b8595966-9481-4f67-ae11-9c01c69e4c9f on nch1-master-1 Nov 06 20:49:06.440979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b00e3b59-af7d-4de2-953c-3527b6b0e8f5 req-2afe7721-2eb9-4463-ae52-1f8c70ba7133 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049245 Nov 06 20:49:06.442409 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 376/825] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:06 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:06.447891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:06.472775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:06.487574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:06.488591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:06.489636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:06.490357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:07.456614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:07.466812 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0fd12e9f-d028-4589-b3f6-e2f477551eb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 1.020698 Nov 06 20:49:07.467436 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 377/826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:06 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:07.489955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-104c5e03-e639-4db7-a841-0c008ac6f3e3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f67156f2790>, body: {"keypair": {"name": "tempest-keypair-386117207", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:07.530783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-104c5e03-e639-4db7-a841-0c008ac6f3e3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:07.536854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-104c5e03-e639-4db7-a841-0c008ac6f3e3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:07.576687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-104c5e03-e639-4db7-a841-0c008ac6f3e3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.095112 Nov 06 20:49:07.577642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 378/827] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Nov 6 20:49:07 2021] POST /compute/v2.1/os-keypairs => generated 573 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:07.583780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f67156c39d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1101399720", "public_key": " "}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:07.608470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:07.613312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:07.634509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 06 20:49:07.635397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:07.637181 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99010c33-102c-4752-93d4-aa2b047f75d6 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057474 Nov 06 20:49:07.638425 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 379/828] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:07 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:49:07.645906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af8296b9-3caf-432d-8f72-2342b06838a4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715615ca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:07.712192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af8296b9-3caf-432d-8f72-2342b06838a4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.072263 Nov 06 20:49:07.713079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 380/829] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:07 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:07.718796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:07.720112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:07.727485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:07.728218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:07.729242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:07.729910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:07.783839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-519089e8-b7c4-4ea7-b5c2-c8a12027064c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.069098 Nov 06 20:49:07.784867 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 381/830] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:07 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:07.794456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:07.795091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:07.802748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:07.803205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:07.804007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:07.804479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:08.275248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:08.283544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62e2628d-a4be-44a4-ad86-681f45405859 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.497288 Nov 06 20:49:08.284122 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 382/831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:07 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:08.298123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15a2b054-761b-4364-a972-96d4fae30a47 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f6715adb3a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:08.323172 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15a2b054-761b-4364-a972-96d4fae30a47 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386117207" status: 202 len: 0 microversion: 2.1 time: 0.037535 Nov 06 20:49:08.324257 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 383/832] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:49:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386117207 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:08.331141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48f4f875-9009-454e-af53-5c8fd841e55d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f6715600670>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:08.333510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48f4f875-9009-454e-af53-5c8fd841e55d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:08.334441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48f4f875-9009-454e-af53-5c8fd841e55d tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009048 Nov 06 20:49:08.340676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 384/833] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Nov 6 20:49:08 2021] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:49:08.346064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f67156dd940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1159096410"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:08.388701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:08.395260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:08.824315 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.network.neutron [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] re-assign floating IP 172.35.0.174 from instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 Nov 06 20:49:08.870631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:08.875817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:08.891247 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-434dc301-bba5-4227-9f93-899b4951feff tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.552559 Nov 06 20:49:08.892217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 385/834] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:08 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:08.896494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Building network info cache for instance {{(pid=134827) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:08.896888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Action: 'create', calling method: .version_select at 0x7f67156009d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1588120277", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:08.917825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:08.923327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Getting quotas for user c19c3f180b7c4a598819e361b0002c96 and project b015967375ac4dfda745d7a4aeddf92a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:08.941297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 06 20:49:08.941904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:08.942899 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d64f8eb7-c443-4cb2-b4b2-f5f42d26f918 tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.049403 Nov 06 20:49:08.943836 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 386/835] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Nov 6 20:49:08 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:49:08.948977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a9ce6229-b23d-476a-a0ce-88e437c8e026 req-b10dd328-f043-4c8d-9591-fe612c72d7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-plugged", "status": "completed", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:08.951278 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:08.951278 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:08.958320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9ce6229-b23d-476a-a0ce-88e437c8e026 req-b10dd328-f043-4c8d-9591-fe612c72d7b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:08.959096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9ce6229-b23d-476a-a0ce-88e437c8e026 req-b10dd328-f043-4c8d-9591-fe612c72d7b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:08.970214 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a9ce6229-b23d-476a-a0ce-88e437c8e026 req-b10dd328-f043-4c8d-9591-fe612c72d7b8 service nova] Creating event network-vif-plugged:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:49:08.975294 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a9ce6229-b23d-476a-a0ce-88e437c8e026 req-b10dd328-f043-4c8d-9591-fe612c72d7b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030103 Nov 06 20:49:08.976417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 387/836] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:08.981518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:08.982090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:08.988193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:08.988606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:08.989402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:08.989846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:09.365882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:09.373773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39e411dc-890f-4384-b23c-c9b0766d8ea5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.396216 Nov 06 20:49:09.374467 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 388/837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:08 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:09.378844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26313256-3b61-4b8e-b705-f4063b2dba57 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67156008b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:09.446764 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26313256-3b61-4b8e-b705-f4063b2dba57 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.071010 Nov 06 20:49:09.447483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 389/838] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:09 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:09.457860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1ebbdc9b-595e-4e9f-aa35-8df3f062613f req-7ae772af-19dd-42c1-a173-2e9a762e3841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:09.459992 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:09.459992 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:09.468109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1ebbdc9b-595e-4e9f-aa35-8df3f062613f req-7ae772af-19dd-42c1-a173-2e9a762e3841 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:09.468814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1ebbdc9b-595e-4e9f-aa35-8df3f062613f req-7ae772af-19dd-42c1-a173-2e9a762e3841 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:09.485819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1ebbdc9b-595e-4e9f-aa35-8df3f062613f req-7ae772af-19dd-42c1-a173-2e9a762e3841 service nova] Creating event network-changed:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:49:09.491501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1ebbdc9b-595e-4e9f-aa35-8df3f062613f req-7ae772af-19dd-42c1-a173-2e9a762e3841 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037734 Nov 06 20:49:09.492959 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 390/839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:09.498290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:09.499604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:09.506832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:09.507632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:09.508706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:09.509305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:09.552717 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1e58d54-2188-4a2f-85f6-a614f180b103 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.057947 Nov 06 20:49:09.554446 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 391/840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:09 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:09.561148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f67156c80d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-950173944"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:09.587565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:09.594260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:09.945452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:09.949510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:09.963570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5929e7fc-e80b-42d2-b9af-2c5df47d4650 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.407740 Nov 06 20:49:09.969411 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 392/841] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:09 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:09.969411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17b1480f-ef4c-49ab-b4a7-94edaed5f14f tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Calling method '.version_select at 0x7f671570ac10>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:09.985944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-17b1480f-ef4c-49ab-b4a7-94edaed5f14f tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1417708907 not found for user c19c3f180b7c4a598819e361b0002c96 Nov 06 20:49:09.986860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17b1480f-ef4c-49ab-b4a7-94edaed5f14f tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1417708907 not found for user c19c3f180b7c4a598819e361b0002c96 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:09.987604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17b1480f-ef4c-49ab-b4a7-94edaed5f14f tempest-KeyPairsNegativeTestJSON-263077810 tempest-KeyPairsNegativeTestJSON-263077810-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1417708907" status: 404 len: 145 microversion: 2.1 time: 0.021863 Nov 06 20:49:09.993059 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 393/842] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:49:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1417708907 => generated 145 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:09.995597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:09.997424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:10.006219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:10.006766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:10.007691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:10.008138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:10.672037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Updating instance_info_cache with network_info: [{"id": "9eaa17aa-8d51-4952-ae6c-ed188e592373", "address": "fa:16:3e:d6:ae:8f", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9eaa17aa-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134827) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:10.674518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:10.694767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Building network info cache for instance {{(pid=134827) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:10.696634 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-970ef1ed-c010-4839-98e9-e574014fc948 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.704301 Nov 06 20:49:10.704402 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 394/843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:09 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:10.712365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "13707f7b-603a-4c93-b168-9b49e124be0a"}], "security_groups": [{"name": "tempest-securitygroup--62457841"}], "key_name": "tempest-keypair-702371140", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:11.060710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] validate_networks() for [('13707f7b-603a-4c93-b168-9b49e124be0a', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:11.850063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:11.850494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:11.850974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:11.851394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:11.851811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:11.868524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:11.870985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:11.874951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:11.875411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:11.931670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for project 1a00b3392ff344cca1531a676e30616a. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:11.947500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Getting quotas for user 817bcf8d2d284d21b41235651d678871 and project 1a00b3392ff344cca1531a676e30616a. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:11.976409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:11.980753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:12.043739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3dea75a-7cd2-43a0-9201-461fa1bf41af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.342919 Nov 06 20:49:12.044610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 395/844] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:10 2021] POST /compute/v2.1/servers => generated 407 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:12.051573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Action: 'create', calling method: .version_select at 0x7f67156dd9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1873132441"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:12.074722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:12.080847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:12.147004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Updating instance_info_cache with network_info: [{"id": "6d26848c-1778-44c0-bace-52e4edf6e3ce", "address": "fa:16:3e:08:89:1e", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6d26848c-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134827) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:12.163052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Releasing lock "refresh_cache-f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:49:12.164257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fec86bbd-4d62-4bf4-8726-e630f1add524 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9/action" status: 202 len: 0 microversion: 2.1 time: 7.939346 Nov 06 20:49:12.167646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 450/845] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:04 2021] POST /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9/action => generated 0 bytes in 7943 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:49:12.177216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:12.181538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:12.196368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.200168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.201440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.204748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.344039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:12.348818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Getting quotas for user 9c3998f38de749b4b240ac7fb78c753b and project 46eaae9e56d0451397edfa335fd5de0a. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:12.364987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f2dd76b-e610-43f4-afd1-37680ee330d4 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.319168 Nov 06 20:49:12.365817 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 396/846] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:49:12 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:12.375881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76cac90d-5e3a-4ef3-a6f6-2a022c25ffcc tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a09430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:12.426978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76cac90d-5e3a-4ef3-a6f6-2a022c25ffcc tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.055033 Nov 06 20:49:12.427734 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 397/847] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:12 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:12.440753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:12.442065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:12.449218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.449931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.450943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.451528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.498819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25321a27-603c-4246-a4cc-083cef57d692 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.061438 Nov 06 20:49:12.499728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 398/848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:12 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:12.507496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cf916082-1bf0-4e32-94ca-c52a3aba2fa3 req-e522d91d-007c-4370-a0cc-0df5de9fa5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9", "tag": "6d26848c-1778-44c0-bace-52e4edf6e3ce"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:12.509254 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:12.509254 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:12.519343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cf916082-1bf0-4e32-94ca-c52a3aba2fa3 req-e522d91d-007c-4370-a0cc-0df5de9fa5d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.520092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cf916082-1bf0-4e32-94ca-c52a3aba2fa3 req-e522d91d-007c-4370-a0cc-0df5de9fa5d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.522254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:12.530494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b2bc814-aa7c-4020-80be-7b21884a5e3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.361575 Nov 06 20:49:12.537441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cf916082-1bf0-4e32-94ca-c52a3aba2fa3 req-e522d91d-007c-4370-a0cc-0df5de9fa5d6 service nova] Creating event network-changed:6d26848c-1778-44c0-bace-52e4edf6e3ce for instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 on nch2-master-1 Nov 06 20:49:12.543419 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cf916082-1bf0-4e32-94ca-c52a3aba2fa3 req-e522d91d-007c-4370-a0cc-0df5de9fa5d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041377 Nov 06 20:49:12.544699 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 399/849] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:12.547215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 451/850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:12 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:12.549847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:12.551032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:12.554771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-33bf94a7-0068-4a38-800c-d86ff0944eb6 req-f824f4c9-67ab-4e89-a669-44d4a766bda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076b774b-c0f3-48be-81d9-19eb22ea5180", "name": "network-vif-plugged", "status": "completed", "tag": "54ace632-cbd6-43aa-8893-e4b61c4f9be1"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:12.557004 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:12.557004 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:12.558978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.559593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.560824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.561581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.565162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-33bf94a7-0068-4a38-800c-d86ff0944eb6 req-f824f4c9-67ab-4e89-a669-44d4a766bda3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:12.565599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-33bf94a7-0068-4a38-800c-d86ff0944eb6 req-f824f4c9-67ab-4e89-a669-44d4a766bda3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:12.593653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-33bf94a7-0068-4a38-800c-d86ff0944eb6 req-f824f4c9-67ab-4e89-a669-44d4a766bda3 service nova] Creating event network-vif-plugged:54ace632-cbd6-43aa-8893-e4b61c4f9be1 for instance 076b774b-c0f3-48be-81d9-19eb22ea5180 on nch2-master-1 Nov 06 20:49:12.613733 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-33bf94a7-0068-4a38-800c-d86ff0944eb6 req-f824f4c9-67ab-4e89-a669-44d4a766bda3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063000 Nov 06 20:49:12.614450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 452/851] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:12.640772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a28bec8d-32c2-4e7c-a097-168655170213 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:12.644245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a28bec8d-32c2-4e7c-a097-168655170213 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:12.769152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a28bec8d-32c2-4e7c-a097-168655170213 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:12.777724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a28bec8d-32c2-4e7c-a097-168655170213 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1225 microversion: 2.1 time: 0.160090 Nov 06 20:49:12.783291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 453/852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:12 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:12.804246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: .version_select at 0x7f6717bd2ca0>, body: {"removeFloatingIp": {"address": "172.35.0.174"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:13.108221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:13.125805 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34f7264f-82f8-426d-ad29-c25f08832e3a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.579659 Nov 06 20:49:13.126681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 400/853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:12 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:13.131464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3bfb3e9e-2bc7-49e7-8aaa-0241f88e8676 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f6715607940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.134502 ncdv-master-1 devstack@n-api.service[134828]: WARNING oslo_db.sqlalchemy.utils [None req-3bfb3e9e-2bc7-49e7-8aaa-0241f88e8676 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:49:13.148604 ncdv-master-1 devstack@n-api.service[134828]: WARNING oslo_db.sqlalchemy.utils [None req-3bfb3e9e-2bc7-49e7-8aaa-0241f88e8676 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:49:13.172983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3bfb3e9e-2bc7-49e7-8aaa-0241f88e8676 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.044862 Nov 06 20:49:13.178797 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 401/854] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:49:13 2021] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:13.183696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c473e65-049b-4121-86f1-2e3da9c4c80e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f6715654820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.208561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c473e65-049b-4121-86f1-2e3da9c4c80e tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873132441" status: 202 len: 0 microversion: 2.1 time: 0.028882 Nov 06 20:49:13.209957 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 402/855] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Nov 6 20:49:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873132441 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:13.216666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:13.218482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f50fd2d-060b-46f0-9209-61cc98b0c46a tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f6715737af0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.224251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.225004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:13.225965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.227300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:13.241676 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f50fd2d-060b-46f0-9209-61cc98b0c46a tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-950173944" status: 202 len: 0 microversion: 2.1 time: 0.027251 Nov 06 20:49:13.246413 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 403/856] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:49:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-950173944 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:49:13.251630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b19c446e-699d-4047-961b-c714fe5386d3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] Calling method '.version_select at 0x7f671564f430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.274859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b19c446e-699d-4047-961b-c714fe5386d3 tempest-KeyPairsV2TestJSON-1280193987 tempest-KeyPairsV2TestJSON-1280193987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1159096410" status: 202 len: 0 microversion: 2.1 time: 0.027269 Nov 06 20:49:13.275584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 404/857] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Nov 6 20:49:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1159096410 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:13.447811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbcde497-df9c-4705-a2d6-de2369bd1928 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67159b9700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.545664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbcde497-df9c-4705-a2d6-de2369bd1928 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.105409 Nov 06 20:49:13.555441 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 405/858] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:13 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:13.578186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:13.579621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:13.598031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.598750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:13.601734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.603042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:13.712842 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b4a0bed-41b0-421a-992b-9d598d2df121 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.155770 Nov 06 20:49:13.714466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 406/859] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:13 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:13.722695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:13.724192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:13.735772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.736707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:13.737986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:13.739180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:14.038613 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] HTTP exception thrown: Floating IP 172.35.0.174 is not associated with instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5. Nov 06 20:49:14.040643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Returning 409 to user: Floating IP 172.35.0.174 is not associated with instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:14.041723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b8b1085-72d2-4cf5-9554-8abc84e89e85 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action" status: 409 len: 146 microversion: 2.1 time: 1.257107 Nov 06 20:49:14.045638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 454/860] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:12 2021] POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action => generated 146 bytes in 1259 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:14.047830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:14.049587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:14.071311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:14.072231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:14.075392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:14.077031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:14.257770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:14.274520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90d63723-7856-4b85-bb1d-3b7e26416618 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1283 microversion: 2.1 time: 0.229810 Nov 06 20:49:14.284704 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 455/861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:14 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:14.499597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-742ef2af-1305-4fda-a783-bf5cefdcd5cb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f671586ae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2038479949", "description": "tempest-description-1954333155"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:14.511537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:14.521843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f16f9096-0476-4207-a8a1-033710d7a13a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.805651 Nov 06 20:49:14.524881 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 407/862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:13 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:14.533645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: .version_select at 0x7f6717bd4ca0>, body: {"removeFloatingIp": {"address": "172.35.0.174"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:15.138414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:15.152869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:15.153423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:15.154243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:15.155133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:15.905389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-742ef2af-1305-4fda-a783-bf5cefdcd5cb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.625559 Nov 06 20:49:15.906665 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 456/863] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:14 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:15.918470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:15.919453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:15.936118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:15.936840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:15.938750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:15.939460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.075059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Acquired lock "refresh_cache-f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:49:16.271367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:16.279899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-283914fc-3480-4159-bc32-e0e3ae591d21 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1319 microversion: 2.1 time: 0.365466 Nov 06 20:49:16.281223 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 457/864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:15 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:16.286165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e00b4230-9827-430e-82ed-593d8dc2dc89 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671586a1f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:16.348923 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e00b4230-9827-430e-82ed-593d8dc2dc89 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.066319 Nov 06 20:49:16.353405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 458/865] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:16 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:16.362286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8595966-9481-4f67-ae11-9c01c69e4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "ceb2b1ae-458d-4e31-95da-03e6fc97edec"}, {"server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "name": "network-vif-plugged", "status": "completed", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:16.364363 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:16.364363 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:16.375559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.376017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.390537 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] Creating event network-vif-plugged:ceb2b1ae-458d-4e31-95da-03e6fc97edec for instance b8595966-9481-4f67-ae11-9c01c69e4c9f on nch1-master-1 Nov 06 20:49:16.391049 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] Creating event network-vif-plugged:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch2-master-1 Nov 06 20:49:16.404122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5b967e7c-1ccf-4b97-b2a1-c5a5503c4e24 req-5252fee9-4822-48d1-9e1d-dc5e552c732b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048520 Nov 06 20:49:16.404919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 459/866] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:16.409930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:16.420806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:16.434226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.434680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.435482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.435921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.497122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9245c61f-401f-4652-8e38-cdb7b39b7b66 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.090719 Nov 06 20:49:16.497763 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 460/867] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:16 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:16.502987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:16.503687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:16.510454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.511850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.512696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.513162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.624895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:16.638120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79688356-9f52-44f6-ba8e-b417a7fad373 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1283 microversion: 2.1 time: 0.139132 Nov 06 20:49:16.645739 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 461/868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:16 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:16.814716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Calling method '.version_select at 0x7f671586ad30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:16.828561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.829223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.830521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.831334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.852700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62b90479-faa7-48b9-96f7-c675e9715068 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.212399 Nov 06 20:49:16.861050 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 462/869] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Nov 6 20:49:16 2021] GET /compute/v2.1/limits => generated 511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:16.876959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:16.877845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:16.887307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.887509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:16.888485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:16.888939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:17.278684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:17.288814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f5c688d-6dff-4198-a0e7-d6341a243679 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1313 microversion: 2.1 time: 0.433094 Nov 06 20:49:17.299674 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 463/870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:16 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:17.305630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f16a8b8-e15b-48cf-b58d-0fdfa277e428 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6715745310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1966218128", "description": "tempest-description-1209866257"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:17.689806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Building network info cache for instance {{(pid=134828) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:17.832977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f16a8b8-e15b-48cf-b58d-0fdfa277e428 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.531896 Nov 06 20:49:17.834165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 464/871] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:17 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:17.839581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1254620186", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:17.964190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:19.169373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Getting quotas for project 7e14c5d54dfd4e30af048d594c5ac56b. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:19.179823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Getting quotas for user 8c65f002297e4473adde462d06b274c8 and project 7e14c5d54dfd4e30af048d594c5ac56b. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:19.207667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 06 20:49:19.208656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:19.209701 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57d04775-c8c5-4ddb-b2f4-80a2cb3776b5 tempest-AbsoluteLimitsNegativeTestJSON-587636223 tempest-AbsoluteLimitsNegativeTestJSON-587636223-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.374191 Nov 06 20:49:19.211021 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 465/872] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Nov 6 20:49:17 2021] POST /compute/v2.1/servers => generated 87 bytes in 1376 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:19.224052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:19.225212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:19.244435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.245339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.246375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.247095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.462581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Updating instance_info_cache with network_info: [{"id": "6d26848c-1778-44c0-bace-52e4edf6e3ce", "address": "fa:16:3e:08:89:1e", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6d26848c-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:19.483934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Releasing lock "refresh_cache-f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:49:19.485905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ea4b2b7-0a6c-4bd8-88b8-09e1ca93093a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9/action" status: 202 len: 0 microversion: 2.1 time: 4.959516 Nov 06 20:49:19.504941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 408/873] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:14 2021] POST /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9/action => generated 0 bytes in 4979 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:49:19.522305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6fee4cbe-c30f-4212-a07a-26279b000eb2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a06f70>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:19.615331 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6fee4cbe-c30f-4212-a07a-26279b000eb2 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.107921 Nov 06 20:49:19.615804 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 409/874] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:19 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:19.633280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:19.636973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:19.650233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.652907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.654771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.656888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.692404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:19.728013 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e57ec152-128c-4e8e-a7dc-5200e5fd284e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1469 microversion: 2.1 time: 0.513749 Nov 06 20:49:19.747350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 466/875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:19 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:19.761606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:19.765503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:19.781031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.782688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.785445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.786849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.808117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9955e107-a131-4e0c-a402-a9edc2828dd5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.187234 Nov 06 20:49:19.813653 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 410/876] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:19 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:19.822695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7de22040-5f95-4235-8bb2-9e849dda6e21 req-d72996da-2a50-4897-84ac-b85ec656ade3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9", "tag": "6d26848c-1778-44c0-bace-52e4edf6e3ce"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:19.826599 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:19.826599 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:19.849654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7de22040-5f95-4235-8bb2-9e849dda6e21 req-d72996da-2a50-4897-84ac-b85ec656ade3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:19.850694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7de22040-5f95-4235-8bb2-9e849dda6e21 req-d72996da-2a50-4897-84ac-b85ec656ade3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:19.873415 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7de22040-5f95-4235-8bb2-9e849dda6e21 req-d72996da-2a50-4897-84ac-b85ec656ade3 service nova] Creating event network-changed:6d26848c-1778-44c0-bace-52e4edf6e3ce for instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 on nch2-master-1 Nov 06 20:49:19.879893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7de22040-5f95-4235-8bb2-9e849dda6e21 req-d72996da-2a50-4897-84ac-b85ec656ade3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063891 Nov 06 20:49:19.881906 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 411/877] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:19.890590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-67592010", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "56bd5fa7-53ab-42b8-8aa7-49a32b3547be"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:19.990994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] validate_networks() for [('56bd5fa7-53ab-42b8-8aa7-49a32b3547be', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:20.868058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:20.884551 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6c237952-22d8-44d5-8edf-debf79d69540 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 1.134244 Nov 06 20:49:20.896404 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 467/878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:19 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:20.905510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:20.907444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:20.918930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:20.921977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:20.926327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:20.928476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.460206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:21.471509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc8876e3-2b0b-4c98-8dbe-3b4033797426 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1463 microversion: 2.1 time: 0.573643 Nov 06 20:49:21.472088 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 468/879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:20 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1463 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:21.476407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:21.489054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:21.496149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.496627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.497419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.497875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.552211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:49:21.663452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:21.664863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:21.665576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:21.666173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:21.666824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:21.692393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b583a47d-fa64-4566-b64e-2bbc3d89dbe9 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 204 len: 0 microversion: 2.1 time: 0.218988 Nov 06 20:49:21.694900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.695594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.702523 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 469/880] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:49:21 2021] DELETE /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:21.703535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:21.704249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:21.704603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.705126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.713119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.714383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.715340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:21.716111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:21.746473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Getting quotas for project 0a012746186e4431bf96fa9c5a3bc116. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:21.759671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Getting quotas for user e2da9baa4b40417294173ec358b91fda and project 0a012746186e4431bf96fa9c5a3bc116. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:21.792252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:21.795754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:21.913266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4399e9f0-db30-4b6d-b33f-ebe2bb90409d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.029134 Nov 06 20:49:21.919333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 412/881] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:21.961012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f116946-e408-4489-8e8f-c94587b357a1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671574c670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:22.043065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f116946-e408-4489-8e8f-c94587b357a1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.122434 Nov 06 20:49:22.043711 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 413/882] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:21 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:22.063322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:22.065585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:22.082304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.083072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:22.087453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.088146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:22.106233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:22.119244 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78a221b7-69a5-41ac-a31d-a4d985548916 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 200 len: 1469 microversion: 2.1 time: 0.419492 Nov 06 20:49:22.120609 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 470/883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:21 2021] GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:22.191023 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9fde45b-f2e8-48d3-91dc-a1215d31b923 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.140222 Nov 06 20:49:22.195793 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 414/884] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:22 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:22.203100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.174"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:22.206910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:22.233942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.234981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:22.236758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.239171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:22.337495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Acquired lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:49:22.505086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:22.506380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:22.513084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.513855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:22.514976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:22.515833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:23.297839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d4d1760-a6f8-45b4-bf2c-07cfa45d98af tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1614 microversion: 2.1 time: 1.175904 Nov 06 20:49:23.300984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 471/885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:22 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1614 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:23.315838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:23.316802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:23.327546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:23.328372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:23.329433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:23.330090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.099989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:24.112513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3112c606-d8d0-422c-bde6-9f2b8eec9200 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 0.809730 Nov 06 20:49:24.127818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 472/886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:23 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:24.133917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:24.134752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:24.143320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.144086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.145127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.145749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.287054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:24.302219 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94a27f23-6c95-4fba-8617-ace6749a1207 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1272 microversion: 2.1 time: 0.172075 Nov 06 20:49:24.303493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 473/887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:24 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:24.311389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d5c312b2-216b-461e-9d77-67b4cfb2f833 req-90192ff2-7648-4f86-99b4-26da5cfa9541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe417ed-b509-4da2-9cd8-d79891f228b7", "tag": "c83693a3-2e65-4ffa-b0e0-7a93f6dabc38"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:24.315883 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:24.315883 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:24.324622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d5c312b2-216b-461e-9d77-67b4cfb2f833 req-90192ff2-7648-4f86-99b4-26da5cfa9541 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.325721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d5c312b2-216b-461e-9d77-67b4cfb2f833 req-90192ff2-7648-4f86-99b4-26da5cfa9541 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.344854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d5c312b2-216b-461e-9d77-67b4cfb2f833 req-90192ff2-7648-4f86-99b4-26da5cfa9541 service nova] Creating event network-changed:c83693a3-2e65-4ffa-b0e0-7a93f6dabc38 for instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 on nch1-master-1 Nov 06 20:49:24.358299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d5c312b2-216b-461e-9d77-67b4cfb2f833 req-90192ff2-7648-4f86-99b4-26da5cfa9541 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049469 Nov 06 20:49:24.359625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 474/888] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:24.365490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:24.371418 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:24.371418 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:24.372921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:24.373955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Searching by: {'reservation_id': 'r-f47m1niu', 'deleted': False, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:49:24.380968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.382507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.383534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.384203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:24.524762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 20:49:24.629609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:24.649733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:24.650607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:25.221499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c91c3dd-76c6-4007-95b4-895981f7d5b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-f47m1niu" status: 200 len: 2931 microversion: 2.1 time: 0.860433 Nov 06 20:49:25.224013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 475/889] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Nov 6 20:49:24 2021] GET /compute/v2.1/servers/detail?reservation_id=r-f47m1niu => generated 2931 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:25.245516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cee100aa-baab-4382-8b7f-678c4fa73518 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67157e2dc0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:25.335565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cee100aa-baab-4382-8b7f-678c4fa73518 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1428 microversion: 2.1 time: 0.110007 Nov 06 20:49:25.337251 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 476/890] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:25 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:25.350980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:25.352659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:25.361934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:25.363208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:25.364570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:25.365241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:25.384584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Building network info cache for instance {{(pid=134828) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:25.462436 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1df30fbd-06eb-4b51-b7f9-7212e2ba1624 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.123587 Nov 06 20:49:25.462984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 477/891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:25 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:25.475891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:25.475891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:25.491586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:25.491994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:25.493092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:25.493270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:25.582622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd09ded262e1b494a8e49659cd261b44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354efa8e67b248809969c1eff9dbd23a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:25.583790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] flavor_id is None. Assuming migration. {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 06 20:49:25.583790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 20:49:26.450144 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6427e3c3-02b4-4606-9175-64f1676c4ceb tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.982704 Nov 06 20:49:26.451559 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 478/892] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:25 2021] POST /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc/action => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:26.562580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-411246474", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:26.668187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:26.686623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Updating instance_info_cache with network_info: [{"id": "9eaa17aa-8d51-4952-ae6c-ed188e592373", "address": "fa:16:3e:d6:ae:8f", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9eaa17aa-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:26.704814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Releasing lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:49:26.705877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a73643d-2dec-42f8-bed7-15c3a0949b28 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action" status: 202 len: 0 microversion: 2.1 time: 4.510858 Nov 06 20:49:26.710592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 415/893] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:22 2021] POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action => generated 0 bytes in 4517 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:49:26.715697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:26.723791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:26.734277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:26.736670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:26.739750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:26.740550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.057112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:27.063947 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de3f6b40-7651-4b27-b960-96231ec0ca75 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 0.351905 Nov 06 20:49:27.064565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 416/894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:26 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:27.106164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8447bde-39a4-43f2-a42f-1f318246081d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:27.129386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.server_groups [None req-a8447bde-39a4-43f2-a42f-1f318246081d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Querying cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) for 2 instances {{(pid=134828) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 06 20:49:27.130665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8447bde-39a4-43f2-a42f-1f318246081d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.131377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8447bde-39a4-43f2-a42f-1f318246081d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.157452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8447bde-39a4-43f2-a42f-1f318246081d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/c37076d6-62ee-44e5-893d-29c8be670b50" status: 200 len: 271 microversion: 2.1 time: 0.075809 Nov 06 20:49:27.158347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 417/895] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:49:27 2021] GET /compute/v2.1/os-server-groups/c37076d6-62ee-44e5-893d-29c8be670b50 => generated 271 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:27.164337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:27.165886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:27.173943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.174580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.175566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.176022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.404925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:27.405347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:27.405826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:27.406242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:27.406656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:27.431180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.431559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.432495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.432927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.434213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:27.443376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-074d967f-85fa-46b0-8364-55e6af374725 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1314 microversion: 2.1 time: 0.283828 Nov 06 20:49:27.445302 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 418/896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:27 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:27.450907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4dab13e9-6612-4797-b400-034ca6797a63 req-8023cc3b-eb6b-4fe7-a6ae-75c19368c8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad", "tag": "e541788d-ed2f-4fde-8f49-0c9128ea5e7a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:27.452783 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:27.452783 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:27.460217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4dab13e9-6612-4797-b400-034ca6797a63 req-8023cc3b-eb6b-4fe7-a6ae-75c19368c8dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.460911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4dab13e9-6612-4797-b400-034ca6797a63 req-8023cc3b-eb6b-4fe7-a6ae-75c19368c8dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.464636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:27.470357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:27.475706 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4dab13e9-6612-4797-b400-034ca6797a63 req-8023cc3b-eb6b-4fe7-a6ae-75c19368c8dc service nova] Creating event network-changed:e541788d-ed2f-4fde-8f49-0c9128ea5e7a for instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad on nch2-master-1 Nov 06 20:49:27.481703 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4dab13e9-6612-4797-b400-034ca6797a63 req-8023cc3b-eb6b-4fe7-a6ae-75c19368c8dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034830 Nov 06 20:49:27.482821 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 419/897] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:27.489751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6dc6591-1732-4282-9ef5-4fe1d1c41daa tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f671564f310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:27.515618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:27.522120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:27.548360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6dc6591-1732-4282-9ef5-4fe1d1c41daa tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1437 microversion: 2.1 time: 0.063374 Nov 06 20:49:27.555063 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 420/898] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:27 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:27.555947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9", "name": "network-vif-deleted", "tag": "6d26848c-1778-44c0-bace-52e4edf6e3ce"}, {"name": "network-changed", "server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:27.557688 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:27.557688 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:27.573247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.573700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.597458 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91a3c3ad-eb05-4fbb-a1ee-ff035da562e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144238 Nov 06 20:49:27.597941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] Creating event network-vif-deleted:6d26848c-1778-44c0-bace-52e4edf6e3ce for instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 on nch2-master-1 Nov 06 20:49:27.598722 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] Creating event network-changed:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:49:27.599344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 479/899] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:27.605498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-31823c31-f99c-4231-87bb-a91f6ede8eb8 req-418d9d1a-6af5-45d0-9cf9-d6d9b9d53f90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055044 Nov 06 20:49:27.606702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 421/900] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:27.610135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:27.611443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:27.613924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:27.615140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:27.622096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.622835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.623646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.624086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.666157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.668807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.669724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:27.670385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:27.852006 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c5e404d-ff29-410f-b319-a1c605d3375b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.243642 Nov 06 20:49:27.854639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 422/901] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:27 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:27.860274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d15fd86d-5ac5-41e9-8e52-6756b8de7100 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '.version_select at 0x7f67156f23a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:28.097757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:28.110566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b01b699e-aa50-4c90-b6bb-a513bee21e48 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1472 microversion: 2.1 time: 0.508636 Nov 06 20:49:28.111229 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 480/902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:27 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:28.126756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:28.138131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:28.154531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.155055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.155936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.156679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.318352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d15fd86d-5ac5-41e9-8e52-6756b8de7100 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/4f3386df-97bb-4e5f-b8e8-8e6e5caa05da" status: 200 len: 185 microversion: 2.1 time: 0.461777 Nov 06 20:49:28.319011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 423/903] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:49:27 2021] GET /compute/v2.1/os-floating-ips/4f3386df-97bb-4e5f-b8e8-8e6e5caa05da => generated 185 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:28.323837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85b42654-391c-47a9-bae7-b0c62b84a10f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715a06280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:28.380117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85b42654-391c-47a9-bae7-b0c62b84a10f tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 200 len: 1437 microversion: 2.1 time: 0.060157 Nov 06 20:49:28.381142 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 424/904] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:49:28 2021] GET /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:28.385973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:28.386686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:28.393132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.393303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.394069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.394503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.426560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1561de6-0529-4be8-b2f7-3a6b07a4a2b1 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 200 len: 1620 microversion: 2.1 time: 0.314201 Nov 06 20:49:28.427167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 481/905] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:28 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 1620 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:28.437919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:28.440429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:28.446696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.447384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.449139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:28.449804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:28.493472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:28.501682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c03f8bcf-baa0-4982-95bb-964f05bd4369 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1218 microversion: 2.1 time: 0.119367 Nov 06 20:49:28.502513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 425/906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:28 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:28.507792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.174"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:29.010246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:29.023020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.024770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.026068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.026706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.037095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:29.048062 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70d4d400-4f79-4565-a484-cc72c3010ebd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 0.614570 Nov 06 20:49:29.048665 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 482/907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:28 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:29.058956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:29.059802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:29.065796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.066554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.067502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.068089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.462503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:29.472334 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70702390-e7a8-41a3-8c99-9e6b37378904 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1467 microversion: 2.1 time: 0.422246 Nov 06 20:49:29.485166 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 483/908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:29 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1467 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:29.491368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Acquired lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:49:29.492051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:29.492750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:29.499338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.499790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.500656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.501091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.822358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66867195-5bc2-427a-a452-ee830c757878 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 200 len: 1620 microversion: 2.1 time: 0.334824 Nov 06 20:49:29.823418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 484/909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:29 2021] GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 1620 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:29.827570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:29.828162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:29.837572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.837572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:29.837572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:29.837572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:30.216401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:30.223673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd1e55a2-aa1f-42c5-be1e-b6dc740bc0ac tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1314 microversion: 2.1 time: 0.399311 Nov 06 20:49:30.224634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 485/910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:29 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:30.229185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:30.229868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:30.235408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:30.235858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:30.236678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:30.237105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:30.278026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-783a1187-ab7a-431e-bdab-a90f3deae7a0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.052239 Nov 06 20:49:30.278957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 486/911] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:30 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:30.283837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:30.284565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:30.291524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:30.291975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:30.292785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:30.293217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:30.625410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:30.632848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fde9e254-2118-4b5f-a8aa-12d70fd5bbb4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.352789 Nov 06 20:49:30.633418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 487/912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:30 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:30.638176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57f14eef-936e-42b7-93ec-46aa3adc00f3 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f6715745af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:30.738055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Building network info cache for instance {{(pid=134828) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:49:31.253713 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57f14eef-936e-42b7-93ec-46aa3adc00f3 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "DELETE /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740" status: 204 len: 0 microversion: 2.1 time: 0.619107 Nov 06 20:49:31.257966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 488/913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:30 2021] DELETE /compute/v2.1/images/f84aca49-fa3c-4a6d-9882-add991089740 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:31.262727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:31.263529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:31.270390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:31.271069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:31.271863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:31.272492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:31.643377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:31.653594 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-604b03d9-86b2-4e54-8c6b-88f4349e5a70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.394187 Nov 06 20:49:31.654835 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 489/914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:31 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:31.660909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9f50bdb5-6bf1-4914-99d0-d205e425f213 req-9c8db16c-3ecd-48d3-be6e-15ed3aaa0e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe417ed-b509-4da2-9cd8-d79891f228b7", "name": "network-vif-plugged", "status": "completed", "tag": "c83693a3-2e65-4ffa-b0e0-7a93f6dabc38"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:31.662836 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:31.662836 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:31.672614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f50bdb5-6bf1-4914-99d0-d205e425f213 req-9c8db16c-3ecd-48d3-be6e-15ed3aaa0e9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:31.673437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f50bdb5-6bf1-4914-99d0-d205e425f213 req-9c8db16c-3ecd-48d3-be6e-15ed3aaa0e9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:31.688036 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9f50bdb5-6bf1-4914-99d0-d205e425f213 req-9c8db16c-3ecd-48d3-be6e-15ed3aaa0e9d service nova] Creating event network-vif-plugged:c83693a3-2e65-4ffa-b0e0-7a93f6dabc38 for instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 on nch1-master-1 Nov 06 20:49:31.695042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9f50bdb5-6bf1-4914-99d0-d205e425f213 req-9c8db16c-3ecd-48d3-be6e-15ed3aaa0e9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038743 Nov 06 20:49:31.697180 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 490/915] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:31.702845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-804670388", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8b5b22e4-35d2-4939-98cb-aa65cd77afbc"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:31.804566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:32.118218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Updating instance_info_cache with network_info: [{"id": "9eaa17aa-8d51-4952-ae6c-ed188e592373", "address": "fa:16:3e:d6:ae:8f", "network": {"id": "70df8f7c-e170-4849-829e-02a0385fa7a0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1189276500-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7a2501529c1496e839dda964a1d9f9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9eaa17aa-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:49:32.136117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Releasing lock "refresh_cache-2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:49:32.137422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93b5503f-e8b0-41c7-87c5-384e11c9f117 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action" status: 202 len: 0 microversion: 2.1 time: 3.633599 Nov 06 20:49:32.138263 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 426/916] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:28 2021] POST /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5/action => generated 0 bytes in 3635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:49:32.143755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.152587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.159516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.160156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.168500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.169156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.338816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:32.339290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:32.339837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:32.340249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:32.340704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:32.354777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.355226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.357065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.357893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.377235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:32.381897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:32.394350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:32.397290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:32.443061 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f016a7e-215c-4ac8-8c9c-d62fd2d9391a tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744347 Nov 06 20:49:32.443886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 491/917] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:32.449915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-436b526a-d016-4aa1-90f3-5cc9ba0cfa49 req-282e71b0-aac5-4c8b-b26b-08356569c427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:32.451636 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:32.451636 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:32.453738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:32.460502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-436b526a-d016-4aa1-90f3-5cc9ba0cfa49 req-282e71b0-aac5-4c8b-b26b-08356569c427 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.460502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-436b526a-d016-4aa1-90f3-5cc9ba0cfa49 req-282e71b0-aac5-4c8b-b26b-08356569c427 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.464817 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66b6ab87-42dd-437e-99c9-b77db9cbef59 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 0.325320 Nov 06 20:49:32.465889 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 427/918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:32 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:32.472435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.473043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.480146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.480894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.482124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.482723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.487657 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-436b526a-d016-4aa1-90f3-5cc9ba0cfa49 req-282e71b0-aac5-4c8b-b26b-08356569c427 service nova] Creating event network-changed:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:49:32.497876 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-436b526a-d016-4aa1-90f3-5cc9ba0cfa49 req-282e71b0-aac5-4c8b-b26b-08356569c427 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052220 Nov 06 20:49:32.502386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 492/919] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:32.510771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03e3841d-ed66-45cf-9014-8c42c969b5e4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '.version_select at 0x7f67158b85e0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.554196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-03e3841d-ed66-45cf-9014-8c42c969b5e4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] HTTP exception thrown: Image not found. Nov 06 20:49:32.554806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03e3841d-ed66-45cf-9014-8c42c969b5e4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:32.556011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03e3841d-ed66-45cf-9014-8c42c969b5e4 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "DELETE /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a" status: 404 len: 62 microversion: 2.1 time: 0.052271 Nov 06 20:49:32.556646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 493/920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:32 2021] DELETE /compute/v2.1/images/c057a45e-af2e-44a4-8225-059244455c4a => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:32.561948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:32.563746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.591040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.591630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.593176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.595057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.662180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aad0184-daee-41a8-abc2-80bfd34b49fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.104017 Nov 06 20:49:32.663485 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 494/921] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:32 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:32.671164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.673458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.690746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.691745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.693276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.693726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.799396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:32.809563 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d34ac72-7c69-47b1-8697-19e230a61727 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1314 microversion: 2.1 time: 0.342282 Nov 06 20:49:32.810510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 428/922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:32 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:32.815561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.816368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.824748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.825827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.826873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:32.827530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:32.846735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] HTTP exception thrown: Instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 could not be found. Nov 06 20:49:32.847813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Returning 404 to user: Instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:32.849456 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad0e7895-ee58-4f76-9165-7f2622ef8919 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 404 len: 111 microversion: 2.1 time: 0.037316 Nov 06 20:49:32.854188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 429/923] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:49:32 2021] DELETE /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:32.881430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98675e83-11a0-4ff0-8faa-21387ed8ad66 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:32.882061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98675e83-11a0-4ff0-8faa-21387ed8ad66 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:32.989297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-98675e83-11a0-4ff0-8faa-21387ed8ad66 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:32.992478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:33.001130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e91c0f98-a71c-4149-a45c-ea06ab231c71 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.336335 Nov 06 20:49:33.001601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98675e83-11a0-4ff0-8faa-21387ed8ad66 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1216 microversion: 2.1 time: 0.139703 Nov 06 20:49:33.002192 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 495/924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:32 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:33.012719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 430/925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:32 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1216 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:33.012719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.012719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.017774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.019821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.021590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.022248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.026500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.027249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.035195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.035792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.036723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.037853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.072121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:49:33.191743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b4c5c9b-8fe5-402f-b351-b8cae26e7991 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 204 len: 0 microversion: 2.1 time: 0.186802 Nov 06 20:49:33.192485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 431/926] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:49:33 2021] DELETE /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:33.201530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.202545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.209092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:33.211308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.211776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.212733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.213376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.217546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2ef8217a-821b-4990-937b-0aad9de53cb0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.203055 Nov 06 20:49:33.218137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 496/927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:33 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:33.223707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.224588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.231487 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] HTTP exception thrown: Instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 could not be found. Nov 06 20:49:33.232166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Returning 404 to user: Instance f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:33.233190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00f926c6-e2a0-4120-9383-ff997042b393 tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9" status: 404 len: 111 microversion: 2.1 time: 0.039262 Nov 06 20:49:33.233829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 432/928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:33 2021] GET /compute/v2.1/servers/f20d9ce7-cb3e-45bc-ab1f-e195fc7df3e9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:33.238514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.239281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.240316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.240801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.241828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b9e6e1f-4c71-4ade-91bd-0e4a3fa033ec tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '.version_select at 0x7f67156154c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.487761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:33.495930 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4be2eb2d-bccc-4594-af9f-f3de1dc874e1 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1473 microversion: 2.1 time: 0.276786 Nov 06 20:49:33.496628 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 497/929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:33 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:33.501072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.501676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.507262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.507715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.508639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.509083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.827875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:33.835282 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-462d678f-de71-4900-945a-90cee3395410 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1349 microversion: 2.1 time: 0.337625 Nov 06 20:49:33.838051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 498/930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:33 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1349 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:33.842955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:33.844272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.851250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.851927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.853023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.853362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.909258 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cc1c6ec-db01-4910-b3d7-480d0054a175 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.069449 Nov 06 20:49:33.910464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 499/931] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:33 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:33.917315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-unplugged", "status": "completed", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}, {"server_uuid": "fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad", "name": "network-vif-plugged", "status": "completed", "tag": "e541788d-ed2f-4fde-8f49-0c9128ea5e7a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:33.918924 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:33.918924 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:33.930214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.930667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.948097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] Creating event network-vif-unplugged:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:49:33.948800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] Creating event network-vif-plugged:e541788d-ed2f-4fde-8f49-0c9128ea5e7a for instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad on nch2-master-1 Nov 06 20:49:33.957662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-aa18e9f4-144f-4aca-8172-09e7eaa0de9b req-d682baa0-d972-47e6-97df-04592141f188 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045398 Nov 06 20:49:33.958492 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 500/932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:33 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:33.965772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:33.967072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:33.975140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.975601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:33.976654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:33.978103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.250515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:34.258339 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fc45f26-3954-4a87-8671-360d2fb9eefa tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1314 microversion: 2.1 time: 0.298707 Nov 06 20:49:34.258914 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 501/933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:33 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:34.264286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.265020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.274482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.274942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.276341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.276946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.402835 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b9e6e1f-4c71-4ade-91bd-0e4a3fa033ec tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/4f3386df-97bb-4e5f-b8e8-8e6e5caa05da" status: 202 len: 0 microversion: 2.1 time: 1.163600 Nov 06 20:49:34.404419 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 433/934] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:49:33 2021] DELETE /compute/v2.1/os-floating-ips/4f3386df-97bb-4e5f-b8e8-8e6e5caa05da => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:49:34.414802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.415505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.430712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.431354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.446893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.450106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.484507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:34.492067 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e34c886-2b65-43c2-a503-19437a17bbe2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.231938 Nov 06 20:49:34.492725 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 502/935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:34 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:34.497560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.498172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.518043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.518043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.526674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.527274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.717695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:34.724583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d74ed04-d0fd-4cde-9a42-ada8d4f79178 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.318281 Nov 06 20:49:34.728406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 434/936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:34 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:34.730105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.730600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.743583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.744858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.746698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.747407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.773897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:34.780513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:49:34.787782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-773b87b7-4a61-4f22-bf28-11bcdb76480c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.293569 Nov 06 20:49:34.788783 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 503/937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:34 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:34.794238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.795219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.802435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.803159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.804516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.805326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.886493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb1dcd0c-9f6c-4498-8e27-626f57cc00cb tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 204 len: 0 microversion: 2.1 time: 0.159690 Nov 06 20:49:34.890368 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 435/938] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:49:34 2021] DELETE /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:34.899487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8c5b6d33-2aab-466f-834d-15e3940f83ad req-0be1f946-7c6a-4ebd-9565-eebe78a3e393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760", "tag": "66e68cd1-c539-47b0-a618-67e82324fd7c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:34.899487 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:34.899487 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:34.906218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8c5b6d33-2aab-466f-834d-15e3940f83ad req-0be1f946-7c6a-4ebd-9565-eebe78a3e393 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.906838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8c5b6d33-2aab-466f-834d-15e3940f83ad req-0be1f946-7c6a-4ebd-9565-eebe78a3e393 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.922809 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8c5b6d33-2aab-466f-834d-15e3940f83ad req-0be1f946-7c6a-4ebd-9565-eebe78a3e393 service nova] Creating event network-changed:66e68cd1-c539-47b0-a618-67e82324fd7c for instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 on nch1-master-1 Nov 06 20:49:34.927985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8c5b6d33-2aab-466f-834d-15e3940f83ad req-0be1f946-7c6a-4ebd-9565-eebe78a3e393 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038816 Nov 06 20:49:34.928969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 436/939] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:34.936209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:34.937147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:34.945161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.945709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:34.946591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:34.947116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.062448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:35.086940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf9da4b5-cb27-4283-b54e-af02cefa7e9e tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1473 microversion: 2.1 time: 0.296506 Nov 06 20:49:35.095224 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 504/940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:34 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:35.105459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:35.107309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:35.120648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.121341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.122440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.123028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.223863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:35.236997 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83fd9db7-16c9-4e38-bc14-b934f1dbc03e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1539 microversion: 2.1 time: 0.306628 Nov 06 20:49:35.238393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 437/941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:34 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1539 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:35.244001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:35.245756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:35.255151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.255867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.257104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.257783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.315375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e21cdb6-db4a-4f65-a2d2-68487abce116 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.074987 Nov 06 20:49:35.316472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 438/942] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:35 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:35.322253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:35.324357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:35.332487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.333408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.334021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.334619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.445068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:35.458688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0fec9c12-efe1-4624-9b06-afc832cdb18e tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1525 microversion: 2.1 time: 0.361964 Nov 06 20:49:35.460150 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 505/943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:35 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1525 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:35.465658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:35.466286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:35.473623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.474253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.475633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.476139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.498152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7206f6e-c223-4603-b9ba-1c9210993992 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179840 Nov 06 20:49:35.499064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 439/944] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:49:35 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:35.506859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8032f68c-4094-41ee-95eb-e09309ec9bdb req-227dcceb-701c-485a-9256-b5016404dac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2", "tag": "d5870610-f04f-4d8b-9b83-6e4dd925cbe7"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:35.509046 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:35.509046 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:35.517678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8032f68c-4094-41ee-95eb-e09309ec9bdb req-227dcceb-701c-485a-9256-b5016404dac0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.518235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8032f68c-4094-41ee-95eb-e09309ec9bdb req-227dcceb-701c-485a-9256-b5016404dac0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.532060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8032f68c-4094-41ee-95eb-e09309ec9bdb req-227dcceb-701c-485a-9256-b5016404dac0 service nova] Creating event network-changed:d5870610-f04f-4d8b-9b83-6e4dd925cbe7 for instance 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 on nch2-master-1 Nov 06 20:49:35.538057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8032f68c-4094-41ee-95eb-e09309ec9bdb req-227dcceb-701c-485a-9256-b5016404dac0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037713 Nov 06 20:49:35.538759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 440/945] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:35.545945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:35.546814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:35.553650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.555720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:35.556576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:35.557220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.315759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:36.329617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c285a082-5ccd-4bbf-b27d-9e4a6a5a24c3 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1314 microversion: 2.1 time: 0.868201 Nov 06 20:49:36.339797 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 506/946] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:35 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:36.346048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:36.346732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:36.354333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.359809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.361096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.361680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.369018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:36.382333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-411f03c8-399c-43cc-8f39-e45ad3c25e67 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.840959 Nov 06 20:49:36.383361 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 441/947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:35 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:36.391025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:36.391999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:36.400060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.400839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.402266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.402836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.717611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:36.726253 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b2f9ba2-5a01-4bda-a2f8-d6eff9f9ff48 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.384856 Nov 06 20:49:36.727483 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 507/948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:36 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:36.734998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:36.735854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:36.753877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.754719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.756329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.757021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.783061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:36.792536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87252d43-53ae-42b5-b897-86ae53593018 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.407601 Nov 06 20:49:36.797264 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 442/949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:36 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:36.802853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:36.804001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:36.812401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.813079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.814637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.815053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.869123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ccf0ce5-5e7f-42a0-990e-801e4043ee44 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.062071 Nov 06 20:49:36.877844 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 443/950] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:36 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:36.882181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:36.884845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:36.894200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.894661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.895462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:36.895907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:36.916682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a09f231ee24f4f798c0a5d6e84be4d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3507687d2944a88c2d5567473ec458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:36.926410 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9006e7ff-c2f5-4a70-bcbb-5fcaf6c3fb83 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 200 len: 1431 microversion: 2.1 time: 0.196182 Nov 06 20:49:36.928603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 508/951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:36 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 1431 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:37.247527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:37.256068 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e0449e23-95db-410f-b9ab-29f0ca5d2f8d tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1525 microversion: 2.1 time: 0.381384 Nov 06 20:49:37.256680 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 444/952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:36 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1525 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:37.346630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:37.347244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:37.354217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.354694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.355490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.356008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.399487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:37.400002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:37.406430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.406894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.407689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.408128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.768567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:37.777297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d8e695f-644c-4cfe-b4a3-997bc6a6b072 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1503 microversion: 2.1 time: 0.434307 Nov 06 20:49:37.778265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 509/953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:37 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:37.783075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ea5c285c-7f73-4892-8980-42cb0a4bd306 req-7c8990ba-c8f8-4fb5-898a-7e73369c6c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288973e-7447-4845-82b2-063995aa24ec", "name": "network-vif-deleted", "tag": "c400deaa-142f-48bc-bad6-a6bc92758225"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:37.784818 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:37.784818 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:37.792765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea5c285c-7f73-4892-8980-42cb0a4bd306 req-7c8990ba-c8f8-4fb5-898a-7e73369c6c6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.793214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:37.793834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea5c285c-7f73-4892-8980-42cb0a4bd306 req-7c8990ba-c8f8-4fb5-898a-7e73369c6c6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.801820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f869f1b-ab2c-4016-90c8-ff4f91b19027 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.405372 Nov 06 20:49:37.802710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 445/954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:37 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:37.807819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:37.808465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:37.815495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ea5c285c-7f73-4892-8980-42cb0a4bd306 req-7c8990ba-c8f8-4fb5-898a-7e73369c6c6b service nova] Creating event network-vif-deleted:c400deaa-142f-48bc-bad6-a6bc92758225 for instance 8288973e-7447-4845-82b2-063995aa24ec on nch1-master-1 Nov 06 20:49:37.815720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.816430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.817377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.817962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.821312 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ea5c285c-7f73-4892-8980-42cb0a4bd306 req-7c8990ba-c8f8-4fb5-898a-7e73369c6c6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041258 Nov 06 20:49:37.822890 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 510/955] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:37.828828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2038479949"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:37.829459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:37.835855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.836339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:37.837148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:37.837593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.422712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:38.432209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.network.security_group_api [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Adding security group 814e77f0-fae4-4da2-bfaf-8a78c6cc6606 to port e541788d-ed2f-4fde-8f49-0c9128ea5e7a Nov 06 20:49:38.442927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-720f16e0-bee8-4af3-9751-ab3f104c3313 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.638938 Nov 06 20:49:38.446546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 446/956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:37 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:38.452227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:38.452889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:38.461437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.461901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.462712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.463158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.705315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:38.714196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a58cb94e-97ef-416d-8de7-aca342579840 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.266608 Nov 06 20:49:38.724370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 447/957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:38 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:38.731662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:38.733647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:38.746070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.746842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.748149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.748809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.804987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29a5b370-0853-4fdd-bbc8-c3b58eaba344 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.078595 Nov 06 20:49:38.806694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 448/958] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:38 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:38.816706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:38.818156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] [instance: 8288973e-7447-4845-82b2-063995aa24ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:38.828923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.829698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.831192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.831836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.854203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] HTTP exception thrown: Instance 8288973e-7447-4845-82b2-063995aa24ec could not be found. Nov 06 20:49:38.855789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] Returning 404 to user: Instance 8288973e-7447-4845-82b2-063995aa24ec could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:38.857213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7de0ea23-c143-4707-a2ff-c68afae91e52 tempest-ImagesOneServerTestJSON-1433783594 tempest-ImagesOneServerTestJSON-1433783594-project] 10.222.0.13 "GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec" status: 404 len: 111 microversion: 2.1 time: 0.047853 Nov 06 20:49:38.869078 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 449/959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:38 2021] GET /compute/v2.1/servers/8288973e-7447-4845-82b2-063995aa24ec => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:38.891053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:38.893931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:38.909022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.910752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.915990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:38.917181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:38.990572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df078fee-613b-459c-887b-d737d69a7092 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/action" status: 202 len: 0 microversion: 2.1 time: 1.165661 Nov 06 20:49:38.995576 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 511/960] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:37 2021] POST /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/action => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:39.004406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.005210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.005967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lazy-loading 'fault' on Instance uuid 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:49:39.007660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:39.011762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:39.024058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.024751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.026326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.026868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.083481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865f95e00cdd4725a1edba328836388f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a2501529c1496e839dda964a1d9f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:39.098888 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fcecff4-2763-4d85-9222-b14a48d7092a tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 200 len: 1312 microversion: 2.1 time: 0.227036 Nov 06 20:49:39.108807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4c4ecbd-6e0d-4c23-bf5a-3fac6ad4f71e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.105321 Nov 06 20:49:39.108807 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 512/961] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:38 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:39.108807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-831e8a7a-2f37-4af4-93e2-0ca0d7db3435 req-c130edf4-4988-44d9-8a3a-1f0255ff869b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe417ed-b509-4da2-9cd8-d79891f228b7", "tag": "c83693a3-2e65-4ffa-b0e0-7a93f6dabc38"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:39.109559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 450/962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:38 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:39.114622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:39.115330 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:39.115330 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:39.115729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:39.122832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.123316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.124112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.124583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.137903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-831e8a7a-2f37-4af4-93e2-0ca0d7db3435 req-c130edf4-4988-44d9-8a3a-1f0255ff869b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.138489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-831e8a7a-2f37-4af4-93e2-0ca0d7db3435 req-c130edf4-4988-44d9-8a3a-1f0255ff869b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.151088 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-831e8a7a-2f37-4af4-93e2-0ca0d7db3435 req-c130edf4-4988-44d9-8a3a-1f0255ff869b service nova] Creating event network-changed:c83693a3-2e65-4ffa-b0e0-7a93f6dabc38 for instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 on nch1-master-1 Nov 06 20:49:39.156818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-831e8a7a-2f37-4af4-93e2-0ca0d7db3435 req-c130edf4-4988-44d9-8a3a-1f0255ff869b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052486 Nov 06 20:49:39.158022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 513/963] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:39.164090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1966218128"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:39.166382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:39.174259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.174932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.175938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.176814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.450328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.network.security_group_api [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Adding security group 6c4f71d4-66fd-4426-9634-6d66ef254dfd to port e541788d-ed2f-4fde-8f49-0c9128ea5e7a Nov 06 20:49:39.459569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:39.473799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbbd7972-ec36-439e-a13e-17633d718d81 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.362487 Nov 06 20:49:39.476555 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 451/964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:39 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:39.482255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:39.487295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:39.498060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.498774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.499908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.501248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.826122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:39.834401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a57fd457-87fb-4af1-a971-1c0c43fcf660 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.356395 Nov 06 20:49:39.843986 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 452/965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:39 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:39.848661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:39.849454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:39.855660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.856503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:39.857653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:39.858305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.129137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:40.144048 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e5b0496-6ee8-4a6f-bf7b-f19994253b71 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.298841 Nov 06 20:49:40.146416 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 453/966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:39 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:40.151883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:40.152909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:40.160674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.161139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.162203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.162823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.214045 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd211089-1e97-40a6-a32c-e144890fdbd4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.066016 Nov 06 20:49:40.214775 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 454/967] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:40 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:40.222582 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1db77ca0-ddd9-4a53-8506-70a758061c1d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/action" status: 202 len: 0 microversion: 2.1 time: 1.063010 Nov 06 20:49:40.224036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 514/968] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:39 2021] POST /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/action => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:40.231347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:40.232285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:40.237650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-aa371758-9433-4d38-9a01-c1a2d2c7bc6e req-7724beb0-7626-4e76-bfff-ab15b4ddbe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760", "name": "network-vif-plugged", "status": "completed", "tag": "66e68cd1-c539-47b0-a618-67e82324fd7c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:40.239242 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:40.239242 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:40.249325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.249899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.250710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.251324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.261117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-aa371758-9433-4d38-9a01-c1a2d2c7bc6e req-7724beb0-7626-4e76-bfff-ab15b4ddbe96 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.261573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-aa371758-9433-4d38-9a01-c1a2d2c7bc6e req-7724beb0-7626-4e76-bfff-ab15b4ddbe96 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.281407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-aa371758-9433-4d38-9a01-c1a2d2c7bc6e req-7724beb0-7626-4e76-bfff-ab15b4ddbe96 service nova] Creating event network-vif-plugged:66e68cd1-c539-47b0-a618-67e82324fd7c for instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 on nch1-master-1 Nov 06 20:49:40.291689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-aa371758-9433-4d38-9a01-c1a2d2c7bc6e req-7724beb0-7626-4e76-bfff-ab15b4ddbe96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071245 Nov 06 20:49:40.292893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 455/969] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:40.298324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:40.301023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] [instance: 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:40.309188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.309715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.310589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.310986 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd327b60-f118-490b-af72-aa3cf9759645 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.084933 Nov 06 20:49:40.311212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.312769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 515/970] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:40 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:40.321293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:40.321836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:40.325647 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] HTTP exception thrown: Instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 could not be found. Nov 06 20:49:40.326762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] Returning 404 to user: Instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:40.327856 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0992275-b955-46bd-b10e-b47fe2ef796f tempest-FloatingIPsAssociationTestJSON-2057475429 tempest-FloatingIPsAssociationTestJSON-2057475429-project] 10.222.0.13 "GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5" status: 404 len: 111 microversion: 2.1 time: 0.033764 Nov 06 20:49:40.328947 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 456/971] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:40 2021] GET /compute/v2.1/servers/2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:40.341715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.342190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.344636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.345243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.493123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:40.493980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:40.501189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.501769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.502629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.503263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.793327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d8b5bc2-c55e-485c-a3bd-71a06d0c2873 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.478350 Nov 06 20:49:40.802077 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 516/972] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Nov 6 20:49:40 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad/os-security-groups => generated 1159 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:40.821950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:40.838246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0db8d8e4-d620-4541-aeef-6c8c3065d1d7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.348557 Nov 06 20:49:40.839559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 457/973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:40 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:40.845677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d66e360f-1258-4602-a7c2-f2aadec4cfe4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6715615280>, body: {"security_group": {"name": " tempest-securitygroup -835854448 ", "description": "tempest-description-1151210609"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:40.958424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] Calling method '.version_select at 0x7f6715602af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:40.969967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.970848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.971890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:40.972569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:40.994891 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07bd273e-5b69-4415-80e4-164c674502af tempest-AbsoluteLimitsTestJSON-1070123173 tempest-AbsoluteLimitsTestJSON-1070123173-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.198296 Nov 06 20:49:41.008906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 517/974] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Nov 6 20:49:40 2021] GET /compute/v2.1/limits => generated 511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:41.020898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:41.023419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:41.031780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.032526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.033329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.033765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.161650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d66e360f-1258-4602-a7c2-f2aadec4cfe4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.320631 Nov 06 20:49:41.162913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 458/975] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:40 2021] POST /compute/v2.1/os-security-groups => generated 223 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:41.170895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:41.171653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:41.179648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.180322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.182172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.182927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.375185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:41.385355 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c49bfff3-5804-4e67-a689-b2cadffd0726 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.374439 Nov 06 20:49:41.386012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 518/976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:41 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:41.390668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f258fcd5-5047-4f22-982c-e8f2ddcf2f36 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67157d1940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:41.811108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:41.818717 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f93504f-1e96-4512-a3e6-0101b750c6ed tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1314 microversion: 2.1 time: 0.654214 Nov 06 20:49:41.828631 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 459/977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:41 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:41.833288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8bbbf4-d12f-495d-984d-b8f1ae159fa5", "name": "network-vif-deleted", "tag": "9eaa17aa-8d51-4952-ae6c-ed188e592373"}, {"name": "network-changed", "server_uuid": "fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad", "tag": "e541788d-ed2f-4fde-8f49-0c9128ea5e7a"}, {"name": "network-changed", "server_uuid": "fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad", "tag": "e541788d-ed2f-4fde-8f49-0c9128ea5e7a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:41.835255 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:41.835255 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:41.840970 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f258fcd5-5047-4f22-982c-e8f2ddcf2f36 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633" status: 200 len: 223 microversion: 2.1 time: 0.453483 Nov 06 20:49:41.842299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 519/978] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:49:41 2021] GET /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633 => generated 223 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:41.844951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.845892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.853706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:41.855561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:41.860556 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Creating event network-vif-deleted:9eaa17aa-8d51-4952-ae6c-ed188e592373 for instance 2d8bbbf4-d12f-495d-984d-b8f1ae159fa5 on nch2-master-1 Nov 06 20:49:41.861589 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Creating event network-changed:e541788d-ed2f-4fde-8f49-0c9128ea5e7a for instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad on nch2-master-1 Nov 06 20:49:41.862298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] Creating event network-changed:e541788d-ed2f-4fde-8f49-0c9128ea5e7a for instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad on nch2-master-1 Nov 06 20:49:41.868793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1010977a-8cd1-41ab-acb3-c297c123f219 req-6f04383d-3061-46f5-8c1a-2af4b2dc1df0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.038897 Nov 06 20:49:41.869938 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 460/979] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:41 2021] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:41.870853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.871321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.873342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.873979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.875692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:41.876831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:41.884250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.885335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.886806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.887317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.953444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04f6052c-e81d-4585-9703-e7b9a024a9ac tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.081950 Nov 06 20:49:41.954054 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 461/980] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:41 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:41.959190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44a61bdb-8ab1-47a6-98c0-16956289851b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156008b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:41.970033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-555a7c2f-9251-4c89-b3ae-354267d85c2f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.125603 Nov 06 20:49:41.971080 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 520/981] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:41 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:41.976709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:41.977455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:41.986607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.987345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:41.988359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:41.989341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:42.458420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:42.468493 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bdfe4dc-70aa-416a-8668-abc86bd5ff64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.495981 Nov 06 20:49:42.469750 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 521/982] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:41 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:42.474688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:42.475361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:42.482929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:42.483525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:42.484422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:42.485034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:42.620462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44a61bdb-8ab1-47a6-98c0-16956289851b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633" status: 202 len: 0 microversion: 2.1 time: 0.664818 Nov 06 20:49:42.624726 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 462/983] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:49:41 2021] DELETE /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:42.629570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156c8700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:42.748509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:49:42.750068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:49:42.750600 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist Nov 06 20:49:42.750600 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-2653f27c-2f7d-4159-a520-11a5cc3697e8'] Nov 06 20:49:42.751679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist Nov 06 20:49:42.751679 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-2653f27c-2f7d-4159-a520-11a5cc3697e8'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:42.752675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b37d75dd-32ba-4cb7-87e5-ba55977258ce tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633" status: 404 len: 194 microversion: 2.1 time: 0.126936 Nov 06 20:49:42.753304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 463/984] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:49:42 2021] GET /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:42.763319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31ee4642-a013-4e75-a013-b12c541ce33e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6715571f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-112136893", "description": "tempest-description-798234961"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:42.951317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:42.959165 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cdcc529c-ce84-40ea-b8c0-0500c7ad4d73 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.488076 Nov 06 20:49:42.968553 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 522/985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:42 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:42.973661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:42.974273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:42.980160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:42.980874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:42.981829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:42.982424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.359952 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31ee4642-a013-4e75-a013-b12c541ce33e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.601156 Nov 06 20:49:43.360599 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 464/986] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:42 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:49:43.371052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:43.372443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:43.380384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.380816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.382314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.383809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.456513 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ab94bf6-3d2d-4152-af65-0f43098c184b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.094432 Nov 06 20:49:43.457748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 465/987] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:43 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:43.466071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:43.467295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:43.468433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:43.476463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.476925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.477054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9069cb8f-85f5-44ac-9195-955ed5d7dae1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1501 microversion: 2.1 time: 0.506616 Nov 06 20:49:43.488324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.488324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.489579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 523/988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:42 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1501 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:43.495196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-533ebec3-5310-493a-aeba-4dc14138d683 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f671586a790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-487303544", "description": "tempest-description-1354137985"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:43.528566 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-758522dd-adb1-46aa-9920-b1a8117c37f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.069175 Nov 06 20:49:43.529211 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 466/989] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:43 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:43.534070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:43.534780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:43.543130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.543787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:43.544783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:43.545377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.027832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:44.043639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28eb5eae-6696-4387-9186-efc66c9dd1ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.512305 Nov 06 20:49:44.045215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 467/990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:43 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:44.059110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:44.059625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:44.073992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.075112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.079583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.080281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.123845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:49:44.202946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-533ebec3-5310-493a-aeba-4dc14138d683 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.711925 Nov 06 20:49:44.204872 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 524/991] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:43 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:44.211476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:44.213784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:44.233839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.234449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.237362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.240931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.307415 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1b86ce3-bd16-45d6-b023-1bb6590246f2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 204 len: 0 microversion: 2.1 time: 0.260031 Nov 06 20:49:44.308284 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 468/992] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:49:44 2021] DELETE /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:44.315604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-439c4900-ec14-4ad5-9b2f-7d94ea5a8052 req-a8c45f86-7170-4796-8e94-16b40ab18ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2", "name": "network-vif-plugged", "status": "completed", "tag": "d5870610-f04f-4d8b-9b83-6e4dd925cbe7"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:44.317159 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:44.317159 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:44.329845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-439c4900-ec14-4ad5-9b2f-7d94ea5a8052 req-a8c45f86-7170-4796-8e94-16b40ab18ba9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.330689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-439c4900-ec14-4ad5-9b2f-7d94ea5a8052 req-a8c45f86-7170-4796-8e94-16b40ab18ba9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.354878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-439c4900-ec14-4ad5-9b2f-7d94ea5a8052 req-a8c45f86-7170-4796-8e94-16b40ab18ba9 service nova] Creating event network-vif-plugged:d5870610-f04f-4d8b-9b83-6e4dd925cbe7 for instance 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 on nch2-master-1 Nov 06 20:49:44.362661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-439c4900-ec14-4ad5-9b2f-7d94ea5a8052 req-a8c45f86-7170-4796-8e94-16b40ab18ba9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051563 Nov 06 20:49:44.364244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 469/993] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:44.375218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f64c6f4-83e2-419a-be3a-a97941295f6a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f671564f280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-763333054", "description": "tempest-description-1684087447"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:44.959262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:44.970327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f337e70a-d7c9-4095-abad-c5c88b33e8e9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.760587 Nov 06 20:49:44.980853 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 525/994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:44 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:44.985827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:44.986675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:44.993560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.994765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:44.995718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:44.996332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.074452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f64c6f4-83e2-419a-be3a-a97941295f6a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.708619 Nov 06 20:49:45.082643 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 470/995] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:44 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:45.088556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:45.089987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:45.102600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.103388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.104898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.105577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.175512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2a357cc9-d808-46a9-97c9-a7637a942839 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.090617 Nov 06 20:49:45.176157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 471/996] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:45 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:45.186350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:45.187391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:45.209558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:45.217271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31096133-a381-4d47-8805-0a79285b988a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1507 microversion: 2.1 time: 0.234980 Nov 06 20:49:45.217861 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 526/997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:44 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:45.223441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:45.224422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:45.231076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.231742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.232975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.233761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.235463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.236120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.237098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:45.238381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:45.306098 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0c7b8cb-4a3c-409a-9e38-9422a2f8b466 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.125939 Nov 06 20:49:45.308736 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 472/998] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:45 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:45.315950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc80781d-5813-4df1-9ab3-b7156e4c6b3e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6715737ca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:45.528486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:45.544607 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1670054-6cd6-4900-8341-d0b96f9851fb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.323999 Nov 06 20:49:45.545229 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 527/999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:45 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:45.686590 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc80781d-5813-4df1-9ab3-b7156e4c6b3e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.376439 Nov 06 20:49:45.687304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 473/1000] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:49:45 2021] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:45.701836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45f6c766-f19e-4266-a781-2a4e3f93819b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6715ba91f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:45.923926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45f6c766-f19e-4266-a781-2a4e3f93819b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f" status: 202 len: 0 microversion: 2.1 time: 0.227176 Nov 06 20:49:45.925286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 528/1001] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:49:45 2021] DELETE /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:45.933521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156c3310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:45.987672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:45.988526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:45.993242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:49:45.994114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:49:45.994935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist Nov 06 20:49:45.994935 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-cd78969e-d958-4091-b301-ea307675f62a'] Nov 06 20:49:45.995766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist Nov 06 20:49:45.995766 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-cd78969e-d958-4091-b301-ea307675f62a'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:45.996936 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0972cd65-9d4a-4fa5-ba4b-f94de498541b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f" status: 404 len: 194 microversion: 2.1 time: 0.067595 Nov 06 20:49:46.001095 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 474/1002] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:49:45 2021] GET /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:49:46.001394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.002092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.002993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.003499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.006733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1012f005-e184-447b-88c9-88d08e3f2cd5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156078b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:46.283237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:46.300395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecab89b0-944f-4164-aa00-3e1687048745 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1316 microversion: 2.1 time: 0.316948 Nov 06 20:49:46.310316 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 529/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:45 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:46.318931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:46.323476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:46.333918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.334902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.335949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.336649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.404673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87f12b36-b796-4b22-a4a9-0c9dd89f4b16 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.102449 Nov 06 20:49:46.405325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 530/1004] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:46 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:46.414038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:46.418779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:46.431627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.432696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.434925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1012f005-e184-447b-88c9-88d08e3f2cd5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f" status: 202 len: 0 microversion: 2.1 time: 0.432112 Nov 06 20:49:46.437040 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 475/1005] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:49:46 2021] DELETE /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:46.446248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.447617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.448168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:46.449755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:46.469443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.470329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.471373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.472750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.561501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07821876-60bb-4751-91d5-4bfe3fefb3f4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.116955 Nov 06 20:49:46.563133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 476/1006] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:46 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:46.570561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6715592670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:46.645255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:49:46.646042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group ee3fd931-9f31-41d5-b7b4-9bee910f739f not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:49:46.646846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist Nov 06 20:49:46.646846 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-64e342c7-895e-4069-b12f-9fa78ef1376c'] Nov 06 20:49:46.648006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist Nov 06 20:49:46.648006 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-64e342c7-895e-4069-b12f-9fa78ef1376c'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:46.649297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06b865ab-b997-433d-8341-28a98b24780b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f" status: 404 len: 194 microversion: 2.1 time: 0.084322 Nov 06 20:49:46.650171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 477/1007] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:49:46 2021] GET /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:46.657479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:46.658469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:46.665934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.666774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.667801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:46.668427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:46.781568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:46.797030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-604d75e2-a297-4041-bd29-3bbd843e4c43 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1507 microversion: 2.1 time: 0.390478 Nov 06 20:49:46.808718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 531/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:46 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:46.817826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14474b56-4ce1-4e02-bfb3-f9be42c0ff16 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6716558790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:46.920649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:46.936877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b77f5a56-53fc-4854-8b7b-b52a241865f6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.285458 Nov 06 20:49:46.938128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 478/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:46 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:47.084576 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14474b56-4ce1-4e02-bfb3-f9be42c0ff16 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537" status: 202 len: 0 microversion: 2.1 time: 0.273880 Nov 06 20:49:47.085979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 532/1010] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:49:46 2021] DELETE /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:49:47.095181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156c88b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:47.133504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:49:47.136072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:49:47.137212 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist Nov 06 20:49:47.137212 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-5e920d2d-db7b-4a3f-9551-08c61a9bdfe0'] Nov 06 20:49:47.138605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist Nov 06 20:49:47.138605 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-5e920d2d-db7b-4a3f-9551-08c61a9bdfe0'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:47.139678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5656179-7c90-4baa-b875-138ed1ad3cda tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537" status: 404 len: 194 microversion: 2.1 time: 0.049343 Nov 06 20:49:47.140702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 479/1011] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:49:47 2021] GET /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:49:47.148576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a5dab09-7949-4f70-a2ee-fbf4e022a9ad tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6715769700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:47.316792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:47.317410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:47.325098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.325560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.326369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.326812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.452710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a5dab09-7949-4f70-a2ee-fbf4e022a9ad tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.307785 Nov 06 20:49:47.453887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 533/1012] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:49:47 2021] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:47.467366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:47.468682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:47.483164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.485883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.486818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.489916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.568933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20c07808-6978-40b1-8b1d-afb15f628ac3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.113061 Nov 06 20:49:47.570033 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 534/1013] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:47 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:47.583535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-595dc353-f25c-4813-98ae-222d341c6b97 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6716699430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1389902080", "description": "tempest-description-525062903"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:47.597291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:47.605724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a30e469b-7115-4b67-a08b-9070ac6358ef tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1465 microversion: 2.1 time: 0.292363 Nov 06 20:49:47.609137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 480/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:47 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1465 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:47.620621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-38c35df8-a23c-4a4f-a0b1-45393883554f req-d3f11065-f172-47a9-bc41-4bf449bf1653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760", "name": "network-vif-deleted", "tag": "66e68cd1-c539-47b0-a618-67e82324fd7c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:47.622778 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:47.622778 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:47.632084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-38c35df8-a23c-4a4f-a0b1-45393883554f req-d3f11065-f172-47a9-bc41-4bf449bf1653 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.645751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-38c35df8-a23c-4a4f-a0b1-45393883554f req-d3f11065-f172-47a9-bc41-4bf449bf1653 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.670569 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-38c35df8-a23c-4a4f-a0b1-45393883554f req-d3f11065-f172-47a9-bc41-4bf449bf1653 service nova] Creating event network-vif-deleted:66e68cd1-c539-47b0-a618-67e82324fd7c for instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 on nch1-master-1 Nov 06 20:49:47.682210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-38c35df8-a23c-4a4f-a0b1-45393883554f req-d3f11065-f172-47a9-bc41-4bf449bf1653 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070964 Nov 06 20:49:47.683332 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 481/1015] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:47.692342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:47.694214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:47.709896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.711128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.712267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.712942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.786947 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30c3b3e2-b432-477c-83ad-20fd97ba218a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.102016 Nov 06 20:49:47.788895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 482/1016] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:47 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:47.795050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:47.797642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:47.805718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.807292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.808496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.809212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.872662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-595dc353-f25c-4813-98ae-222d341c6b97 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.300554 Nov 06 20:49:47.873465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 535/1017] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:47 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:47.884906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:47.886108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:47.898625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.901837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.903152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.916712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.971908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:47.972340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:47.973255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'fault' on Instance uuid d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:49:48.047298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ecb02ba-1a5a-463c-a0df-b2beabb2caf9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1616 microversion: 2.1 time: 0.255751 Nov 06 20:49:48.048280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:48.048694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 483/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:47 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1616 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:48.055724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-586f3b56-06ba-47d7-882d-4704fad2be73 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6715a06f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-566865833", "description": "tempest-description-738987813"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:48.070964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e73b0e67-73e6-4c2e-9e0b-415712f50120 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 200 len: 1304 microversion: 2.1 time: 0.189576 Nov 06 20:49:48.071979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 536/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:47 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:48.076543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:48.078744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:48.091568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:48.095176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:48.099418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:48.100082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:48.515041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:48.536083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-586f3b56-06ba-47d7-882d-4704fad2be73 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.484056 Nov 06 20:49:48.537159 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 484/1020] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:49:48 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:48.545595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe6048aa-87ae-4fed-a9ee-657ead57f74c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.472572 Nov 06 20:49:48.556620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-217129315", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8b5b22e4-35d2-4939-98cb-aa65cd77afbc"]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:48.564031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 537/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:48 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:48.593767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:48.595034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:48.617943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:48.618391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:48.620334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:48.623163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:48.682897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:48.711932 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-430bba9a-b96d-4be0-8d4b-223a9d5eb4e1 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 14 microversion: 2.1 time: 0.134468 Nov 06 20:49:48.714458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 538/1022] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:48 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:49:48.773022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-458264462", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "56bd5fa7-53ab-42b8-8aa7-49a32b3547be"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:48.841777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] validate_networks() for [('56bd5fa7-53ab-42b8-8aa7-49a32b3547be', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:49.605263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:49.605842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:49.606150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:49.606558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:49.606968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:49.625097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.626162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.628425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.629394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.666747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:49.674019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:49.707305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:49.710305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:49.809699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fcada421-16ff-43e3-b3af-c3a41ed532bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270889 Nov 06 20:49:49.817089 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 485/1023] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:49.827232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:49.828906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:49.839213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.842041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.845411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.846187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.877274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:49.877800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:49.878893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:49.879515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:49.880094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:49.894910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.895433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.896179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.896659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.909228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a2e0803-f14c-48c8-b087-5a76158cc0fb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.090744 Nov 06 20:49:49.913979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 486/1024] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:49 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:49.929221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:49.929935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:49.937086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Getting quotas for project 0a012746186e4431bf96fa9c5a3bc116. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:49.941771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Getting quotas for user e2da9baa4b40417294173ec358b91fda and project 0a012746186e4431bf96fa9c5a3bc116. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:49.955302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:49.955888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.956526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.957802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:49.958293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:49.959757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:50.001516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. Nov 06 20:49:50.004256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:50.008650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e8c4faa-309d-4eef-b853-60a6e0c4bd12 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 404 len: 111 microversion: 2.1 time: 0.091306 Nov 06 20:49:50.028003 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4bb37b9d-88a5-42e2-a644-ce72bb226e7b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258851 Nov 06 20:49:50.035679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 539/1025] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:50.036915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:50.037795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:50.044788 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 487/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:49 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:49:50.045575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.046227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:50.047199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.047795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:50.052066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:50.061438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:50.104813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.105376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:50.109113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.109647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:50.228317 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d484c58f-76d9-40af-a7d4-72f93e3e2f3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 16352 microversion: 2.1 time: 0.181785 Nov 06 20:49:50.229436 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 488/1027] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:50 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 16352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:50.239819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cabb727b-3cfb-4c27-a55e-99dd6b68bf6e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:50.241855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cabb727b-3cfb-4c27-a55e-99dd6b68bf6e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:50.454160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cabb727b-3cfb-4c27-a55e-99dd6b68bf6e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:50.468158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cabb727b-3cfb-4c27-a55e-99dd6b68bf6e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1216 microversion: 2.1 time: 0.235818 Nov 06 20:49:50.471826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 489/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:50 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:50.479764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63213786-55c0-471d-8269-f2f8ae9d0a79 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:50.484720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63213786-55c0-471d-8269-f2f8ae9d0a79 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:50.515466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:50.531322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1de16b7f-c294-4f2b-a7c2-6245877446b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.499710 Nov 06 20:49:50.540351 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 540/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:50 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:50.540351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1939851919", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:50.602248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-63213786-55c0-471d-8269-f2f8ae9d0a79 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:50.610659 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63213786-55c0-471d-8269-f2f8ae9d0a79 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1215 microversion: 2.1 time: 0.136026 Nov 06 20:49:50.612132 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 490/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:50 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:50.642174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:49:50.924257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:50.925580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:50.945387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.949603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:50.952764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:50.953702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.056727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d782f61d-55c3-4565-b0b1-13451e2ab8b9 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.136717 Nov 06 20:49:51.057442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 491/1031] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:50 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:51.221718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:49:51.222802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:49:51.223538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:49:51.224148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:49:51.225118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:49:51.238014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.238896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.239974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.240516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:51.241004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.241816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:51.252036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.254372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.258567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.260708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.283237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:51.294261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:51.316199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:49:51.319435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:49:51.380010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7647bf4f-64c2-4fd1-86b9-c6625a5994be tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 16352 microversion: 2.1 time: 0.143678 Nov 06 20:49:51.381143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 492/1032] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:51 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 16352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:51.437563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8c2e850-e759-4571-a558-48a0edb7e43a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903604 Nov 06 20:49:51.443102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 541/1033] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:49:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:49:51.450516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78aa9eed-f2b6-454a-80c6-7b14eb55fec7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:51.451212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78aa9eed-f2b6-454a-80c6-7b14eb55fec7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:51.488882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:51.491408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:51.530039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.530039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.531602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.532252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.664195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-78aa9eed-f2b6-454a-80c6-7b14eb55fec7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:51.675667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78aa9eed-f2b6-454a-80c6-7b14eb55fec7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1215 microversion: 2.1 time: 0.230539 Nov 06 20:49:51.679509 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 493/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:51 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:51.689308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:51.689936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:51.704603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.705060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.710850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.714622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.832674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:51.840506 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d59768e4-09b5-485d-9ed8-bd4f9735ff88 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1276 microversion: 2.1 time: 0.355343 Nov 06 20:49:51.844095 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 542/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:51 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:51.856129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:51.857791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:51.867918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.871491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:51.872671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:51.873719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.026810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:52.037567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8cf2ceb-31f3-433b-97e9-952caee0166a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1275 microversion: 2.1 time: 0.192025 Nov 06 20:49:52.050127 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 543/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:51 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:52.218196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:52.225787 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a7aa68e-99d5-4624-8128-b62dc3291219 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1477 microversion: 2.1 time: 0.545005 Nov 06 20:49:52.226357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 494/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:51 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1477 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:52.274404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:52.276410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:52.297358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.325325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.326418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.326873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.364160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-304aab03-8158-48cf-8a7c-867ebefef5d1 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Calling method '.version_select at 0x7f67157450d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:52.406375 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-304aab03-8158-48cf-8a7c-867ebefef5d1 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.407230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-304aab03-8158-48cf-8a7c-867ebefef5d1 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.408247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-304aab03-8158-48cf-8a7c-867ebefef5d1 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "DELETE /compute/v2.1/images/286742a2-58db-4e82-b6ce-b151ac431701/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.354405 Nov 06 20:49:52.408891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 544/1038] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Nov 6 20:49:52 2021] DELETE /compute/v2.1/images/286742a2-58db-4e82-b6ce-b151ac431701/metadata/os_distro => generated 62 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:52.428799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d3cc5df-3098-43d1-bb44-c57d5a60070d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.170448 Nov 06 20:49:52.429745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 495/1039] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:52 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:52.432691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:52.438148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:52.453595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eadd7952-2507-4e29-9d3d-71ee2068a6c3 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Calling method '.version_select at 0x7f67155c51f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:52.466367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.469106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.469973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.471603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.519220 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-eadd7952-2507-4e29-9d3d-71ee2068a6c3 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.521241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eadd7952-2507-4e29-9d3d-71ee2068a6c3 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.522745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eadd7952-2507-4e29-9d3d-71ee2068a6c3 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "GET /compute/v2.1/images/81815762-2062-4e9b-9fbd-7ac6a6b12e0d/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.091418 Nov 06 20:49:52.523950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 496/1040] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Nov 6 20:49:52 2021] GET /compute/v2.1/images/81815762-2062-4e9b-9fbd-7ac6a6b12e0d/metadata/os_version => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:52.550203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98d57ff7-d65e-4962-9bb2-e809241ac08d tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Calling method '.version_select at 0x7f6715607ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:52.582941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-98d57ff7-d65e-4962-9bb2-e809241ac08d tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.583546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98d57ff7-d65e-4962-9bb2-e809241ac08d tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.584402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98d57ff7-d65e-4962-9bb2-e809241ac08d tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "GET /compute/v2.1/images/0329ecba-8fc6-420f-bbcb-801892f2df5d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052130 Nov 06 20:49:52.586987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 497/1041] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Nov 6 20:49:52 2021] GET /compute/v2.1/images/0329ecba-8fc6-420f-bbcb-801892f2df5d/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:52.596205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1207846-7235-46d5-8f29-f7100f03da04 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Action: 'update_all', calling method: .version_select at 0x7f6715796dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:52.620962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b0d373f-1551-48bd-85fe-652a8744a353 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 16352 microversion: 2.1 time: 0.203213 Nov 06 20:49:52.623296 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 545/1042] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:52 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 16352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:52.631921 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f1207846-7235-46d5-8f29-f7100f03da04 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.633073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1207846-7235-46d5-8f29-f7100f03da04 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.634168 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1207846-7235-46d5-8f29-f7100f03da04 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "PUT /compute/v2.1/images/95ea0d53-b7bb-4415-8c94-5c0be91d9b49/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041633 Nov 06 20:49:52.635165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 498/1043] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:49:52 2021] PUT /compute/v2.1/images/95ea0d53-b7bb-4415-8c94-5c0be91d9b49/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:49:52.646042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4296e336-acf0-4562-958d-f002c4a7fde5 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Action: 'update', calling method: .version_select at 0x7f671650b550>, body: {"meta": {"os_distro": "alt"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:52.687174 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4296e336-acf0-4562-958d-f002c4a7fde5 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.687837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4296e336-acf0-4562-958d-f002c4a7fde5 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.688871 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4296e336-acf0-4562-958d-f002c4a7fde5 tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "PUT /compute/v2.1/images/11dee3dd-edea-45b1-b60b-f2e58da4130a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.047370 Nov 06 20:49:52.689443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 546/1044] 10.222.0.13 () {60 vars in 1309 bytes} [Sat Nov 6 20:49:52 2021] PUT /compute/v2.1/images/11dee3dd-edea-45b1-b60b-f2e58da4130a/metadata/os_distro => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:52.706004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:52.706816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:52.721913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.722297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.723141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.723589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.780195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a8c3065-a0d1-4788-ad16-13c1688ebbec tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Action: 'create', calling method: .version_select at 0x7f67157db820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:52.814674 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9a8c3065-a0d1-4788-ad16-13c1688ebbec tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] HTTP exception thrown: Image not found. Nov 06 20:49:52.816153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a8c3065-a0d1-4788-ad16-13c1688ebbec tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:49:52.818946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a8c3065-a0d1-4788-ad16-13c1688ebbec tempest-ImagesMetadataNegativeTestJSON-847837740 tempest-ImagesMetadataNegativeTestJSON-847837740-project] 10.222.0.13 "POST /compute/v2.1/images/2f11ad3a-81ca-4023-b3dc-12bf2e108267/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044611 Nov 06 20:49:52.820263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 547/1045] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Nov 6 20:49:52 2021] POST /compute/v2.1/images/2f11ad3a-81ca-4023-b3dc-12bf2e108267/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:49:52.869657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:52.870821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:52.892658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.893560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.894265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:52.898365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:52.899020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:52.906149 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e745119a-5d7f-4623-96a7-46efd9d44ea9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1267 microversion: 2.1 time: 0.214411 Nov 06 20:49:52.908973 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 499/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:52 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:53.026900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:53.044750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d867e87f-bd85-4692-aca8-5db5c3f72e8b tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1274 microversion: 2.1 time: 0.186875 Nov 06 20:49:53.046104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 548/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:52 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:53.064883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:53.075805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:53.082743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.083443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.084492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.085096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.237850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:53.244038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:53.247280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:53.262703 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-742d446e-5f3f-4f24-9aea-9dce2539408e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1273 microversion: 2.1 time: 0.203865 Nov 06 20:49:53.265053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.265879 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 500/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:53 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:53.266526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.267538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.268145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.443126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:53.445017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:53.457549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.468572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.469852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.470466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.580334 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04039976-272f-4db1-b715-b54f5163357c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.140222 Nov 06 20:49:53.582002 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 501/1049] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:53 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:49:53.637105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:53.638613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:53.655835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.659014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.661563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.662202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.746224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55894699-4b5a-4a58-a367-e0336051d32d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 16352 microversion: 2.1 time: 0.115110 Nov 06 20:49:53.748224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 502/1050] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:53 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 16352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:49:53.926003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:53.926767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:53.937834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:53.948677 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f5d227d-acc1-42b3-885b-a3f16a2d9455 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1476 microversion: 2.1 time: 0.709123 Nov 06 20:49:53.951190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.956476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:53.956915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 549/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:53 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:53.958218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:53.959027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:54.063289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:54.066666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:54.081114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:54.082332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:54.083383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:54.090216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:54.114182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:54.146002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b28f25f1-195d-47bf-8bd4-3bf424d5f21f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1273 microversion: 2.1 time: 0.216627 Nov 06 20:49:54.148042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 503/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:53 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:54.282530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:54.283154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:54.294953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:54.295418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:54.299641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:54.301787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.250681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:55.267074 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9418c35a-8dba-4a24-be47-7b51659d3e50 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 1.207765 Nov 06 20:49:55.275419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:55.283243 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cea9c773-1891-4029-a884-d894504ba628 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 1.004313 Nov 06 20:49:55.292362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 550/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:54 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:55.292824 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 504/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:54 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:49:55.299638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:55.300666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:55.317244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:55.318631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:55.328475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.328936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.329749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.330185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.352607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.362417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.365413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.371302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.418837 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ab6dab9-6937-4534-95c5-e64dac78131e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.132878 Nov 06 20:49:55.420056 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 551/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:55 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:55.426457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:55.433997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:55.445732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.449648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.450712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.451317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.547713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ef0fab06-90bb-4f3b-8899-6ec956c5924d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.256750 Nov 06 20:49:55.549665 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 505/1056] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:55 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:55.557471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:55.558382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:55.567874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.568782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.569883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:55.570487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:55.935883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:55.967929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fbfc61c-37c6-4df7-9f41-675944537446 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1273 microversion: 2.1 time: 0.409504 Nov 06 20:49:55.969388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 506/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:55 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:55.983890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "name": "network-vif-unplugged", "status": "completed", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:56.002834 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:56.002834 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:56.038015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:56.038473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:56.074426 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] Creating event network-vif-unplugged:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch1-master-1 Nov 06 20:49:56.109062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] Instance d26d50be-c69a-406f-a982-b6afbc265cfc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:49:56.140707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9eb6e9ce-4785-465d-99f2-5027028cf4b0 req-6d7ff282-6904-496b-8e49-ca0529e54646 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159156 Nov 06 20:49:56.143172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 507/1058] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:56.303339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:56.304929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:56.320407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:56.322818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:56.327129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:56.327914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.105375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:57.130077 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-510f197b-e88a-47d0-b301-04a8bf7a81ae tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1476 microversion: 2.1 time: 1.708672 Nov 06 20:49:57.134465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 552/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:55 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1476 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:57.148568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:57.149405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:57.173728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.174819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.175738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.177289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.184604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:57.192861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9963a916-0b2d-42d2-8a13-022896bca119 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.895060 Nov 06 20:49:57.204951 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 508/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:56 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:57.204951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:57.204951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:57.223511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.223993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.224877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.225320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.296536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86a46bd3-2af4-4cde-85a1-781ef69dbc7a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.098695 Nov 06 20:49:57.297332 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 509/1061] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:57 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:57.447482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715544d30>, body: {"keypair": {"name": "tempest-keypair-447769172"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:57.485213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:57.498362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:57.592422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:57.600964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f126e911-e9ca-4711-8fdc-b05676c9edf5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.464586 Nov 06 20:49:57.604109 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 553/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:57 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:57.616746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:57.617956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:57.636561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.637290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.638262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.638867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.710833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ef0708d-009a-463c-a2cc-3877fd8a434c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.105145 Nov 06 20:49:57.711731 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 554/1063] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:57 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:57.717698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2e7b9de8-ceba-4c56-86d3-5add8c2028ca req-54471671-85cd-46a5-808b-fa3c6344d992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585f0d61-50d1-4453-9ffd-c65faeb3cf89", "tag": "a262919e-18f2-4731-a6fd-471327f376d3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:57.722034 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:57.722034 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:49:57.742730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2e7b9de8-ceba-4c56-86d3-5add8c2028ca req-54471671-85cd-46a5-808b-fa3c6344d992 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.743544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2e7b9de8-ceba-4c56-86d3-5add8c2028ca req-54471671-85cd-46a5-808b-fa3c6344d992 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.774051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2e7b9de8-ceba-4c56-86d3-5add8c2028ca req-54471671-85cd-46a5-808b-fa3c6344d992 service nova] Creating event network-changed:a262919e-18f2-4731-a6fd-471327f376d3 for instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 on nch1-master-1 Nov 06 20:49:57.780920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2e7b9de8-ceba-4c56-86d3-5add8c2028ca req-54471671-85cd-46a5-808b-fa3c6344d992 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067068 Nov 06 20:49:57.781762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 555/1064] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:57.786946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:57.788003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:57.800673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.802007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:57.803622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:57.804933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.018198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:58.022424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:58.046590 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-179caab0-9467-44bf-bea6-921c6d7520b1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.747747 Nov 06 20:49:58.047352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 510/1065] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:49:57 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 749 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:58.066478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05ce1415-3366-4494-9537-f5ee81d1b3fd tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715522d30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.086081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05ce1415-3366-4494-9537-f5ee81d1b3fd tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-447769172" status: 200 len: 706 microversion: 2.2 time: 0.023906 Nov 06 20:49:58.089037 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 511/1066] 10.222.0.13 () {60 vars in 1254 bytes} [Sat Nov 6 20:49:58 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-447769172 => generated 706 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:58.102261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f35a488-e9fc-49ec-95eb-49774f80c306 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f67155965e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.123275 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f35a488-e9fc-49ec-95eb-49774f80c306 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447769172" status: 204 len: 0 microversion: 2.2 time: 0.026491 Nov 06 20:49:58.123869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 512/1067] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Nov 6 20:49:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447769172 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:49:58.139700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715600790>, body: {"keypair": {"name": "tempest-keypair-176299766"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:58.167403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:58.172171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:58.188417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:58.199996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ecf206c-ae63-4766-96d6-7c3c82c7a013 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.416876 Nov 06 20:49:58.201114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 556/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:57 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:58.216609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.218929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:58.245054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.245266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.246078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.246589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.352051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:58.357229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:58.377822 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c215d4f4-6d30-45dc-9c43-f3047d0a336c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.248550 Nov 06 20:49:58.378590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 513/1069] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:49:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 250 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:49:58.390133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:58.391725 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:49:58.391725 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:49:58.405419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.406081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.418629 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] Creating event network-changed:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch1-master-1 Nov 06 20:49:58.425735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] Instance d26d50be-c69a-406f-a982-b6afbc265cfc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:49:58.437684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e8176ef9-2a4c-4895-b164-009223d165f5 req-b4f026af-8418-4532-ada0-37c4e9e4ad0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054584 Nov 06 20:49:58.438995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 514/1070] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:49:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:49:58.446895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.447992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:58.457354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.458050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.459475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.460698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.664695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:58.678390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9f4268c-3c44-4536-915d-54bb6d969752 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1476 microversion: 2.1 time: 0.475262 Nov 06 20:49:58.679808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 557/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:58 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:58.687106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:58.688567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:58.697017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.697709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.698697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.699794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.756453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fe5d083-ea17-43f8-ab82-f260b23846de tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 32647 microversion: 2.1 time: 0.073801 Nov 06 20:49:58.772403 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 558/1072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:58 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 32647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:58.778635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7b0ed4e-1e22-42e8-89ff-f2e876b44dd7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715a2aee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.810668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:58.817019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7b0ed4e-1e22-42e8-89ff-f2e876b44dd7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176299766" status: 204 len: 0 microversion: 2.2 time: 0.043154 Nov 06 20:49:58.822590 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 559/1073] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Nov 6 20:49:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176299766 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:58.828255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:58.833147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89536cd6-0f6e-40a2-9785-d4f3aea5ea89 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.392610 Nov 06 20:49:58.834225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:58.835308 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 515/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:58 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:58.840575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:58.849383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.849819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:58.853586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.854641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.855246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.861732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.864218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.865247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:58.873017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:58.937768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5bccddd-8c3c-41f7-8e90-1495ff5177cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.101037 Nov 06 20:49:58.943175 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 516/1075] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:58 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:49:58.950243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4545d733-b227-49c9-8991-212786140540 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715796700>, body: {"keypair": {"name": "tempest-keypair-456225538", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:58.978175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4545d733-b227-49c9-8991-212786140540 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:58.984349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4545d733-b227-49c9-8991-212786140540 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.026204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4545d733-b227-49c9-8991-212786140540 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.081469 Nov 06 20:49:59.027221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 517/1076] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 20:49:58 2021] POST /compute/v2.1/os-keypairs => generated 588 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 06 20:49:59.036625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f960a10-72c7-4c30-8e3b-0fe1532ab94f tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715541310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:59.058089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f960a10-72c7-4c30-8e3b-0fe1532ab94f tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456225538" status: 204 len: 0 microversion: 2.2 time: 0.025452 Nov 06 20:49:59.059468 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 518/1077] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Nov 6 20:49:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456225538 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:59.069970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f67156004c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-272510705"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:59.098832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.111556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.258093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:59.267609 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55e31188-dbd3-4b6f-a60d-d628ce682f8e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.443426 Nov 06 20:49:59.268426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 560/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:58 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:59.272867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:59.273655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:59.282258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.283162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:59.284195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.284886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:59.464556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.469203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.486412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26e22d27-d20d-4c97-86c4-2ca66d070236 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.421533 Nov 06 20:49:59.487088 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 519/1079] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:49:59 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:49:59.497545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f67155925e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1178021795"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:59.518564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.523264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.615722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.620564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.633595 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eabaa00e-70fa-43bc-8660-9e8e0ec73ec1 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.140812 Nov 06 20:49:59.634225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 520/1080] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:49:59 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:59.656802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715544310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2043705839"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:59.672263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:49:59.681464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6d14d4d6-cad2-4d5b-a9d9-64378dc604a1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.411145 Nov 06 20:49:59.682035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.692938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 561/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:59 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:49:59.697455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.704762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:49:59.705619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:59.715369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.716102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:59.717107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.717694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:59.917034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:49:59.921329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:49:59.937416 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11bc3e37-17fe-4cf1-9de5-f75165aa278e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.287290 Nov 06 20:49:59.944405 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 521/1082] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:49:59 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 299 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:49:59.947851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:49:59.948918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:49:59.955916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.956387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:49:59.957182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:49:59.957614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.015675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43180b80-1ae1-4bca-8a8e-d9a5121f5742 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action" status: 200 len: 40792 microversion: 2.1 time: 0.072990 Nov 06 20:50:00.017541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 522/1083] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:49:59 2021] POST /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba/action => generated 40792 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:00.023560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-144555a8-a03b-4978-8a1d-97fdc4a497c8 req-3752e676-7cfa-4e88-9378-0a6843944436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d899a05-d09f-40e8-8d9a-61b9adb4c094", "tag": "77547b61-5323-47fa-ba9f-e4c8c8dd716b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:00.025674 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:00.025674 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:00.034312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-144555a8-a03b-4978-8a1d-97fdc4a497c8 req-3752e676-7cfa-4e88-9378-0a6843944436 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.034762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-144555a8-a03b-4978-8a1d-97fdc4a497c8 req-3752e676-7cfa-4e88-9378-0a6843944436 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.049066 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-144555a8-a03b-4978-8a1d-97fdc4a497c8 req-3752e676-7cfa-4e88-9378-0a6843944436 service nova] Creating event network-changed:77547b61-5323-47fa-ba9f-e4c8c8dd716b for instance 1d899a05-d09f-40e8-8d9a-61b9adb4c094 on nch2-master-1 Nov 06 20:50:00.054868 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-144555a8-a03b-4978-8a1d-97fdc4a497c8 req-3752e676-7cfa-4e88-9378-0a6843944436 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Nov 06 20:50:00.056254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 523/1084] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:00.056910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:00.062936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.063627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:00.068313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7dc3c898-6192-4ec5-8673-414de7f35b49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1474 microversion: 2.1 time: 0.373989 Nov 06 20:50:00.080017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 562/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:49:59 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:00.082287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.082750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.083606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.084552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.086110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:00.087843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:00.096642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.097549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.099087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.099564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.150805 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-065391d7-674b-4096-ad4f-e595618bbe54 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.068049 Nov 06 20:50:00.151472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 563/1086] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:00 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:00.156809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7061a90-d002-453c-9830-6f621d7f6854 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715a31160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.159942 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-d7061a90-d002-453c-9830-6f621d7f6854 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:00.167924 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-d7061a90-d002-453c-9830-6f621d7f6854 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:00.174388 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7061a90-d002-453c-9830-6f621d7f6854 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1723 microversion: 2.2 time: 0.021362 Nov 06 20:50:00.175775 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 564/1087] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Nov 6 20:50:00 2021] GET /compute/v2.1/os-keypairs => generated 1723 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:00.180237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.181284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:00.190373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.191234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.192242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.192714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.305150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:00.313606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-293ef833-c819-4387-8762-3878e28d929f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.255984 Nov 06 20:50:00.324335 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 524/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:00 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:00.330167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8164a5ef-f44d-41f0-bfb6-24422223e5a8 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f67155410d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.358541 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8164a5ef-f44d-41f0-bfb6-24422223e5a8 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2043705839" status: 204 len: 0 microversion: 2.2 time: 0.032466 Nov 06 20:50:00.359667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 525/1089] 10.222.0.13 () {60 vars in 1320 bytes} [Sat Nov 6 20:50:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2043705839 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:00.365643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.366509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:00.375792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.376536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.378669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.379722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.482054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:00.489975 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee2b71ef-5e25-4df4-b41b-69d7d6be7456 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 200 len: 1704 microversion: 2.1 time: 0.313029 Nov 06 20:50:00.490553 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 565/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:00 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 1704 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:00.503586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-421f82aa-a641-4675-ae6b-50e9c16ce7b9 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715769d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.527813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-421f82aa-a641-4675-ae6b-50e9c16ce7b9 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1178021795" status: 204 len: 0 microversion: 2.2 time: 0.034880 Nov 06 20:50:00.528848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 566/1091] 10.222.0.13 () {60 vars in 1320 bytes} [Sat Nov 6 20:50:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1178021795 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:00.534360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-493715c4-e71f-4b6e-aab9-d6dce95c928e req-7118fee3-8b5b-4e87-86d8-c3cd4421a802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183e64a4-ecc9-4623-b4f8-72c80bfae9d8", "tag": "62b4b2c1-0e64-4879-8eab-3188cee48679"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:00.537153 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:00.537153 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:00.549797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-493715c4-e71f-4b6e-aab9-d6dce95c928e req-7118fee3-8b5b-4e87-86d8-c3cd4421a802 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.550243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-493715c4-e71f-4b6e-aab9-d6dce95c928e req-7118fee3-8b5b-4e87-86d8-c3cd4421a802 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.568331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-493715c4-e71f-4b6e-aab9-d6dce95c928e req-7118fee3-8b5b-4e87-86d8-c3cd4421a802 service nova] Creating event network-changed:62b4b2c1-0e64-4879-8eab-3188cee48679 for instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 on nch1-master-1 Nov 06 20:50:00.573467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-493715c4-e71f-4b6e-aab9-d6dce95c928e req-7118fee3-8b5b-4e87-86d8-c3cd4421a802 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042797 Nov 06 20:50:00.575001 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 567/1092] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:00.579849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dca85fe8-1f62-4f8f-9d1c-0f42291c9f3c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f67157e2ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.603583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dca85fe8-1f62-4f8f-9d1c-0f42291c9f3c tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272510705" status: 204 len: 0 microversion: 2.2 time: 0.027314 Nov 06 20:50:00.608997 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 568/1093] 10.222.0.13 () {60 vars in 1317 bytes} [Sat Nov 6 20:50:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272510705 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:00.617196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715a31d30>, body: {"keypair": {"name": "tempest-keypair-1193626652"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:00.647063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:00.650185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:00.651385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:00.658944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c0cfc13-c068-4bd1-a111-4b2de0833c2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.297930 Nov 06 20:50:00.659524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 526/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:00 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:00.699347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:00.700451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:00.707039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.707498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:00.708320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:00.708758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.057595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:01.062222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:01.078373 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef90e782-e5dd-499a-8e1c-6c9a7d596e9b tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.467789 Nov 06 20:50:01.080452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 569/1095] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:50:00 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 470 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:01.087561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.088329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:01.095288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.096105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.097061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.097617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.302963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:01.308457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72f71cea-cf33-4369-8c9b-07804137cee4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.613416 Nov 06 20:50:01.309766 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 527/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:00 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:01.315832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5e383e7-ee9e-470a-9a44-9a799be71683 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715adb3a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.323944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5e383e7-ee9e-470a-9a44-9a799be71683 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1193626652" status: 200 len: 707 microversion: 2.2 time: 0.012672 Nov 06 20:50:01.326973 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 528/1097] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Nov 6 20:50:01 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1193626652 => generated 707 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:01.335246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:01.335246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:01.338717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.339145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.339941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.340412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.390585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e34be67-bb8f-444c-9dc6-bdc5ac32fe3d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.062336 Nov 06 20:50:01.391243 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 529/1098] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:01 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:01.397870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.398468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:01.409395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.409865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.410669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.411114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.448437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:01.468605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:01.478042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a56cee5-2dc4-47b5-9464-d5124ff81952 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1474 microversion: 2.1 time: 0.395069 Nov 06 20:50:01.490131 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 570/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:01 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:01.496114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.496847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:01.505052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.505511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.506299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.506852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.568574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53cd0e8f-7c7f-4f6b-80c7-61155ecf7675 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 204 len: 0 microversion: 2.1 time: 0.175746 Nov 06 20:50:01.569774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 530/1100] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:01 2021] DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:01.583085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b270248b-0d20-48dd-b687-1dac69a24ddf tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f671564fdc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.587634 ncdv-master-1 devstack@n-api.service[134828]: WARNING oslo_db.sqlalchemy.utils [None req-b270248b-0d20-48dd-b687-1dac69a24ddf tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:01.598731 ncdv-master-1 devstack@n-api.service[134828]: WARNING oslo_db.sqlalchemy.utils [None req-b270248b-0d20-48dd-b687-1dac69a24ddf tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:01.604475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b270248b-0d20-48dd-b687-1dac69a24ddf tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.032985 Nov 06 20:50:01.605629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 531/1101] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Nov 6 20:50:01 2021] GET /compute/v2.1/os-keypairs => generated 564 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:01.615668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3068a77f-691e-4626-bb35-fc51e2594e05 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715541160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.659623 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3068a77f-691e-4626-bb35-fc51e2594e05 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193626652" status: 204 len: 0 microversion: 2.2 time: 0.047382 Nov 06 20:50:01.661171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 532/1102] 10.222.0.13 () {60 vars in 1260 bytes} [Sat Nov 6 20:50:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193626652 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:01.672749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Action: 'create', calling method: .version_select at 0x7f6715615700>, body: {"keypair": {"name": "tempest-keypair-1769861145", "type": "x509"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:01.701903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:01.707533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:01.736129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.processutils [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpwcy2e3lf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwcy2e3lf/temp.key -subj /CN=e5cbc98a57b5492d8082b4d67a76a03e -extensions v3_req_client {{(pid=134828) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:01.796057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:01.804565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce1803ca-9f28-480f-9535-5732899dcc46 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.312651 Nov 06 20:50:01.807135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 571/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:01 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:01.812993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:01.813819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:01.822884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.823497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:01.825140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:01.826000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.012015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:02.022322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b694458b-5e65-4049-9876-7008d9e488d1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.213435 Nov 06 20:50:02.023781 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 572/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:01 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.030833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1546111083", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "1494599763", "adminPass": "***", "networks": [{"uuid": "30f7f650-50d0-446a-82d8-39753cfb0023"}], "security_groups": [{"name": "tempest-securitygroup--1942292788"}], "key_name": "tempest-keypair-1085876697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:02.171716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] validate_networks() for [('30f7f650-50d0-446a-82d8-39753cfb0023', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:02.232855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.processutils [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpwcy2e3lf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwcy2e3lf/temp.key -subj /CN=e5cbc98a57b5492d8082b4d67a76a03e -extensions v3_req_client" returned: 0 in 0.499s {{(pid=134828) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:02.234166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.processutils [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpwcy2e3lf/temp.key -password pass: {{(pid=134828) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:02.256772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.processutils [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpwcy2e3lf/temp.key -password pass:" returned: 0 in 0.022s {{(pid=134828) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:02.319032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:02.323963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Getting quotas for user e5cbc98a57b5492d8082b4d67a76a03e and project 07938e1fdbcf41738a0e1888a9d5f952. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:02.342391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73712d08-e025-4d20-9852-901997a44678 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.674743 Nov 06 20:50:02.343926 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 533/1105] 10.222.0.13 () {62 vars in 1197 bytes} [Sat Nov 6 20:50:01 2021] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 677 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:02.349427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.350786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:02.357530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.358227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.359119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.359565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.624668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:02.634254 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa24aa45-d577-4064-bcce-c9b47d9d30b9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.288576 Nov 06 20:50:02.635012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 534/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.640533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fa0dcfe-8a2f-45d4-9f3e-5826c456079e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f67155225e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.650917 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fa0dcfe-8a2f-45d4-9f3e-5826c456079e tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1769861145" status: 200 len: 1534 microversion: 2.2 time: 0.014661 Nov 06 20:50:02.651422 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 535/1107] 10.222.0.13 () {60 vars in 1257 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1769861145 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.660870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:02.661826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:02.666492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:02.667476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:02.668537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:02.668764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.669239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.669793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:02.670044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.670488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.670725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:02.684818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.685301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.686132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.686838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.706245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for project 3e0376f3231e49d495f1777d2f774450. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:02.710894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Getting quotas for user 34bc3358aaee478c9da0d68688f1a4ce and project 3e0376f3231e49d495f1777d2f774450. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:02.724036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:02.726740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:02.731834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b85e14dc-a9a1-4a96-9c1e-e0d1a11f796e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.077526 Nov 06 20:50:02.732780 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 536/1108] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:02 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:02.738212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.739420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:02.748006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.748509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.749441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.749886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.781052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa2764b9-a6eb-4f89-b9cd-51e9410422e2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754512 Nov 06 20:50:02.781973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 573/1109] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:02.786947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5b7cb4d-9efd-43e2-b2b1-f16d2d5d0be7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715a2aca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.791265 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-f5b7cb4d-9efd-43e2-b2b1-f16d2d5d0be7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:02.809409 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-f5b7cb4d-9efd-43e2-b2b1-f16d2d5d0be7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 20:50:02.818546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5b7cb4d-9efd-43e2-b2b1-f16d2d5d0be7 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.035342 Nov 06 20:50:02.824211 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 574/1110] 10.222.0.13 () {60 vars in 1176 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.825977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58c0dfdb-007d-494c-a0de-0dd55b85ff61 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.826601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58c0dfdb-007d-494c-a0de-0dd55b85ff61 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:02.908535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58c0dfdb-007d-494c-a0de-0dd55b85ff61 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:02.924973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58c0dfdb-007d-494c-a0de-0dd55b85ff61 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1265 microversion: 2.1 time: 0.103898 Nov 06 20:50:02.925689 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 575/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.930720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:02.931297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:02.938271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.938741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.939662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:02.939966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:02.959760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:02.969934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd44a19a-9e91-47fa-8268-1c3eb1fbd1c6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1474 microversion: 2.1 time: 0.234654 Nov 06 20:50:02.972268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 537/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:02.976775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dff80bdf-2bf8-4547-8468-4b075d985f36 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] Calling method '.version_select at 0x7f6715592160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:03.006069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dff80bdf-2bf8-4547-8468-4b075d985f36 tempest-KeyPairsV22TestJSON-892436425 tempest-KeyPairsV22TestJSON-892436425-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769861145" status: 204 len: 0 microversion: 2.2 time: 0.032631 Nov 06 20:50:03.010225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 538/1113] 10.222.0.13 () {60 vars in 1260 bytes} [Sat Nov 6 20:50:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769861145 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:03.042585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:03.044656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:03.054869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.056217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.056693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.057142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.189569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:03.198942 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e4b4f81-d347-4ca1-8a41-d09c719acf52 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.271604 Nov 06 20:50:03.199821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 576/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:02 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:03.273567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:03.285300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe3206e1-77e4-4b2e-8b80-ef0b29cbffd7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.247677 Nov 06 20:50:03.295709 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 539/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:03 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:03.651421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:03.652134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:03.672439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.673042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.674895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.675398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.745019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:03.747302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:03.761462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.762529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.763589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.764561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.822863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76a8a62e-31db-44b7-b816-68531c706491 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.082323 Nov 06 20:50:03.824697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 540/1116] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:03 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:03.944213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:03.945594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:03.967695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.970046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.975465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:03.975465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:03.989897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:03.998700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-718ff540-68de-482b-b8d7-5c5d61eeae40 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.351335 Nov 06 20:50:04.000267 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 577/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:03 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:04.010230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:04.021209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:04.034089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.046399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.047391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.048833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.128647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:04.148391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc92bd73-7c87-4ab0-87a2-27f8a76d0a2d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1317 microversion: 2.1 time: 0.206221 Nov 06 20:50:04.153486 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 541/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:03 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:04.218828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:04.219494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:04.242417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.243540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.244425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.244885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.493579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:04.502855 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12d6513b-318b-43b1-a913-e3d87f6ea747 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1471 microversion: 2.1 time: 0.501487 Nov 06 20:50:04.517280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 578/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:04 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:04.523679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:04.527554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:04.543773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.544237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.545094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.545527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.726683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:04.742234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ae176f1-4d26-43f3-8d84-4a470aec12e5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.529020 Nov 06 20:50:04.743416 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 542/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:04 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:04.758448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9ea5b447-2830-4b63-99da-23478c0f0f52 req-6d1e1549-d496-4690-8ca4-2df51ff82893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d899a05-d09f-40e8-8d9a-61b9adb4c094", "name": "network-vif-plugged", "status": "completed", "tag": "77547b61-5323-47fa-ba9f-e4c8c8dd716b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:04.760302 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:04.760302 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:04.781719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9ea5b447-2830-4b63-99da-23478c0f0f52 req-6d1e1549-d496-4690-8ca4-2df51ff82893 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.782194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9ea5b447-2830-4b63-99da-23478c0f0f52 req-6d1e1549-d496-4690-8ca4-2df51ff82893 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.794761 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9ea5b447-2830-4b63-99da-23478c0f0f52 req-6d1e1549-d496-4690-8ca4-2df51ff82893 service nova] Creating event network-vif-plugged:77547b61-5323-47fa-ba9f-e4c8c8dd716b for instance 1d899a05-d09f-40e8-8d9a-61b9adb4c094 on nch2-master-1 Nov 06 20:50:04.818278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9ea5b447-2830-4b63-99da-23478c0f0f52 req-6d1e1549-d496-4690-8ca4-2df51ff82893 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073283 Nov 06 20:50:04.818882 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 543/1121] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:04.824549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:04.830329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:04.842282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.842776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.843588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:04.844032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:04.984430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9960f798-6da4-4843-adae-3023580d10e2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc/action" status: 204 len: 0 microversion: 2.1 time: 0.158521 Nov 06 20:50:04.988671 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 544/1122] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:04 2021] POST /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc/action => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:05.012089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:05.013417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:05.020906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.021719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.022792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.023516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.050532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:05.071432 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5b3acf6-18ef-47db-b25b-96501f6ad5db tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.552878 Nov 06 20:50:05.081090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 579/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:04 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:05.088284 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-baa3b948-bceb-4e05-9395-db917e792733 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.096476 Nov 06 20:50:05.089008 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 545/1124] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:04 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:05.093700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:05.094545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:05.095008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:05.097696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:05.105278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.106163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.107543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.108170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.113734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.114220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.115086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.117454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.548976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:05.562465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-131949af-bfde-4149-b085-700fba218f3f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.469013 Nov 06 20:50:05.565070 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 546/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:05 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:05.581079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:05.581732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:05.599978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.600463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.603365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.603813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.614218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:05.628801 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9fd7e34-d109-46d2-bcfd-21f0d4202bca tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1471 microversion: 2.1 time: 0.542163 Nov 06 20:50:05.636503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 580/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:05 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1471 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:05.772755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:05.773818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:05.790657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.792618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:05.793731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:05.794397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.456061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:06.472823 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c48c6ed2-8048-4c80-9b68-dfcdfc5cfff6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.905815 Nov 06 20:50:06.474826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 547/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:05 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:06.496453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:06.497499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:06.504008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.504652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.506411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.507774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.557562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:06.569940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0cfeac86-4c60-4bb3-9454-1149aa358e2b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.810977 Nov 06 20:50:06.573062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 581/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:05 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:06.582957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:06.589084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:06.600819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.601623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.603148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.603800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.704672 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-772e9af8-e68e-4d08-87da-1c83a69d674f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.127790 Nov 06 20:50:06.705993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 582/1129] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:06 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:06.712669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-408c1b94-20c2-44f3-8f6e-e835ed78e7a1 req-a9651f46-55db-484b-a5ac-ff97777ab4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbc8ec1-8c19-4586-a720-c08f62c147ba", "name": "network-vif-deleted", "tag": "5935a02d-18df-4c4f-9301-484bbfd49bab"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:06.714469 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:06.714469 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:06.738539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-408c1b94-20c2-44f3-8f6e-e835ed78e7a1 req-a9651f46-55db-484b-a5ac-ff97777ab4e1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.739273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-408c1b94-20c2-44f3-8f6e-e835ed78e7a1 req-a9651f46-55db-484b-a5ac-ff97777ab4e1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.757751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-408c1b94-20c2-44f3-8f6e-e835ed78e7a1 req-a9651f46-55db-484b-a5ac-ff97777ab4e1 service nova] Creating event network-vif-deleted:5935a02d-18df-4c4f-9301-484bbfd49bab for instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba on nch1-master-1 Nov 06 20:50:06.776325 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-408c1b94-20c2-44f3-8f6e-e835ed78e7a1 req-a9651f46-55db-484b-a5ac-ff97777ab4e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068632 Nov 06 20:50:06.777870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 583/1130] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:06.790413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:06.791486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:06.806765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.807614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:06.809885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:06.811882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.315429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:07.327084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb8d8807-e103-4cf7-8b53-cb30296e89e1 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1316 microversion: 2.1 time: 0.839264 Nov 06 20:50:07.328278 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 548/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:06 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:07.345707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:07.346526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:07.353734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.354407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.357554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.358018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.591450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:07.603386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a4979ab-6074-43c3-b93b-a727b359c9dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.822102 Nov 06 20:50:07.617523 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 584/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:06 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:07.627275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f7f41fc2-cf6d-43c4-849c-0a73b37429da req-3e9ce4c4-9d2e-4c75-aee4-63c7a8733b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585f0d61-50d1-4453-9ffd-c65faeb3cf89", "name": "network-vif-plugged", "status": "completed", "tag": "a262919e-18f2-4731-a6fd-471327f376d3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:07.637638 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:07.637638 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:07.656368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f7f41fc2-cf6d-43c4-849c-0a73b37429da req-3e9ce4c4-9d2e-4c75-aee4-63c7a8733b6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.656819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f7f41fc2-cf6d-43c4-849c-0a73b37429da req-3e9ce4c4-9d2e-4c75-aee4-63c7a8733b6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.686230 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f7f41fc2-cf6d-43c4-849c-0a73b37429da req-3e9ce4c4-9d2e-4c75-aee4-63c7a8733b6b service nova] Creating event network-vif-plugged:a262919e-18f2-4731-a6fd-471327f376d3 for instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 on nch1-master-1 Nov 06 20:50:07.702129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f7f41fc2-cf6d-43c4-849c-0a73b37429da req-3e9ce4c4-9d2e-4c75-aee4-63c7a8733b6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081308 Nov 06 20:50:07.705683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 585/1133] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:07.717120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:07.718922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:07.742704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.744904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.746112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:07.747217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.753291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.760158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8466fd4-907d-4b6a-800e-14952b043e08 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1471 microversion: 2.1 time: 0.418554 Nov 06 20:50:07.763234 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 549/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:07 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:07.770924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:07.773268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:07.793237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.796633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:07.797741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:07.798339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.644991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:08.653637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b39b4e88-aa4d-4381-adff-225c0f1a1c1c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.889133 Nov 06 20:50:08.664587 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 550/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:07 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:08.672083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:08.674137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:08.685899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.686818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.688200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.689206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.749008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac1890fd-52c2-47aa-a203-4806655848f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.079440 Nov 06 20:50:08.752287 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 551/1136] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:08 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:08.776340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-85bb5df5-b2d2-4275-94e7-eaa115a55153 req-8d769b7f-f939-4577-b37a-e1d5d2eed039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c525837-e57b-4864-9ece-7aec3a941be2", "tag": "1bb283d3-dee3-4b3b-b05d-39267648a295"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:08.778761 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:08.778761 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:08.788047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:08.788589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-85bb5df5-b2d2-4275-94e7-eaa115a55153 req-8d769b7f-f939-4577-b37a-e1d5d2eed039 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.789101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-85bb5df5-b2d2-4275-94e7-eaa115a55153 req-8d769b7f-f939-4577-b37a-e1d5d2eed039 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.807713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-85bb5df5-b2d2-4275-94e7-eaa115a55153 req-8d769b7f-f939-4577-b37a-e1d5d2eed039 service nova] Creating event network-changed:1bb283d3-dee3-4b3b-b05d-39267648a295 for instance 6c525837-e57b-4864-9ece-7aec3a941be2 on nch2-master-1 Nov 06 20:50:08.808807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b6392389-7104-4c4b-bce0-e710568373cb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 1.100834 Nov 06 20:50:08.809414 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 586/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:07 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:08.817886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:08.822454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-85bb5df5-b2d2-4275-94e7-eaa115a55153 req-8d769b7f-f939-4577-b37a-e1d5d2eed039 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068286 Nov 06 20:50:08.823151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:08.823779 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 552/1138] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:08.829300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:08.829855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.830477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:08.830658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.831608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.832429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.842087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.842554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:08.844051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:08.844942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.167119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:09.201300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f242762-db01-4ce8-a119-274b1adc67b2 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1466 microversion: 2.1 time: 0.386470 Nov 06 20:50:09.202958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:09.208160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 587/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:08 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1466 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:09.216078 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae0d4da0-29a4-416b-8c82-f760e2b62fa1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.390390 Nov 06 20:50:09.216774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 553/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:08 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:09.228033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:09.228973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:09.234983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.235436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.236407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.237013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.238207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:09.238842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:09.269093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.273074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.280111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.280860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.513905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-516917fb-afbf-444a-8980-e55157d72039 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1617 microversion: 2.1 time: 0.294605 Nov 06 20:50:09.514466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 554/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:09 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1617 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:09.518306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:09.528223 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b08c24bd-1197-4ca1-816e-057a799610b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1463 microversion: 2.1 time: 0.317664 Nov 06 20:50:09.544640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 588/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:09 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:09.550684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:09.551410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:09.558261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.558725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.559661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.560340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.673930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Calling method '.version_select at 0x7f67158ab0d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:09.716944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9ab09ec-11db-4fd6-b3f1-0f82f2429861 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:09.717588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Neutron security group c9ab09ec-11db-4fd6-b3f1-0f82f2429861 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:09.718154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] HTTP exception thrown: Security group c9ab09ec-11db-4fd6-b3f1-0f82f2429861 does not exist Nov 06 20:50:09.718154 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-6336d2cb-645c-42e6-860e-1eaff52c00e7'] Nov 06 20:50:09.718781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Returning 404 to user: Security group c9ab09ec-11db-4fd6-b3f1-0f82f2429861 does not exist Nov 06 20:50:09.718781 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-6336d2cb-645c-42e6-860e-1eaff52c00e7'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:09.719649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3cec224e-7fe3-4179-9504-e4777874f6c2 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c9ab09ec-11db-4fd6-b3f1-0f82f2429861" status: 404 len: 194 microversion: 2.1 time: 0.197335 Nov 06 20:50:09.720992 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 555/1143] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:09 2021] DELETE /compute/v2.1/os-security-groups/c9ab09ec-11db-4fd6-b3f1-0f82f2429861 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:09.727761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-838085143", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8b5b22e4-35d2-4939-98cb-aa65cd77afbc"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:09.757912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8aee3646-b463-4944-a55f-78d1b4df16ba tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1614 microversion: 2.1 time: 0.211140 Nov 06 20:50:09.758791 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 589/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:09 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1614 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:09.763527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:09.765624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:09.775136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.776262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.777619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:09.778337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:09.794330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:10.031100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:10.040819 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-832503d7-cdf6-4fd1-9cd0-1d6210ffe26d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1315 microversion: 2.1 time: 0.280688 Nov 06 20:50:10.041589 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 590/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:09 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:10.055953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24ec9015-91ad-4455-99bf-41d1cf784353 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003626 Nov 06 20:50:10.056776 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 591/1146] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Nov 6 20:50:10 2021] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 06 20:50:10.061476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:10.062630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:10.068634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.068976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.069756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.070367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.087290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:10.088459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:10.089690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:10.090219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:10.090879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:10.100969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.101430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.102429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.102870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.113615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7a80a7c-0852-4322-9bb8-2bd8480326e2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.055413 Nov 06 20:50:10.117795 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 592/1147] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:10 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:10.120970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:10.121890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11db0374-476a-45f7-ae57-5c4a5d668f7b tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '.version_select at 0x7f671576b280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.123149 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:10.123149 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:10.124590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11db0374-476a-45f7-ae57-5c4a5d668f7b tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.125034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11db0374-476a-45f7-ae57-5c4a5d668f7b tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.125574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Getting quotas for user f49e092b163444568ad6cb851b62e3f6 and project 4ce2d4abd58240c3a94718d2a022d67c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:10.137124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:10.140438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11db0374-476a-45f7-ae57-5c4a5d668f7b tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.024089 Nov 06 20:50:10.141026 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 593/1148] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:50:10 2021] GET /compute/v2.1/os-migrations => generated 409 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:10.141257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:10.147208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.148555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:10.170815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.171339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.172479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.172976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.195701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c9ab245-a215-4caa-9842-6748b8337439 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473133 Nov 06 20:50:10.197616 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 556/1149] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:10.208061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "name": "network-vif-plugged", "status": "completed", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}, {"server_uuid": "183e64a4-ecc9-4623-b4f8-72c80bfae9d8", "name": "network-vif-plugged", "status": "completed", "tag": "62b4b2c1-0e64-4879-8eab-3188cee48679"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:10.210631 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:10.210631 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:10.227633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.227982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.249896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] Creating event network-vif-plugged:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch1-master-1 Nov 06 20:50:10.250839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] Creating event network-vif-plugged:62b4b2c1-0e64-4879-8eab-3188cee48679 for instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 on nch1-master-1 Nov 06 20:50:10.264700 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d9fa3853-9ffe-4250-9c85-1dc8a64ced15 req-232e2dd4-0e61-4843-aa87-c2dc1f036b67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064548 Nov 06 20:50:10.266184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 557/1150] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:10.277835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c07e412-22c0-413e-98e7-b3f33159383e tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Calling method '.version_select at 0x7f6715522700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.411593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:10.421851 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a01adcf1-949e-497e-bc4b-3fe00d1c8cb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.278084 Nov 06 20:50:10.422990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 594/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:10 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:10.428099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-161f18cc-2df8-4cdc-9a48-2db4af1cd748 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.428729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-161f18cc-2df8-4cdc-9a48-2db4af1cd748 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:10.517805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-161f18cc-2df8-4cdc-9a48-2db4af1cd748 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:10.525366 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-161f18cc-2df8-4cdc-9a48-2db4af1cd748 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1216 microversion: 2.1 time: 0.101104 Nov 06 20:50:10.535238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 595/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:10 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:10.541948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.542964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:10.550345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.551059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.552025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:10.552866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:10.677361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c07e412-22c0-413e-98e7-b3f33159383e tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.409535 Nov 06 20:50:10.678852 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 558/1153] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:50:10 2021] GET /compute/v2.1/os-security-groups => generated 707 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:10.698710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-144698992", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:10.748528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:10.753080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:10.757613 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0f2adb2-6d7c-4581-9059-f454d6ba2c86 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.223287 Nov 06 20:50:10.758494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 596/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:10 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:10.770214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f96a33ac-902b-412b-a8ad-f6fa3106faa9 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Calling method '.version_select at 0x7f6715436b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:10.988136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-f96a33ac-902b-412b-a8ad-f6fa3106faa9 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:10.989029 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f96a33ac-902b-412b-a8ad-f6fa3106faa9 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 06 20:50:10.989029 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-87679eea-a78f-4f74-b8e7-8a852b8a5c18'] Nov 06 20:50:10.989623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f96a33ac-902b-412b-a8ad-f6fa3106faa9 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 06 20:50:10.989623 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-87679eea-a78f-4f74-b8e7-8a852b8a5c18'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:10.990496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f96a33ac-902b-412b-a8ad-f6fa3106faa9 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e1ea89f6-f8c8-45e4-a22d-2ab193e891ea" status: 400 len: 182 microversion: 2.1 time: 0.226167 Nov 06 20:50:10.991188 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 597/1155] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:10 2021] DELETE /compute/v2.1/os-security-groups/e1ea89f6-f8c8-45e4-a22d-2ab193e891ea => generated 182 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:50:11.006430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Calling method '.version_select at 0x7f67153e7160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:11.064777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2f55979-ba71-4c56-a0e7-9e7633b601b3 does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:11.065363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Neutron security group c2f55979-ba71-4c56-a0e7-9e7633b601b3 not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:11.065891 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] HTTP exception thrown: Security group c2f55979-ba71-4c56-a0e7-9e7633b601b3 does not exist Nov 06 20:50:11.065891 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-01e40e59-b869-4d4a-8057-d124dfe376da'] Nov 06 20:50:11.066525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Returning 404 to user: Security group c2f55979-ba71-4c56-a0e7-9e7633b601b3 does not exist Nov 06 20:50:11.066525 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-01e40e59-b869-4d4a-8057-d124dfe376da'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:11.068983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f0c481d-2654-49e6-89b5-5fc2d38c6788 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/c2f55979-ba71-4c56-a0e7-9e7633b601b3" status: 404 len: 194 microversion: 2.1 time: 0.066083 Nov 06 20:50:11.069545 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 598/1156] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:50:11 2021] GET /compute/v2.1/os-security-groups/c2f55979-ba71-4c56-a0e7-9e7633b601b3 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:11.076980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:11.077589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.084249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.084766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.085516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.085947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.089002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:11.090183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:11.090816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:11.091396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:11.092023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:11.103852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.105634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.106908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.109020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.147693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:11.153373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for user 3ffff819b4c04c92a90993dcd4fa39c9 and project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:11.167674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:11.170405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:11.223118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71001c02-1039-43cd-bc8c-705bb9641f38 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535955 Nov 06 20:50:11.223765 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 559/1157] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:11.228506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Action: 'update', calling method: .version_select at 0x7f67156c88b0>, body: {"security_group": {"name": "tempest-sg-1222596433", "description": "tempest-description-1275415817"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:11.270931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5ed5239-c97d-476e-9f43-2e94ff40c444 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:11.271836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Neutron security group a5ed5239-c97d-476e-9f43-2e94ff40c444 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:11.273024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] HTTP exception thrown: Security group a5ed5239-c97d-476e-9f43-2e94ff40c444 does not exist Nov 06 20:50:11.273024 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-d3bbc828-1eee-4696-b98a-2bd1873c5a1d'] Nov 06 20:50:11.273716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] Returning 404 to user: Security group a5ed5239-c97d-476e-9f43-2e94ff40c444 does not exist Nov 06 20:50:11.273716 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-d3bbc828-1eee-4696-b98a-2bd1873c5a1d'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:11.274622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2833892-e13f-499e-bea8-97804bc9e1a8 tempest-SecurityGroupsNegativeTestJSON-1948299524 tempest-SecurityGroupsNegativeTestJSON-1948299524-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/a5ed5239-c97d-476e-9f43-2e94ff40c444" status: 404 len: 194 microversion: 2.1 time: 0.049598 Nov 06 20:50:11.275722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 560/1158] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Nov 6 20:50:11 2021] PUT /compute/v2.1/os-security-groups/a5ed5239-c97d-476e-9f43-2e94ff40c444 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:11.277351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:11.281946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:11.282928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.290961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.291852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.292605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a228974-7c86-451a-8946-3fe3fd00805c tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1504 microversion: 2.1 time: 0.221622 Nov 06 20:50:11.292886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.293324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.294916 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 599/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:11 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:11.299540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a9cedf0-a457-4bc4-8e97-5cbb75fd4b3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:11.300368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a9cedf0-a457-4bc4-8e97-5cbb75fd4b3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.353949 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c854a98c-701c-4456-a63e-2bb6adb6d00d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.075321 Nov 06 20:50:11.353949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 561/1160] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:11 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:11.359028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1389902080"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:11.359825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.368730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.369460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.370388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.370902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.372664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9a9cedf0-a457-4bc4-8e97-5cbb75fd4b3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:11.386054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a9cedf0-a457-4bc4-8e97-5cbb75fd4b3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1212 microversion: 2.1 time: 0.089856 Nov 06 20:50:11.398387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 600/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:11 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:11.439057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:11.439668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.446384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.446841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.447636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.448073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.740138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Adding security group 2312d131-9fb2-465a-9667-f841f85ba544 to port a262919e-18f2-4731-a6fd-471327f376d3 Nov 06 20:50:11.960563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:11.974480 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95c51b2b-a66a-4811-a43c-d3218313087c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.539074 Nov 06 20:50:11.983678 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 601/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:11 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:11.987789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:11.988431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:11.995384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.996038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:11.997035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:11.997484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.078800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:12.090828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a968cd63-d091-4829-a008-d8c5358668f9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1274 microversion: 2.1 time: 0.114190 Nov 06 20:50:12.092429 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 602/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:11 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:12.098748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:12.099631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:12.107337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.108143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.109187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.109781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.497983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:12.511724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa4a5767-73d7-4537-b8dd-d23ec1c6a6ca tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1315 microversion: 2.1 time: 0.416636 Nov 06 20:50:12.519847 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 603/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:12 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:12.534071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:12.536233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:12.551625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.562153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.566427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.569337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.678015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7b0d757-c890-4e8c-8b27-ec479f15b721 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.156283 Nov 06 20:50:12.682503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 604/1165] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:12 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:12.690067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:12.693289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:12.710891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.715939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.717067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.719910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.851212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:12.866408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2261b30-7be0-4e4a-ad76-0193ee9b69b2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1270 microversion: 2.1 time: 0.183600 Nov 06 20:50:12.878716 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 605/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:12 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:12.912840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7abd9837-0e96-4f36-a5c3-483201b5a9d9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action" status: 202 len: 0 microversion: 2.1 time: 1.557050 Nov 06 20:50:12.916432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 562/1167] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:11 2021] POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action => generated 0 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:12.925277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cda365da-bf20-4891-9e83-22c84b06656b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67158a3670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:12.928893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-324f9745-6810-4e9d-81f6-5f6d1d4e5e61 req-027e3665-635f-4bea-941c-4d1f6aa801bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585f0d61-50d1-4453-9ffd-c65faeb3cf89", "tag": "a262919e-18f2-4731-a6fd-471327f376d3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:12.930997 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:12.930997 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:12.939394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-324f9745-6810-4e9d-81f6-5f6d1d4e5e61 req-027e3665-635f-4bea-941c-4d1f6aa801bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:12.940255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-324f9745-6810-4e9d-81f6-5f6d1d4e5e61 req-027e3665-635f-4bea-941c-4d1f6aa801bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:12.963772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-324f9745-6810-4e9d-81f6-5f6d1d4e5e61 req-027e3665-635f-4bea-941c-4d1f6aa801bf service nova] Creating event network-changed:a262919e-18f2-4731-a6fd-471327f376d3 for instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 on nch1-master-1 Nov 06 20:50:12.980877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-324f9745-6810-4e9d-81f6-5f6d1d4e5e61 req-027e3665-635f-4bea-941c-4d1f6aa801bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056241 Nov 06 20:50:12.983419 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 563/1168] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:12.997966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:13.000233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:13.014084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.015269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.016686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.017472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.449068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-cda365da-bf20-4891-9e83-22c84b06656b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2312d131-9fb2-465a-9667-f841f85ba544 in use.", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:13.449748 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-cda365da-bf20-4891-9e83-22c84b06656b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security Group 2312d131-9fb2-465a-9667-f841f85ba544 in use. Nov 06 20:50:13.449748 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-93037685-ac0c-4da7-a00f-5a4833316445'] Nov 06 20:50:13.450334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cda365da-bf20-4891-9e83-22c84b06656b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 400 to user: Security Group 2312d131-9fb2-465a-9667-f841f85ba544 in use. Nov 06 20:50:13.450334 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-93037685-ac0c-4da7-a00f-5a4833316445'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:13.451155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cda365da-bf20-4891-9e83-22c84b06656b tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544" status: 400 len: 185 microversion: 2.1 time: 0.530535 Nov 06 20:50:13.451707 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 606/1169] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:12 2021] DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544 => generated 185 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:50:13.456816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:13.457425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:13.470742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.473892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.475568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.478283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.482377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:13.494839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-451b3570-0426-4605-9786-6908c8f569d6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.504596 Nov 06 20:50:13.497209 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 564/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:12 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:13.514473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:13.516003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:13.522068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.522742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.523702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.524391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.713046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31c5c9e0-7fbe-44ce-8422-5310bacbcfb2 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action" status: 202 len: 0 microversion: 2.1 time: 0.208654 Nov 06 20:50:13.713046 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 565/1171] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:13 2021] POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:13.726338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:13.736413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:13.761324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.762113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:13.764517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:13.765188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:14.905097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:14.915087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-995a3016-0841-431d-b225-947507c59e08 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 1.462070 Nov 06 20:50:14.932990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 607/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:13 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:14.947539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:14.951595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:14.971630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:14.976745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:14.978170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:14.979074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:15.040480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:15.056630 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ac9be30-4b5a-48f0-a901-23c43452a205 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.121455 Nov 06 20:50:15.056851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a410f4e-6411-45a7-ad3d-da3000074a54 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1503 microversion: 2.1 time: 1.334441 Nov 06 20:50:15.057286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 566/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:13 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1503 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:15.062370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:15.072714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:15.076404 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 608/1174] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:14 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:15.082322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:15.083344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:15.089838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:15.090312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:15.091099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:15.091236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:15.091945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:15.092170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:15.093255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:15.094100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:15.970973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:15.983083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-085818a3-9254-4718-bbac-67c63cb9661d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.905063 Nov 06 20:50:15.993377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 609/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:15 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:15.998401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:16.002864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:16.018387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.018852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.019667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.020105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.061490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:16.076703 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a920de7f-5717-42b7-b9e1-32d9e07b1249 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1575 microversion: 2.1 time: 1.013434 Nov 06 20:50:16.078401 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 567/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:15 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1575 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:16.092850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-185185f6-3a05-4652-a6be-0d51fc6a0e2e req-a3560c4a-3760-4295-8bf1-845bfc36c77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:16.096194 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:16.096194 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:16.107051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-185185f6-3a05-4652-a6be-0d51fc6a0e2e req-a3560c4a-3760-4295-8bf1-845bfc36c77e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.107591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-185185f6-3a05-4652-a6be-0d51fc6a0e2e req-a3560c4a-3760-4295-8bf1-845bfc36c77e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.134965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-185185f6-3a05-4652-a6be-0d51fc6a0e2e req-a3560c4a-3760-4295-8bf1-845bfc36c77e service nova] Creating event network-changed:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch2-master-1 Nov 06 20:50:16.143791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-185185f6-3a05-4652-a6be-0d51fc6a0e2e req-a3560c4a-3760-4295-8bf1-845bfc36c77e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063762 Nov 06 20:50:16.145020 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 568/1177] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:16.151227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:16.152191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:16.162965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.163739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.165290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.165982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.720696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:16.727615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e6181f6-627e-4e68-a1e1-c27a045b0ab7 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.732422 Nov 06 20:50:16.737723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 610/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:15 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:16.737723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:16.737723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:16.744738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.745371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.746349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:16.747048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:16.802583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ef0ca7a-d8b0-4ecc-8eea-3debed5d9890 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.073105 Nov 06 20:50:16.806492 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 611/1179] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:16 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:16.818743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:16.831059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40fbd9b6-5fba-457d-add9-79ff84551d37 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.684545 Nov 06 20:50:16.832520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 569/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:16 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:17.002057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:17.003471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:17.020087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.020864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.032080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.033513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.099802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:17.101235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:17.128115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.128786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.131529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.134072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.692940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:17.719511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f71032d-5de4-43fe-9447-51d410156df7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.722437 Nov 06 20:50:17.730673 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 612/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:16 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:17.738860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8882978-9643-4508-9f06-f2502787c159"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:17.740813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:17.748634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.749823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.750787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.751525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.761205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:17.782655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9b230e9-cf00-4c47-be48-4f116c9e6d42 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1575 microversion: 2.1 time: 0.688959 Nov 06 20:50:17.783750 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 570/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:17 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1575 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:17.788481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:17.789794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:17.805175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.805975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:17.807199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:17.808865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.182999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:18.226545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-417c6afc-28d8-43f7-90f4-76d8c0f2e63a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1391 microversion: 2.1 time: 0.441387 Nov 06 20:50:18.229501 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 571/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:17 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1391 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:18.235471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:18.245893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:18.252678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.254756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.266239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.266968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.354230 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3dcf876-a700-4b2a-8aff-986d2d732b4e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.122927 Nov 06 20:50:18.355822 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 572/1184] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:18 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:18.362152 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc58a3c0-323c-44d6-a54f-0a222cb335ea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629529 Nov 06 20:50:18.364227 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 613/1185] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 20:50:17 2021] POST /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:18.375491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:18.376562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:18.379740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-bc46dacf-5bad-439d-be4b-a3749469a378 req-a3e3d3b7-ff61-4455-8424-63d07f502843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c525837-e57b-4864-9ece-7aec3a941be2", "name": "network-vif-plugged", "status": "completed", "tag": "1bb283d3-dee3-4b3b-b05d-39267648a295"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:18.387209 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:18.387209 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:18.397831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bc46dacf-5bad-439d-be4b-a3749469a378 req-a3e3d3b7-ff61-4455-8424-63d07f502843 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.399514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bc46dacf-5bad-439d-be4b-a3749469a378 req-a3e3d3b7-ff61-4455-8424-63d07f502843 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.405055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.405695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.406471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.411706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.421428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-bc46dacf-5bad-439d-be4b-a3749469a378 req-a3e3d3b7-ff61-4455-8424-63d07f502843 service nova] Creating event network-vif-plugged:1bb283d3-dee3-4b3b-b05d-39267648a295 for instance 6c525837-e57b-4864-9ece-7aec3a941be2 on nch2-master-1 Nov 06 20:50:18.437956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-bc46dacf-5bad-439d-be4b-a3749469a378 req-a3e3d3b7-ff61-4455-8424-63d07f502843 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071879 Nov 06 20:50:18.439313 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 614/1186] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:18.448462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ea05e436-1c56-48d9-86e8-f782c8948f48 req-c1782ef3-33ef-452b-aa70-6c7eaf724d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d94de5-0ebe-4c5f-afc4-bb644fca2f6b", "tag": "21224404-6313-48a9-849f-646fc9609ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:18.450470 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:18.450470 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:18.471565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea05e436-1c56-48d9-86e8-f782c8948f48 req-c1782ef3-33ef-452b-aa70-6c7eaf724d82 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.472805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ea05e436-1c56-48d9-86e8-f782c8948f48 req-c1782ef3-33ef-452b-aa70-6c7eaf724d82 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.523333 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ea05e436-1c56-48d9-86e8-f782c8948f48 req-c1782ef3-33ef-452b-aa70-6c7eaf724d82 service nova] Creating event network-changed:21224404-6313-48a9-849f-646fc9609ae6 for instance 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b on nch1-master-1 Nov 06 20:50:18.539001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ea05e436-1c56-48d9-86e8-f782c8948f48 req-c1782ef3-33ef-452b-aa70-6c7eaf724d82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097693 Nov 06 20:50:18.545462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 615/1187] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:18.933700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:18.942360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1810fe72-bcef-4766-9f9e-a38cd1d112af tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.585018 Nov 06 20:50:18.942983 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 573/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:18 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:18.958788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:18.959445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:18.967335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.973607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.974894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:18.975515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:18.997230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-310419417", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0e936355-eba9-4975-b6c7-019db9b3e654"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:19.105943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] validate_networks() for [('0e936355-eba9-4975-b6c7-019db9b3e654', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:19.954627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:19.966902 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1731212f-5165-42c0-ad2c-92b383d61943 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 1.018508 Nov 06 20:50:19.968173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 574/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:18 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:19.973311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:19.974875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:19.981732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:19.982228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:19.983278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:19.983857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:20.523130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:20.533944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5de01e18-ad75-4e03-a1bd-25305a9d3b85 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1573 microversion: 2.1 time: 0.564287 Nov 06 20:50:20.535952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 575/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:19 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1573 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:20.543565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:20.544890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:20.582983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:20.583848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:20.585601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:20.587022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:20.918744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:20.919371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:20.925303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:20.927879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:20.928487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:20.946423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:20.947490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:20.949216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:20.950422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:20.989702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:21.000987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for user 251bfed29e8e448792810993d5d8742e and project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:21.018783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:21.022307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:21.055244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:21.066962 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1eccc9a0-baa5-45d0-9987-e8ff63c9893e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1589 microversion: 2.1 time: 0.528190 Nov 06 20:50:21.068620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 576/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:20 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1589 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:21.076476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:21.077843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:21.086344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.087165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.088056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.089114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.122873 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dab220ef-87a4-4744-abfb-bde4febd9a9a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432280 Nov 06 20:50:21.126028 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 616/1192] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:21.145311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:21.148337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:21.156710 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50dcf3f0-dec9-4838-b8d5-fe9522a3d152 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.084259 Nov 06 20:50:21.159270 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 577/1193] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:21 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:21.161407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.162056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.163374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.164837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.176587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-566865833"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:21.177570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:21.199117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.200451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.208987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.209748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.681971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Adding security group 7681db22-dd59-4cad-87e8-f7985ec03b47 to port a262919e-18f2-4731-a6fd-471327f376d3 Nov 06 20:50:21.688852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:21.699287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f20df742-5c8a-4388-96b3-e45b489be733 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.572160 Nov 06 20:50:21.712766 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 617/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:21 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:21.721101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:21.726293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:21.733733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.734192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:21.734975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:21.741856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.081776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:22.093055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-386cf835-9af3-4a14-8e01-f43cceed963b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.377697 Nov 06 20:50:22.095286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 618/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:21 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:22.106561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.107914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.118593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.119092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.120032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.120475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.269652 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73d30862-87ed-4ded-a4ff-f8fe8a54a772 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173164 Nov 06 20:50:22.270242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 619/1196] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:50:22 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:22.276312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.277242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.283646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.284513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.285596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.286184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.368773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:22.378069 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb5bb6a6-78af-46aa-893f-6730992ac500 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1269 microversion: 2.1 time: 0.106382 Nov 06 20:50:22.378764 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 620/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:22 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:22.385937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:22.387187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.399943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.400427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.401385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.401830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.457137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b0d4501d-989b-4a85-a1b1-d18efb39f01f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.076561 Nov 06 20:50:22.459250 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 621/1198] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:22 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:22.475917 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7295ab39-7ebd-4cd7-92ec-c2bd8237901e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action" status: 202 len: 0 microversion: 2.1 time: 1.314945 Nov 06 20:50:22.477195 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 578/1199] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:21 2021] POST /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89/action => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:22.486840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a052483-e02c-40fb-8338-5501bbc8e27d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67153b7700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.495040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-bf861c7f-3080-4620-bfd6-c8e6bacf4e11 req-ee9fdefa-1c4b-4781-a986-8d3f20d3cc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585f0d61-50d1-4453-9ffd-c65faeb3cf89", "tag": "a262919e-18f2-4731-a6fd-471327f376d3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:22.505491 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:22.505491 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:22.520349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bf861c7f-3080-4620-bfd6-c8e6bacf4e11 req-ee9fdefa-1c4b-4781-a986-8d3f20d3cc3c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.523429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bf861c7f-3080-4620-bfd6-c8e6bacf4e11 req-ee9fdefa-1c4b-4781-a986-8d3f20d3cc3c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.553347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-bf861c7f-3080-4620-bfd6-c8e6bacf4e11 req-ee9fdefa-1c4b-4781-a986-8d3f20d3cc3c service nova] Creating event network-changed:a262919e-18f2-4731-a6fd-471327f376d3 for instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 on nch1-master-1 Nov 06 20:50:22.562989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-bf861c7f-3080-4620-bfd6-c8e6bacf4e11 req-ee9fdefa-1c4b-4781-a986-8d3f20d3cc3c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073405 Nov 06 20:50:22.564190 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 579/1200] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:22.623034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-9a052483-e02c-40fb-8338-5501bbc8e27d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7681db22-dd59-4cad-87e8-f7985ec03b47 in use.", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:22.623842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9a052483-e02c-40fb-8338-5501bbc8e27d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security Group 7681db22-dd59-4cad-87e8-f7985ec03b47 in use. Nov 06 20:50:22.623842 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-b652ece3-0a04-4e7c-a94e-a678bdf53813'] Nov 06 20:50:22.625533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a052483-e02c-40fb-8338-5501bbc8e27d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 400 to user: Security Group 7681db22-dd59-4cad-87e8-f7985ec03b47 in use. Nov 06 20:50:22.625533 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-b652ece3-0a04-4e7c-a94e-a678bdf53813'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:22.626468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a052483-e02c-40fb-8338-5501bbc8e27d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47" status: 400 len: 185 microversion: 2.1 time: 0.145117 Nov 06 20:50:22.627178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 622/1201] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:22 2021] DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47 => generated 185 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:50:22.639337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.640896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.657852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.658671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.659871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.660556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.705247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:22.716896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.717641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.734201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.734646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.735440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.735877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.826930 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7523ef45-0cb5-4c02-aa48-0e85e22a28e4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 204 len: 0 microversion: 2.1 time: 0.194278 Nov 06 20:50:22.828031 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 580/1202] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:22 2021] DELETE /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:22.837575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:22.839266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:22.846905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.848145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:22.849555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:22.850236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.147878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:23.159790 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3062ea3-eb62-42a0-b542-c455a5e036cd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.446840 Nov 06 20:50:23.162823 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 623/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:22 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:23.169850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:23.170766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:23.179277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.180780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.182711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.183753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.315000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:23.323531 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c71fbd53-c82e-4ffc-bdc5-17bb7bbfe566 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1647 microversion: 2.1 time: 0.491278 Nov 06 20:50:23.324733 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 581/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:22 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1647 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:23.397087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:23.398939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:23.405683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.406749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.408737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.409722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.508227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:23.518107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7be0056b-a5e5-469e-a38a-76ee970bda14 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1275 microversion: 2.1 time: 0.125327 Nov 06 20:50:23.530741 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 582/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:23 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:23.541301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:23.543605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:23.556463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.561210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:23.569349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.573832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:23.574303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:23.577937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b24ad4b6-d7db-44d7-abc1-00dec366ecf9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.413539 Nov 06 20:50:23.578552 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 624/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:23 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:23.644572 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a2a2bad-9dad-46ac-a825-50857fefc3d6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.109393 Nov 06 20:50:23.646384 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 583/1207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:23 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:24.178979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:24.180122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.187328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.187776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.188593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.189027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.331160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:24.342735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:24.343389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2f1470e-e85a-4848-a84c-6acaedc887bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.168060 Nov 06 20:50:24.343977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.344625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 625/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:24 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:24.361391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.362287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.363104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.363551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.382872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:24.385410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.393666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.394334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.395414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.395847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.440980 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2bebf560-a637-4732-81e6-6e02f7270e3c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.063437 Nov 06 20:50:24.442096 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 626/1209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:24 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:24.448653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d5e2c46e-9c4f-4726-8e66-44bd49b31a56 req-a5134fa7-0f8d-452b-8a74-f879d158772a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c525837-e57b-4864-9ece-7aec3a941be2", "tag": "1bb283d3-dee3-4b3b-b05d-39267648a295"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:24.451703 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:24.451703 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:24.463597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d5e2c46e-9c4f-4726-8e66-44bd49b31a56 req-a5134fa7-0f8d-452b-8a74-f879d158772a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.465615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d5e2c46e-9c4f-4726-8e66-44bd49b31a56 req-a5134fa7-0f8d-452b-8a74-f879d158772a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.489639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d5e2c46e-9c4f-4726-8e66-44bd49b31a56 req-a5134fa7-0f8d-452b-8a74-f879d158772a service nova] Creating event network-changed:1bb283d3-dee3-4b3b-b05d-39267648a295 for instance 6c525837-e57b-4864-9ece-7aec3a941be2 on nch2-master-1 Nov 06 20:50:24.496925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d5e2c46e-9c4f-4726-8e66-44bd49b31a56 req-a5134fa7-0f8d-452b-8a74-f879d158772a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052068 Nov 06 20:50:24.497885 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 627/1210] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:24.537838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:24.538548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.569029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.569771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.570990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.571585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.572978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:24.593077 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80062c47-655d-4cdd-bd75-bae76985c17f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1647 microversion: 2.1 time: 0.254501 Nov 06 20:50:24.593706 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 584/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:24 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1647 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:24.610890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:24.611825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.621994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.622771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.634429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.636521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.849971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:24.858587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29f464e9-8304-41d0-aa4a-08c563f484fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.325593 Nov 06 20:50:24.862083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 628/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:24 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:24.869501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:24.876320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:24.886170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.886604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.887419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:24.887842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:24.901131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:24.943794 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cd65714-1a9e-49bc-b085-e9c63948eeeb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.335311 Nov 06 20:50:24.947345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 585/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:24 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:24.961902 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-289eebc9-9812-456e-8201-8273a614e51d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.095523 Nov 06 20:50:24.964465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 629/1214] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:24 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:25.177323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:25.177805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:25.186906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.188542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:25.190587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.191126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:25.234301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:25.364116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:25.364116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:25.365964 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d953aca-3707-4a29-b24d-3df248506ff7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 204 len: 0 microversion: 2.1 time: 0.192386 Nov 06 20:50:25.371899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 586/1215] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:25 2021] DELETE /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:25.375039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.375426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:25.376228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.376690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:25.379053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:25.380028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:25.393166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.394580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:25.395644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:25.397761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.052890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:26.060383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27697057-9505-4859-858d-b52044275567 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.702404 Nov 06 20:50:26.071444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 630/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:25 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:26.073060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:26.074295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:26.090305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.091015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.092009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.092630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.101930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:26.109983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2ec957a-5a1d-4099-8b82-c66e0b596565 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1555 microversion: 2.1 time: 0.736027 Nov 06 20:50:26.110963 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 587/1217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:25 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1555 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:26.121528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:26.124838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:26.142481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.145960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.147010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.147649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.190340 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d634686-509e-4394-9ac5-088e691745c0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.123046 Nov 06 20:50:26.192776 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 631/1218] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:26 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:26.200414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:26.209884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:26.224999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.227908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.230743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.233996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.278845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:26.287163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad823b14-eced-4982-832b-8ac206e80802 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 200 len: 1468 microversion: 2.1 time: 0.174824 Nov 06 20:50:26.297548 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 588/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:26 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:26.303502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:26.303851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:26.318049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.318639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.319555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.320734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.643341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:26.646729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:26.659241 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78079bde-7ea8-4cc6-b820-ad7a5a11cc42 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.459582 Nov 06 20:50:26.659867 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 632/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:26 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:26.665453 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd9ca23b-32ce-4a05-8516-fe2723af7f49 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.364660 Nov 06 20:50:26.665853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:26.666710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 589/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:26 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:26.673087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:26.675773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e8e6f4b6-f892-41d5-823c-d0d659d6bf45 req-b971ed3e-8e2c-436a-8b43-bfc3907e45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "name": "network-vif-plugged", "status": "completed", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:26.681541 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:26.681541 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:26.686574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.687830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.689776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e8e6f4b6-f892-41d5-823c-d0d659d6bf45 req-b971ed3e-8e2c-436a-8b43-bfc3907e45d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.690252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e8e6f4b6-f892-41d5-823c-d0d659d6bf45 req-b971ed3e-8e2c-436a-8b43-bfc3907e45d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.698411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.699212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.703002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e8e6f4b6-f892-41d5-823c-d0d659d6bf45 req-b971ed3e-8e2c-436a-8b43-bfc3907e45d7 service nova] Creating event network-vif-plugged:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch2-master-1 Nov 06 20:50:26.708200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e8e6f4b6-f892-41d5-823c-d0d659d6bf45 req-b971ed3e-8e2c-436a-8b43-bfc3907e45d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039875 Nov 06 20:50:26.709167 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 590/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:26.715624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3338cf56-f57f-467c-bc3b-342f3a2c0eb3 req-906e19f3-f244-4a49-8312-c0756ee9fe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585f0d61-50d1-4453-9ffd-c65faeb3cf89", "name": "network-vif-deleted", "tag": "a262919e-18f2-4731-a6fd-471327f376d3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:26.717674 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:26.717674 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:26.727085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3338cf56-f57f-467c-bc3b-342f3a2c0eb3 req-906e19f3-f244-4a49-8312-c0756ee9fe7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.727818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3338cf56-f57f-467c-bc3b-342f3a2c0eb3 req-906e19f3-f244-4a49-8312-c0756ee9fe7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.739460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3338cf56-f57f-467c-bc3b-342f3a2c0eb3 req-906e19f3-f244-4a49-8312-c0756ee9fe7d service nova] Creating event network-vif-deleted:a262919e-18f2-4731-a6fd-471327f376d3 for instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 on nch1-master-1 Nov 06 20:50:26.747034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3338cf56-f57f-467c-bc3b-342f3a2c0eb3 req-906e19f3-f244-4a49-8312-c0756ee9fe7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Nov 06 20:50:26.747909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 591/1223] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:26.759161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1cac5945-3f89-4d2f-8574-21da1dcc249a req-71386a79-fcec-453a-bce6-dd010a1b2a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270a8546-67d9-4233-977b-d8d71a4b3f51", "tag": "4bcbf763-7122-4e3c-924c-724aca38e98e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:26.760846 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:26.760846 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:26.766301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bdf72bc4-654b-4d18-9d20-7bbc3b0e517d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.104965 Nov 06 20:50:26.768517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1cac5945-3f89-4d2f-8574-21da1dcc249a req-71386a79-fcec-453a-bce6-dd010a1b2a38 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:26.769170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1cac5945-3f89-4d2f-8574-21da1dcc249a req-71386a79-fcec-453a-bce6-dd010a1b2a38 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:26.770700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 633/1224] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:26 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:26.784425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1cac5945-3f89-4d2f-8574-21da1dcc249a req-71386a79-fcec-453a-bce6-dd010a1b2a38 service nova] Creating event network-changed:4bcbf763-7122-4e3c-924c-724aca38e98e for instance 270a8546-67d9-4233-977b-d8d71a4b3f51 on nch2-master-1 Nov 06 20:50:26.791153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1cac5945-3f89-4d2f-8574-21da1dcc249a req-71386a79-fcec-453a-bce6-dd010a1b2a38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038142 Nov 06 20:50:26.791748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 592/1225] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:27.079593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.080310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:27.087804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.088370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.089169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.089607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.127597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.129046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:27.135956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.136705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.137679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.138125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.298496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:27.306913 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1aa123ff-448f-4b5f-a54f-8644426eaf4f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.231885 Nov 06 20:50:27.307482 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 634/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:27 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:27.311872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:27.312817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:27.321560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.322491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.322778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.323214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.326599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:27.334667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3afe4cd-e5d9-438f-a547-73e5b741b392 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1555 microversion: 2.1 time: 0.211251 Nov 06 20:50:27.335574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 593/1227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:27 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:27.340535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.341145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:27.346920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.347380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.348267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.348635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.363574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. Nov 06 20:50:27.364205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:27.365263 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf01cd87-f2f6-4ea6-bf56-602e1a9889da tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 404 len: 111 microversion: 2.1 time: 0.028099 Nov 06 20:50:27.365799 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 594/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:27 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:27.372525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc61fd84-e47f-4344-b7b9-801583a5e6cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.063780 Nov 06 20:50:27.375894 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 635/1229] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:27 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:27.376587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-741a9cda-d63a-4e9e-970d-c5135edeb8bf tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f6715596af0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.567527 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-741a9cda-d63a-4e9e-970d-c5135edeb8bf tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544" status: 202 len: 0 microversion: 2.1 time: 0.194295 Nov 06 20:50:27.568261 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 595/1230] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:27 2021] DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:27.577716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec711571-9887-4bc2-86b6-481509e1aef4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67153aa160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.676551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:27.677167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:27.683319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.683768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:27.684600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:27.685160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.073171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec711571-9887-4bc2-86b6-481509e1aef4 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47" status: 202 len: 0 microversion: 2.1 time: 0.499428 Nov 06 20:50:28.079794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 636/1231] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:27 2021] DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:28.095607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:28.096651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:28.106232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.107026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.108095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.108838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.277085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:28.285925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6778bfaf-fe59-4115-8bf6-92fe8373618b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.612842 Nov 06 20:50:28.286630 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 596/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:27 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:28.292267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:28.293637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:28.302936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.303670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.305162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.305602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.350952 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dde42286-c9ff-41d2-81d7-8ab5643daa94 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.062838 Nov 06 20:50:28.355208 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 597/1233] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:28 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:28.357042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bac86e61-95dc-453d-a0e3-6e042f5dd4b0 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'create', calling method: .version_select at 0x7f6715541160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-906216393", "description": "tempest-description-78078028"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:28.519314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:28.527064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe0d2d43-8d99-4354-a447-7357a29fc323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1312 microversion: 2.1 time: 0.441910 Nov 06 20:50:28.527558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 637/1234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:28 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:28.531792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:28.532417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:28.538361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.539726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.540530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.540963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.906469 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bac86e61-95dc-453d-a0e3-6e042f5dd4b0 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.552943 Nov 06 20:50:28.907062 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 598/1235] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 20:50:28 2021] POST /compute/v2.1/os-security-groups => generated 241 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:28.911445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:28.912178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:28.918983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.919442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.920238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:28.920709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:28.989630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:28.997239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc5f14d8-12c4-49ad-93b1-7cc0ede1e86c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.468711 Nov 06 20:50:28.997810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 638/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:28 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:29.002107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.003286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:29.009485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.009938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.010729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.011162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.050616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-abac8d16-ea3b-4577-a476-02e0321c7ceb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.051571 Nov 06 20:50:29.054454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 639/1237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:28 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:29.056313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-be7ce079-92bb-4f82-9547-2e8849ada020 req-065becb0-4be9-481b-b7bc-3e3ec5e5e3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d94de5-0ebe-4c5f-afc4-bb644fca2f6b", "name": "network-vif-plugged", "status": "completed", "tag": "21224404-6313-48a9-849f-646fc9609ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.058094 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:29.058094 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:29.065571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be7ce079-92bb-4f82-9547-2e8849ada020 req-065becb0-4be9-481b-b7bc-3e3ec5e5e3d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.066029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be7ce079-92bb-4f82-9547-2e8849ada020 req-065becb0-4be9-481b-b7bc-3e3ec5e5e3d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.078048 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-be7ce079-92bb-4f82-9547-2e8849ada020 req-065becb0-4be9-481b-b7bc-3e3ec5e5e3d7 service nova] Creating event network-vif-plugged:21224404-6313-48a9-849f-646fc9609ae6 for instance 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b on nch1-master-1 Nov 06 20:50:29.083278 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-be7ce079-92bb-4f82-9547-2e8849ada020 req-065becb0-4be9-481b-b7bc-3e3ec5e5e3d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030353 Nov 06 20:50:29.083836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 640/1238] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:29.089699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b0fd8e8-7123-4abc-9f0f-b66b0fd652f9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Action: 'update', calling method: .version_select at 0x7f6715446c10>, body: {"security_group": {"name": "tempest-sg-hth-1660278616", "description": "tempest-description-hth-760436242"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.289956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:29.301030 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2092a6d-9ac9-44bc-ae9b-ac4596c3907d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 200 len: 1555 microversion: 2.1 time: 0.392745 Nov 06 20:50:29.302220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 599/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:28 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 1555 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:29.308609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4505744d-3fc9-4ff7-8840-fe98a4c2ae00 req-aaa1819b-87ff-4704-942b-c6d36bf42d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183e64a4-ecc9-4623-b4f8-72c80bfae9d8", "name": "network-vif-deleted", "tag": "62b4b2c1-0e64-4879-8eab-3188cee48679"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.310363 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:29.310363 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:29.319344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4505744d-3fc9-4ff7-8840-fe98a4c2ae00 req-aaa1819b-87ff-4704-942b-c6d36bf42d96 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.319845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4505744d-3fc9-4ff7-8840-fe98a4c2ae00 req-aaa1819b-87ff-4704-942b-c6d36bf42d96 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.346308 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4505744d-3fc9-4ff7-8840-fe98a4c2ae00 req-aaa1819b-87ff-4704-942b-c6d36bf42d96 service nova] Creating event network-vif-deleted:62b4b2c1-0e64-4879-8eab-3188cee48679 for instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 on nch1-master-1 Nov 06 20:50:29.359506 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4505744d-3fc9-4ff7-8840-fe98a4c2ae00 req-aaa1819b-87ff-4704-942b-c6d36bf42d96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055429 Nov 06 20:50:29.361414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 600/1240] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:29.372580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:29.375056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:29.390526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.391235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.392353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.393061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.441331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b0fd8e8-7123-4abc-9f0f-b66b0fd652f9 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d" status: 200 len: 217 microversion: 2.1 time: 0.355814 Nov 06 20:50:29.442630 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 641/1241] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Nov 6 20:50:29 2021] PUT /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d => generated 217 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:29.448653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.450743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:29.459877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.460679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.461659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.463629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.582258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:29.593460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b43c8f63-259a-4efc-8bad-97edd3ba0b96 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.230577 Nov 06 20:50:29.594683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 601/1242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:29 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:29.599369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e1ad78d-f810-4326-b869-ab5dd95a938a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67155c5ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:29.654667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e1ad78d-f810-4326-b869-ab5dd95a938a tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d" status: 200 len: 217 microversion: 2.1 time: 0.058703 Nov 06 20:50:29.655514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 602/1243] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:50:29 2021] GET /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d => generated 217 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:29.659901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:29.660870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:29.668467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.668937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.669762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.670209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.685500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2277b2dc-ae9b-46ce-810c-4d1c58bcfaa9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.241204 Nov 06 20:50:29.687586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 642/1244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:29 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:29.696839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-665300fa-ca9e-4d92-98cb-2fe6326a7442 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f671574a160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:29.928051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:29.942542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e8afb90-7cbd-4ad1-bd7e-497b695fdff0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1461 microversion: 2.1 time: 0.286243 Nov 06 20:50:29.944950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 603/1245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:29 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1461 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:29.962419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:29.963722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:29.971260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.972109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:29.973295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:29.973955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.065888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-665300fa-ca9e-4d92-98cb-2fe6326a7442 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d" status: 202 len: 0 microversion: 2.1 time: 0.375529 Nov 06 20:50:30.065888 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 643/1246] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:29 2021] DELETE /compute/v2.1/os-security-groups/c2910442-fb3e-43cb-bde3-1d188feaec4d => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:30.072106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.073083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.091842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.092511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.095119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.095594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.111600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:30.122862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Old instance type m1.heat2, new instance type m1.heat {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 20:50:30.139229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:30.153012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:30.155597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:30.156328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:30.156887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:30.354323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:30.363996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58a47091-a12e-43c6-8f3f-48d8c80beff4 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1316 microversion: 2.1 time: 0.296483 Nov 06 20:50:30.364819 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 644/1247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:30 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:30.369599 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad1fb4b6-fff1-42ee-8de0-9d522c702bb1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22/action" status: 202 len: 0 microversion: 2.1 time: 0.411148 Nov 06 20:50:30.371074 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 604/1248] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:29 2021] POST /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:30.378577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.379614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.384714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:30.386381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.389177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.389908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.390952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.391578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.393511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.393966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.395888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.396639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.413010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. Nov 06 20:50:30.416846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:30.418136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d370d523-9f3f-44fc-8bcb-903c177b2864 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 404 len: 111 microversion: 2.1 time: 0.045881 Nov 06 20:50:30.424354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 605/1249] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:30 2021] DELETE /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:30.432345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.433496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.449047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.449848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.450862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.451567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.476715 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. Nov 06 20:50:30.477484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:30.481181 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9de56cd6-d955-42c5-881c-8b6d0c3e79cb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 404 len: 111 microversion: 2.1 time: 0.053414 Nov 06 20:50:30.482765 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 606/1250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:30 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:30.492948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.493808 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d52c61fe-29a8-45c2-bd81-abfcded05ce1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.107828 Nov 06 20:50:30.497394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 645/1251] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:30 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:30.500943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.505177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.506177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: 585f0d61-50d1-4453-9ffd-c65faeb3cf89] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.513939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.514933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.515936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.516552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.517984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.518462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.519483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.519988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.541469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. Nov 06 20:50:30.542405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Instance 585f0d61-50d1-4453-9ffd-c65faeb3cf89 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:30.543420 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b8bd0d50-66cc-4ed4-b173-46471cd1ee87 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89" status: 404 len: 111 microversion: 2.1 time: 0.044208 Nov 06 20:50:30.547479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 646/1252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:30 2021] GET /compute/v2.1/servers/585f0d61-50d1-4453-9ffd-c65faeb3cf89 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:30.552648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67153a0e50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.624530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7681db22-dd59-4cad-87e8-f7985ec03b47 does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:30.625422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 7681db22-dd59-4cad-87e8-f7985ec03b47 not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:30.626024 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 7681db22-dd59-4cad-87e8-f7985ec03b47 does not exist Nov 06 20:50:30.626024 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-7abb59e2-5e71-45f2-914c-1f9d9479fdce'] Nov 06 20:50:30.626750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 7681db22-dd59-4cad-87e8-f7985ec03b47 does not exist Nov 06 20:50:30.626750 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-7abb59e2-5e71-45f2-914c-1f9d9479fdce'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:30.627700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f26fca20-535f-43eb-bd6c-3c2dccf84b2d tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47" status: 404 len: 194 microversion: 2.1 time: 0.078780 Nov 06 20:50:30.631103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 647/1253] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:30 2021] DELETE /compute/v2.1/os-security-groups/7681db22-dd59-4cad-87e8-f7985ec03b47 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:30.638318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:30.641481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:30.658299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.658763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.663133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:30.663864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:30.901705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:30.910366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d95627ea-27be-4550-a5e7-a63058dafc45 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1470 microversion: 2.1 time: 0.420910 Nov 06 20:50:30.916597 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 607/1254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:30 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:30.935036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f671564f430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.026804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2312d131-9fb2-465a-9667-f841f85ba544 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:31.027689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 2312d131-9fb2-465a-9667-f841f85ba544 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:31.028193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 2312d131-9fb2-465a-9667-f841f85ba544 does not exist Nov 06 20:50:31.028193 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-9cf11dea-bd31-4e21-b981-3f662ab59202'] Nov 06 20:50:31.028926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 2312d131-9fb2-465a-9667-f841f85ba544 does not exist Nov 06 20:50:31.028926 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-9cf11dea-bd31-4e21-b981-3f662ab59202'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.029773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abf11840-ff77-4f4d-9714-a36afd7b7243 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544" status: 404 len: 194 microversion: 2.1 time: 0.102781 Nov 06 20:50:31.030321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 608/1255] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:30 2021] DELETE /compute/v2.1/os-security-groups/2312d131-9fb2-465a-9667-f841f85ba544 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:31.035464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.036451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:31.060911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.061379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.064515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.066181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.105523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. Nov 06 20:50:31.106135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.106984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c0946b1-fa30-4b77-8369-7a337ac5176b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075585 Nov 06 20:50:31.107538 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 609/1256] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:50:31 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:31.115326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:31.124033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-921ae1a5-3bfe-4400-ac47-6e813f26e752 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.493722 Nov 06 20:50:31.125678 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 648/1257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:30 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:31.131380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67154508b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.138568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:31.139848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:31.150643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.151384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.153710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.154451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.156710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:31.157480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:31.158158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist Nov 06 20:50:31.158158 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-9e48fe95-1985-45cf-a321-003115ff4fe1'] Nov 06 20:50:31.159058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 9d7a3df1-c466-4715-9fdf-fe423f81c537 does not exist Nov 06 20:50:31.159058 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-9e48fe95-1985-45cf-a321-003115ff4fe1'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.160110 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a33dca11-a501-4e35-8675-3e9e387a266f tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537" status: 404 len: 194 microversion: 2.1 time: 0.033105 Nov 06 20:50:31.161173 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 649/1258] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:31 2021] DELETE /compute/v2.1/os-security-groups/9d7a3df1-c466-4715-9fdf-fe423f81c537 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:31.172719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f671537c550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.200435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:31.201113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group ee3fd931-9f31-41d5-b7b4-9bee910f739f not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:31.201687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist Nov 06 20:50:31.201687 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-790dce29-a8b2-4142-a9ac-c2c636532bc0'] Nov 06 20:50:31.202275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group ee3fd931-9f31-41d5-b7b4-9bee910f739f does not exist Nov 06 20:50:31.202275 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-790dce29-a8b2-4142-a9ac-c2c636532bc0'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.203437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a94d447-0f42-4618-bcd0-6f67c2b7b58e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f" status: 404 len: 194 microversion: 2.1 time: 0.036484 Nov 06 20:50:31.204522 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 650/1259] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:31 2021] DELETE /compute/v2.1/os-security-groups/ee3fd931-9f31-41d5-b7b4-9bee910f739f => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:31.213495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8ddbfb3-d07c-497d-bc19-32caf3e2eba9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.094003 Nov 06 20:50:31.214175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f671537c700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.217334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 610/1260] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:31 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:31.241476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:31.243063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f not found {{(pid=134827) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:31.243828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist Nov 06 20:50:31.243828 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-e6879fee-9423-44e7-9360-ab7b888785ed'] Nov 06 20:50:31.244729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 3407ec17-4e80-4e5d-b432-27a6f3bd1d3f does not exist Nov 06 20:50:31.244729 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-e6879fee-9423-44e7-9360-ab7b888785ed'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.247542 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ad8c01c-3db6-41a6-bf29-525f6a6bd9d5 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f" status: 404 len: 194 microversion: 2.1 time: 0.039029 Nov 06 20:50:31.248722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 651/1261] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:31 2021] DELETE /compute/v2.1/os-security-groups/3407ec17-4e80-4e5d-b432-27a6f3bd1d3f => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:31.258507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67156074c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.319167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG neutronclient.v2_0.client [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist", "detail": ""}} {{(pid=134828) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:50:31.319914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.security_group_api [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Neutron security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 not found {{(pid=134828) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 06 20:50:31.320618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist Nov 06 20:50:31.320618 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-f5a0867f-cf9b-4258-91b0-f167c272ed77'] Nov 06 20:50:31.321835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Security group 9eec5b68-e6bf-434f-8f3e-b833b5361633 does not exist Nov 06 20:50:31.321835 ncdv-master-1 devstack@n-api.service[134828]: Neutron server returns request_ids: ['req-f5a0867f-cf9b-4258-91b0-f167c272ed77'] {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:31.325984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9002fb2-1f77-4f58-aaaa-00a780330931 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633" status: 404 len: 194 microversion: 2.1 time: 0.072438 Nov 06 20:50:31.328350 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 611/1262] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:31 2021] DELETE /compute/v2.1/os-security-groups/9eec5b68-e6bf-434f-8f3e-b833b5361633 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:50:31.336420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.337735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:31.349561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.353627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.354847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.355637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.384319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:31.385199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:31.398737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.400304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.401915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:31.405987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:31.457746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:31.627610 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe99b481-d2f6-4a8b-8ae0-ba18b65f73c1 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 204 len: 0 microversion: 2.1 time: 0.295599 Nov 06 20:50:31.635667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 652/1263] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:31 2021] DELETE /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:50:31.641273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-832540829", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:31.795285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:31.993240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:32.003909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82f71960-f25a-407e-9935-8a88efee0d31 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1466 microversion: 2.1 time: 0.624923 Nov 06 20:50:32.008409 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 612/1264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:31 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1466 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:32.015761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:32.017722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:32.028560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.029404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.030814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.031562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.111624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a3f3054-b9a6-4f84-b90b-6367b8bdcddd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.101336 Nov 06 20:50:32.117121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 613/1265] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:32 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:32.128123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:32.129036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:32.146747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.147614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.149696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.150360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.552778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:32.565522 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b94951e-d10d-434e-8361-accb229ffcfb tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1647 microversion: 2.1 time: 0.446583 Nov 06 20:50:32.567051 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 614/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:32 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1647 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:32.588084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:32.588904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:32.596073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.598666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.600030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.601649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.628130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:32.629261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:32.630947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:32.631539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:32.632127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:32.660472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.661216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.662272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.668060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.703710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:32.721115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:32.742504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:32.745009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:32.813920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:32.830560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd265c0c-df6d-4d4a-8240-29dfe9b469de tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1470 microversion: 2.1 time: 0.256042 Nov 06 20:50:32.841310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cb55092d-4ad4-4126-9688-2a4f67f00f62 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203659 Nov 06 20:50:32.842801 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 653/1267] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:32.849932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:32.850849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:32.858686 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 615/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:32 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:32.867093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.871179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:32.874353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.876628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.877652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.881391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:32.902858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.903499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:32.904705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:32.905484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.243392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:33.243730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45d27655-dd23-4689-ae14-35b4089209f9 tempest-ServersOnMultiNodesTest-859297187 tempest-ServersOnMultiNodesTest-859297187-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1617 microversion: 2.1 time: 0.394709 Nov 06 20:50:33.246388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 654/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:32 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1617 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:33.255804 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abd04acb-833b-4ff5-83b2-d67cdccba607 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.394922 Nov 06 20:50:33.261662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:33.265613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.266898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 616/1270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:32 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:33.277542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'create', calling method: .version_select at 0x7f67156c83a0>, body: {"keypair": {"name": "tempest-keypair-886713322"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:33.281475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.281936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.285700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.286656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.325447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:33.340142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for user 407605b252be40ad88a3fce348750e79 and project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:33.370011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02e9e1e0-0965-48c8-a6f1-b042b2d5eb62 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.120462 Nov 06 20:50:33.371855 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 655/1271] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:33 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:33.378252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-705c5936-afee-49b0-9671-5183d7615961 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:33.378956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-705c5936-afee-49b0-9671-5183d7615961 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.529804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-705c5936-afee-49b0-9671-5183d7615961 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:33.536686 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-705c5936-afee-49b0-9671-5183d7615961 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 200 len: 1214 microversion: 2.1 time: 0.163472 Nov 06 20:50:33.537619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 656/1272] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:33 2021] GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:33.544916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:33.545855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.569037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.570271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.571250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.571874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.581867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:33.599629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for user 407605b252be40ad88a3fce348750e79 and project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:33.627931 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91a1d427-22bb-4be7-9ab8-75904e2d0f6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.42 time: 0.359529 Nov 06 20:50:33.629197 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 617/1273] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 20:50:33 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 362 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:50:33.646175 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5d75e98-4be9-4ae3-a56b-ab187c609d7c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.104654 Nov 06 20:50:33.646687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:33.648937 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 657/1274] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:33 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:33.650618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.662104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:33.663091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.667195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.667689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.668546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.668995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.671923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.672690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.673614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.674208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.713318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:33.736906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:33.746638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.747354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.767966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'flavor' on Instance uuid 73dd5f4c-bb98-45e4-941f-1245453637c1 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:50:33.884579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'system_metadata' on Instance uuid 73dd5f4c-bb98-45e4-941f-1245453637c1 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:50:33.946873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edd83647-9ed5-48da-a753-5efce485ca5d tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 204 len: 0 microversion: 2.1 time: 0.315831 Nov 06 20:50:33.948102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 618/1275] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:33 2021] DELETE /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:33.976786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:33.977824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:33.992510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.993990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:33.996343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:33.997988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.056473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'metadata' on Instance uuid 73dd5f4c-bb98-45e4-941f-1245453637c1 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:50:34.261335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.261799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.398623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2da9baa4b40417294173ec358b91fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a012746186e4431bf96fa9c5a3bc116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:34.406631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-115a4224-90cc-4893-a133-2e6b8574e921 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 200 len: 1647 microversion: 2.1 time: 0.456734 Nov 06 20:50:34.414649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 619/1276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:33 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 1647 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:34.426104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:34.426743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:34.448833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.449317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.450153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.450596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.481006 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c6f54a1-3c65-4f31-a2e2-3f132f81c4f8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 204 len: 0 microversion: 2.1 time: 0.830302 Nov 06 20:50:34.481863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 658/1277] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:33 2021] DELETE /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:34.501745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:34.504993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:34.518355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.518981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.519981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.522429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.788101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:34.796697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7064115f-070a-40f4-ad0b-810977eade5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.381018 Nov 06 20:50:34.797267 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 620/1278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:34 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:34.801752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:34.802354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:34.808232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.808724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.809518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.810008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.814039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:34.824454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bb9cc9f-923b-4062-b47b-ef87217913b8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1472 microversion: 2.1 time: 0.337468 Nov 06 20:50:34.834099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 659/1279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:34 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:34.834099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:34.834099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:34.839340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.839747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.840652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.841104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.897549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d84fa7e8-d919-43b8-ae9d-1ed247ce8c2a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.070608 Nov 06 20:50:34.899044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 660/1280] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:34 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:34.909688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:34.910646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:34.918605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.919294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:34.920965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:34.921584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.064888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:35.073024 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9611c2e3-bc9d-4141-b4a6-327fa3f0e203 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 200 len: 1216 microversion: 2.1 time: 0.168633 Nov 06 20:50:35.074154 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 661/1281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:34 2021] GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:35.078754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6f0b4f9a-a569-4f74-9aa6-dff5cb125916 req-3b125995-dc1c-47c7-8de2-bc3d1539e208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad", "name": "network-vif-deleted", "tag": "e541788d-ed2f-4fde-8f49-0c9128ea5e7a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:35.080320 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:35.080320 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:35.096406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6f0b4f9a-a569-4f74-9aa6-dff5cb125916 req-3b125995-dc1c-47c7-8de2-bc3d1539e208 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.097639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6f0b4f9a-a569-4f74-9aa6-dff5cb125916 req-3b125995-dc1c-47c7-8de2-bc3d1539e208 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.116348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:35.123795 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc6bcb04-769a-42fa-9b51-2b39ce03150e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.325331 Nov 06 20:50:35.124204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6f0b4f9a-a569-4f74-9aa6-dff5cb125916 req-3b125995-dc1c-47c7-8de2-bc3d1539e208 service nova] Creating event network-vif-deleted:e541788d-ed2f-4fde-8f49-0c9128ea5e7a for instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad on nch2-master-1 Nov 06 20:50:35.131883 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 621/1282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:34 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:35.136856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6f0b4f9a-a569-4f74-9aa6-dff5cb125916 req-3b125995-dc1c-47c7-8de2-bc3d1539e208 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061315 Nov 06 20:50:35.137516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:35.137879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 662/1283] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:35.140604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:35.155171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.155824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.156889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.157486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.216591 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4742337-7d32-49c7-b429-895f0e95f455 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 14 microversion: 2.1 time: 0.079332 Nov 06 20:50:35.218130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 622/1284] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:35 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:50:35.427123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:35.428152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] [instance: fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:35.437768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.438493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.439477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.440072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.461023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] HTTP exception thrown: Instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad could not be found. Nov 06 20:50:35.462023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Returning 404 to user: Instance fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:35.463030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f8ac5eb-1b45-4ffe-8ac5-651800ea8350 tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad" status: 404 len: 111 microversion: 2.1 time: 0.040421 Nov 06 20:50:35.464187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 663/1285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:35 2021] GET /compute/v2.1/servers/fc2b98f6-2bbf-4d47-9bba-cdb5dcc4b1ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:35.474241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f941472c-9eb1-44ef-9fd1-737072cb6eab tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f671574c5e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:35.814035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:35.815236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:35.822110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.822781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.823585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:35.824057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:35.984459 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f941472c-9eb1-44ef-9fd1-737072cb6eab tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6c4f71d4-66fd-4426-9634-6d66ef254dfd" status: 202 len: 0 microversion: 2.1 time: 0.515801 Nov 06 20:50:35.985120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 623/1286] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:35 2021] DELETE /compute/v2.1/os-security-groups/6c4f71d4-66fd-4426-9634-6d66ef254dfd => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:35.992311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1829426676", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ac9c34d5-c747-4b87-9e0a-345684b21c29"}, {"port": "b2314b90-7099-4642-9659-4a7f9cf3fccc", "tag": "port-1"}, {"port": "ae68264b-1862-48ec-9e32-e8afd5d1d1a9", "tag": "port-2"}, {"uuid": "1ed770e6-9b00-40af-a51d-f21c36fc4854", "tag": "net-1"}, {"uuid": "1ed770e6-9b00-40af-a51d-f21c36fc4854"}, {"uuid": "958012f3-be05-4daa-8ea3-73508f133764", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "958012f3-be05-4daa-8ea3-73508f133764", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7f35eb51-5bb5-43ec-a170-cc81ed19014d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c0d911bb-c272-4d66-8272-d951168b4a48", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1763317174"}], "key_name": "tempest-keypair-886713322", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:36.114961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:36.123408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecc00f64-6af8-4b23-b5d4-c5ba466f5f1b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.312928 Nov 06 20:50:36.124104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 664/1287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:35 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:36.132067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:36.133203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:36.142626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:36.143174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:36.144229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:36.144782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:36.294087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] validate_networks() for [('ac9c34d5-c747-4b87-9e0a-345684b21c29', None, None, None, None, None), (None, None, 'b2314b90-7099-4642-9659-4a7f9cf3fccc', None, None, None), (None, None, 'ae68264b-1862-48ec-9e32-e8afd5d1d1a9', None, None, None), ('1ed770e6-9b00-40af-a51d-f21c36fc4854', None, None, None, None, None), ('1ed770e6-9b00-40af-a51d-f21c36fc4854', None, None, None, None, None), ('958012f3-be05-4daa-8ea3-73508f133764', '10.2.2.100', None, None, None, None), ('958012f3-be05-4daa-8ea3-73508f133764', '10.2.2.200', None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:36.676552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:36.683843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1797499d-826a-410c-af47-5a2b0b87b3f7 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 200 len: 1472 microversion: 2.1 time: 0.558528 Nov 06 20:50:36.693142 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 665/1288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:36 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 1472 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:36.698265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:36.699234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:36.704948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:36.705400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:36.706188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:36.706619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:36.746382 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cacdf19-dd8c-4902-b382-48b67b7a3fd4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.051962 Nov 06 20:50:36.747339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 666/1289] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:36 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:36.753922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f09f0a5-c503-4990-a5c8-cbae72e27b4e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] Calling method '.version_select at 0x7f67153aae50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:37.314902 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f09f0a5-c503-4990-a5c8-cbae72e27b4e tempest-SecurityGroupsTestJSON-403655037 tempest-SecurityGroupsTestJSON-403655037-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/814e77f0-fae4-4da2-bfaf-8a78c6cc6606" status: 202 len: 0 microversion: 2.1 time: 0.566167 Nov 06 20:50:37.316193 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 667/1290] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:50:36 2021] DELETE /compute/v2.1/os-security-groups/814e77f0-fae4-4da2-bfaf-8a78c6cc6606 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:37.324199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:37.325207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:37.333346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.334121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.335240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.335938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.352554 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. Nov 06 20:50:37.353524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:37.355699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6f5e663-a0fa-43b5-bbbd-45ed82946a05 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 404 len: 111 microversion: 2.1 time: 0.037354 Nov 06 20:50:37.377985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 668/1291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:37 2021] GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:37.391134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e22d47b1-8eb7-4af8-8c61-e70c67c65631 req-05eadb27-805d-43c4-8be3-cab88bb722d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270a8546-67d9-4233-977b-d8d71a4b3f51", "name": "network-vif-plugged", "status": "completed", "tag": "4bcbf763-7122-4e3c-924c-724aca38e98e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:37.398234 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:37.398234 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:37.411199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e22d47b1-8eb7-4af8-8c61-e70c67c65631 req-05eadb27-805d-43c4-8be3-cab88bb722d8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.416610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e22d47b1-8eb7-4af8-8c61-e70c67c65631 req-05eadb27-805d-43c4-8be3-cab88bb722d8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.428322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e22d47b1-8eb7-4af8-8c61-e70c67c65631 req-05eadb27-805d-43c4-8be3-cab88bb722d8 service nova] Creating event network-vif-plugged:4bcbf763-7122-4e3c-924c-724aca38e98e for instance 270a8546-67d9-4233-977b-d8d71a4b3f51 on nch2-master-1 Nov 06 20:50:37.434869 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e22d47b1-8eb7-4af8-8c61-e70c67c65631 req-05eadb27-805d-43c4-8be3-cab88bb722d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047305 Nov 06 20:50:37.435466 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 669/1292] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:37.445209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:37.445917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:37.452261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.452695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.453487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.453922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.689649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:37.697755 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef5223a2-991f-4e13-bbe9-6cb0f7d8018b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.261082 Nov 06 20:50:37.700663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 670/1293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:37 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:37.709221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:37.710975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:37.733204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.734024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:37.735264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:37.736019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:38.013641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-30e35bee-cdd5-4dab-8976-f68658d1bd68 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 16395 microversion: 2.1 time: 0.309962 Nov 06 20:50:38.018411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 671/1294] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:37 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 16395 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:38.026796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:38.027550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:38.036542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:38.036991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:38.037778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:38.038206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:38.288336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:38.296958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c52ce4d4-d44b-4e90-b46b-b8b81e1ee35a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.276679 Nov 06 20:50:38.310724 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 672/1295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:38 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:38.319245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-574acf7f-dc99-428e-8479-496eec9d2ab4 req-d51442dd-5d8e-4cd5-9838-b2c1fce2c097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d94de5-0ebe-4c5f-afc4-bb644fca2f6b", "name": "network-vif-deleted", "tag": "21224404-6313-48a9-849f-646fc9609ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:38.321849 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:38.321849 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:38.332028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-574acf7f-dc99-428e-8479-496eec9d2ab4 req-d51442dd-5d8e-4cd5-9838-b2c1fce2c097 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:38.333247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-574acf7f-dc99-428e-8479-496eec9d2ab4 req-d51442dd-5d8e-4cd5-9838-b2c1fce2c097 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:38.352015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-574acf7f-dc99-428e-8479-496eec9d2ab4 req-d51442dd-5d8e-4cd5-9838-b2c1fce2c097 service nova] Creating event network-vif-deleted:21224404-6313-48a9-849f-646fc9609ae6 for instance 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b on nch1-master-1 Nov 06 20:50:38.357488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-574acf7f-dc99-428e-8479-496eec9d2ab4 req-d51442dd-5d8e-4cd5-9838-b2c1fce2c097 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045102 Nov 06 20:50:38.358411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 673/1296] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:38.363495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1829793083", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:38.418015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:38.998380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:38.998939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:38.999532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:39.000041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:39.000570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:39.011051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.011650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.012607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.015829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.032679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:39.036723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:39.049650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:39.052157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:39.100644 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b15118e7-a56c-4967-8917-1e50a9c02abb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741187 Nov 06 20:50:39.102375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 674/1297] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:39.107214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:39.107832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:39.115053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.115677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.116896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.117485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.137263 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b could not be found. Nov 06 20:50:39.138042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 20d94de5-0ebe-4c5f-afc4-bb644fca2f6b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:39.138878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e200f6a2-7797-4aab-8563-4af865e8c8c5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b" status: 404 len: 111 microversion: 2.1 time: 0.035346 Nov 06 20:50:39.142471 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 675/1298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:39 2021] GET /compute/v2.1/servers/20d94de5-0ebe-4c5f-afc4-bb644fca2f6b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:39.146164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:39.147147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:39.154530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.154985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.155853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.156311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.206541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37763514-189d-4959-ae54-01336d9c1933 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.065195 Nov 06 20:50:39.211346 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 676/1299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:39 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:39.220629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:39.229981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:39.241616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.244458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.245696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.246589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.856640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:39.864595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3798b105-33af-48eb-bace-2502483f9986 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1317 microversion: 2.1 time: 0.655051 Nov 06 20:50:39.865175 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 677/1300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:39 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:39.870564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:39.871707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:39.879048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.879847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.880863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.881741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.934429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fef2910a-695f-445b-8463-b4d9cc9af38d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 16395 microversion: 2.1 time: 0.067773 Nov 06 20:50:39.935401 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 678/1301] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:39 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 16395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:39.941427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:39.942385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:39.950257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.950738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.951615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.952069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.953702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:39.958186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:39.958186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:39.958186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:39.958804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:39.969986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.970832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.972776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:39.973575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:39.996617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:40.002171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Getting quotas for user 407605b252be40ad88a3fce348750e79 and project 21f37b0e9c3a4480a04ebeec1085ec97. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:40.045888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:40.058135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-377a9cbf-cd9c-4a70-94af-b2b21456884b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1267 microversion: 2.1 time: 0.121159 Nov 06 20:50:40.059107 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 679/1302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:39 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:40.066025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:40.066730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.078178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.078690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.079493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.079936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.111680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:40.261414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4aafbd4b-3cca-4224-b52b-82915e5535bd tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 204 len: 0 microversion: 2.1 time: 0.200469 Nov 06 20:50:40.266121 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 680/1303] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:40 2021] DELETE /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:40.273937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:40.274910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.278434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:40.282279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7f35eb51-5bb5-43ec-a170-cc81ed19014d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c0d911bb-c272-4d66-8272-d951168b4a48',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:40.283199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.283844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.284989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.285665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.601844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:40.613016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a5dada9-369b-4f8f-b13c-9b51f3a6d4d0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.344757 Nov 06 20:50:40.613598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 681/1304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:40 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:40.633281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:40.635606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.653569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.654228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.655320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.655862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.723768 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd1f3e67-18cd-4e8f-b110-903d2ee5f0d7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.104437 Nov 06 20:50:40.725581 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 682/1305] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:40 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:40.739953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e03043f2-f494-4fd6-bbac-03a0ff390b4e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.753380 Nov 06 20:50:40.740636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:40.742107 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 624/1306] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Nov 6 20:50:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 4755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:50:40.745257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.761766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:40.764234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.772425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.773171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.775647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.778120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.864521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:40.885943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:40.888462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:40.893224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c7f939a-0106-4fac-a15a-226e5790ba94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1285 microversion: 2.42 time: 0.145226 Nov 06 20:50:40.894331 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 625/1307] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:40 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:40.899660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:40.900500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:40.916262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.917037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:40.918235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:40.919423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.172149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:41.182310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99413fb0-2608-454d-99fe-278811f26b76 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1472 microversion: 2.1 time: 0.454718 Nov 06 20:50:41.183938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 683/1308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:40 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:41.197998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:41.199625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.215742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.216841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.219641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.220244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.303406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e5665e8-d597-4434-b75e-b0b574ea7115 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 16395 microversion: 2.1 time: 0.116704 Nov 06 20:50:41.304749 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 684/1309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:41 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 16395 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:41.319545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:41.320860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.329400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.330396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.331667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.332378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.437170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:41.447771 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6831af3e-b2b1-464d-81b5-05d60e644141 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1508 microversion: 2.1 time: 0.552118 Nov 06 20:50:41.451461 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 626/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:40 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:41.468438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:41.469110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.479053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.479864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.480869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.481669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.556037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:41.564030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e6a8dd7-6782-483d-97c0-7e87681a4265 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.257251 Nov 06 20:50:41.567783 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 685/1311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:41 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:41.631479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:41.635609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.654724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.655252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.656089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.656551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.906761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:41.915898 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18741e26-6860-416f-841a-e8ce4e3050cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1508 microversion: 2.1 time: 0.451250 Nov 06 20:50:41.917091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 627/1312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:41 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:41.922122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:41.923355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.930687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.931142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.932145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.932660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.975285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8d23689-c5c5-4ca3-9259-64d13f24a5f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.056544 Nov 06 20:50:41.976216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 628/1313] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:41 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:41.982519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:41.983599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:41.993384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.994069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:41.995304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:41.995953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.166784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:42.184391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:42.186235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:42.187586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd2e266f-b46d-478a-8122-aacfa0532761 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1575 microversion: 2.42 time: 0.210109 Nov 06 20:50:42.188150 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 629/1314] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:41 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:42.192822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:42.195205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.217609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.218776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.219794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.221005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.306876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:42.322987 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccab31ab-e660-4ce6-840b-4d0ff262051d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.695745 Nov 06 20:50:42.327225 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 686/1315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:41 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:42.346646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:42.349021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:42.349021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:42.349327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:42.349952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:42.355766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:42.356409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.373096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.373531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.374426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.379224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.480481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.488904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.490194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.491186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.492329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.526649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-494f0276-187d-4178-b31d-ec8e4f7ac323 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "POST /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51/action" status: 202 len: 1110 microversion: 2.1 time: 0.336754 Nov 06 20:50:42.527929 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 630/1316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:42 2021] POST /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51/action => generated 1110 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 06 20:50:42.543880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:42.545285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.553283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.555739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.555739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.555926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.722917 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17b41290-286c-4fb0-9b64-2ada17c63c4e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.182899 Nov 06 20:50:42.723846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 631/1317] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:42 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:42.732997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1b5c20cb-9b23-48d2-a7c6-98446047eee4 req-79869813-f8d4-47c5-9cf3-598097d76dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8178249b-6303-419f-b736-dd5b58d024cd", "tag": "96b8edba-64b5-434d-81d3-d315f822f083"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:42.735441 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:42.735441 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:42.755586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1b5c20cb-9b23-48d2-a7c6-98446047eee4 req-79869813-f8d4-47c5-9cf3-598097d76dbc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.756057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1b5c20cb-9b23-48d2-a7c6-98446047eee4 req-79869813-f8d4-47c5-9cf3-598097d76dbc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.790699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1b5c20cb-9b23-48d2-a7c6-98446047eee4 req-79869813-f8d4-47c5-9cf3-598097d76dbc service nova] Creating event network-changed:96b8edba-64b5-434d-81d3-d315f822f083 for instance 8178249b-6303-419f-b736-dd5b58d024cd on nch2-master-1 Nov 06 20:50:42.796931 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1b5c20cb-9b23-48d2-a7c6-98446047eee4 req-79869813-f8d4-47c5-9cf3-598097d76dbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071352 Nov 06 20:50:42.797850 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 632/1318] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:42.802958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:42.804259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.812100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.812822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.814098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.814659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.935191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:42.943362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d3d4bde-ad1b-41f9-afd8-4a0cd9e263a6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 200 len: 1472 microversion: 2.1 time: 0.614525 Nov 06 20:50:42.944164 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 687/1319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:42 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:42.950019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:42.950832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:42.963685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.964365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:42.965454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:42.967048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.440569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:43.449522 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30cce574-4ecf-4aae-a0f9-ba3ac74f7391 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.650494 Nov 06 20:50:43.453061 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 633/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:42 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:43.466617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:43.468738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:43.500881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.509202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.510757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.511689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.597745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44b29328-f946-49d7-a26b-f925c1a5d232 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.142512 Nov 06 20:50:43.601929 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 634/1321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:43 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:43.613024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:43.614516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:43.624090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.626012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.626162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.627282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.671691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:43.692917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9acdc2cc-1c87-4668-a161-d429c4b322e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.747383 Nov 06 20:50:43.694348 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 688/1322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:42 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:43.698817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:43.699421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:43.718743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.720368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.723234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:43.724019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:43.974997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:43.987764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:43.989854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:43.992286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ae60d5f-b507-4288-bd16-bd6c1eadff10 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1593 microversion: 2.42 time: 0.389223 Nov 06 20:50:44.005941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 635/1323] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:43 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1593 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:44.011836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:44.012898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:44.020561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.020751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.021614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.022064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.073246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29662f06-135d-4660-b6c3-3f16344b9277 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.065742 Nov 06 20:50:44.084785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 636/1324] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:44 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:44.092999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:44.093934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 1d899a05-d09f-40e8-8d9a-61b9adb4c094] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:44.104206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.104890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.106789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.107821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.126349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 1d899a05-d09f-40e8-8d9a-61b9adb4c094 could not be found. Nov 06 20:50:44.128676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 1d899a05-d09f-40e8-8d9a-61b9adb4c094 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:44.129681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1ee4ef9-3609-4bf5-ab25-a8fa831e2929 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094" status: 404 len: 111 microversion: 2.1 time: 0.042824 Nov 06 20:50:44.130376 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 637/1325] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:44 2021] GET /compute/v2.1/servers/1d899a05-d09f-40e8-8d9a-61b9adb4c094 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:44.139171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:44.140547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:44.151830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.152670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.154626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.155246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.159518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:44.173252 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7140efd0-ba61-4a47-a79c-bce940c4750e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.477670 Nov 06 20:50:44.184207 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 689/1326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:43 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:44.189671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:44.323584 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4395f4e7-cfe7-4e9e-bd2f-5e441688bda5 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 204 len: 0 microversion: 2.1 time: 0.188624 Nov 06 20:50:44.324701 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 638/1327] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:44 2021] DELETE /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:50:44.340546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:44.343104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:44.357279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.361704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.363429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.363735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.480835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:44.484737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:44.502220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.509138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:44.510683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:44.511145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.187450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.203785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-445ba6a7-a844-45a9-9a5e-e9d9aad99a2f tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1471 microversion: 2.1 time: 0.873507 Nov 06 20:50:45.205031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.205495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 690/1328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:44 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1471 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:45.212035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:45.214105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:45.220571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b0abf98-b96b-4949-bb8e-084d832fc7af tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.753602 Nov 06 20:50:45.223327 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 639/1329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:44 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:45.246022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.247285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.247526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:45.248186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:45.249315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.249981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.268539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.268998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.271949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.272949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.316803 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e02a0733-894f-4110-a86b-497c724e18b9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.106231 Nov 06 20:50:45.320335 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 691/1330] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:45 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:45.341536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-75575986-c005-4370-897c-9d17cc6e428a req-2b9b2d8b-7312-4c5b-b546-5b3bb3556ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d899a05-d09f-40e8-8d9a-61b9adb4c094", "name": "network-vif-deleted", "tag": "77547b61-5323-47fa-ba9f-e4c8c8dd716b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:45.344341 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:45.344341 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:45.364649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-75575986-c005-4370-897c-9d17cc6e428a req-2b9b2d8b-7312-4c5b-b546-5b3bb3556ff8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.368342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-75575986-c005-4370-897c-9d17cc6e428a req-2b9b2d8b-7312-4c5b-b546-5b3bb3556ff8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.395722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-75575986-c005-4370-897c-9d17cc6e428a req-2b9b2d8b-7312-4c5b-b546-5b3bb3556ff8 service nova] Creating event network-vif-deleted:77547b61-5323-47fa-ba9f-e4c8c8dd716b for instance 1d899a05-d09f-40e8-8d9a-61b9adb4c094 on nch2-master-1 Nov 06 20:50:45.403254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-75575986-c005-4370-897c-9d17cc6e428a req-2b9b2d8b-7312-4c5b-b546-5b3bb3556ff8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080206 Nov 06 20:50:45.404507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 692/1331] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:45.414059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:45.415254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:45.423151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.424898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.427095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.427928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.832538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.843197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d79c07d4-bcbb-4a32-a107-7b6f5332d70e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.611326 Nov 06 20:50:45.854865 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 640/1332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:45 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:45.862193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:45.863698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:45.872770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.873484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.874518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.875370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.927167 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-965dec73-8f2d-44bf-aef0-406408c73fa4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.070199 Nov 06 20:50:45.930946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.933440 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 641/1333] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:45 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:45.941031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:45.941893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:45.946527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.948042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:45.951065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.951608 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-931932b9-561f-455c-ab70-3eb56360b240 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1661 microversion: 2.42 time: 0.543220 Nov 06 20:50:45.951752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:45.952189 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 693/1334] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:45 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1661 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:45.952786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:45.953383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.230642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:46.233096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:46.249263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.250529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.251805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.253217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.415021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:46.423377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61abf0a7-389e-4119-b340-26f78c0ac0bd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.487767 Nov 06 20:50:46.434453 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 642/1335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:45 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:46.439858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:46.443351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:46.450883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.451643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.454319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.455116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.777794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:46.794530 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9effd233-c215-44ab-b792-5dc241dbe376 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 200 len: 1471 microversion: 2.1 time: 0.572595 Nov 06 20:50:46.805580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 694/1336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:46 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:46.816008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:46.818590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:46.831001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.831613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.832929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.836519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.941215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b757de0-761f-4592-a5cf-8f1e2578a89d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.133648 Nov 06 20:50:46.942259 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 695/1337] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:46 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:46.948459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:46.949503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:46.958272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.959005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:46.960669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:46.961275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.079474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:47.095754 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c895dcf3-1892-4733-9f5e-cb70c48f6d2c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.656471 Nov 06 20:50:47.097427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 643/1338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:46 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:47.107134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:47.109428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:47.123344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.123797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.127099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.132199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.252340 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df820078-80e9-495d-939e-efbf2a9eb2a1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.153120 Nov 06 20:50:47.252893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 644/1339] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:47 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:47.260656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:47.261509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:47.277117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.277755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.279203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.279818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.530140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:47.537694 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b2be505-8169-4cdf-b65f-3442a1bdb88e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.594239 Nov 06 20:50:47.539640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 696/1340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:46 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:47.544661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-955f40ae-435d-4244-a25e-d5717e8f9580 req-3fb23a7c-db73-48f4-bcf3-02c0d6d1aab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2", "name": "network-vif-deleted", "tag": "d5870610-f04f-4d8b-9b83-6e4dd925cbe7"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:47.546415 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:47.546415 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:47.559475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-955f40ae-435d-4244-a25e-d5717e8f9580 req-3fb23a7c-db73-48f4-bcf3-02c0d6d1aab2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.560237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-955f40ae-435d-4244-a25e-d5717e8f9580 req-3fb23a7c-db73-48f4-bcf3-02c0d6d1aab2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.594431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-955f40ae-435d-4244-a25e-d5717e8f9580 req-3fb23a7c-db73-48f4-bcf3-02c0d6d1aab2 service nova] Creating event network-vif-deleted:d5870610-f04f-4d8b-9b83-6e4dd925cbe7 for instance 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 on nch2-master-1 Nov 06 20:50:47.603431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-955f40ae-435d-4244-a25e-d5717e8f9580 req-3fb23a7c-db73-48f4-bcf3-02c0d6d1aab2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060974 Nov 06 20:50:47.604899 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 697/1341] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:47.621634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:47.621944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:47.628815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.630350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:47.631197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:47.632565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.007530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:48.027878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:48.030590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:48.032155 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46b05516-0c2f-4f4e-b39f-4b063973c43b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1696 microversion: 2.42 time: 0.777905 Nov 06 20:50:48.033603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 645/1342] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:47 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1696 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:48.041680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.042481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.050783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.051435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.052674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.054111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.074125 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 could not be found. Nov 06 20:50:48.075185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:48.077438 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da24d19b-1d03-45de-9a18-71fbbdcba7b9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2" status: 404 len: 111 microversion: 2.1 time: 0.040954 Nov 06 20:50:48.078456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 646/1343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:48 2021] GET /compute/v2.1/servers/9e9b7c90-8b30-4f08-b528-3ff1b2b6dad2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:48.085050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:48.087116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.102614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.103584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.104723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.105685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.180269 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a31b37a7-6019-4cab-8e30-d946b3c860c9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.099862 Nov 06 20:50:48.181121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 647/1344] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:48 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:48.186461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.187173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.196963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.197756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.198670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.200473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.233259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:48.321323 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da97acff-c2e3-4125-99f2-a4b79644c04e tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 204 len: 0 microversion: 2.1 time: 0.138650 Nov 06 20:50:48.322295 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 648/1345] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:48 2021] DELETE /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:48.327641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.328369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.335265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.335722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.336633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.337075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.489393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:48.497775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e60448f-a18c-4e91-a86f-9388d06f9955 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.890051 Nov 06 20:50:48.498374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 698/1346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:47 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:48.502997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:48.503985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.510036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.510825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.511740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.512250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.551581 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c35dc31-aa8b-47c4-8ab4-147ebc606a27 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.051917 Nov 06 20:50:48.552494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 699/1347] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:48 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:48.557955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.558541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.565590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.566044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.566836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.567274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.591874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:48.673516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e134d1bc-6e82-45aa-95c9-1b2a72cd27a9 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 204 len: 0 microversion: 2.1 time: 0.119833 Nov 06 20:50:48.674257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 700/1348] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:48 2021] DELETE /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:48.680323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.681030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.687177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.687632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.688566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.689010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.865948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:48.869182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7c7155f-fabf-47c1-a57e-babec4dfabe0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.545492 Nov 06 20:50:48.869761 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 649/1349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:48 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:48.874407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:48.875221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:48.883733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.884216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:48.885040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:48.885474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.122054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.129414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf6d8005-9cab-4769-b9e5-49932f4cac72 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.454063 Nov 06 20:50:49.129974 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 701/1350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:48 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:49.134886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:49.135681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:49.141502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.141946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.142722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.143223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.268276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.278147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-352e6914-06a4-473c-813c-ac1e95fa0461 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 200 len: 1475 microversion: 2.1 time: 0.407149 Nov 06 20:50:49.278946 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 650/1351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:48 2021] GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 1475 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:49.284360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:49.287019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:49.295554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.296219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.297060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.297499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.342014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f272d534-25f9-42fb-b9c3-699e003c8f72 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.061510 Nov 06 20:50:49.342678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 651/1352] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:49 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:49.515266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:49.516430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:49.523651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.524103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.524944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.525386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.533238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.547004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.549615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.565798 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f08ae6e9-5a4d-4d94-b0c3-e5e8bb1cd93c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1696 microversion: 2.42 time: 0.434550 Nov 06 20:50:49.578587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 702/1353] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:49 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1696 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:49.584060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:49.585266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:49.600455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.601019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.602079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.602792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.672903 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58d2828d-9fbe-4774-b428-bac73e868913 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.092860 Nov 06 20:50:49.677262 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 703/1354] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:49 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:49.816278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:49.825328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89ba1a84-8931-40f2-8dfc-1294704cc663 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.314133 Nov 06 20:50:49.827229 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 652/1355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:49 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:49.886273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:49.886992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:49.904715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: .version_select at 0x7f67151dd9d0>, body: {"keypair": {"name": "tempest-keypair-1437948848"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:49.912746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.916965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.918068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:49.918714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:49.943763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:49.949268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:50.329777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:50.335700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:50.357878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59f040e2-fc2f-46d1-a9a2-36fe3c83a98d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.663971 Nov 06 20:50:50.360509 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 704/1356] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:50:49 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:50.368584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e81b5390-3954-4e05-951b-84aa33649973 req-f775c238-a73f-4814-b1da-8308c9afc0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8178249b-6303-419f-b736-dd5b58d024cd", "name": "network-vif-plugged", "status": "completed", "tag": "96b8edba-64b5-434d-81d3-d315f822f083"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:50.372487 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:50.372487 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:50.382588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e81b5390-3954-4e05-951b-84aa33649973 req-f775c238-a73f-4814-b1da-8308c9afc0f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.383435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e81b5390-3954-4e05-951b-84aa33649973 req-f775c238-a73f-4814-b1da-8308c9afc0f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.398224 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e81b5390-3954-4e05-951b-84aa33649973 req-f775c238-a73f-4814-b1da-8308c9afc0f2 service nova] Creating event network-vif-plugged:96b8edba-64b5-434d-81d3-d315f822f083 for instance 8178249b-6303-419f-b736-dd5b58d024cd on nch2-master-1 Nov 06 20:50:50.405450 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e81b5390-3954-4e05-951b-84aa33649973 req-f775c238-a73f-4814-b1da-8308c9afc0f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043323 Nov 06 20:50:50.406669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 705/1357] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:50.414039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:50.415272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:50.423441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.424311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.425310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.425905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.709311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:50.719756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6aaa947e-a523-4098-b304-acfd027727c5 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.837076 Nov 06 20:50:50.724933 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 653/1358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:49 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:50:50.739020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:50.740068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:50.769083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.769811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.770827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.771555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.939680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:50.954368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a99664bd-01f7-4663-a0e1-ea1419a03535 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1315 microversion: 2.1 time: 0.544429 Nov 06 20:50:50.955710 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 706/1359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:50 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:50.971286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:50.972781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:50.990074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.992969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:50.996880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:50.997586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.100187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-899961b4-0c84-494b-b936-f340fbbacd4c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.142634 Nov 06 20:50:51.101166 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 707/1360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:50 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:51.109866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:51.110881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:51.122899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.123764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.124801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.125400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.527408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:51.535490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04096e02-ec53-4f81-a6bb-bc794733a279 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 200 len: 1475 microversion: 2.1 time: 0.809117 Nov 06 20:50:51.536068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 654/1361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:50 2021] GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 1475 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:51.546813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:51.551023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:51.568843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.570015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.570976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.572424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.646074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0f7cab1-bef5-4276-afc7-39332da2fd9f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.104268 Nov 06 20:50:51.648739 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 655/1362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:51 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:51.663195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:51.663861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:51.682524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.683203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:51.684218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:51.684833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:52.099272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:52.115429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:52.118813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:52.121410 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01c720c9-e26d-46a7-be1a-7288ac357e00 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1790 microversion: 2.42 time: 1.019069 Nov 06 20:50:52.125330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 708/1363] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:51 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1790 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:52.133822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c425f7b1-77d9-4b5b-8f01-29d0f32e0830 req-c3b1b487-ed8b-4577-9709-7d53cfe85876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076b774b-c0f3-48be-81d9-19eb22ea5180", "name": "network-vif-deleted", "tag": "54ace632-cbd6-43aa-8893-e4b61c4f9be1"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:52.135705 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:52.135705 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:52.163007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c425f7b1-77d9-4b5b-8f01-29d0f32e0830 req-c3b1b487-ed8b-4577-9709-7d53cfe85876 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:52.175608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c425f7b1-77d9-4b5b-8f01-29d0f32e0830 req-c3b1b487-ed8b-4577-9709-7d53cfe85876 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:52.216700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c425f7b1-77d9-4b5b-8f01-29d0f32e0830 req-c3b1b487-ed8b-4577-9709-7d53cfe85876 service nova] Creating event network-vif-deleted:54ace632-cbd6-43aa-8893-e4b61c4f9be1 for instance 076b774b-c0f3-48be-81d9-19eb22ea5180 on nch2-master-1 Nov 06 20:50:52.251029 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c425f7b1-77d9-4b5b-8f01-29d0f32e0830 req-c3b1b487-ed8b-4577-9709-7d53cfe85876 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114809 Nov 06 20:50:52.278099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 709/1364] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:52.284653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:52.288776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:52.300748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:52.301469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:52.305996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:52.306722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:52.821145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:52.830227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4ad507c-4baf-47b0-85e1-d179f1f1adf4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 1.180167 Nov 06 20:50:52.841746 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 656/1365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:51 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:52.850002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:52.850660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:52.867375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:52.868194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:52.896976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:52.897994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.031692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:53.043901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd945250-c4d8-4e4b-8264-ce9af9a6765e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.763704 Nov 06 20:50:53.044853 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 710/1366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:52 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:53.063399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:53.064635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.072884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.073434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.074481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.075024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.125130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2956114c-cdd1-4619-afc1-3493dc14c2ae tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 24526 microversion: 2.1 time: 0.077862 Nov 06 20:50:53.125899 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 711/1367] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:53 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 24526 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:53.131315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3a912cff-2c30-45be-94c7-897d5ff057e5 req-71cde4aa-c4e3-4aab-b390-0f07d7e7efc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8595966-9481-4f67-ae11-9c01c69e4c9f", "name": "network-vif-deleted", "tag": "ceb2b1ae-458d-4e31-95da-03e6fc97edec"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:53.132935 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:53.132935 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:50:53.143038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3a912cff-2c30-45be-94c7-897d5ff057e5 req-71cde4aa-c4e3-4aab-b390-0f07d7e7efc4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.143826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3a912cff-2c30-45be-94c7-897d5ff057e5 req-71cde4aa-c4e3-4aab-b390-0f07d7e7efc4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.157009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3a912cff-2c30-45be-94c7-897d5ff057e5 req-71cde4aa-c4e3-4aab-b390-0f07d7e7efc4 service nova] Creating event network-vif-deleted:ceb2b1ae-458d-4e31-95da-03e6fc97edec for instance b8595966-9481-4f67-ae11-9c01c69e4c9f on nch1-master-1 Nov 06 20:50:53.162119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3a912cff-2c30-45be-94c7-897d5ff057e5 req-71cde4aa-c4e3-4aab-b390-0f07d7e7efc4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Nov 06 20:50:53.163355 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 712/1368] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:53.170163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:53.170656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:53.172284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 076b774b-c0f3-48be-81d9-19eb22ea5180] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.180759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.180759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.181602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.181952 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11b6a328-f424-453b-a72f-afbb121cbce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1503 microversion: 2.1 time: 0.337367 Nov 06 20:50:53.182210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.183552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 657/1369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:52 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:53.188402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:53.189641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.203130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 076b774b-c0f3-48be-81d9-19eb22ea5180 could not be found. Nov 06 20:50:53.203820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 076b774b-c0f3-48be-81d9-19eb22ea5180 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:53.204846 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0507d949-0678-4617-a872-eb5c65b3f919 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180" status: 404 len: 111 microversion: 2.1 time: 0.039864 Nov 06 20:50:53.205443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.205934 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 713/1370] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:53 2021] GET /compute/v2.1/servers/076b774b-c0f3-48be-81d9-19eb22ea5180 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:53.206369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.207367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.208010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.211806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-348908941", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb18f83c-d18b-4a29-9010-a6e673304a12"}], "security_groups": [{"name": "tempest-securitygroup--542941414"}], "key_name": "tempest-keypair-1437948848", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:53.254803 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58e55bcd-2f4b-4ddf-b5d0-e3f4ccc57f67 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.069546 Nov 06 20:50:53.258291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 658/1371] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:53 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:53.273409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:53.275623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.287684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.288954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.290209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.290801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.448745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] validate_networks() for [('eb18f83c-d18b-4a29-9010-a6e673304a12', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:50:53.719087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:53.730793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:53.732338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:53.733493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84a93826-4420-47a2-8599-c648e063eaf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1837 microversion: 2.42 time: 0.474056 Nov 06 20:50:53.734062 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 659/1372] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:53 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1837 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:53.739691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:53.740480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.747228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.747683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.748514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.748957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.825725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64f35086-2a67-4a40-acce-593be36f25e0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd/action" status: 202 len: 0 microversion: 2.1 time: 0.089930 Nov 06 20:50:53.830029 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 660/1373] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:53 2021] POST /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:50:53.831660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:53.832502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: b8595966-9481-4f67-ae11-9c01c69e4c9f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.840081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.840279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.841038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.841538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.857365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance b8595966-9481-4f67-ae11-9c01c69e4c9f could not be found. Nov 06 20:50:53.857950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance b8595966-9481-4f67-ae11-9c01c69e4c9f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:50:53.858805 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5052827-625f-429b-9eb8-ceaa34e44298 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f" status: 404 len: 111 microversion: 2.1 time: 0.031034 Nov 06 20:50:53.859961 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 661/1374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:53 2021] GET /compute/v2.1/servers/b8595966-9481-4f67-ae11-9c01c69e4c9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:50:53.866757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:53.867420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:53.886593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.887168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:53.888367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:53.888824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.193572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:54.201516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-160bfb4a-2b2d-4c40-85cb-6814d6781869 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1508 microversion: 2.1 time: 0.340105 Nov 06 20:50:54.202072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 662/1375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:53 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:54.206533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.207371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.212996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.213448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.214222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.214658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.389743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:50:54.390686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:50:54.391162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:50:54.391567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:50:54.391974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:50:54.405248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.405959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.407161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.407826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.434251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:50:54.439128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:50:54.451880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:50:54.454874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:50:54.502954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:54.513915 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e96ad94a-ae8c-464d-872d-090da1fe2208 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.310313 Nov 06 20:50:54.525079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 663/1376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:54 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:54.532653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbfd4b7d-89fd-4dd6-a515-7f14e5f1c7e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.533114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-adb1f055-dae9-4bb6-983b-d3952deefec2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.320187 Nov 06 20:50:54.534392 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 714/1377] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:50:53 2021] POST /compute/v2.1/servers => generated 408 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:50:54.549485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.552625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.560696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.561273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.562741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.563308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.602071 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbfd4b7d-89fd-4dd6-a515-7f14e5f1c7e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c37076d6-62ee-44e5-893d-29c8be670b50" status: 204 len: 0 microversion: 2.1 time: 0.073145 Nov 06 20:50:54.606087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 664/1378] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 20:50:54 2021] DELETE /compute/v2.1/os-server-groups/c37076d6-62ee-44e5-893d-29c8be670b50 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:54.611628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:54.612908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.621735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.622423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.623399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.623996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.683348 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f94c476b-4a73-4939-b3e1-c57d0637b091 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.075738 Nov 06 20:50:54.684182 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 665/1379] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:54 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:54.691187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:54.701637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.709040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.709584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.711144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.712577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.775229 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15cea12c-2e29-482e-b0b4-d28f150cd5e5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.088428 Nov 06 20:50:54.779782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 666/1380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:54 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:54.788877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4bfa3e53-266e-4c84-823c-1e0dc0f06b2c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.789758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4bfa3e53-266e-4c84-823c-1e0dc0f06b2c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.815803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:54.824773 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c7c3602-91c8-4850-9807-d9641d1bb3c8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.289138 Nov 06 20:50:54.825835 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 715/1381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:54 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:54.830535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.831836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.842443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.843190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.844020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.844518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.875114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:54.903726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4bfa3e53-266e-4c84-823c-1e0dc0f06b2c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:54.915899 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4bfa3e53-266e-4c84-823c-1e0dc0f06b2c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1238 microversion: 2.1 time: 0.133561 Nov 06 20:50:54.917183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 667/1382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:54 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:54.921666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:54.922459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:54.929999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.930684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:54.931665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:54.932273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.023992 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad1f63a6-899c-4b87-a29f-89647e0be57c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 204 len: 0 microversion: 2.1 time: 0.196408 Nov 06 20:50:55.026394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 716/1383] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:54 2021] DELETE /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:55.035801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.036413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.043631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.044166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.044986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.045419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.073602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:55.159303 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5de08f6f-4d0c-405e-9fc3-ef4d2324a037 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 204 len: 0 microversion: 2.1 time: 0.126867 Nov 06 20:50:55.160454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 717/1384] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:55 2021] DELETE /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:55.172240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.174176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.181115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.181720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.182523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.182967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.315077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.327987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.329559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.330724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e779a19-0363-4779-b4a2-d9fb46d460ca tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1837 microversion: 2.42 time: 0.412455 Nov 06 20:50:55.332126 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 668/1385] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:54 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1837 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:55.337490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-84beb0f8-dab9-445f-a199-6b46a91e41c4 req-2e515e70-67c5-4870-8a70-d2235ad6be6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "da512244-df04-4f1e-9589-476f01bcf03c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:55.339265 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:55.339265 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:55.347001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-84beb0f8-dab9-445f-a199-6b46a91e41c4 req-2e515e70-67c5-4870-8a70-d2235ad6be6e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.347450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-84beb0f8-dab9-445f-a199-6b46a91e41c4 req-2e515e70-67c5-4870-8a70-d2235ad6be6e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.358878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-84beb0f8-dab9-445f-a199-6b46a91e41c4 req-2e515e70-67c5-4870-8a70-d2235ad6be6e service nova] Creating event network-changed:da512244-df04-4f1e-9589-476f01bcf03c for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:50:55.364894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-84beb0f8-dab9-445f-a199-6b46a91e41c4 req-2e515e70-67c5-4870-8a70-d2235ad6be6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031082 Nov 06 20:50:55.365390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 669/1386] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:55.371302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.371994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.381835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.382390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.384485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.384485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.485412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.495644 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f7ba623-8388-487f-ac30-280ff513a44c tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 200 len: 1475 microversion: 2.1 time: 0.329729 Nov 06 20:50:55.496219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 718/1387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:55 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:55.532765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.533677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.542299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.543646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.544986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.545456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.710520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.722368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b44a877-48f0-4c03-8657-568855b72177 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1488 microversion: 2.1 time: 0.353023 Nov 06 20:50:55.722368 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 670/1388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:55 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1488 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:55.739058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:55.740892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.777360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.778271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.779282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.779891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.826035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84216673-2cd6-466c-8ef9-d5801d14db4b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.104030 Nov 06 20:50:55.827108 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 671/1389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:55 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:55.832139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.832761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.848502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.851491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.854190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.855446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.878050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:55.886935 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5a2561b-69cb-405f-acdd-907803146aad tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.358608 Nov 06 20:50:55.887526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 719/1390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:55 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:55.895568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:55.901109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.913198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.915226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.916221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.920934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.922510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:50:55.982365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7b69bb3-5d7a-472f-9074-71d60e64b8d5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.093542 Nov 06 20:50:55.983379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 720/1391] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:55 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:55.988190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:55.989290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:55.997197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.997790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:55.998739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:55.999266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.048962 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7f7796e-25cb-4b7d-b88d-cbf17c478a44 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 204 len: 0 microversion: 2.1 time: 0.220390 Nov 06 20:50:56.049974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 672/1392] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:50:55 2021] DELETE /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:50:56.056640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:56.057542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.063932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.064649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.065442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.065877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.169065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.182873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a4fbae1-4825-4f30-bbd3-e986c64f1754 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1296 microversion: 2.1 time: 0.131474 Nov 06 20:50:56.184140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 673/1393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:56 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1296 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:56.190167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:56.190993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.198463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.199176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.199988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.200480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.342296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.351039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bd1b5a7-5c33-42ca-8e8f-03e1670ac98b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.366496 Nov 06 20:50:56.351888 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 721/1394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:55 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:56.356806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:56.357600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.363529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.363969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.364779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.365210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.654523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.664460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d248555-7127-4bc7-afa1-fd1c487d0791 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1494 microversion: 2.1 time: 0.477857 Nov 06 20:50:56.676184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 674/1395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:56 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:56.682242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:56.682982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.695880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.697005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.697390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.697845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.750542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.765822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.767508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:56.768862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6c464820-1369-4eb6-9a31-5ee6c02e11b9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1858 microversion: 2.42 time: 0.415841 Nov 06 20:50:56.781047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 722/1396] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:56 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1858 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:56.838537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:56.839877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.848200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.849274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.850376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.851033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.906600 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13faa06d-940d-495f-9abe-3b3cdbe70a8b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.071823 Nov 06 20:50:56.907773 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 723/1397] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:56 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:56.917240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:56.917940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:56.925700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.926365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:56.927316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:56.927751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.108636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:57.118654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70a44d6a-8edc-42a2-9eeb-8d343df43329 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 200 len: 1475 microversion: 2.1 time: 0.441067 Nov 06 20:50:57.119324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 675/1398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:56 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 1475 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:57.124948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:57.126093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:57.132517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.132858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.133643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.134516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.187072 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2164c049-f02b-47fa-8aa0-d10877d3475b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.065518 Nov 06 20:50:57.191922 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 676/1399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:57 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:57.204605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:57.205625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:57.216163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.218267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.219371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.220028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.515624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:57.526890 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6d7c295-ed04-4add-83b4-c1b594dc9f12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.612295 Nov 06 20:50:57.527805 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 724/1400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:56 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:57.541360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:57.542714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:57.562354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.563343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:57.564385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:57.565533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.216844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:58.231746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e892f9ba-9510-4090-8dd2-0242b3f66429 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1363 microversion: 2.1 time: 1.033707 Nov 06 20:50:58.235597 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 677/1401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:57 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1363 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:58.242090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8a3ab39a-328a-4143-a847-8a3771a82e10 req-90680089-e6d7-409d-95e8-c001c13c8731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "b2314b90-7099-4642-9659-4a7f9cf3fccc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:58.244640 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:58.244640 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:58.253981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a3ab39a-328a-4143-a847-8a3771a82e10 req-90680089-e6d7-409d-95e8-c001c13c8731 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.254644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a3ab39a-328a-4143-a847-8a3771a82e10 req-90680089-e6d7-409d-95e8-c001c13c8731 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.266536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8a3ab39a-328a-4143-a847-8a3771a82e10 req-90680089-e6d7-409d-95e8-c001c13c8731 service nova] Creating event network-changed:b2314b90-7099-4642-9659-4a7f9cf3fccc for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:50:58.274191 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8a3ab39a-328a-4143-a847-8a3771a82e10 req-90680089-e6d7-409d-95e8-c001c13c8731 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036950 Nov 06 20:50:58.275072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 678/1402] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:58.283138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ff8e5efd-d773-48a6-ad27-5a0bac5fbe03 req-aeef1ccc-af49-4ff6-be65-c01d546e8e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:58.285182 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:50:58.285182 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:50:58.297979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ff8e5efd-d773-48a6-ad27-5a0bac5fbe03 req-aeef1ccc-af49-4ff6-be65-c01d546e8e56 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.299010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ff8e5efd-d773-48a6-ad27-5a0bac5fbe03 req-aeef1ccc-af49-4ff6-be65-c01d546e8e56 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.311169 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ff8e5efd-d773-48a6-ad27-5a0bac5fbe03 req-aeef1ccc-af49-4ff6-be65-c01d546e8e56 service nova] Creating event network-changed:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:50:58.316770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ff8e5efd-d773-48a6-ad27-5a0bac5fbe03 req-aeef1ccc-af49-4ff6-be65-c01d546e8e56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039781 Nov 06 20:50:58.317388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 679/1403] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:50:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:50:58.323204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:58.324782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:58.331437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.332398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.333368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.334054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.350110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:58.358027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f61f0b9-5043-4ced-944f-2f19f0f8c315 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.828559 Nov 06 20:50:58.358809 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 725/1404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:57 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:58.363439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:58.364264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:58.378073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.379051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:58.380165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:58.380934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.124012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.131862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc70af9a-b880-41bd-81c2-801e4a399a45 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 200 len: 1494 microversion: 2.1 time: 0.813143 Nov 06 20:50:59.132930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 680/1405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:58 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 1494 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:59.137843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:59.138832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.145584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.146070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.146839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.147720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.189549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-937561ee-33e2-4677-8cd5-66fb41398df0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.055756 Nov 06 20:50:59.190204 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 681/1406] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:59 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:59.195408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:59.196108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.202975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.203443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.204230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.204688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.233886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.251343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.252794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.253035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.254574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lazy-loading 'fault' on Instance uuid e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:50:59.259121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.269139 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a6b2486-6d5d-438c-b131-7f85f8f7b134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.909034 Nov 06 20:50:59.281357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 726/1407] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:50:58 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:50:59.282724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:50:59.284079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.292495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.293131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.294193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.294934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.347169 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6aebb39-8066-4dd0-a04b-25ef5840cec5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.074541 Nov 06 20:50:59.347826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 727/1408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:50:59 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:50:59.356841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:59.359256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.372157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.387466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.388203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.389178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.390396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.391422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3d41eb6-c61c-4744-854a-bf0a79a22ba3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 200 len: 1309 microversion: 2.1 time: 0.200005 Nov 06 20:50:59.392500 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 682/1409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:59 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:59.398279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:59.399157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.407731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.408604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.409657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.410308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.851046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.859511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cecd72e-e0a7-4ebb-bb1e-96fe031637e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.510307 Nov 06 20:50:59.860472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 728/1410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:59 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:50:59.883186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:50:59.883805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:50:59.890378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.891214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.892100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:50:59.892566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:50:59.895617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:50:59.903498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0292bddf-6634-4252-b81a-f46bdc731a15 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1363 microversion: 2.1 time: 0.509430 Nov 06 20:50:59.913207 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 683/1411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:59 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:00.149365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:00.150258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:00.156976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.157786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.158817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.160093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.177074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. Nov 06 20:51:00.178100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:51:00.179159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e26766f3-d90f-44ae-a3ac-43aa817e255e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 404 len: 111 microversion: 2.1 time: 0.034082 Nov 06 20:51:00.179947 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 684/1412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:00 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:51:00.202933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:00.204231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:00.213535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.214413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.215476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.216219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.249799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:00.259016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd49c6d4-e239-4490-a571-953cb24299df tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.387511 Nov 06 20:51:00.266851 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 729/1413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:50:59 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:00.279977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0182137d-3fa2-44e9-968e-7f32e07a394f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.081672 Nov 06 20:51:00.280693 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 685/1414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:00 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:00.288726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:00.289607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:00.299233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.299690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.301938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.302301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.308219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "ae68264b-1862-48ec-9e32-e8afd5d1d1a9"}, {"server_uuid": "e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c", "name": "network-vif-deleted", "tag": "b2d30164-6f5c-42b2-8599-18365256a9bc"}, {"server_uuid": "55a83ee6-c727-41e1-bd07-5b04fa793f3c", "name": "network-vif-deleted", "tag": "bc2d32ba-7e3c-4416-a06d-11173ab3a5d6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:00.310029 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:00.310029 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:00.319747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.320552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.336635 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Creating event network-changed:ae68264b-1862-48ec-9e32-e8afd5d1d1a9 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:00.337338 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Creating event network-vif-deleted:b2d30164-6f5c-42b2-8599-18365256a9bc for instance e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c on nch1-master-1 Nov 06 20:51:00.338008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] Creating event network-vif-deleted:bc2d32ba-7e3c-4416-a06d-11173ab3a5d6 for instance 55a83ee6-c727-41e1-bd07-5b04fa793f3c on nch1-master-1 Nov 06 20:51:00.347287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-81db1472-8d1d-464d-84f1-10711910f45c req-330fa4c9-accd-4622-8ae3-3bbd8ce0ad9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.044897 Nov 06 20:51:00.348002 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 686/1415] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:00.353348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-903954209", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:00.406960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:51:00.869613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:00.880120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:00.883421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:00.885005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ab5c126-3dde-42aa-90b8-93ee78177645 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.600644 Nov 06 20:51:00.885957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 730/1416] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:00 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:51:00.890373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:00.891345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:00.898557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.899007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.899787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.900220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.945571 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-884ccda2-baba-453b-9198-13dd00c5d8a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.058268 Nov 06 20:51:00.949859 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 731/1417] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:00 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:00.951259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:00.951938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:00.959486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.959930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.960741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.961171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:00.974856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c could not be found. Nov 06 20:51:00.975474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:51:00.976283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3549fd01-ba60-4eb7-a745-b42d848c06b0 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c" status: 404 len: 111 microversion: 2.1 time: 0.028713 Nov 06 20:51:00.976944 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 732/1418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:00 2021] GET /compute/v2.1/servers/e2b66e0d-6a57-4eb6-aee6-5184b7abbc4c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:51:00.981426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-bbc655f1-a049-45a5-861b-cb3c16ab5c2d req-33014530-85ca-4249-bf8b-926471a8180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8178249b-6303-419f-b736-dd5b58d024cd", "name": "network-vif-deleted", "tag": "96b8edba-64b5-434d-81d3-d315f822f083"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:00.982933 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:00.982933 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:00.989517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bbc655f1-a049-45a5-861b-cb3c16ab5c2d req-33014530-85ca-4249-bf8b-926471a8180e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:00.989955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bbc655f1-a049-45a5-861b-cb3c16ab5c2d req-33014530-85ca-4249-bf8b-926471a8180e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.000981 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-bbc655f1-a049-45a5-861b-cb3c16ab5c2d req-33014530-85ca-4249-bf8b-926471a8180e service nova] Creating event network-vif-deleted:96b8edba-64b5-434d-81d3-d315f822f083 for instance 8178249b-6303-419f-b736-dd5b58d024cd on nch2-master-1 Nov 06 20:51:01.005575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-bbc655f1-a049-45a5-861b-cb3c16ab5c2d req-33014530-85ca-4249-bf8b-926471a8180e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027573 Nov 06 20:51:01.006751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 733/1419] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:01.011539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:01.012224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:01.017933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.018383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.019156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.019587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.735012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:01.742341 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51c02900-34ae-4dc8-94c1-4257a5f5d5e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.734438 Nov 06 20:51:01.742903 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 734/1420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:01 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:01.747114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:01.748056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:01.753787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.754220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.755050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.755659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.760444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:01.760963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:01.761357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:01.761778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:01.762235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:01.782442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.782876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.783809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.784609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.803977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:51:01.809001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:51:01.821619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:51:01.824048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:51:01.870096 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d64c9533-ca8d-430c-a637-ac95ee12f0c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520710 Nov 06 20:51:01.870969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 687/1421] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:51:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:51:01.880465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:01.880898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 55a83ee6-c727-41e1-bd07-5b04fa793f3c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:01.895684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.904679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.905506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.905955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.921441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 55a83ee6-c727-41e1-bd07-5b04fa793f3c could not be found. Nov 06 20:51:01.922059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 55a83ee6-c727-41e1-bd07-5b04fa793f3c could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:51:01.922892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c058cd26-9982-4e6e-9aaa-4ec13fae7b40 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c" status: 404 len: 111 microversion: 2.1 time: 0.046273 Nov 06 20:51:01.923437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 688/1422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:01 2021] GET /compute/v2.1/servers/55a83ee6-c727-41e1-bd07-5b04fa793f3c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:51:01.931821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:01.933070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:01.940364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.941085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:01.942306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:01.943278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.151712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.179985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f46b5d5-82e0-4e39-a539-fcd02eebf31f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1363 microversion: 2.1 time: 0.433822 Nov 06 20:51:02.191475 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 735/1423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:01 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:02.200240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:02.201245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.222728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.223504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.224514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.225172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.273412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c8f0d88-03a4-4a0d-937b-34ee472fe119 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.079794 Nov 06 20:51:02.274064 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 736/1424] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:02 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:02.281273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aaa2b665-14a9-421c-8e91-17b5527a5da7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.282209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aaa2b665-14a9-421c-8e91-17b5527a5da7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.349848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.353993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aaa2b665-14a9-421c-8e91-17b5527a5da7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.362375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9645ef9-17bc-47fa-9b2a-8575b35d3f93 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.437813 Nov 06 20:51:02.363361 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 689/1425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:01 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:02.363626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aaa2b665-14a9-421c-8e91-17b5527a5da7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1214 microversion: 2.1 time: 0.087456 Nov 06 20:51:02.364335 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 737/1426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:02 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:02.369501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07187392-f786-41d5-bdde-8ba046c1f3d6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.378486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.379328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.388523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.389065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.390205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.390648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.416464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07187392-f786-41d5-bdde-8ba046c1f3d6 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/580f7e6b-4796-4b73-95a4-ba911765cb63" status: 204 len: 0 microversion: 2.1 time: 0.050791 Nov 06 20:51:02.417393 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 738/1427] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 20:51:02 2021] DELETE /compute/v2.1/os-server-groups/580f7e6b-4796-4b73-95a4-ba911765cb63 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:51:02.422796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:02.423709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.432040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.432511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.433295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.433722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.486638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0cd7891a-87c2-4523-bfdc-5331417328a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.067768 Nov 06 20:51:02.488387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 739/1428] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:02 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:02.496833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9e857328-177a-444c-bcf6-a7d9bbe362a9 req-acf95f26-bc58-4063-bb15-2c561167cd24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "9210c3a1-39eb-4a93-b546-62b199efbddb"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:02.499005 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:02.499005 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:02.509142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9e857328-177a-444c-bcf6-a7d9bbe362a9 req-acf95f26-bc58-4063-bb15-2c561167cd24 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.509841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9e857328-177a-444c-bcf6-a7d9bbe362a9 req-acf95f26-bc58-4063-bb15-2c561167cd24 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.521577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9e857328-177a-444c-bcf6-a7d9bbe362a9 req-acf95f26-bc58-4063-bb15-2c561167cd24 service nova] Creating event network-changed:9210c3a1-39eb-4a93-b546-62b199efbddb for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:02.529083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9e857328-177a-444c-bcf6-a7d9bbe362a9 req-acf95f26-bc58-4063-bb15-2c561167cd24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039119 Nov 06 20:51:02.529687 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 740/1429] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:02.535897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.536572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.546110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.546755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.547982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.548742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.591357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:51:02.754864 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa6a148a-7cee-4f58-b05e-9a33788d6559 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 204 len: 0 microversion: 2.1 time: 0.222476 Nov 06 20:51:02.760387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 741/1430] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:51:02 2021] DELETE /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:51:02.767383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.768526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.775004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.775529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.776262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.776728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.926168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.934862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.936394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:02.937537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc5aa7d7-743d-4f3d-aace-3f9bd9354f80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.572920 Nov 06 20:51:02.938759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 690/1431] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:02 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:02.942330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:02.942938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:02.949539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.949997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:02.950835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:02.951277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.242109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:03.257827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14d5d9eb-f86b-4f61-b61c-91892357616d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.493477 Nov 06 20:51:03.268178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 742/1432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:02 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:03.277897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:03.278748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.286613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.287218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.288663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.289615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.387236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:03.396766 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9877a9c0-37c9-4d94-85e0-3f89c36f2321 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1472 microversion: 2.1 time: 0.457437 Nov 06 20:51:03.398251 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 691/1433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:02 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1472 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:03.424776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:03.426074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.432420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.433701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.434508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.434937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.478168 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d83488a8-aa8c-40ca-be73-68d2c4df32b4 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.078437 Nov 06 20:51:03.478827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 692/1434] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:03 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:03.487269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:03.488160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.495790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.496708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.497874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.498536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.594150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:03.602457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e50b6b10-0ad9-4039-b664-a154140b72ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1363 microversion: 2.1 time: 0.335782 Nov 06 20:51:03.603488 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 743/1435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:03 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:03.608081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:03.608983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.621751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.623943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.629412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.630237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.761094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:03.773751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2591536c-80bd-4378-8e69-cf254ce89407 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1272 microversion: 2.1 time: 0.168767 Nov 06 20:51:03.774907 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 744/1436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:03 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:03.779819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:03.780949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.788670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.789677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.790699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.791284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.807492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:03.815882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88c32847-12ab-4a84-9db9-fbc50de9cf63 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.335516 Nov 06 20:51:03.816477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 693/1437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:03 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:03.847300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-468faa63-5fcc-4ad6-af78-af99302aa60e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.069114 Nov 06 20:51:03.848334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 745/1438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:03 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:03.959096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:03.962359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:03.984640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.985148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:03.988869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:03.989380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.211767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2daacae7-3c54-4e0e-831d-4f5c696dadb9 req-5bdeeb57-cf2f-45e8-9462-e8abde93695a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-plugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:04.214227 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:04.214227 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:04.226413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2daacae7-3c54-4e0e-831d-4f5c696dadb9 req-5bdeeb57-cf2f-45e8-9462-e8abde93695a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.226925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2daacae7-3c54-4e0e-831d-4f5c696dadb9 req-5bdeeb57-cf2f-45e8-9462-e8abde93695a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.243373 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2daacae7-3c54-4e0e-831d-4f5c696dadb9 req-5bdeeb57-cf2f-45e8-9462-e8abde93695a service nova] Creating event network-vif-plugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:51:04.249596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2daacae7-3c54-4e0e-831d-4f5c696dadb9 req-5bdeeb57-cf2f-45e8-9462-e8abde93695a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043531 Nov 06 20:51:04.250994 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 746/1439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:04.277931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:04.278791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:04.295770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.296219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.297661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.298319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.410257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:04.420986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:04.422671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:04.423853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f3aec653-9a0e-4455-b47e-456209bd46e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.470167 Nov 06 20:51:04.424778 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 694/1440] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:03 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:04.429894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:04.430496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:04.436826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.437279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.438064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.438677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.788113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:04.796032 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e6f3b9c-8a89-4cb3-9177-48cebac55b43 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.524632 Nov 06 20:51:04.804959 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 747/1441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:04 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:04.804959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:04.804959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:04.809029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.809553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.810403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.810834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.851446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64019325-c463-4b3b-ab74-4d66b0ee7175 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.053460 Nov 06 20:51:04.852228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 748/1442] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:04 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:04.857220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "fcdcc226-5447-40fc-ae90-f14b9d979ea3"}, {"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "17be14bc-9403-4e98-b5d4-244642a0bc18"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:04.858807 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:04.858807 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:04.867511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.867688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:04.867920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.877665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62bbb8d0-4e63-4270-bdf3-0b889b51e7f3 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1472 microversion: 2.1 time: 0.451309 Nov 06 20:51:04.879104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 695/1443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:04 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:04.881244 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] Creating event network-changed:fcdcc226-5447-40fc-ae90-f14b9d979ea3 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:04.881751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] Creating event network-changed:17be14bc-9403-4e98-b5d4-244642a0bc18 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:04.887904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:04.889258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:04.890256 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-60563e55-fc67-4f5b-9667-1929aebc2924 req-e26a2ce1-cd9c-4228-ae34-ecf9b95e5972 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036778 Nov 06 20:51:04.891286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 749/1444] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:04.896359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8d2fc350-3f75-49a0-8b5b-4209bf48a27d req-cd552125-0859-4b12-80a4-a225d9814f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392ca076-1799-441a-9449-9c6f872899d4", "tag": "7bf13337-75ad-4296-b933-78a2962b57e9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:04.896705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.897344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.898397 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:04.898397 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:04.899238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.899874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.908159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8d2fc350-3f75-49a0-8b5b-4209bf48a27d req-cd552125-0859-4b12-80a4-a225d9814f19 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.908722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8d2fc350-3f75-49a0-8b5b-4209bf48a27d req-cd552125-0859-4b12-80a4-a225d9814f19 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.921979 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8d2fc350-3f75-49a0-8b5b-4209bf48a27d req-cd552125-0859-4b12-80a4-a225d9814f19 service nova] Creating event network-changed:7bf13337-75ad-4296-b933-78a2962b57e9 for instance 392ca076-1799-441a-9449-9c6f872899d4 on nch2-master-1 Nov 06 20:51:04.926951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8d2fc350-3f75-49a0-8b5b-4209bf48a27d req-cd552125-0859-4b12-80a4-a225d9814f19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034663 Nov 06 20:51:04.927771 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 750/1445] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:04.932830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:04.933524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:04.940100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.940520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:04.941309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:04.941766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.759177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:05.765972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:05.778892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b4eb16e-00d4-4c27-8c87-4c8019eced3c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1363 microversion: 2.1 time: 0.898662 Nov 06 20:51:05.779474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 696/1446] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:04 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1363 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:05.780796 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b38849d-b4c9-43cc-b42f-7cf4507658c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.844826 Nov 06 20:51:05.788472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 751/1447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:04 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:05.793780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:05.794788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:05.795044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:05.795673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:05.801657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.802108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.802257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.802912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.803034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.803346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.803706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.804534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.849464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33076b47-3278-471e-910b-3abf5edf3f71 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.059146 Nov 06 20:51:05.850110 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 752/1448] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:05 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:05.855225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:05.856067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:05.865001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.865450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:05.866466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:05.866906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.389157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.410169 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9df9ac0e-4697-45c0-9c51-f7ea3fe0c565 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.629278 Nov 06 20:51:06.411679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 697/1449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:05 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:06.426625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:06.427354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:06.439037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.439649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.440729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.441278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.461154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.482711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.484769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.485972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6d2dea27-1523-4df7-9c61-6387982d9ecf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.634767 Nov 06 20:51:06.497990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 753/1450] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:05 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:06.497990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:06.500989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:06.511765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.512233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.513288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.513779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.558351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8684e62f-956f-4c26-80a0-18951f6d98f6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.070081 Nov 06 20:51:06.559139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 754/1451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:06 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:06.564506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:06.565373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:06.573436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.574047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.574954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.575572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.618867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.619704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.620410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lazy-loading 'fault' on Instance uuid 8b5b22e4-35d2-4939-98cb-aa65cd77afbc {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:51:06.694630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49e092b163444568ad6cb851b62e3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce2d4abd58240c3a94718d2a022d67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.704738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6fe9f8b-032e-438c-811f-ca285d83f752 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 200 len: 1307 microversion: 2.1 time: 0.143607 Nov 06 20:51:06.715091 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 755/1452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:06 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:06.795054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:06.795965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:06.802803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.803142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.803947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:06.804721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:06.974285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:06.982937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0076f3d4-8316-4455-bc06-d9d204583d10 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1475 microversion: 2.1 time: 0.569425 Nov 06 20:51:06.983697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 698/1453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:06 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1475 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:06.997015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:06.997625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.003468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.003953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.004783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.005232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.351694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:07.360019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b62a42be-31bd-4c97-8dde-7c567121a6ed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1550 microversion: 2.1 time: 0.568764 Nov 06 20:51:07.368913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 756/1454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:06 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1550 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:07.373647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:07.374621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.381516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.382064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.382856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.383292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.430744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73e91bdb-dca8-483a-9360-a5da7e985706 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.060583 Nov 06 20:51:07.434487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 757/1455] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:07 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:07.436346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "6129e605-3b1f-4e2f-bd52-7ed954bb7a76"}, {"server_uuid": "8b5b22e4-35d2-4939-98cb-aa65cd77afbc", "name": "network-vif-deleted", "tag": "a735dd25-7d8c-46d8-89ad-ff913abce138"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:07.438701 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:07.438701 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:07.447470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.447913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.460789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] Creating event network-changed:6129e605-3b1f-4e2f-bd52-7ed954bb7a76 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:07.461295 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] Creating event network-vif-deleted:a735dd25-7d8c-46d8-89ad-ff913abce138 for instance 8b5b22e4-35d2-4939-98cb-aa65cd77afbc on nch1-master-1 Nov 06 20:51:07.469112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e8df4780-e053-4a96-9836-4f832f87f3a5 req-79004f87-a1b9-483c-9565-d4974d035bf5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036474 Nov 06 20:51:07.469710 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 758/1456] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:07.474645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:07.475322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.481343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.481798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.482586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.483025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.489577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:07.503250 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44b63417-726e-4fff-8b47-827caee39c14 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.509414 Nov 06 20:51:07.510836 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 699/1457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:06 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:07.510836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:07.510836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.517176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.517745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.518697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.519256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.744566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a540a2a-a9be-4691-85bd-0c955b49d0cc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273555 Nov 06 20:51:07.745187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 759/1458] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:51:07 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:07.755380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:07.757138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.763279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.763759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.764825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.765265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.925913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:07.934781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f702c16e-0662-49e3-8db9-9c3349b4a58f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.429446 Nov 06 20:51:07.943712 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 700/1459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:07 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:07.943712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:07.943712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:07.947681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.948141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.948987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:07.949427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:07.989750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1819449-29a5-4b1b-8b5d-bdd07f786fe6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.052684 Nov 06 20:51:07.995904 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 701/1460] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:07 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:07.996828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:07.997518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] [instance: 8b5b22e4-35d2-4939-98cb-aa65cd77afbc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:08.004823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.005485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.006534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.007186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.023025 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] HTTP exception thrown: Instance 8b5b22e4-35d2-4939-98cb-aa65cd77afbc could not be found. Nov 06 20:51:08.023633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] Returning 404 to user: Instance 8b5b22e4-35d2-4939-98cb-aa65cd77afbc could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:51:08.024800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c35a3f2f-ad44-4ac2-b0c3-71bbbf4998e8 tempest-ServersOnMultiNodesTest-88669987 tempest-ServersOnMultiNodesTest-88669987-project] 10.222.0.13 "GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc" status: 404 len: 111 microversion: 2.1 time: 0.031390 Nov 06 20:51:08.028168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 702/1461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:07 2021] GET /compute/v2.1/servers/8b5b22e4-35d2-4939-98cb-aa65cd77afbc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:51:08.033354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:08.033977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:08.041823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.042278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.043076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.043526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.546906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:08.556937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:08.558956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:08.560671 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85ddf2b7-98ee-4afb-b0ce-1d2fe8dbd145 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.808899 Nov 06 20:51:08.572491 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 760/1462] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:07 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:08.577918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:08.578843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:08.584941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.585396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.586440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.586887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.632212 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-492ccc70-0b63-4b41-9740-d5a017c4af75 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.058088 Nov 06 20:51:08.632969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 761/1463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:08 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:08.646432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:08.647699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:08.655600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.656616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.657824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.658548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.796507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:08.806337 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9115d198-0b42-41f0-9a8a-4ca748ab9b0c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1474 microversion: 2.1 time: 0.779913 Nov 06 20:51:08.829848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 703/1464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:08 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1474 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:08.951912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:08.953616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:08.965099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.966518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:08.967325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:08.968907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.058445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:09.066052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cafec4a0-7ea2-4e12-be42-633de878a4c9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.431551 Nov 06 20:51:09.078865 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 762/1465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:08 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:09.087128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:09.089776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:09.098004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.098747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.101559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.102166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.168371 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eab6e304-464f-463b-baa2-fc5701d49663 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.085876 Nov 06 20:51:09.171140 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 763/1466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:09 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:09.176486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b19aaecf-5744-4b51-bc8b-cb2792e249c5 req-fff657b7-7ab5-4faa-b772-499cf9047915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:09.178363 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:09.178363 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:09.187553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b19aaecf-5744-4b51-bc8b-cb2792e249c5 req-fff657b7-7ab5-4faa-b772-499cf9047915 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.188818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b19aaecf-5744-4b51-bc8b-cb2792e249c5 req-fff657b7-7ab5-4faa-b772-499cf9047915 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.203595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b19aaecf-5744-4b51-bc8b-cb2792e249c5 req-fff657b7-7ab5-4faa-b772-499cf9047915 service nova] Creating event network-changed:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:51:09.210193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b19aaecf-5744-4b51-bc8b-cb2792e249c5 req-fff657b7-7ab5-4faa-b772-499cf9047915 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037603 Nov 06 20:51:09.211212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 764/1467] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:09.218915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:09.220786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:09.247340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.249179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.249937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.250368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.297523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-389b1f00-d71e-4e13-862b-94d237084847 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.084707 Nov 06 20:51:09.304860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 765/1468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:09 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:09.439904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:09.449958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49520b7c-2998-454f-ba70-637db3b18b97 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.502611 Nov 06 20:51:09.456559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 704/1469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:08 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:09.537953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "name": "network-vif-unplugged", "status": "completed", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}, {"name": "network-changed", "server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:09.540216 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:09.540216 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:09.549140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.550583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.565667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Creating event network-vif-unplugged:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch1-master-1 Nov 06 20:51:09.566531 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Creating event network-changed:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch1-master-1 Nov 06 20:51:09.575956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] Instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:51:09.584538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:09.585277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:09.597334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.598040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.598944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.602383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.611938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-13e21e4f-c1d5-4d10-8ae4-0ededa3c371f req-5d857fcb-f377-4323-bb8c-1d2fa7f3e1e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.080015 Nov 06 20:51:09.622732 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 766/1470] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:09.645599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:09.647132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:09.661576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.663186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.664484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.665131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.714820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55f031cd-620b-4f6a-9dfe-4f26e628b510 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.073511 Nov 06 20:51:09.720744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 767/1471] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:09 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:09.826374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:09.827357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:09.843084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.843888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:09.845600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:09.846280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.281299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:10.293198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:10.294796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:10.295963 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8cc8143-6ca3-4ce1-baa9-cf78a775aaee tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.715552 Nov 06 20:51:10.307333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 705/1472] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:09 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:10.307333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:10.307333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:10.309862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.310307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.311097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.311571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.546024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:10.554594 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b13d499c-87f8-436b-9d59-9e298c509325 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1474 microversion: 2.1 time: 0.732573 Nov 06 20:51:10.556651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 768/1473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:09 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1474 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:10.562148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:10.563329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:10.571209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.572109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.573157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.573803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.621788 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e96e00d7-9c12-4ee2-b279-65ad1c11e312 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.063299 Nov 06 20:51:10.625452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 769/1474] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:10 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:10.631400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:10.633048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:10.641060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.641818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.642801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.643435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.692511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b08dbd2c-53c4-49e0-bb7a-dfdf91205bc3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.065184 Nov 06 20:51:10.693674 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 770/1475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:10 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:10.706653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:10.707687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:10.718246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.718981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.720382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.722974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.836118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:10.849616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00d38cbf-8723-4edb-8da1-8ffd06e16651 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.551490 Nov 06 20:51:10.850328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 706/1476] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:10 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:10.855404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:10.856758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:10.863894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.864498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.865661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:10.866335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:10.918900 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-766d80eb-1c0f-4d2b-bafb-179d24cef8ff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.067071 Nov 06 20:51:10.919797 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 707/1477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:10 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:11.155342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:11.163028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e337889d-9919-4842-978b-aa23089812f1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.467674 Nov 06 20:51:11.163686 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 771/1478] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:10 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:11.314734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.314936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.315513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:11.316182 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.316182 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.320576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.321033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.322163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.322612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.323150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.323427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.324488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.325355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.375316 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d318993-2d80-4c6e-a4ea-98e440d44888 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.183632 Nov 06 20:51:11.376090 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 708/1479] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services => generated 947 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:11.389914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.391146 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.391146 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.392720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.393309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.394127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.394572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.419964 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e8fa4f5-2e17-40af-be8c-daa4a1d40595 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.033694 Nov 06 20:51:11.420587 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 709/1480] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:11.432766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.433908 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.433908 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.435458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.435914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.436749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.437184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.461912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62e8130c-f4f1-491b-9543-744f876ef85b tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032512 Nov 06 20:51:11.462676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 710/1481] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services => generated 947 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:51:11.472744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.473988 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.473988 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.475579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.476026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.476993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.477272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.500262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c2cf9e1-f40b-4a37-8200-6c5bfc55cb83 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.030902 Nov 06 20:51:11.500846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 711/1482] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:51:11.511445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.512634 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.512634 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.514147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.514592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.515397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.515839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.539502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34187b66-7b71-4bcb-bec9-c3e41a633776 tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.031185 Nov 06 20:51:11.540262 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 712/1483] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services => generated 947 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:11.550361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.551608 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:11.551608 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:11.553735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.554213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.555107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.555586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.579573 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9aa04f6-fd1c-4ea3-996e-3b3a421ecbcd tempest-ServicesAdminNegativeTestJSON-1419633841 tempest-ServicesAdminNegativeTestJSON-1419633841-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.032531 Nov 06 20:51:11.580183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 713/1484] 10.222.0.13 () {58 vars in 1197 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:51:11.587845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:11.588654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:11.595332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.595803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:11.596652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:11.597099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.022780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.032526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.034454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.035643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa54f041-2aa7-48f7-9a9f-cd6d18c73564 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.724613 Nov 06 20:51:12.036200 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 772/1485] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:51:12.145697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2875ff54-708f-4e27-a7e6-ffab0ca4a9d0 tempest-ServicesAdminNegativeTestJSON-1196766035 tempest-ServicesAdminNegativeTestJSON-1196766035-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:12.147498 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:12.147498 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:12.150780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2875ff54-708f-4e27-a7e6-ffab0ca4a9d0 tempest-ServicesAdminNegativeTestJSON-1196766035 tempest-ServicesAdminNegativeTestJSON-1196766035-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ea737d11a71f49f9a1af052c1832bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6ae26e31d547e8b98b0f3b798f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.151719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2875ff54-708f-4e27-a7e6-ffab0ca4a9d0 tempest-ServicesAdminNegativeTestJSON-1196766035 tempest-ServicesAdminNegativeTestJSON-1196766035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:51:12.152793 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2875ff54-708f-4e27-a7e6-ffab0ca4a9d0 tempest-ServicesAdminNegativeTestJSON-1196766035 tempest-ServicesAdminNegativeTestJSON-1196766035-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.114711 Nov 06 20:51:12.153762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 773/1486] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:51:12 2021] GET /compute/v2.1/os-services => generated 112 bytes in 117 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:51:12.167377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:12.171283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:12.190225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.190891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.193424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.194048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.212666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.223384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4c431a1-94cb-4858-944d-a4cca74a9ec1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1472 microversion: 2.1 time: 0.639330 Nov 06 20:51:12.224022 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 714/1487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:11 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1472 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:12.230973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:12.233154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:12.242543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.243014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.243823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.244265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.244487 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc6a7309-2f93-463e-bcfb-eca764d66295 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.089206 Nov 06 20:51:12.245763 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 774/1488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:12 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:12.259946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:12.260709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:12.274029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.274975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.276280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.278356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.308909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46cfe198-561d-44ac-9ec5-1b6dec28f9bd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.083006 Nov 06 20:51:12.314480 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 715/1489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:12 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:12.321327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:12.322569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:12.329847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.330309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.331101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.331529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.375026 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ce8e4d2-0d86-46ec-a292-5d2698d8eb36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.058454 Nov 06 20:51:12.379363 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 716/1490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:12 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:12.385585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:12.386297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:12.393755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.394212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.395012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:12.395452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:12.689193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.698205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9205cd5-7de7-430b-a6ca-1e3dbe699877 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.451071 Nov 06 20:51:12.698781 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 775/1491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:12 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:12.812731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:12.820935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5ca9058-4f14-4d39-986d-a0d6821235b2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.440118 Nov 06 20:51:12.821515 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 717/1492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:12 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:13.056184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:13.057139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.063488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.063935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.064981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.065597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.241955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:13.242561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.261182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.261647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.262968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.263622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.388093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:13.397761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:13.399960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:13.401361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0505526e-b5e8-4d04-b2dc-e8b986ef2df1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.349469 Nov 06 20:51:13.414303 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 776/1493] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:13 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:13.421454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:13.422648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.431722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.432275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.433367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.434333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.481349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a8fb8e4-1e7b-4bf6-9ee4-c5f9a27b5511 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.065443 Nov 06 20:51:13.485267 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 777/1494] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:13 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:13.491739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:13.492882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.501208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.501665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.502461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.503125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.548089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-025e4c29-d54c-470d-a17c-c3f630e085c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.060585 Nov 06 20:51:13.549103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 778/1495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:13 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:13.554869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:13.555874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.556447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:13.563337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.563800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.564691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-020f09e8-2516-4bc2-9aca-c68f3d18a684 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1472 microversion: 2.1 time: 0.326918 Nov 06 20:51:13.564821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.565197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.565757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 718/1496] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:13 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:13.614412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-178bab5c-c9aa-4cd6-8789-3655d3705d36 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.063596 Nov 06 20:51:13.615181 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 779/1497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:13 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:13.717003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:13.717673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.725859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.726399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.727962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.728537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.839346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:13.840412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:13.847590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.848036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.849631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:13.849631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:13.988785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.002183 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e991427-916f-4b76-a9bd-c296462993bd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.290060 Nov 06 20:51:14.003339 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 719/1498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:13 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:14.129028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.138411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5da8a30f-94f7-4c37-86d1-8c1349287f45 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1515 microversion: 2.1 time: 0.303262 Nov 06 20:51:14.149102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 780/1499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:13 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:14.383363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-090391ac-8d03-418d-813d-6fd69a6f6458 req-46e02d30-40ce-4f42-a856-92d88997b080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392ca076-1799-441a-9449-9c6f872899d4", "name": "network-vif-plugged", "status": "completed", "tag": "7bf13337-75ad-4296-b933-78a2962b57e9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:14.386591 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:14.386591 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:14.395605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-090391ac-8d03-418d-813d-6fd69a6f6458 req-46e02d30-40ce-4f42-a856-92d88997b080 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.396566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-090391ac-8d03-418d-813d-6fd69a6f6458 req-46e02d30-40ce-4f42-a856-92d88997b080 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.410084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-090391ac-8d03-418d-813d-6fd69a6f6458 req-46e02d30-40ce-4f42-a856-92d88997b080 service nova] Creating event network-vif-plugged:7bf13337-75ad-4296-b933-78a2962b57e9 for instance 392ca076-1799-441a-9449-9c6f872899d4 on nch2-master-1 Nov 06 20:51:14.415408 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-090391ac-8d03-418d-813d-6fd69a6f6458 req-46e02d30-40ce-4f42-a856-92d88997b080 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038666 Nov 06 20:51:14.416759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 720/1500] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:14.421106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:14.421929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.429149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.429828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.430973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.432064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.493442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:14.494592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.501334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.501796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.502585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.503028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.543841 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2494862-1a28-4932-89fd-48f7585aceda tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.055282 Nov 06 20:51:14.545201 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 721/1501] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:14 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:14.575091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:14.576695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.585632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.586472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.587611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.588982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.649434 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb3a8e48-32b2-40af-8a44-895a96a7964d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.078686 Nov 06 20:51:14.654997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 722/1502] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:14 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:14.660262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:14.665839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.676623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.678064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.679876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.680868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.729697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.738702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.740814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.741997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a346826-f1b8-4b7c-a750-708177fb7938 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.324641 Nov 06 20:51:14.750713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 781/1503] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:14 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:14.759511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:14.760828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.773968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.774554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.775429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.775933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.951291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:14.959114 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aba3e257-07e0-4867-bef9-5a95cacebeb8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1469 microversion: 2.1 time: 0.302324 Nov 06 20:51:14.959668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 723/1504] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:14 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:14.976523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:14.976979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:14.982819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.983276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:14.984063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:14.984525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.012437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da8257ed-4958-476c-9dc3-4968736a4d1a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.260308 Nov 06 20:51:15.014597 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 782/1505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:14 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:15.025120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:15.026752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.034804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.035266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.036390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.037812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.050963 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8fcf67b4-79d4-4a06-aff2-cbee57703c0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22/action" status: 204 len: 0 microversion: 2.1 time: 0.078600 Nov 06 20:51:15.052045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 724/1506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:14 2021] POST /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:51:15.064259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:15.065226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.072459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.073093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.075335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.075854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.370993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:15.381429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a75617d5-0685-4394-a9ec-6e7c2d3bba63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1314 microversion: 2.1 time: 0.363961 Nov 06 20:51:15.392191 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 783/1507] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:15 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:15.397560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:15.398175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.412425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:15.423395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.423944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79122a45-65e1-48be-ad91-edebd0bf88bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1469 microversion: 2.1 time: 0.367382 Nov 06 20:51:15.425176 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 725/1508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:15 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:15.438021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.440167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.442758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.554968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:15.555886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.563805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.564619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.565631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.566327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.626225 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73040448-2c1c-4f6e-890a-a4e29caae7b6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.074712 Nov 06 20:51:15.627489 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 726/1509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:15 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:51:15.650593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:15.664394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:15.666044 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd3ab4e5-1d06-414b-aa89-a6f57127129a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.272387 Nov 06 20:51:15.675743 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 784/1510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:15 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:15.677003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.684932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.685389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.686187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.686622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.731232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36850531-316d-4b77-81dd-3f6874a54291 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.072336 Nov 06 20:51:15.735616 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 727/1511] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:15 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:15.772199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:15.773005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:15.782089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.782649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:15.784004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:15.784548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.026892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:16.028224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.040235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.040887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.041820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.042356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.125378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.131881 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fd316a0-e3bc-465f-884c-7f642195a7b8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.108903 Nov 06 20:51:16.137285 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 728/1512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:16 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:16.141150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.145058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.148971 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bff407ab-e849-4485-9c21-50d9f4c8d75f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.385725 Nov 06 20:51:16.150092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 785/1513] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:15 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:16.399911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:16.400746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.412018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.412510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.414225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.414855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.445315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:16.446497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.467531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.468260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.469401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.469838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.652403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.667360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37b08226-2929-49f6-9195-c4a033ea1da4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1501 microversion: 2.1 time: 0.271864 Nov 06 20:51:16.678294 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 729/1514] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:16 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:16.687466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "name": "network-vif-plugged", "status": "completed", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:16.689467 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:16.689467 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:16.697499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.697942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.711427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] Creating event network-vif-plugged:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch1-master-1 Nov 06 20:51:16.715083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.719450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] Instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:51:16.723863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cbf82bb-5336-4c7a-9054-4a509bed6866 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1469 microversion: 2.1 time: 0.282841 Nov 06 20:51:16.724515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 786/1515] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:16 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:16.733466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-41ae1625-aeb5-4c08-85cd-af603cda865f req-a6066f28-107c-4853-ab40-da3adf848f33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052095 Nov 06 20:51:16.734679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 730/1516] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:16.739559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:16.740805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.741556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:16.742748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.747069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.747691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.748516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.748728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.748955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.749558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.750682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.751188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.795053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aeb91ad3-320e-4ba3-8075-9074a7e25a13 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.069305 Nov 06 20:51:16.796008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 787/1517] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:16 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:16.801164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:16.801780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.809931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.810294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.811090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.811524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.838040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'flavor' on Instance uuid 392ca076-1799-441a-9449-9c6f872899d4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:51:16.922914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:16.940937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-531a6613-e5dc-4273-9e5e-a96b73cd642b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.205013 Nov 06 20:51:16.944063 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 731/1518] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:16 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:16.952629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:16.954131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:16.960604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.961256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:16.962215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:16.962819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.008991 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-124cef5a-7caa-49f1-a764-e2e62087bc76 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.063288 Nov 06 20:51:17.010540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 732/1519] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:16 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:17.145464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:17.146955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.147914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f97698cd-9e86-4035-8692-53b0ac06014a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4/action" status: 202 len: 0 microversion: 2.1 time: 0.350044 Nov 06 20:51:17.149102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 788/1520] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:16 2021] POST /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:51:17.160809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.161378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.162721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.165470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.169431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:17.171837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.180210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.180754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.181594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.181999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.266496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa8a869a-6467-4732-9955-cc6d146eeb8e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.124655 Nov 06 20:51:17.271603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 733/1521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:17 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:17.286478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:17.286752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.312126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.312126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.312126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.312538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.384450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:17.408763 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ef26112-e082-4376-a878-3f5b62fcabc2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.242814 Nov 06 20:51:17.416990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 789/1522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:17 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:17.563484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:17.573522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:17.575352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:17.576530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd32e415-8b08-4604-ae10-22cdf75f8418 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.303694 Nov 06 20:51:17.577087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 734/1523] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:17 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:17.740681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:17.741965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.748809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.749265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.750076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.750700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.806584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:17.807665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.815372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.816280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.817374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.818367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.862345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01ac0680-df25-455d-b94d-7967d72f02a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.059473 Nov 06 20:51:17.866465 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 735/1524] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:17 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:51:17.961261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:17.962296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:17.973808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.974366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:17.975332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:17.976224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.303203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:18.310699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6e147e0-f5df-41ea-ba10-94a112c5c2b7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1461 microversion: 2.1 time: 0.573685 Nov 06 20:51:18.322790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 790/1525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:17 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1461 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:18.323650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:18.327507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:18.328520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.334824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1839b282-f785-49ef-9199-f56dcadc19ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.377274 Nov 06 20:51:18.343884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 736/1526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:17 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:18.344081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.344081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.344081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.344081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.348192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:18.350010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.365635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.366404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.366796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.367251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.412279 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-953c87f3-9009-4e0f-86c8-34b73e4b9a15 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.087920 Nov 06 20:51:18.412971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 791/1527] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:18 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:18.422486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:18.424724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.425972 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59947908-15ef-44d9-ace8-6f2b5c98db59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.087140 Nov 06 20:51:18.429456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 737/1528] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:18 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:18.434452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.434905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.436027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.436202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:18.436840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.437510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.452720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.454343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.455193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.455649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.757522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:18.772424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:18.780957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b300d04-c237-4bfc-8a55-f4fe3cdf59da tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.349899 Nov 06 20:51:18.781617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26dc977b-d5b1-4f3b-a72b-2f9f2afffa9c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1461 microversion: 2.1 time: 0.362149 Nov 06 20:51:18.782863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 792/1529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:18 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1461 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:18.792614 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 738/1530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:18 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:18.792797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:18.793398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.793895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-84fd70ca-7a92-456d-bd9e-64b22fed6e81 req-347e81e5-d3b7-48a1-b577-05b9c323ac32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270a8546-67d9-4233-977b-d8d71a4b3f51", "name": "network-vif-unplugged", "status": "completed", "tag": "4bcbf763-7122-4e3c-924c-724aca38e98e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:18.798347 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:18.798347 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:18.805689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.808117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.809058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.810935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-84fd70ca-7a92-456d-bd9e-64b22fed6e81 req-347e81e5-d3b7-48a1-b577-05b9c323ac32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.811474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.815890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-84fd70ca-7a92-456d-bd9e-64b22fed6e81 req-347e81e5-d3b7-48a1-b577-05b9c323ac32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.837872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-84fd70ca-7a92-456d-bd9e-64b22fed6e81 req-347e81e5-d3b7-48a1-b577-05b9c323ac32 service nova] Creating event network-vif-unplugged:4bcbf763-7122-4e3c-924c-724aca38e98e for instance 270a8546-67d9-4233-977b-d8d71a4b3f51 on nch2-master-1 Nov 06 20:51:18.845320 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-84fd70ca-7a92-456d-bd9e-64b22fed6e81 req-347e81e5-d3b7-48a1-b577-05b9c323ac32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060505 Nov 06 20:51:18.846710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 739/1531] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:18.854902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4a83cc9-0d2f-423c-abbb-238cbcc57d6c tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '.version_select at 0x7f67153e4ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:18.858935 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:18.858935 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:18.861210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a83cc9-0d2f-423c-abbb-238cbcc57d6c tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.862036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a83cc9-0d2f-423c-abbb-238cbcc57d6c tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.885595 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4a83cc9-0d2f-423c-abbb-238cbcc57d6c tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 802 microversion: 2.1 time: 0.037359 Nov 06 20:51:18.887052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 740/1532] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:51:18 2021] GET /compute/v2.1/os-migrations => generated 802 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:18.891949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:18.893414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:18.905663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.907550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.909390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:18.909856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:18.957682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-481b5a80-5216-4539-9fb2-b97fe4fca6ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 14 microversion: 2.1 time: 0.069115 Nov 06 20:51:18.959801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 741/1533] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:18 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:18.969696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bba44c2e-3393-496a-902f-51d121abcfb4 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:18.986217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bba44c2e-3393-496a-902f-51d121abcfb4 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024833 Nov 06 20:51:18.987662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 742/1534] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:51:18 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:19.007644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42ac30e5-3a33-4719-8e98-f76db019f210 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1518183742", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:19.010862 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:19.010862 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:19.035670 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42ac30e5-3a33-4719-8e98-f76db019f210 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.038972 Nov 06 20:51:19.036664 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 743/1535] 10.222.0.13 () {60 vars in 1145 bytes} [Sat Nov 6 20:51:18 2021] POST /compute/v2.1/flavors => generated 499 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:19.048622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3844a5b-0fd6-484e-829f-4902aa1a557d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:19.059755 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3844a5b-0fd6-484e-829f-4902aa1a557d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016072 Nov 06 20:51:19.060504 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 744/1536] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Nov 6 20:51:19 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:51:19.179130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-680009133", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "0e57ec4d-4acb-428a-ada1-7e558a737580"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:19.233379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:51:19.382439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:19.392808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:19.394282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:19.395710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a16a01af-9aec-4418-a06c-7022697b77d4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.610287 Nov 06 20:51:19.396205 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 793/1537] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:18 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:19.403276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:19.403881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:19.409990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.410439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.411446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.412333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.745740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:19.746165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:19.746642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:19.747056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:19.747471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:19.770396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.771652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.772731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.773281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.782202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:19.791268 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-932e4b39-857d-4518-8321-5e73ae7dc537 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.392051 Nov 06 20:51:19.791931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 794/1538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:19 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:19.807620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:19.809129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:19.809598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:51:19.816094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for user 3ffff819b4c04c92a90993dcd4fa39c9 and project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:51:19.816307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.816806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.817607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.819103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.836622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:51:19.839561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:51:19.879961 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7af95ab8-9cbb-454f-b5b1-c6ff7b1114aa tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.086686 Nov 06 20:51:19.886532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 795/1539] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:19 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:19.895353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:19.898206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:19.902385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7834d97-fe29-4626-9776-a5208bfa678e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727674 Nov 06 20:51:19.904509 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 745/1540] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:51:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:51:19.906449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.906907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.907714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.908611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.918712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:19.919338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:19.932564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.933465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:19.934506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:19.935162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.028092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2d3d1af-fc24-488d-bee6-8051858ce41b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.139815 Nov 06 20:51:20.030227 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 796/1541] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:19 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:20.053360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d520e04b-eb24-47d7-922c-09d609151786 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:20.054368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d520e04b-eb24-47d7-922c-09d609151786 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:20.263281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d520e04b-eb24-47d7-922c-09d609151786 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:20.278381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d520e04b-eb24-47d7-922c-09d609151786 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1278 microversion: 2.1 time: 0.246340 Nov 06 20:51:20.279449 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 797/1542] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:20 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:20.284420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:20.285647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:20.304817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.305553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.308559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.309358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.336873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:20.350927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37bc5883-ba3b-492a-8e5d-764cc39610e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.441855 Nov 06 20:51:20.351698 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 746/1543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:19 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:20.373274 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9617bb8-0b4d-4793-8644-d056eb2a64e9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 8194 microversion: 2.1 time: 0.091675 Nov 06 20:51:20.374281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 798/1544] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:20 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 8194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:20.415500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:20.416539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:20.431459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.432263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.433926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.434569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.770707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:20.784989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:20.787790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:20.789451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e5984e5-ba2d-461b-8c81-4ffa67336e67 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.378654 Nov 06 20:51:20.790520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 747/1545] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:20 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:20.811183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:20.813752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:20.826620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.827067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.827865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.828311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.898581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:20.899610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:20.906177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.906909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.907900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:20.908361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:20.965475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0661113a-388e-4270-b221-268c77ff0c82 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.071308 Nov 06 20:51:20.967174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 748/1546] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:20 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:21.042740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:21.043869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.051085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.051759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.052618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.053051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.104106 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fe147bd-2260-4fd9-b471-3b9be3049546 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.065528 Nov 06 20:51:21.105392 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 749/1547] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:21 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:21.152051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:21.164590 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74c76785-bb5b-4bbf-95c8-82be57037fe3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.357003 Nov 06 20:51:21.165727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 799/1548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:20 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:21.297752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:21.299455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.309762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.312872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.313704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.314159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.373885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:21.374518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.390774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.392472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.393726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.394349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.440012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:21.452051 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12b98841-f055-4f46-9de3-9e00632a4dcb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1348 microversion: 2.1 time: 0.157425 Nov 06 20:51:21.452865 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 750/1549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:21 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1348 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:21.467530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:21.468716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.487252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.490137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.493626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.494276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.592133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ee8f07b-5ed2-4a36-a8a3-ce9c0d8c7973 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 16386 microversion: 2.1 time: 0.127639 Nov 06 20:51:21.593215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 751/1550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:21 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 16386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:21.632013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:21.640143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53d1249d-1169-4daf-b40d-5274aa1b5d70 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.276446 Nov 06 20:51:21.642075 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 800/1551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:21 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:21.808542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:21.809239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.816314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.817003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.818609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.818909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.978621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:21.980910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:21.987781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.988237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:21.989072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:21.989559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.039801 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b508bd74-c5b5-4a49-809f-c7403b081a05 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.065189 Nov 06 20:51:22.040830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 801/1552] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:21 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:22.120851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:22.122195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:22.132078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.133011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.134035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.134884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.197300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9346417-f24f-4666-9b4f-54f98ee774bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.085046 Nov 06 20:51:22.198708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 802/1553] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:22 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:22.203951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:22.204914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:22.215211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.216440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.217450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.218043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.254189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:22.265279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:22.267061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:22.268443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bd85ef6-69d6-4ee5-a410-5b4e1b0afe91 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.463970 Nov 06 20:51:22.281297 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 752/1554] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:21 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:22.470352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:22.470886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:22.483257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.484774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.485893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.486525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.546823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:22.565385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0efcbbb-a0ef-4839-a318-def78ffb92be tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.364199 Nov 06 20:51:22.589855 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 803/1555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:22 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:22.607272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:22.608345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:22.619458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.619941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.621292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.621896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.679055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4654301-51de-4cb0-89c3-3d3d33ca5495 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 16386 microversion: 2.1 time: 0.076248 Nov 06 20:51:22.680408 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 804/1556] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:22 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 16386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:22.689645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:22.690375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:22.708662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.709385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:22.711801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:22.712763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.363697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:23.371203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9c45217-714a-44d1-b029-4a353b2f3f8b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.904677 Nov 06 20:51:23.371774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 753/1557] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:22 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:23.385125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:23.386327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:23.392969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.393661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.394711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.395314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.477710 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73be0a23-1d66-422e-b519-b030b42ea71b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.100321 Nov 06 20:51:23.479922 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 754/1558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:23 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:23.494228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:23.496850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:23.513534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.516117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.516982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.517428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.528491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:23.545155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58cb5313-1495-48f3-8aef-03946ce34360 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.863406 Nov 06 20:51:23.546380 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 805/1559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:22 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:23.552388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:23.560509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:23.577631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.578110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.579029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.579505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.601579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-993d99ca-f210-4d27-b30a-1b9984dfb7bd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.118122 Nov 06 20:51:23.608258 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 755/1560] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:23 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:23.620484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:23.622955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:23.641041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.643334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:23.646286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:23.649679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.185187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:24.196130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:24.197737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:24.208864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa773168-3691-4058-bd57-ebf1b5814486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.597673 Nov 06 20:51:24.209639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:24.211198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-605a9da5-ea7f-4fb0-8d10-2033c8e5e58c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.663595 Nov 06 20:51:24.212210 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 806/1561] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:23 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:24.217332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:24.220609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:24.221110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 756/1562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:23 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:24.253823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.254599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.258915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.259371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.326273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-235770f3-f5e6-48f3-ae99-48a4b0632836 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 16386 microversion: 2.1 time: 0.111962 Nov 06 20:51:24.328806 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 807/1563] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:24 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 16386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:24.388733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:24.389492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:24.398552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.400847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.401786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.402415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.492990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:24.494179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:24.517673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.518467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.520674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.522218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.605267 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-728bd6be-e834-452a-8b6a-0a1ca1c843c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.117578 Nov 06 20:51:24.605950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 808/1564] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:24 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:24.625190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:24.626268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:24.645770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.646224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.647038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:24.647474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:24.998987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.007077 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45cc1b55-22db-48d5-84f5-2d3307fb579a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.622358 Nov 06 20:51:25.007871 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 757/1565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:24 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:25.014781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:25.017475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:25.021981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.032856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c08724ca-9855-4d1f-8b26-ffe0b24ab5cf tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.425710 Nov 06 20:51:25.033445 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 809/1566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:24 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:25.037364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.038123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.043007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.043765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.110983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f819fc3-ff02-4c0d-ab83-874b543d782f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.101148 Nov 06 20:51:25.115114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 758/1567] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:25 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:25.162823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2cdce53d-2903-4663-853a-d453d14350c6 req-fda03b55-926b-492f-92b2-892e520b9146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:25.168093 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:25.168093 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:25.192008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2cdce53d-2903-4663-853a-d453d14350c6 req-fda03b55-926b-492f-92b2-892e520b9146 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.193009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2cdce53d-2903-4663-853a-d453d14350c6 req-fda03b55-926b-492f-92b2-892e520b9146 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.225000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2cdce53d-2903-4663-853a-d453d14350c6 req-fda03b55-926b-492f-92b2-892e520b9146 service nova] Creating event network-changed:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:51:25.227872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:25.228853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:25.234561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2cdce53d-2903-4663-853a-d453d14350c6 req-fda03b55-926b-492f-92b2-892e520b9146 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075367 Nov 06 20:51:25.236562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 810/1568] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:25.240601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.243259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.244432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.245952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:25.246547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.247242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:25.259009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.259660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.260713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.261319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.824020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.841282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.842774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.843963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c591a26-92d2-44f2-8c5f-afe861f3ad39 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.605274 Nov 06 20:51:25.859508 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 811/1569] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:25 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:25.860278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:25.865832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:25.869786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:25.879208 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b74f2605-057b-4d4d-85aa-efd2328738ca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.655899 Nov 06 20:51:25.884778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.885417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.886395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.886985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.889121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 759/1570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:25 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:25.894182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:25.898274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:25.918648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.919307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.920272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:25.920901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:25.957634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa7606c4-a183-4f38-929e-e183faac3af6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 16386 microversion: 2.1 time: 0.096750 Nov 06 20:51:25.958666 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 812/1571] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:25 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 16386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:25.980238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf307162-ac94-436f-940a-ab1e1c5491a2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.089557 Nov 06 20:51:25.980924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 760/1572] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:25 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:26.023228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:26.023922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:26.041826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.042352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.044091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.044655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.055528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:26.056528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:26.066251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.069831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.073523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.091471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.342405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:26.349905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9623d6ae-2494-47a1-962f-c7b06b6f878b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.330646 Nov 06 20:51:26.359621 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 813/1573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:26 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:26.364696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:26.365981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:26.372009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.372559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.373574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.374223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.381366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:26.391497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb9adce1-a1a4-4512-a049-0e30d45cd73e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.340930 Nov 06 20:51:26.393461 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 761/1574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:26 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:26.424578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a1a7d9c-258f-40a2-a325-7c0a33e26477 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.063256 Nov 06 20:51:26.429737 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 814/1575] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:26 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:26.557095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4a23cd47-ac89-4bcb-b1f2-b779dc72c8c8 req-f9d1463d-3618-4ab3-90ae-d768749cbe9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270a8546-67d9-4233-977b-d8d71a4b3f51", "name": "network-vif-plugged", "status": "completed", "tag": "4bcbf763-7122-4e3c-924c-724aca38e98e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:26.558587 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:26.558587 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:26.566847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a23cd47-ac89-4bcb-b1f2-b779dc72c8c8 req-f9d1463d-3618-4ab3-90ae-d768749cbe9b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.568188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a23cd47-ac89-4bcb-b1f2-b779dc72c8c8 req-f9d1463d-3618-4ab3-90ae-d768749cbe9b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.580802 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4a23cd47-ac89-4bcb-b1f2-b779dc72c8c8 req-f9d1463d-3618-4ab3-90ae-d768749cbe9b service nova] Creating event network-vif-plugged:4bcbf763-7122-4e3c-924c-724aca38e98e for instance 270a8546-67d9-4233-977b-d8d71a4b3f51 on nch2-master-1 Nov 06 20:51:26.586570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4a23cd47-ac89-4bcb-b1f2-b779dc72c8c8 req-f9d1463d-3618-4ab3-90ae-d768749cbe9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033229 Nov 06 20:51:26.588414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 762/1576] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:26.883466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:26.884171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:26.894108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.894898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.896518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.897171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.897309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:26.899191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:26.914571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.918359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:26.920982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:26.921445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.276447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.283895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1a81aba-6ce9-4415-8c76-6b84204ec531 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.391748 Nov 06 20:51:27.288188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 763/1577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:26 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:27.300720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:27.302477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:27.309184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.309844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.310827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.311425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.316739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.328057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.330509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.332270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eaab0222-0d7b-42fe-b41f-21da154790ae tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.472239 Nov 06 20:51:27.352051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 815/1578] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:26 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:27.357217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:27.358838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:27.370054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.370518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.371354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.371787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.395489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b608ff6-b6ce-4f89-a3f3-eda26190a501 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.105379 Nov 06 20:51:27.396648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 764/1579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:27 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:27.403639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:27.407675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:27.422735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.423844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.424827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.426381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.431858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02538de8-bc94-4e33-ab41-1099c5036b2d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.078421 Nov 06 20:51:27.440782 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 816/1580] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:27 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:27.453756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:27.460060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:27.473369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.474647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.475745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.477765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.769629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.776709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:27.784218 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf8b84e5-012d-4ddb-9ab3-aa547dbeca04 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.334804 Nov 06 20:51:27.790592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-470bffad-7cbd-4365-a536-db756703ab85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.392408 Nov 06 20:51:27.791360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 765/1581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:27 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:27.796068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:27.797468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:27.800272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 817/1582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:27 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:27.807980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.809165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.810820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:27.811361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:27.861167 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d92685f2-bef9-49dc-8f1c-71efe40101e4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.068229 Nov 06 20:51:27.862372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 766/1583] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:27 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:28.306324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:28.307721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.323728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.324499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.325478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.326066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.358347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:28.359647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.379054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.379808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.381347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.385135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.702873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:28.711923 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c84380c1-ec40-41cb-84f1-c573314809dd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1521 microversion: 2.1 time: 0.410557 Nov 06 20:51:28.715596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 818/1584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:28 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:28.725413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:28.729009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.743156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.744919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.748123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.750077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.802189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:28.814908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:28.816975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:28.819280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53cc80f2-5a90-435f-b995-07a29aae757f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.465086 Nov 06 20:51:28.820452 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 767/1585] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:28 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:28.821308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99559363-b7a9-4b36-88cc-f5908282b7f1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.104079 Nov 06 20:51:28.821948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 819/1586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:28 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:28.826189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:28.827527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.834517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.835107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.835997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.836558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.840391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:28.846871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.854952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.855658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.857058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.857648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.888555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c8dcabf-083a-43c5-8afc-6ad4dcc63a17 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.066067 Nov 06 20:51:28.890856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 768/1587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:28 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:28.897075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:28.898038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:28.905023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.905741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:28.906926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:28.907606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.153995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:29.165464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38fd48c8-9dd5-483f-8863-cfa8f9c43bc3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.333473 Nov 06 20:51:29.166237 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 820/1588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:28 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:29.170578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:29.171495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:29.187822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.188274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.189314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.189915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.214714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:29.227213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da66604c-c9d8-4f74-a45b-4eb4412221cd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.334702 Nov 06 20:51:29.228570 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 769/1589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:28 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:29.242643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-201f5cf8-34c2-487f-8989-5232da5fb940 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.075278 Nov 06 20:51:29.247561 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 821/1590] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:29 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:29.734264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:29.741117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:29.749542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.750308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.751335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.751938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.849789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:29.851468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:29.866001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.871453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.872610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:29.874861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:29.967527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21a58052-b122-48b9-a46e-335838cb27ca tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.124473 Nov 06 20:51:29.969037 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 822/1591] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:29 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:29.985543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:29.997972 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2e063da-fec9-4d0e-909b-168fa5033ccd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1506 microversion: 2.1 time: 0.267576 Nov 06 20:51:29.999666 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 770/1592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:29 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:30.009171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:30.009171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.015177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.021914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.022887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:30.025345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.029009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.029566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.057810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.058942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.066174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.067176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.174709 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3cf4bb61-5274-4976-a276-b80187d5f1c0 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.160257 Nov 06 20:51:30.178219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 771/1593] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:30 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:30.192081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:30.194119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.209794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.211409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.213811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.217356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.555290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:30.575500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:30.577518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:30.578753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1894e356-5588-41b7-a9b1-c64913701afd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.607747 Nov 06 20:51:30.579522 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 823/1594] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:29 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:30.592029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:30.594886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.611275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.612009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.613066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.614382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.669370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:30.689831 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a861a2ac-87f6-4390-9e41-64442f412b7d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 200 len: 1506 microversion: 2.1 time: 0.509821 Nov 06 20:51:30.692381 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 772/1595] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:30 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:30.705245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:30.705867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.713947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.714759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.716749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.717837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.905961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:30.914647 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2ca64fa-ad15-4ebe-a70e-6a89045c19e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.214009 Nov 06 20:51:30.916492 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 773/1596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:30 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:30.921286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:30.922391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:30.929545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.930207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:30.931162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:30.931759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.022398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aab0784d-c15d-45d3-ad93-c2298f3f684e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.104273 Nov 06 20:51:31.028007 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 774/1597] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:30 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:31.045582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:31.047888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:31.075743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.076212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.077063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.077509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.134736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:51:31.272865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6cd4be87-d9f7-4ec9-854b-8411bb379a39 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 204 len: 0 microversion: 2.1 time: 0.242520 Nov 06 20:51:31.276543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:31.278969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 775/1598] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:51:31 2021] DELETE /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:51:31.297599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:31.298824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:31.307581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.308193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.309039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.309484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.326736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8142ef0-afbf-41f7-964f-1455a552c83d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.744573 Nov 06 20:51:31.344062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 824/1599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:30 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:31.357004 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac5f2d3c-a9f5-433e-92dc-4990d712b561 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.065130 Nov 06 20:51:31.359573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:31.362273 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 776/1600] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:31 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:31.364967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:31.390683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.392862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.394100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.396632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.466214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-100446625", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0e936355-eba9-4975-b6c7-019db9b3e654"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:31.480562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-390f434a-bbe2-40bc-9c0c-a770e9769d3a tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.133759 Nov 06 20:51:31.481896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 825/1601] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:31 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:31.559104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] validate_networks() for [('0e936355-eba9-4975-b6c7-019db9b3e654', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:51:31.608079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:31.608829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:31.624192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.632553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:31.634102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:31.634725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.074917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.085994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.087825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.089658 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56bfd816-d3ac-403f-8e0e-41cbeffcd150 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.491230 Nov 06 20:51:32.101269 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 826/1602] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:31 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:32.106737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:32.107355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.114531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.115155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.116124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.117343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.220885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:32.221371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:32.222280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:32.222706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:32.224049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:32.236659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.237117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.238107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.238546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.306895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.318381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:51:32.322690 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7b54ead-5246-492c-93d0-a7025744a62e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.218573 Nov 06 20:51:32.323574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for user 251bfed29e8e448792810993d5d8742e and project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:51:32.339928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:51:32.343248 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 827/1603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:32 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:32.344057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:51:32.350809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:32.353209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.359602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.360427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.361562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.362168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.400704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f5061fe-d340-4858-b914-32b4dbe409aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940305 Nov 06 20:51:32.406848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 777/1604] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:51:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:51:32.412273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-764258b5-a251-493d-8928-932623eff5da req-7ff2624d-4deb-4895-95f2-25435f081da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "b2314b90-7099-4642-9659-4a7f9cf3fccc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:32.414845 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:32.414845 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:32.420997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04dc97f8-345b-4495-94fc-6d0a379c63a3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 24570 microversion: 2.1 time: 0.075917 Nov 06 20:51:32.422988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-764258b5-a251-493d-8928-932623eff5da req-7ff2624d-4deb-4895-95f2-25435f081da9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.423451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-764258b5-a251-493d-8928-932623eff5da req-7ff2624d-4deb-4895-95f2-25435f081da9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.427220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 828/1605] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:32 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:32.433979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:32.447960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-764258b5-a251-493d-8928-932623eff5da req-7ff2624d-4deb-4895-95f2-25435f081da9 service nova] Creating event network-vif-plugged:b2314b90-7099-4642-9659-4a7f9cf3fccc for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:32.453701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-764258b5-a251-493d-8928-932623eff5da req-7ff2624d-4deb-4895-95f2-25435f081da9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Nov 06 20:51:32.454777 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 778/1606] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:32.460100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:32.461139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.461707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.468356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.468904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.470022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.470473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.479009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.479659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.480683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.481270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.557291 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95d3e7db-51ee-49ef-93cd-09d86d960416 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.100992 Nov 06 20:51:32.560992 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 779/1607] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:32 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:32.564609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2a6845f2-69ff-4c81-b004-891a9cdbf365 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:32.565406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2a6845f2-69ff-4c81-b004-891a9cdbf365 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.664048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2a6845f2-69ff-4c81-b004-891a9cdbf365 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.675517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2a6845f2-69ff-4c81-b004-891a9cdbf365 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1217 microversion: 2.1 time: 0.114820 Nov 06 20:51:32.677570 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 780/1608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:32 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:32.682082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:32.683164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:32.690237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.690777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.691610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:32.692009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:32.754931 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e105017-d2fe-44ba-b325-851cac3c45b8 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.075856 Nov 06 20:51:32.760613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 781/1609] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:32 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:32.797252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:32.808860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acd0e89f-c049-48b8-9c5b-479bbd23caa6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.378562 Nov 06 20:51:32.816969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 829/1610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:32 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:33.110109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:33.110978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.127099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.128233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.130536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.132189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.347031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:33.349825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.369971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.371865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.374701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.375300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.718866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:33.734609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:33.737378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:33.738587 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0266ccde-78f5-4965-84e7-9af160b13abe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.633498 Nov 06 20:51:33.745389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 782/1611] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:33 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:33.750201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:33.751197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.776127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:33.779292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.780785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.783133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.784184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.784375 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b30f790-e30d-4342-9af6-11d627ceba3d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.442800 Nov 06 20:51:33.787382 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 830/1612] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:33 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:33.793952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:33.799359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.816683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.818846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.820132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.829016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.876244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df9bd2c1-3ba4-4a70-964a-1a66f26e9bf8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.129483 Nov 06 20:51:33.882509 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 783/1613] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:33 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:33.887922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:33.891416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.904629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa92072a-e938-4820-b93f-1de2bda8e5d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.115499 Nov 06 20:51:33.910371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.914545 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 831/1614] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:33 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:33.914816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.915868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.917736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.920834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:33.924959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:33.939968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.944170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:33.945223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:33.948027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.070387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b427f4f-83e1-4ba8-b22a-a7f921a64236 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.147417 Nov 06 20:51:34.076112 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 832/1615] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:33 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:34.085879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:34.097237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:34.120623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.122586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.127017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.128984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.184718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:34.198544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33df9b8d-4774-4f77-82a7-2ece5bfe8120 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1269 microversion: 2.1 time: 0.314524 Nov 06 20:51:34.208283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 784/1616] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:33 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:34.488604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:34.496716 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b0c4f4e1-8296-43b2-a8c8-0408453a7f6e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.419135 Nov 06 20:51:34.510598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 833/1617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:34 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:34.516865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "ae68264b-1862-48ec-9e32-e8afd5d1d1a9"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "9210c3a1-39eb-4a93-b546-62b199efbddb"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "da512244-df04-4f1e-9589-476f01bcf03c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:34.518950 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:34.518950 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:34.539106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.539849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.561920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Creating event network-vif-plugged:ae68264b-1862-48ec-9e32-e8afd5d1d1a9 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:34.562473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Creating event network-vif-plugged:9210c3a1-39eb-4a93-b546-62b199efbddb for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:34.562993 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] Creating event network-vif-plugged:da512244-df04-4f1e-9589-476f01bcf03c for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:34.578633 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-30cefabf-42dd-4a05-8247-df01720d9255 req-0f6e2f5e-b70d-4f03-8075-60cf99928624 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065322 Nov 06 20:51:34.579046 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 785/1618] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:51:34.771285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:34.772087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:34.784596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.790885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.793437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.795007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.810736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:34.812078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:34.825821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.826723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:34.828515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:34.830805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.671068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:35.697660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:35.702968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:35.710643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc3b7579-b874-41e4-91fd-cfb77bf79e99 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.943533 Nov 06 20:51:35.718987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 834/1619] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:34 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:35.735097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:35.741747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:35.759947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.762446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.763487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.765456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.831880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:35.848552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-02ee3081-d952-4bbc-8bc5-59aa7770936e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 1.041658 Nov 06 20:51:35.858279 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ceba6444-f281-4761-a841-58cd8ab6dac4 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.131974 Nov 06 20:51:35.859582 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 786/1620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:34 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:35.866435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:35.867623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:35.868511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 835/1621] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:35 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:35.874949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.875700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.884939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:35.885969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:35.891309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.892178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.900057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.904812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.905983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:35.909503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:35.998240 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45026735-343a-4048-9d41-8ef712a1e570 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.135952 Nov 06 20:51:35.999597 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-662eb87c-989c-4001-831e-4526e58a5533 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.126617 Nov 06 20:51:36.011134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 836/1622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:35 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:36.011351 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 787/1623] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:35 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:36.014272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:36.015771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:36.035083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.037616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:36.038332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.039026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:36.040023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.043047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.104619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.105078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.115019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.120889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.223575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:36.232185 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72af963a-038a-41fe-8984-e4a0099d5feb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1275 microversion: 2.1 time: 0.227608 Nov 06 20:51:36.232998 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 788/1624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:36 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:36.238061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9c28616d-9e1d-4f5c-9caf-5bb87205b35f req-8473ff85-4a11-444d-94b9-586017888222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270a8546-67d9-4233-977b-d8d71a4b3f51", "name": "network-vif-deleted", "tag": "4bcbf763-7122-4e3c-924c-724aca38e98e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:36.241085 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:36.241085 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:36.253987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9c28616d-9e1d-4f5c-9caf-5bb87205b35f req-8473ff85-4a11-444d-94b9-586017888222 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.255458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9c28616d-9e1d-4f5c-9caf-5bb87205b35f req-8473ff85-4a11-444d-94b9-586017888222 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.271353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9c28616d-9e1d-4f5c-9caf-5bb87205b35f req-8473ff85-4a11-444d-94b9-586017888222 service nova] Creating event network-vif-deleted:4bcbf763-7122-4e3c-924c-724aca38e98e for instance 270a8546-67d9-4233-977b-d8d71a4b3f51 on nch2-master-1 Nov 06 20:51:36.279613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9c28616d-9e1d-4f5c-9caf-5bb87205b35f req-8473ff85-4a11-444d-94b9-586017888222 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045194 Nov 06 20:51:36.281098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 789/1625] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:36.511231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:36.522423 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d554a745-9635-4a9d-bd88-c9f0bffc88dc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.503670 Nov 06 20:51:36.523512 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 837/1626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:36 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:36.599352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "6129e605-3b1f-4e2f-bd52-7ed954bb7a76"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "17be14bc-9403-4e98-b5d4-244642a0bc18"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-plugged", "status": "completed", "tag": "fcdcc226-5447-40fc-ae90-f14b9d979ea3"}, {"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-plugged", "status": "completed", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:36.601682 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:36.601682 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:36.624864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.625554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.656836 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Creating event network-vif-plugged:6129e605-3b1f-4e2f-bd52-7ed954bb7a76 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:36.658856 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Creating event network-vif-plugged:17be14bc-9403-4e98-b5d4-244642a0bc18 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:36.659539 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Creating event network-vif-plugged:fcdcc226-5447-40fc-ae90-f14b9d979ea3 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:36.663683 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] Creating event network-vif-plugged:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:51:36.684493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-36f4f84f-4b73-4365-8e0f-42b5a1b595e4 req-118ec90e-0822-4184-a379-cb52d11b77b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.089683 Nov 06 20:51:36.685546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 790/1627] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:36 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:36.744828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:36.745443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:36.759579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.760034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.772322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.772902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.872521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:36.873218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:36.884560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.885017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:36.885816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:36.886251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.219524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:37.228823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:37.230330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:37.231536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-371a0cae-7d75-44d7-a7e4-9e7e01945b8f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.491259 Nov 06 20:51:37.232264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 838/1628] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:36 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:37.237074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:37.237982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:37.244171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.244940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.245929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.246843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.248950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:37.273737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60b8e169-ef5f-4f9d-aa7d-bd689428858b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.405089 Nov 06 20:51:37.274732 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 791/1629] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:36 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:37.280237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:37.281536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:37.287816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.288281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.289357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.289800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.614685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09563e63-86eb-41eb-9538-a56fcf0b8b59 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.380944 Nov 06 20:51:37.618693 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 839/1630] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:37 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:37.622676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:37.623727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1d19c82-5bfd-43eb-9298-52444b625f08 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.347463 Nov 06 20:51:37.623864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:37.628683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 792/1631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:37 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:37.631581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.632111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.633019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.633516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.636531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:37.637328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:37.645840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.646394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.647249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.647752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.693235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e65d97b2-6e30-4099-aa19-f1ad24a63c07 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.076400 Nov 06 20:51:37.695610 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 840/1632] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:37 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:37.700770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:37.702053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:37.710088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.710676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.711759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:37.712327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:37.948690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:37.957122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c32059c-3b92-4557-a25c-a8ea7957a0d0 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.326919 Nov 06 20:51:37.967171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 793/1633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:37 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:38.045399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:38.053095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-995370c8-b28b-4424-9f6a-e36729b75ce2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.356055 Nov 06 20:51:38.054062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 841/1634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:37 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:38.253650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:38.255300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.261926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.262382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.263332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.263774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.291409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:38.292022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.298739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.299194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.299989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.307433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.676639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:38.687735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5d0fbb7-0450-4128-8848-2e267413641e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1378 microversion: 2.1 time: 0.400022 Nov 06 20:51:38.694881 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 842/1635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:38 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1378 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:38.703895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:38.718170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:38.720094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:38.721397 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-444cfc31-56d9-4fac-8a5e-e7f04828c2ba tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1879 microversion: 2.42 time: 0.471691 Nov 06 20:51:38.722171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 794/1636] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:38 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1879 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:38.727758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:38.728996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.731130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:38.734074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.736189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.736600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.737537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.737905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.745734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.746463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.747472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.748079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.795895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7ef4671-1667-4449-ba4c-a41eccdecabd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.071829 Nov 06 20:51:38.796697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 795/1637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:38 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:38.802020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-012327bc-2d5e-4e23-9447-0104bd28f044 req-5f901430-73c7-465f-b90c-97dd1620a42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67451694-6fbf-4c87-996e-577bf998c9d8", "tag": "3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:38.803589 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:38.803589 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:38.809689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b96d1e33-2fd0-4c6e-935e-6485c97c4396 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.113091 Nov 06 20:51:38.810877 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 843/1638] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:38 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:38.816025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:38.817837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.820337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-012327bc-2d5e-4e23-9447-0104bd28f044 req-5f901430-73c7-465f-b90c-97dd1620a42b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.820791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-012327bc-2d5e-4e23-9447-0104bd28f044 req-5f901430-73c7-465f-b90c-97dd1620a42b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.826234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.827075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.828563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.829749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.834670 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-012327bc-2d5e-4e23-9447-0104bd28f044 req-5f901430-73c7-465f-b90c-97dd1620a42b service nova] Creating event network-changed:3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d for instance 67451694-6fbf-4c87-996e-577bf998c9d8 on nch2-master-1 Nov 06 20:51:38.841165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-012327bc-2d5e-4e23-9447-0104bd28f044 req-5f901430-73c7-465f-b90c-97dd1620a42b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042735 Nov 06 20:51:38.842058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 796/1639] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:38.884495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca58668b-f60d-4c9e-8c9f-8ad72c280543 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.071936 Nov 06 20:51:38.888625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 844/1640] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:38 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:38.976557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:38.977169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:38.983077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.983767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:38.984797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:38.985244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.075794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:39.077449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:39.108680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.110606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.113213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.115178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.289694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:39.304516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-268bc406-83e5-4577-b1fe-55a6bf63971d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.326345 Nov 06 20:51:39.305372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 797/1641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:38 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:39.416996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:39.425772 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c653d64-604b-4a1e-ba77-5c73ea12d7ee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.358051 Nov 06 20:51:39.426727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 845/1642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:39 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:39.711675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:39.712718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:39.720320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.721094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.722708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.723314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.741023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:39.741624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:39.751284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.751733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:39.752714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:39.753176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.140023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.147950 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3fe1376-ec91-4d39-b3cb-13fe00125e0b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1528 microversion: 2.1 time: 0.441173 Nov 06 20:51:40.149344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 798/1643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:39 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:40.154452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:40.155423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.162229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.162902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.164633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.165223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.171105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.186330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.187831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.189131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e43ed6c-910f-4a56-bd0c-83fd41ec13f4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2834 microversion: 2.42 time: 0.452286 Nov 06 20:51:40.189901 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 846/1644] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:51:39 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2834 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:51:40.202331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:40.203248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.212139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.212618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.213474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.213906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.231996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d804135-5353-469f-b1fd-421db6db84b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.081157 Nov 06 20:51:40.236825 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 799/1645] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:40 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:40.242851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:40.244388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.259776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.260225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.261056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.261485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.273385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0614b2ee-aabb-49b5-bad7-d2e70fc93e6b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.077636 Nov 06 20:51:40.274612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 847/1646] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:40 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:40.283331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.284043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.292075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.292557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.293555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.293780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.307671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f244d2f-7bc1-4456-8a6c-c40e662982f2 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.069242 Nov 06 20:51:40.308532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 800/1647] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:40 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:40.314779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.315500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.323653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.324104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.324946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.325381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.485367 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30b71338-35e9-4ca7-8984-b00bfca800df tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.175611 Nov 06 20:51:40.486162 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 801/1648] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 20:51:40 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/os-interface => generated 1829 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:51:40.491858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.502939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.515257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.515910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.516920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.517364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.534393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.548096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86836a20-2284-49eb-952f-56be35dfc8ef tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1528 microversion: 2.1 time: 0.272098 Nov 06 20:51:40.549222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 848/1649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:40 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:40.564350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.565052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.572094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.572925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.573794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.574299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.726682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.734153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79aa24fe-7839-4261-b2a6-3f5c0e977357 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.246831 Nov 06 20:51:40.743854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 802/1650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:40 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:40.748752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a96de8a6-de99-46c9-983d-5d0d36f4d65e tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.749879 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:40.749879 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:40.781232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a96de8a6-de99-46c9-983d-5d0d36f4d65e tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/0e57ec4d-4acb-428a-ada1-7e558a737580" status: 202 len: 0 microversion: 2.1 time: 0.035790 Nov 06 20:51:40.782628 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 803/1651] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:51:40 2021] DELETE /compute/v2.1/flavors/0e57ec4d-4acb-428a-ada1-7e558a737580 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:51:40.792456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.792959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72623d4a-fde1-4b06-a724-924392181434 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:40.813270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14afcf29-80a6-4946-bfb1-078cd9909484 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.262792 Nov 06 20:51:40.825286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 849/1652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:40 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:40.829042 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72623d4a-fde1-4b06-a724-924392181434 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036610 Nov 06 20:51:40.830176 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 804/1653] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:51:40 2021] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:40.847756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:40.849522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:40.856916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.857651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.859289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:40.860155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:40.972977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:40.980202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Old instance type tempest-test_resize_flavor_-1518183742, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 20:51:40.991127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:40.991794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:40.992452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:40.993012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:40.993814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:41.139054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47be7aa1-2752-4267-98ba-c5d80d038c17 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428/action" status: 202 len: 0 microversion: 2.1 time: 0.297440 Nov 06 20:51:41.139676 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 850/1654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:40 2021] POST /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:51:41.150184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:41.155691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.169913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.170565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.173949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.174584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.245378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:41.247192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.291246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.293971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.294885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.295277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.379922 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4acd7e9c-ef15-4450-85ae-c08ce1459ad3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.138768 Nov 06 20:51:41.386424 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 851/1655] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:41 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:41.392315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:41.393462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.401020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.401744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.402698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.403234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.420947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:41.430648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-179f1263-f2ed-4448-9102-ae053dea4b7a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1537 microversion: 2.1 time: 0.286542 Nov 06 20:51:41.435415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 805/1656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:41 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:41.441345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:41.447436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.458133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.462005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.463075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.467901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.492316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5325239-e651-4e30-8ebf-4bab4192d2be tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.103876 Nov 06 20:51:41.493702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 852/1657] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:41 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:41.522113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-036be9f0-8459-4814-9dc9-7ea096aa808e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.085185 Nov 06 20:51:41.523216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 806/1658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:41 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:41.747808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:41.748862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.751967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:41.752966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.762126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.762538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.762889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.763687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.764122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.767726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.768970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.769754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.896477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-121776c3-6842-4c7d-a36a-372b3741ce9c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.155131 Nov 06 20:51:41.898562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 853/1659] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:41.906766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-994ed556-a971-453f-94ef-1da360f4cfb2 req-734b6ee0-103d-4ef9-9a17-3ad06dcd1e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "tag": "da512244-df04-4f1e-9589-476f01bcf03c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:41.911849 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:41.911849 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:51:41.923904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-994ed556-a971-453f-94ef-1da360f4cfb2 req-734b6ee0-103d-4ef9-9a17-3ad06dcd1e65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.925354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-994ed556-a971-453f-94ef-1da360f4cfb2 req-734b6ee0-103d-4ef9-9a17-3ad06dcd1e65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.941599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-994ed556-a971-453f-94ef-1da360f4cfb2 req-734b6ee0-103d-4ef9-9a17-3ad06dcd1e65 service nova] Creating event network-changed:da512244-df04-4f1e-9589-476f01bcf03c for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:51:41.951597 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-994ed556-a971-453f-94ef-1da360f4cfb2 req-734b6ee0-103d-4ef9-9a17-3ad06dcd1e65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049936 Nov 06 20:51:41.954377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 854/1660] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:41.965249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:41.965995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:41.982100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.983037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:41.983849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:41.984305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.118498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:42.127595 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7f816e7-953d-4b1f-88b2-e159fca53f24 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.380326 Nov 06 20:51:42.139035 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 807/1661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:41 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:42.322568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:42.334379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-028f3836-bb09-4e27-ac9e-7c33dfa5a428 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.378730 Nov 06 20:51:42.346299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 855/1662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:41 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:42.393797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:42.394821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:42.403296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.403764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.420281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.420803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.453082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:42.453719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:42.464796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.465878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.466731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.470745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.499124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43aab681-2f39-448c-8a9b-0d23ab07b9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.108685 Nov 06 20:51:42.503399 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 808/1663] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:42 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:42.511438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:42.513757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:42.534002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.534475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.535292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.535852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.592132 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b93ad48a-e3f2-4c1a-bada-f208981c220d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.087135 Nov 06 20:51:42.602542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 809/1664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:42 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:42.610499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:42.611897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:42.626889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.627357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.628176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.628645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.701929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc0fa3a0-e198-4165-993b-8e97eda56aa6 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.097848 Nov 06 20:51:42.703333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 810/1665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:42 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:42.868261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:42.878607 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-213281d3-2eed-4163-a25c-85dc2730cf83 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1537 microversion: 2.1 time: 0.430156 Nov 06 20:51:42.881746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 856/1666] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:42 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1537 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:42.907812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:42.909270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:42.920127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.920888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.923225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:42.923841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:42.981359 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-973e43ae-5629-4cf1-8820-59a3ff96dff3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.077544 Nov 06 20:51:42.984589 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 811/1667] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:42 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:43.144935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:43.161070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.178904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.181697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.184173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.186303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.352499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:43.353457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.366445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.367264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.368220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.368683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.809305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:43.814170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:43.820478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70494b97-23a6-47f7-9eb2-872d05483e80 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.472520 Nov 06 20:51:43.830578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4e317a3-f7ef-424e-b719-f762a4023430 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.683665 Nov 06 20:51:43.833381 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 812/1668] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:43 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:43.834984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 857/1669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:43 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:43.839349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:43.840554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.848017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.848696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.849648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.850246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.852152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:43.853278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.859306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.859763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.861069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.861695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.922266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba36bdd7-d226-4012-a08b-50d93e7e93a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.087316 Nov 06 20:51:43.923970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 813/1670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:43 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:43.933054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c106ce2-3bdf-41bd-b18e-9e7a17504290 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.097187 Nov 06 20:51:43.933449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:43.933946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 858/1671] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:43 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:43.936210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.942416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:43.943126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:43.945511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.946221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.947676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.948418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.956988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.957337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.958148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:43.963433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:43.996970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fca7491d-777c-4056-a18b-ac290cd76b53 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.070836 Nov 06 20:51:43.998626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 814/1672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:43 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:44.004013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:44.006604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:44.021253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.022329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:44.023237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.023770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:44.071259 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c2faca0-5dfd-4c4c-853b-7b72dfd69c90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.071045 Nov 06 20:51:44.072059 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 815/1673] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:43 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:44.229154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:44.242635 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cb1389e-a2ca-472e-938d-090e53b3be14 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1537 microversion: 2.1 time: 0.304024 Nov 06 20:51:44.243272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 859/1674] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:43 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1537 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:44.840738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:44.842073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:44.843493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:44.844262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:44.849628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.850292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:44.851279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.851882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:44.852914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.853587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:44.854467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:44.855109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.093809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:45.100057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:45.102074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9aea4312-60b9-4c41-b4fa-a5c1f4524e9b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.265939 Nov 06 20:51:45.102883 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 816/1675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:44 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:45.107898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:45.109064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:45.115938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.116768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.117785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.118291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.121036 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f46cf21-b7e7-48a3-896a-2c43f3d43ceb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.282423 Nov 06 20:51:45.125188 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 860/1676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:44 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:45.130879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:45.133099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:45.139142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.139675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.140722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.141216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.173986 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ba711f8-a23e-4173-9a26-e25f2dd6c004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.069577 Nov 06 20:51:45.174776 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 817/1677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:45 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:45.180634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:45.181905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:45.185303 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53e7f5bf-5991-4455-a96f-b9f81531172b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.058812 Nov 06 20:51:45.190085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 861/1678] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:45 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:45.190682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.191311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.192997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.193434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.196665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:45.197756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:45.204788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.205554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.206427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.206957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.240978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe98025f-a9e8-4907-a2d8-2d3416a85424 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.064360 Nov 06 20:51:45.242323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 818/1679] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:45 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:45.250220 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-989b1154-49e9-4901-a2a5-f6f7a910a2d5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.058320 Nov 06 20:51:45.251214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 862/1680] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:45 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:45.260028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:45.260747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:45.268097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.268567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.269347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:45.270309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:45.429688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:45.437636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6af39879-2743-4233-9217-4c0ac0f3224c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.181541 Nov 06 20:51:45.438770 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 819/1681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:45 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:46.120875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:46.122461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.130070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.130860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.132622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.133288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.138959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:46.140194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.155716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.156180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.157138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.157590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.356235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:46.369477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:46.372570 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-67a36eea-fac3-4b60-b589-d8c2faa44427 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.255643 Nov 06 20:51:46.373966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 863/1682] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:46 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:46.386183 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12f303f3-6b2b-40b7-814a-36f3e0268bd9 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.251285 Nov 06 20:51:46.386986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:46.388923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.395936 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 820/1683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:46 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:46.399803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.400411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.400765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:46.401511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.401750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.402137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.408210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.408722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.410092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.410092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.460278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abb28627-f645-4f87-8166-eeb4be508e80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.062827 Nov 06 20:51:46.461252 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 821/1684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:46 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:46.468026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-893fa866-35d4-4d3e-a6c5-24ce1474bcbf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.091941 Nov 06 20:51:46.468249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:46.469324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.473659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 864/1685] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:46 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:46.478597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.479056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.479603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:46.479859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.480335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.480952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.488911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.488911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.489956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.490489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.525577 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7964d2d1-866f-42f3-9f9c-546870c8cbbd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.062665 Nov 06 20:51:46.530473 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 822/1686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:46 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:46.538252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:46.539775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29c90692-91e0-49b0-978b-d386a3277f5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.063683 Nov 06 20:51:46.540248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:46.541256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 865/1687] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:46 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:46.551336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.551792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.552638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:46.553083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:46.704082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:46.716159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75ac18d8-0755-48f8-b2d0-143f7ca278c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.184377 Nov 06 20:51:46.717012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 823/1688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:46 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:47.390277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:47.390965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.402711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:47.403333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.408726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.409182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.410004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.410496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.410599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.411166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.412248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.412828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.641739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:47.644929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:47.651071 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d93dd617-6d3c-45c3-9f6e-4216301d1c2b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.264876 Nov 06 20:51:47.651905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 866/1689] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:47 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:47.664197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:47.664547 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c91e633-afc1-4453-a3ad-c9ae80666659 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.265051 Nov 06 20:51:47.665150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.674055 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 824/1690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:47 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:47.674055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:47.674055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.674473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.674473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.674473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.674473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.678013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.678569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.679456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.679993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.723501 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e806b40-8f5e-4b25-92c5-994cbaba379e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.069972 Nov 06 20:51:47.728219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 867/1691] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:47 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:47.732684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af487903-7f13-47dd-84fa-e400e7e52454 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.065787 Nov 06 20:51:47.736320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:47.736474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 825/1692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:47 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:47.736604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.741268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:47.742413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.742540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.742966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.743733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.744165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.750433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.752517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.753618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.754221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.794026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63c2abd4-babf-4b6b-a5a3-6d92ed973843 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.068359 Nov 06 20:51:47.794675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 868/1693] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:47 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:47.800657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:47.802119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:47.803284 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bc5076c-8207-4060-9d7c-5daa520f7856 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.068038 Nov 06 20:51:47.806625 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 826/1694] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:47 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:47.812281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.812886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.813788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:47.814331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:47.966366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:47.976090 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9dd9fe0a-2edd-411d-96d6-3d1ce5f7e2a4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.180060 Nov 06 20:51:47.976993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 869/1695] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:47 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:48.091563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b349e21c-e4c7-4d48-93fd-2238df843b43 req-8ade269d-0287-481d-ab23-db3f4df52b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67451694-6fbf-4c87-996e-577bf998c9d8", "name": "network-vif-plugged", "status": "completed", "tag": "3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:48.093233 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:48.093233 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:48.104394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b349e21c-e4c7-4d48-93fd-2238df843b43 req-8ade269d-0287-481d-ab23-db3f4df52b20 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.105086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b349e21c-e4c7-4d48-93fd-2238df843b43 req-8ade269d-0287-481d-ab23-db3f4df52b20 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.117587 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b349e21c-e4c7-4d48-93fd-2238df843b43 req-8ade269d-0287-481d-ab23-db3f4df52b20 service nova] Creating event network-vif-plugged:3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d for instance 67451694-6fbf-4c87-996e-577bf998c9d8 on nch2-master-1 Nov 06 20:51:48.124130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b349e21c-e4c7-4d48-93fd-2238df843b43 req-8ade269d-0287-481d-ab23-db3f4df52b20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Nov 06 20:51:48.125321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 827/1696] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:48.668907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:48.669520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:48.678619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.678812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.679596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.680033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.685602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:48.686314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:48.702138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.703036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.704852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.705723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.902730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:48.910866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1492490-cf81-4663-806d-7c27fa1bc6c1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.230545 Nov 06 20:51:48.920674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 828/1697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:48 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:48.925414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:48.926954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:48.933758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.935336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.935336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.935541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.936971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:48.953769 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2edd6faa-a0f9-400a-86ac-a83071e0d81d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1507 microversion: 2.1 time: 0.288172 Nov 06 20:51:48.963211 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 870/1698] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:48 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:48.963211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:48.963211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:48.969183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.969636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.970486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.970993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.984157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc877b34-6cd7-47b5-87aa-92815b92e54e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.062068 Nov 06 20:51:48.984891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 829/1699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:48 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:48.990394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:48.991386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:48.998369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:48.998831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:48.999664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.000110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.025525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2f0f83d-86e5-4f4d-b867-8a31c4726ab7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.069387 Nov 06 20:51:49.026713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 871/1700] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:48 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:49.035054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:49.036317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:49.044067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.044714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.045561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.045945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.047854 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f6c8dfc-fdcb-4932-b761-34daa15e568c tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.061582 Nov 06 20:51:49.048579 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 830/1701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:48 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:49.053917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:49.054637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:49.061486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.061936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.062720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.063159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.099848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edca4661-81c3-4c79-ba38-05727ac58668 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.072300 Nov 06 20:51:49.101174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 872/1702] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:49 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:49.215224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:49.223916 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3854c40-4617-4300-95c4-46e548ee9509 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.174263 Nov 06 20:51:49.233627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 831/1703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:49 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:49.927387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:49.928934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:49.936765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.937685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.938740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.939393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.970455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:49.971226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:49.978329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.983974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:49.985042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:49.985595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.204827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:50.213503 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fdd56c7d-dc4b-4e07-9d55-e00c8595c69c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1317 microversion: 2.1 time: 0.290272 Nov 06 20:51:50.223661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 873/1704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:49 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:50.276064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:50.286347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66b34e1b-7ea9-41c1-aa78-42ab3fb90130 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1528 microversion: 2.1 time: 0.319367 Nov 06 20:51:50.298250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 832/1705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:49 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1528 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:50.303889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:50.305109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:50.312232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.312889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.313788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.314307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.367527 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebe521ac-89be-45aa-8581-f1f08ac583e6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.067850 Nov 06 20:51:50.368173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 833/1706] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:50 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:50.371595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:50.372139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:50.376724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:50.377839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:50.378507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.379799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.380629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.381070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.385873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.386465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.387567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.388113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.431907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c4c4e7b-7723-48b0-bcd0-f88b94000f0a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.206943 Nov 06 20:51:50.432868 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 874/1707] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:50 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:50.435359 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3f44b19-f3bb-44d1-929f-46c9e48e88a9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.065435 Nov 06 20:51:50.439637 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 834/1708] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:50 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:50.442322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:50.444818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:50.446757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:50.447672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:50.454259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.454849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.455750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.456176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.456404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.457033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.458063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:50.458685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:50.522595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df565882-c390-42d0-aaf9-51bff97b6b2b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.077098 Nov 06 20:51:50.527489 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 875/1709] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:50 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:50.631547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:50.640404 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e3192d5-2a8b-4d21-a144-6b91b54346a9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.198952 Nov 06 20:51:50.641194 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 835/1710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:50 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:51.230904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:51.231692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.240135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.240639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.241464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.241903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.306582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:51.307859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.315816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.317093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.318152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.318798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.439353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:51.448037 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e25b2c7-859d-4330-9417-8a5c4464a8aa tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1508 microversion: 2.1 time: 0.221318 Nov 06 20:51:51.448740 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 876/1711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:51 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:51.453495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:51.454406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.460464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.461015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.461807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.462354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.506477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:51.513564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13cba03f-ca6b-4829-b44e-aa4c032779d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.063278 Nov 06 20:51:51.514458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 877/1712] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:51 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:51.515873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c75d0594-5faf-4ba5-898b-61762167e925 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1528 microversion: 2.1 time: 0.213898 Nov 06 20:51:51.517000 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 836/1713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:51 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1528 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:51.521517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:51.521989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:51.522429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.523422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.529366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.529821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.530016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.530475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.530675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.531160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.531315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.531757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.576300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4defa554-6594-46e3-ae4f-3484407cb3ba tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.058128 Nov 06 20:51:51.576776 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6367a2f0-783f-4a61-8853-ff3828b73c6d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.060752 Nov 06 20:51:51.580689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 837/1714] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:51 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:51.580835 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 878/1715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:51 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:51.581775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:51.582512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.589655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.590112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.590913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.591351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.630482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-98377575", "imageRef": "acc53ecc-ab68-4d4c-8ef5-11d4f15a7d1b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3185d025-395a-4e4e-9061-29af97345887"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:51.691895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] validate_networks() for [('3185d025-395a-4e4e-9061-29af97345887', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:51:51.798290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:51.806538 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55ce367b-eedd-4f4e-b4e2-0554e191f58d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1508 microversion: 2.1 time: 0.228355 Nov 06 20:51:51.807118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 838/1716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:51 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:51.811576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:51.812575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.819429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.819889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.820750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.821194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.863636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54795d51-abf8-4547-9c5e-b34cb61edef0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.055282 Nov 06 20:51:51.866747 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 839/1717] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:51 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:51.869970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:51.870815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:51.877064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.877532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:51.878317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:51.878752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.099154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:52.108410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b178f99-a627-43bc-849b-c6db7ba47755 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.242744 Nov 06 20:51:52.109168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 840/1718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:51 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.114198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.115493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.121902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.122354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.123332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.123766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.192737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b06cc44b-83af-41d1-8ee8-8664fee19f34 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "PUT /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1080 microversion: 2.1 time: 0.082656 Nov 06 20:51:52.202128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 841/1719] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 20:51:52 2021] PUT /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1080 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.202329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:52.202329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:52.202329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:52.202329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:52.202329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:52.202789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b50f8cc9-bca7-459c-8155-d24bbe52a16e req-4c6236ca-8150-443e-a4b1-f16d15bf5737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392ca076-1799-441a-9449-9c6f872899d4", "name": "network-vif-plugged", "status": "completed", "tag": "7bf13337-75ad-4296-b933-78a2962b57e9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.202789 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:51:52.202789 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:51:52.205712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.206162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.206447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b50f8cc9-bca7-459c-8155-d24bbe52a16e req-4c6236ca-8150-443e-a4b1-f16d15bf5737 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.206882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b50f8cc9-bca7-459c-8155-d24bbe52a16e req-4c6236ca-8150-443e-a4b1-f16d15bf5737 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.207593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.208009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.218780 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b50f8cc9-bca7-459c-8155-d24bbe52a16e req-4c6236ca-8150-443e-a4b1-f16d15bf5737 service nova] Creating event network-vif-plugged:7bf13337-75ad-4296-b933-78a2962b57e9 for instance 392ca076-1799-441a-9449-9c6f872899d4 on nch2-master-1 Nov 06 20:51:52.223705 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b50f8cc9-bca7-459c-8155-d24bbe52a16e req-4c6236ca-8150-443e-a4b1-f16d15bf5737 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029234 Nov 06 20:51:52.224330 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 842/1720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:51:52.229121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:52.229712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Getting quotas for project 669205b495ef4088b1d5dae005f87509. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:51:52.229858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.233935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Getting quotas for user 09ba9c491fa948f3b57c84b232fb54e9 and project 669205b495ef4088b1d5dae005f87509. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:51:52.236244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.236799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.237682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.238234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.245322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:51:52.247885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acc53ecc-ab68-4d4c-8ef5-11d4f15a7d1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:51:52.298739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8913a72d-5f3e-41f1-ace3-c16b44e56918 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719242 Nov 06 20:51:52.299390 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 879/1721] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:51:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:51:52.309712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d06aa99f-b8f4-42f3-9949-e0b056d3bf55 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:52.310458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d06aa99f-b8f4-42f3-9949-e0b056d3bf55 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.374660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d06aa99f-b8f4-42f3-9949-e0b056d3bf55 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:52.382436 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d06aa99f-b8f4-42f3-9949-e0b056d3bf55 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1220 microversion: 2.1 time: 0.076557 Nov 06 20:51:52.383208 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 880/1722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:52 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.422571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:52.430349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71777d99-3f23-4302-953a-3e6e9c041471 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1506 microversion: 2.1 time: 0.204921 Nov 06 20:51:52.431328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 843/1723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:52 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.449738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:52.450364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.458113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.458569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.459429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.459868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.526411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.527786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.535748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.536391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.537301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.538046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.586598 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-229b90be-39ba-4f55-9f32-7fd8df7152f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.064026 Nov 06 20:51:52.590952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 844/1724] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:52.593178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:52.594291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.602045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.602617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.603471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.604031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.618780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:52.627360 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd334da4-037f-4fa2-9d3d-65b9bf3b3fa4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1506 microversion: 2.1 time: 0.184435 Nov 06 20:51:52.628051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 881/1725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:52 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.633322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.634190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.641258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.641657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.642476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.642915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.684455 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16a9ad0e-ba22-4640-876b-037cd745a69b tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.054877 Nov 06 20:51:52.685936 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 882/1726] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:52.690503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.692216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.699426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.700024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.701059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.701506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.756697 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aafa4a47-c88a-458d-b230-007ca4f4f27b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.070205 Nov 06 20:51:52.757633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 883/1727] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:52.762461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.763972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.771919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.772427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.773220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.773655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.780527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:52.788589 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e8acddb-a009-44ad-a259-495af72d6437 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1528 microversion: 2.1 time: 0.199523 Nov 06 20:51:52.789966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 845/1728] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:52 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1528 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:52.859806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:51:52.860406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:51:52.864342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:51:52.864342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:51:52.864342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:51:52.880965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:52.881949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.888163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.888686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.889472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.890047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.934204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-658cfd31-9966-4687-b52c-727cd5d7661b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 14 microversion: 2.42 time: 0.062546 Nov 06 20:51:52.935755 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 846/1729] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:52.949190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:52.958179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.958772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.959742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:52.960277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:52.997987 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d97f496-dbbe-4801-a55f-875eaec8d0e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "POST /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8/action" status: 202 len: 1112 microversion: 2.1 time: 0.238946 Nov 06 20:51:53.008396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 884/1730] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:52 2021] POST /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8/action => generated 1112 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 06 20:51:53.017775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:53.018681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.026314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.026787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.027557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.027990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.125852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:53.126500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.133371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.133817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.134800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.135257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.173871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:53.182733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3118095-eeed-41a6-bd3e-0a53c809a3b8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.169724 Nov 06 20:51:53.183309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 847/1731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:53 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:53.283424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:53.291814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ceb6d93-265b-4068-9ac5-2126d5cd1889 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.169870 Nov 06 20:51:53.292410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 885/1732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:53 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:51:53.399346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:53.399873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.406258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.406710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.407578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.407953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.469139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:53.477900 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49a583ae-a4b8-4e15-b4b3-0141da7e55e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1272 microversion: 2.1 time: 0.082315 Nov 06 20:51:53.478455 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 848/1733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:53 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:53.599140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:53.600271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.607258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.607731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.608853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.609286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.653143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08c9c60b-e9ed-4bb5-b4b1-a1d7e0a80afa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.058290 Nov 06 20:51:53.653690 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 886/1734] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:53 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:53.696481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:53.697574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.703884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.704375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.705187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.705650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.746586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-162083a4-18e5-4b5b-bd56-77f8beeeff79 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.053705 Nov 06 20:51:53.747741 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 849/1735] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:53 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:51:53.770551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:53.771624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.778941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.779602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.780514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.780936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.808617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:53.809582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.820344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.821030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.821831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.822269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.830109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b47dbe4f-718e-42ea-a96c-bc92c9038f7b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.064921 Nov 06 20:51:53.833748 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 887/1736] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:53 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:51:53.947407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:53.948489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:53.956366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.957675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:53.958669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:53.959273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.043650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:54.055315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f844db4c-f08a-42c2-8bbf-a88aa3fc1338 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1528 microversion: 2.1 time: 0.251729 Nov 06 20:51:54.056474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 850/1737] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:53 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1528 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:54.201547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:54.202701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:54.213172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.213994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.215248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.215962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.471571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:54.484619 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edb0fd2e-76f0-4a4b-94e3-79fc7cf1cc37 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.288901 Nov 06 20:51:54.486053 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 851/1738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:54 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:54.491830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:54.492480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:54.500118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.501324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.502651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.503286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.651943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:54.659241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5fbbdfe-2bed-4801-aa86-79ce6e979b54 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.172009 Nov 06 20:51:54.659810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 852/1739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:54 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:54.664896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:51:54.665502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:54.671111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.671569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.672379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.672852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.808367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:51:54.816159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2850d109-58cf-4ae6-acff-6d32e5d52633 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.154774 Nov 06 20:51:54.816975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 853/1740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:51:54 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:51:54.821837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:51:54.822787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:51:54.828420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.828871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:51:54.829648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:51:54.830105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.157545 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0657f641-7db8-4267-b9ae-f11e98f44cf1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 13.213953 Nov 06 20:52:07.158163 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 888/1741] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:51:53 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 13216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:07.163632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:07.165033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.169218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2bcb4d72-50ff-483d-8ea7-a894d2548aaf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 12.350510 Nov 06 20:52:07.173359 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 854/1742] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:51:54 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 12353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:07.173573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.174005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.174798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.174936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:07.175235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.175824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.183240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.183699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.184534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.184971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.217922 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9402d839-9fdc-420d-9bb1-8c02303387f7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.058407 Nov 06 20:52:07.218741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 889/1743] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:07 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:07.223467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:07.224163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.231455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.231912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.232727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.233164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.272047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c00a3a20-5670-4004-a998-0cc8273cd649 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.100202 Nov 06 20:52:07.272579 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 855/1744] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:07 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:07.277789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:07.279020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.285406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.288513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.288513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.288513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.603370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:07.612511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:07.613760 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-218ff9e5-ab75-41d9-9ac6-d42cc110ae74 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.339134 Nov 06 20:52:07.614818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 856/1745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:07 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:07.625248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:07.631915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.637753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f4ca0f5-266b-4c0b-89b7-a6a379307e74 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1528 microversion: 2.1 time: 0.417328 Nov 06 20:52:07.640600 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 890/1746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:07 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:07.647717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.652974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.653682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:07.654605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:07.658548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.660939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.673024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.673980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:07.675163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:07.676026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.146111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:08.165227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e49c1f8-56c2-4a04-ab1e-efdad1be4913 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.545362 Nov 06 20:52:08.167652 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 857/1747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:07 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:08.172993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:08.174671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.185389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:08.205137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78e5bdd6-f14f-4d54-80f4-95dda52b18e3 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.563119 Nov 06 20:52:08.211629 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 891/1748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:07 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:08.218644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.219924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.221136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.221932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.222966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:08.227158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.245607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.248176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.249499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.250568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.300054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b0f87b8-f7fd-45ef-9256-57ce108501b4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.130654 Nov 06 20:52:08.302480 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 858/1749] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:08 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:08.312161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:08.313585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.316921 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86e6fe30-5f98-4aee-b966-310c5d89d795 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.102024 Nov 06 20:52:08.317971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 892/1750] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:08 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:08.328385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:08.329562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.330563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.332537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.333852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.334678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.341486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.341938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.343804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.346643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.417288 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ed554116-4746-4b41-92ea-1c9fe9f3bde6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.097217 Nov 06 20:52:08.418744 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c2a1996-0ccb-497a-8d85-bad54d5259bc tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.114186 Nov 06 20:52:08.419866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 893/1752] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:08 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:08.420005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 859/1752] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:08 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:08.617361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8bcd2be7-3f8a-44ee-a5d2-7622e55c2b4a req-5d2f92c3-bef1-4ba7-a449-f73fdf74cb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1c1154-4869-49cb-87aa-799375f3b9f0", "tag": "90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:08.618956 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:08.618956 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:08.629281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8bcd2be7-3f8a-44ee-a5d2-7622e55c2b4a req-5d2f92c3-bef1-4ba7-a449-f73fdf74cb79 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.630038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8bcd2be7-3f8a-44ee-a5d2-7622e55c2b4a req-5d2f92c3-bef1-4ba7-a449-f73fdf74cb79 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.641973 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8bcd2be7-3f8a-44ee-a5d2-7622e55c2b4a req-5d2f92c3-bef1-4ba7-a449-f73fdf74cb79 service nova] Creating event network-changed:90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa for instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 on nch2-master-1 Nov 06 20:52:08.647960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8bcd2be7-3f8a-44ee-a5d2-7622e55c2b4a req-5d2f92c3-bef1-4ba7-a449-f73fdf74cb79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153832 Nov 06 20:52:08.649256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 860/1753] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:08.651290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:08.652481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.655314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:08.656176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:08.663077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.663663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.664098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.664756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.664995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.665352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.667131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:08.667794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:08.983539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:09.002477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4962fc4c-95dd-43dc-8857-8803529a9bae tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.369776 Nov 06 20:52:09.005228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 894/1754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:08 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:09.031291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:09.043083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4e2872c-3aa8-4442-9b7a-0e71dfa8af36 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.391368 Nov 06 20:52:09.045184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 861/1755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:08 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:09.186816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:09.196163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.216522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.216956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.217791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.218441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.233964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:09.234732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.245383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.246259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.247144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.247697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.575763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:09.586179 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-432f0535-e1f8-461e-b51e-a39f2c228321 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.359162 Nov 06 20:52:09.587442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 862/1756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:09 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:09.593277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:09.594465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.601908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.602714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.603683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.604221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.658823 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91e354a5-7ab5-4473-89e8-654be8808ad7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.069655 Nov 06 20:52:09.663164 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 863/1757] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:09 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:09.666637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:09.668132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.677998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.678674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.679594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.680160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.734694 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1e84d42-ee58-4be0-b7e3-9ae7ee84b5dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.072575 Nov 06 20:52:09.737590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 864/1758] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:09 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:09.745783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:09.746945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.757950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.758410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.759373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.761120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.822248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dfad9444-f325-4c6c-b919-5c2a5fe8560f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.081076 Nov 06 20:52:09.824455 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 865/1759] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:09 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:09.837017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:09.838651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:09.858141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.859067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:09.895486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:09.896119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.008196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b32952c-e2c2-4236-8a5b-b22dd8ae495b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.180511 Nov 06 20:52:10.009216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 866/1760] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:09 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:10.030354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:10.034298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.045625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.046172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.047042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.047542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.075814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:10.085935 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84a5eaf2-e425-4618-b0a2-f0dfb0b34da7 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.903991 Nov 06 20:52:10.086785 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 895/1761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:09 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:10.102371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:10.105822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.121661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.122471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.123572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.124196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.363764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:10.372662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70b69221-1b93-417b-b0c1-d6159a39ab36 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.353469 Nov 06 20:52:10.374675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 867/1762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:10 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:10.459588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:10.482625 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d2a7393-deda-4ba1-9554-0523c274e241 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.384847 Nov 06 20:52:10.490698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 896/1763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:10 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:10.610154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:10.611868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.620439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.621350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.629155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.629948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.674025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:10.675673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.691406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.692728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.697722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.698482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.772975 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-668a51bf-ac8e-4c8f-aea8-a2ef9e4748d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.103611 Nov 06 20:52:10.778238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 897/1764] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:10 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:10.784061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:10.785414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.793628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.794166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.795022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.795662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.844661 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-603e275a-6d50-4c07-898b-f9e9ccef5162 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.064243 Nov 06 20:52:10.846334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:10.849630 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 898/1765] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:10 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:10.856148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77da1d42-5f1e-4c77-bbc6-dec7f72d141f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.253955 Nov 06 20:52:10.856619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:10.857854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:10.861235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 868/1766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:10 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:10.867970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.868850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.870435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:10.871030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:10.923443 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72e5484c-3326-46f7-bc92-8654f8c5652f tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.071625 Nov 06 20:52:10.924896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 899/1767] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:10 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:11.021615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:11.022603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.030454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.031035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.031783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.032227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.083115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eec3dcdc-2e0a-4bda-8e34-c70e854a2c43 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.066104 Nov 06 20:52:11.087805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 869/1768] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:11 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:11.106037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:11.106795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.114673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.115336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.116618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.117293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.283838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:11.293231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32611620-d997-48b2-876b-d5cfd041deec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.192956 Nov 06 20:52:11.294088 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 900/1769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:11 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:11.391942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:11.392598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.400092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.400597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.401400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.401848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.507144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:11.508537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.520723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.521641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.522610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.523374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.559608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:11.569929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5e10724-0047-4017-8046-a8eaf7fff230 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.182120 Nov 06 20:52:11.584128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 870/1770] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:11 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:11.713912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:11.725198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03ee00e8-a325-4a01-848b-309fa78f5e91 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.221829 Nov 06 20:52:11.735666 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 901/1771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:11 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:11.785554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:11.786117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.798601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.799354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.800252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.800857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.858093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:11.859644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.865454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76c8b388-87e3-4349-be63-9e62ec69e24a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.082843 Nov 06 20:52:11.869335 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 871/1772] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:11.877271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.878024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.879026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.879647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.892221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:11.892976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.911353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.911840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.912919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.913335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.934652 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec25ff54-b713-42e2-ad37-6cb253a8306d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.081676 Nov 06 20:52:11.938607 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 902/1773] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:11 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:11.941417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:11.942408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:11.950781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.951543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:11.952426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:11.952884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.008846 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3b4a24f-3f05-48b6-8f06-9c8d0844f74d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.071415 Nov 06 20:52:12.010254 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 903/1774] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:11 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:12.097809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:12.099419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.119659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.120640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.123320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.125439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.130374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:12.141492 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-910dc20f-69f8-4a33-b24c-3aaf8936e964 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.261561 Nov 06 20:52:12.142550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 872/1775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:11 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:12.199285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd8eba5f-9a60-426e-9d93-10414c1bf151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.107090 Nov 06 20:52:12.205165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 904/1776] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:12 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:12.322578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:12.323885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.346694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.347917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.349441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.350310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.580623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:12.592148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:12.592967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.595211 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5978a29-ad40-495e-990e-858034520f30 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.281053 Nov 06 20:52:12.602281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.602770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.604727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.605289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.605707 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 873/1777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:12 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:12.744384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:12.745041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.754721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.755178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.756119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.756462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.785655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:12.798812 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-758972ec-0c46-43c9-b718-359569db3f68 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.212020 Nov 06 20:52:12.801924 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 905/1778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:12 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:12.887982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:12.890284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.899417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.901329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.902466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.903250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.934697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:12.944154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58dc7e7a-d53c-44a9-86e1-a9c467eb4a07 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.205019 Nov 06 20:52:12.945025 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 874/1779] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:12 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:12.959206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:12.961169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:12.965026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c6815a3-e2b0-4a5f-8f93-b26266ab7c02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.091106 Nov 06 20:52:12.965680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 906/1780] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:12 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:12.974116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.974904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:12.975764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:12.976320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.023537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:13.026580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.027141 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29ea07cc-3cd7-4b48-8c93-c4c448f17c19 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.072995 Nov 06 20:52:13.027909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 875/1781] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:12 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:13.035137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.035714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.036772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.037309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.082862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4af4c84c-7138-4471-89d7-e5dc3d78895e tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.064134 Nov 06 20:52:13.087685 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 907/1782] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:13 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:13.162747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:13.162747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.171800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.172281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.173145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.173809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.215130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:13.216489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.226093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.226922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.228076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.228850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.279475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f22848fb-f0af-4ca6-b521-132f44161866 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.069275 Nov 06 20:52:13.285772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 908/1783] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:13 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:13.335731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:13.344093 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e36520d8-966c-4594-8b25-987dd6489948 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.188174 Nov 06 20:52:13.344952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 876/1784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:13 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:13.616790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:13.617564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.625903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.626347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.627207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.627664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.796774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:13.806311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd08e4d2-7448-4ded-92e6-df0cfdf46d6d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.195510 Nov 06 20:52:13.816876 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 909/1785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:13 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:13.818343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:13.819806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.827601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.828198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.829033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.829492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.963973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:13.964738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:13.975807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.976371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:13.977260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:13.977754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.016610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:14.028987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-386a24af-8bdb-4a22-8989-47423ece6695 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.214877 Nov 06 20:52:14.029832 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 877/1786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:13 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:14.036279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:14.037278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.048000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.048704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.054550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.055055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.120133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6945a043-a10d-4e71-a16c-1221a2c31057 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.087089 Nov 06 20:52:14.120822 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 878/1787] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:14 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:14.129051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:14.130138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.138218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.140214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.140214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.140713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.193904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:14.198862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c9340d6-1055-428e-9a33-26b445c42b25 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.076578 Nov 06 20:52:14.200578 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 879/1788] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:14 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:14.212097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f904c35b-1f73-4939-be7b-81eec1f510e3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.253735 Nov 06 20:52:14.224041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 910/1789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:13 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:14.229987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:14.234055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.245305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.246098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.247393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.248312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.293536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64fb2182-8664-40ea-b4b7-bab2b259aee3 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.090588 Nov 06 20:52:14.294464 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 880/1790] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:14 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:14.294588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:14.295551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.304324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.304943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.305898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.306349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.363535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:14.364416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.365432 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-585bd5de-194c-43e4-a74b-515d2d53090d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.076385 Nov 06 20:52:14.369584 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 911/1791] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:14 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:14.371890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.372399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.373570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.374115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.538791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:14.550766 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-988470af-397d-43a4-8f9a-5dea050a994b tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.192831 Nov 06 20:52:14.552674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 881/1792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:14 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:14.825355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:14.826745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:14.833816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.834273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:14.835061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:14.835505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.034569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:15.049801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:15.051237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.058648 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36d4140a-f482-462b-88ab-ef05d5bc7ad5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.237901 Nov 06 20:52:15.063969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 912/1793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:14 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:15.065936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.066602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.067667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.070041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.133804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:15.137221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.149765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.150475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.154372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.155273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.220165 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5486b2d7-193a-42c2-9372-d28cb0d7d5d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.091140 Nov 06 20:52:15.223371 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 913/1794] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:15.229889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:15.231627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.238692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.239948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.240699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.241439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.266114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:15.278789 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32ebe27b-32bf-4a13-b061-304b698df6a7 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.234768 Nov 06 20:52:15.288502 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 882/1795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:15 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:15.294095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c00967b9-c100-4ee8-abed-613f5e8585d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.069139 Nov 06 20:52:15.298370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 914/1796] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:15 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:15.298520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:15.298520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.307547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:15.308865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.317921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.318523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.318768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.319290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.320982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.321721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.321902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.322579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.396956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3dc093c-0bd2-4445-b23a-494ba1dcdee9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.094459 Nov 06 20:52:15.398627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 915/1797] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:15 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:15.405338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:15.406602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.418395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.419536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.420547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.422142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.483706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-979f8224-e709-4b7a-aaf5-07974f3db61a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.083548 Nov 06 20:52:15.487808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 916/1798] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:15 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:15.523714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:15.536921 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-793d92da-fec7-4779-abd2-aeef5dbdd46f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.246575 Nov 06 20:52:15.537652 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 883/1799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:15 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:15.567590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:15.568829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:15.576603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.577058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.577864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:15.578303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:15.763636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:15.774754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10e2df90-92a3-4d33-9f5e-30f40d1a1549 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.211359 Nov 06 20:52:15.786271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 917/1800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:15 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:16.084788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:16.086316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.094137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.094963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.096185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.096921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.264633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7abf5ee7-ed49-4e55-8c41-10e53d79334e req-9b581ee3-727d-4184-b49c-522d4f87fe6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1c1154-4869-49cb-87aa-799375f3b9f0", "name": "network-vif-plugged", "status": "completed", "tag": "90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:16.267209 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:16.267209 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:16.287069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7abf5ee7-ed49-4e55-8c41-10e53d79334e req-9b581ee3-727d-4184-b49c-522d4f87fe6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.287514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7abf5ee7-ed49-4e55-8c41-10e53d79334e req-9b581ee3-727d-4184-b49c-522d4f87fe6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.303791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:16.310481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7abf5ee7-ed49-4e55-8c41-10e53d79334e req-9b581ee3-727d-4184-b49c-522d4f87fe6b service nova] Creating event network-vif-plugged:90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa for instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 on nch2-master-1 Nov 06 20:52:16.314290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39a7d8ef-8028-48ee-87a0-22afb507d7f9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.238944 Nov 06 20:52:16.314785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 884/1801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:16 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:16.316612 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7abf5ee7-ed49-4e55-8c41-10e53d79334e req-9b581ee3-727d-4184-b49c-522d4f87fe6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161697 Nov 06 20:52:16.317630 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 918/1802] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:16.336828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:16.338430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.338576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:16.339140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.346938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.347322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.347494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.347606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.348174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.348460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.348810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.349084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.414653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2aa83ea9-61c8-4b03-b481-3662c3572b89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.081653 Nov 06 20:52:16.420930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 885/1803] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:16 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:16.425247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:16.426812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.436491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.437381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.438361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.438949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.501625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac1e907f-4a8d-45be-9f5d-a5193f4882dc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.081844 Nov 06 20:52:16.509058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 886/1804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:16 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:16.516762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:16.518058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.533693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.534858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.535668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.536252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.605770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b613b685-5e5f-47bb-b6e1-64cb16d637f9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.093585 Nov 06 20:52:16.606922 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 887/1805] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:16 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:16.618880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:16.620563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.627857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:16.639153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.642060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.642201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bc9d9ad-43f5-4d3e-ba02-6d5e8aad0e48 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.321549 Nov 06 20:52:16.642319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.642319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.642503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 919/1806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:16 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:16.647412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:16.648246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.658233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.658937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.659931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.660623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.842143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:16.854896 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f53255f-9a8b-45ba-a2f6-13501fb3a549 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.211382 Nov 06 20:52:16.865220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 920/1807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:16 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:16.865220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:16.865220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:16.869284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.869924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.870804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:16.871268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:16.891461 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a42473f-6197-4025-a626-d3c02ddfbdc1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.282626 Nov 06 20:52:16.892572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 888/1808] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:16 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:17.043105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:17.053472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23293c24-c42d-4089-a2da-0b1300c36c44 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.196609 Nov 06 20:52:17.054404 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 921/1809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:16 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:17.334545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:17.336215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.342839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.343323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.344089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.344550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.430591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:17.431970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.443461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.445778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.448653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.449839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.531337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:17.542043 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9a0116c-7733-4dc9-b76e-7dbb72388082 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.213083 Nov 06 20:52:17.544333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 889/1810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:17 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:17.548186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:17.549190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.557619 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-245b2686-6cc1-4c34-8eba-ca640769f00e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.131026 Nov 06 20:52:17.558723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.558980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 922/1811] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:17 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:17.559308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.561154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.561814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.611197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-69c46363-3fb2-4b92-bfef-890f4ffc2d4d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.066517 Nov 06 20:52:17.613989 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 890/1812] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:17 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:17.620187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:17.621274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.629515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.629966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.630792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.631224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.662220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:17.663032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.672532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.673095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.673961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.674485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.682479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fb50c9c-79a1-404f-a89c-7d628cbae13d tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.066389 Nov 06 20:52:17.684574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 923/1813] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:17 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:17.851554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:17.859982 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7289893-9ca5-4292-a062-011f4ac1318b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.202609 Nov 06 20:52:17.871916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 891/1814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:17 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:17.880550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:17.881350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.889768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.890226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.891026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.891468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.905281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:17.906384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:17.913610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.914444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.916941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:17.917406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:17.975187 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f059526e-d0a5-4b75-80ee-c3f14145caef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.075354 Nov 06 20:52:17.981580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 892/1815] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:17 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:18.073921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:18.074311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:18.074791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.084513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.084984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.085803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.086386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.094409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a23e6cf-ba59-4b22-be33-3677298d46e5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.220471 Nov 06 20:52:18.107265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 924/1816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:17 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:18.283815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:18.301922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b72cc769-ffa2-4436-b918-34065fdda985 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1320 microversion: 2.1 time: 0.233554 Nov 06 20:52:18.304336 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 893/1817] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:18 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:18.561808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:18.563154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.569610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:18.570522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.579337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.579800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.580644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.581088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.584577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.585468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.586672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.587709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.640824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3830fa13-9e51-4368-9af8-134a614874bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.074318 Nov 06 20:52:18.644549 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 894/1818] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:18.654649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:18.655673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.663030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.663475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.664552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.664990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.722257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3421b6e0-bc24-4566-aa7d-7d7efb356287 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.076273 Nov 06 20:52:18.726137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 895/1819] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:18 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:18.737003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:18.738057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.745620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.746089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.748324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.748324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.792185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:18.799591 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82f0dd7b-ba6a-41fe-be8c-13927e7784a8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1542 microversion: 2.1 time: 0.242047 Nov 06 20:52:18.800157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 925/1820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:18 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:18.801585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c1e5a03-c1d0-4aba-960c-d5489927bcfe tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.075710 Nov 06 20:52:18.804334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 896/1821] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:18 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:18.877633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:18.878377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.885747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.886199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.886999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:18.887433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:18.990900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:18.991897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:18.999597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.000053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.001049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.001336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.046395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:19.054842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5f31c23-ea26-4ffe-a193-46b5f10dd27d tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.181029 Nov 06 20:52:19.055563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 926/1822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:18 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:19.060514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6635b333-2dfc-427b-9ae9-a8c1ee344baf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.074257 Nov 06 20:52:19.061383 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 897/1823] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:18 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:19.114175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:19.114752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.122926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.123643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.124579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.125045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.261099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:19.268857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5650622-574c-4c87-9589-ba0b2a0e218a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1523 microversion: 2.1 time: 0.158504 Nov 06 20:52:19.269428 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 927/1824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:19 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:19.321494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:19.322193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.329544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.330034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.330830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.331277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.460129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:19.468480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20815375-64d1-4214-8b24-c2a9b9e50d72 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1506 microversion: 2.1 time: 0.151133 Nov 06 20:52:19.469045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 898/1825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:19 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:19.655612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:19.656601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.662859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.663300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.664413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.664846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.734969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:19.736170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.752074 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a782eb38-c0af-4c9d-86d8-a5d04df7c88d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.099461 Nov 06 20:52:19.753494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.755968 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 928/1826] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:19 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:19.756924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.758363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.760022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.813818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:19.814822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.821109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.821766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.823248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.823693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.834886 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bdbde7d1-25e8-4d03-9648-4d3319bb3d76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.103933 Nov 06 20:52:19.835810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 899/1827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:19 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:19.842399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:19.842767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:19.850769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.851541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.852558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:19.853180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:19.876641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e070bbe3-7d75-465e-b333-409943303429 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.065904 Nov 06 20:52:19.881195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 929/1828] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:19 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:20.051036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:20.062864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-295bee4d-119f-4d42-b566-9d4c070ce687 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1541 microversion: 2.1 time: 0.225594 Nov 06 20:52:20.076012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 900/1829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:19 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1541 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:20.076926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:20.076926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.084689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:20.086010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.089659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.090365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.091178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.095233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.095732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.096728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.097653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.099107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.171824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21824cc4-8991-457b-be76-c8e6895b6757 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.093518 Nov 06 20:52:20.172734 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 901/1830] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:20 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:20.285589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:20.286302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.293668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.294275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.295202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.295711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.519028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:20.526775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2c0038e-3659-400c-947a-918b8d3fbaa2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.457552 Nov 06 20:52:20.527339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 930/1831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:20 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:20.719397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:20.726578 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea8774ec-76d5-4add-bdb9-3cb702d1dc3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1505 microversion: 2.1 time: 0.445110 Nov 06 20:52:20.727335 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 902/1832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:20 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:20.768160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:20.770358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.783787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.784541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.785344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.785774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.836362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a26c1461-c0b9-4308-9306-da17b5126476 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.073249 Nov 06 20:52:20.841518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 931/1833] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:20 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:20.846859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:20.847949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.855388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.856098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.857076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.857683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.863437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce9792b5-5699-4e73-8f1a-4e82d8c983fa"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:20.865155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.876198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.876834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.877964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.878723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.908183 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e9f4bf7-624c-48e8-b3c2-08f12029a686 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.064724 Nov 06 20:52:20.912011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 903/1834] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:20 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:20.915073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:20.916880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:20.925495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.926161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.927297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:20.927889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:20.981602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a9fdda1-e4c1-4300-b845-1a51731200af tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.070902 Nov 06 20:52:20.984812 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 904/1835] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:20 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:21.083917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:21.085011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.096622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.097624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.098868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.098868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.160220 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "POST /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303659 Nov 06 20:52:21.166694 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 932/1836] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 20:52:20 2021] POST /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:52:21.184704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:21.185911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.199808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.200310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.201173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.201609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.267272 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c496920-0a91-4976-954f-b7d38a2ea72b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.087422 Nov 06 20:52:21.267926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 933/1837] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:21 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:21.299961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:21.307576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd1a3153-55dc-44c8-aeed-7389dc15f9b6 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1541 microversion: 2.1 time: 0.227759 Nov 06 20:52:21.308194 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 905/1838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:21 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1541 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:21.544390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:21.545089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.552129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.552602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.553382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.553818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.687825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:21.696130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86e2f709-c3ae-48fa-a35a-1b7c362ac6f4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.155766 Nov 06 20:52:21.697643 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 934/1839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:21 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:21.744788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:21.745401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.751717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.752170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.752999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.753462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.849233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:21.850160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.857076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.857534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.858330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.858767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.904489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:21.906833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df56eeed-8942-4161-bb75-6f9d2250ccd2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.061213 Nov 06 20:52:21.908616 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 935/1840] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:21.912178 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75e5f290-d2dd-45e7-935a-4e907341bd6f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1505 microversion: 2.1 time: 0.171708 Nov 06 20:52:21.912939 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 906/1841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:21 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:21.920551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:21.921557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:21.928465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.928923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.929713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:21.930151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:21.972200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-433c7795-9e89-4017-90a7-cca73ed7c630 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.055905 Nov 06 20:52:21.973434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 936/1842] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:21 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:21.994755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:21.995872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.002677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.003135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.003979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.004465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.048391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa2206ba-37aa-499c-8407-ca1fb92a9928 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.058033 Nov 06 20:52:22.049173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 907/1843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:21 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:22.191831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-unplugged", "status": "completed", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:22.193722 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:22.193722 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:22.202027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.202458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.214507 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] Creating event network-vif-unplugged:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:52:22.220369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] Instance 0f449d21-9a2c-46a7-99aa-707210a04428 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:52:22.226462 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1bc94909-5b55-49f1-a15c-9db3582efba4 req-6a7257d8-479e-4c61-be11-d9b6ec5e6bda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038749 Nov 06 20:52:22.227365 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 937/1844] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:22.278809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:22.280154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.287335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.287915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.288844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.289778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.326656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:22.327371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.335114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.340716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.341678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.342201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.407150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7ba4fcb-55f4-4bcb-ad41-f352e72e1ebe tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.132204 Nov 06 20:52:22.411649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 908/1845] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:22 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:22.619616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:22.627868 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-384f1ee0-fb4c-458a-a263-052430dfd17a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1473 microversion: 2.1 time: 0.306650 Nov 06 20:52:22.628479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 938/1846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:22 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1473 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:22.719903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:22.720675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.730044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.730604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.731502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.732033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.918781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:22.919744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.926283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.926731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.927506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.927937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.979305 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7a3e2c8-cf04-40ad-8433-881a5a65be4d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.063965 Nov 06 20:52:22.980439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 939/1847] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:22 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:22.984691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:22.985375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:22.992046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.992532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:22.993310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:22.993736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.055206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:23.064175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4596b7e-e6cf-4e52-a087-c532e0e8a005 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.348985 Nov 06 20:52:23.064792 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 909/1848] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:22 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:23.069333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:23.070454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:23.077007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.077458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.078234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.078715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.125037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5808fa1-8b0c-4334-a445-5978d452f81b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.058998 Nov 06 20:52:23.126342 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 910/1849] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:23 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:23.131553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:23.132579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:23.139812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.140264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.141063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.141495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.186099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cef276e1-529f-4ec2-905b-fc98803a9a55 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 32594 microversion: 2.1 time: 0.058121 Nov 06 20:52:23.192491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 911/1850] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:23 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 32594 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:23.229605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:23.237117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b2b27b4-272a-4de0-b9f6-50ab733dccd2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1505 microversion: 2.1 time: 0.256119 Nov 06 20:52:23.237677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 940/1851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:22 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:23.426184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:23.427984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:23.437116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.437695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.438594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.439315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.484403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e679a8ab-e7bc-47f9-932a-fa71f1b116cd tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.062583 Nov 06 20:52:23.485709 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 912/1852] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:23 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:23.645005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:23.645614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:23.652116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.652607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.653402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:23.653837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:23.868670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:23.883539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af597e8b-d7c9-42a7-ab77-ec0383bc9e37 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1473 microversion: 2.1 time: 0.241483 Nov 06 20:52:23.884132 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 941/1853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:23 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:23.993393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:23.994393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.003312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.003697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.004510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.004946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.052435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8aa94ba2-7f3e-42c6-9704-34707d6a1e6e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.064161 Nov 06 20:52:24.054032 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 913/1854] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:24.081694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.082326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.089523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.089972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.090760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.091192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.138332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:24.139365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.146295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.146740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.147522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.147955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.210547 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d95f2cd-2b2b-4cc1-97d5-36dae5c056f3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 24549 microversion: 2.1 time: 0.076830 Nov 06 20:52:24.211388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 914/1855] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:24 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 24549 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:24.217260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:24.218454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.226287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.226769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.227537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.228009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.245075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:24.254832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96cf38aa-3d35-4cf2-823c-643b70fecdf2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.176442 Nov 06 20:52:24.255290 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 942/1856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:24 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:24.261758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.262382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.268907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.269408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.270328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.270769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.281775 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54f28651-2fdf-4ba8-a648-9a85d2af30c7 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action" status: 200 len: 40744 microversion: 2.1 time: 0.068892 Nov 06 20:52:24.292385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 915/1857] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:24 2021] POST /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7/action => generated 40744 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:24.292385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8134ee9f-35cd-44e0-960f-1ca8ef13e69a req-68814ff1-ccc5-47af-899d-b9933754de1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392ca076-1799-441a-9449-9c6f872899d4", "name": "network-vif-unplugged", "status": "completed", "tag": "7bf13337-75ad-4296-b933-78a2962b57e9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:24.292385 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:24.292385 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:24.297243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8134ee9f-35cd-44e0-960f-1ca8ef13e69a req-68814ff1-ccc5-47af-899d-b9933754de1c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.297695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8134ee9f-35cd-44e0-960f-1ca8ef13e69a req-68814ff1-ccc5-47af-899d-b9933754de1c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.309286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.server_external_events [req-8134ee9f-35cd-44e0-960f-1ca8ef13e69a req-68814ff1-ccc5-47af-899d-b9933754de1c service nova] Unable to find a host for instance 392ca076-1799-441a-9449-9c6f872899d4. Dropping event network-vif-unplugged {{(pid=134828) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 06 20:52:24.310171 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8134ee9f-35cd-44e0-960f-1ca8ef13e69a req-68814ff1-ccc5-47af-899d-b9933754de1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026735 Nov 06 20:52:24.310756 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 916/1858] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 06 20:52:24.403818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:24.411166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff021729-05c9-42cd-992e-a75a9bb854d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 200 len: 1448 microversion: 2.1 time: 0.154506 Nov 06 20:52:24.411938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 943/1859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:24 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:24.427637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.428340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.435156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.435610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.436413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.436887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.461499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:52:24.467562 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Working on deleting snapshot 73e066ec-84cf-4b29-8995-e47907e02d4a from shelved instance... Nov 06 20:52:24.490635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.491611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.498050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.498503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.499297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.499739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.528990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d24735a2-eafe-4bf5-8cba-9f26413a64df tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Nov 06 20:52:24.529560 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 944/1860] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:52:24 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:52:24.533893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:24.534806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.541340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.541798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.542588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.543472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.592032 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ac2b004-da69-4a7a-a36f-39deb561ee63 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.061173 Nov 06 20:52:24.592955 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 945/1861] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:24 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:24.597915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.598485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.606598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.607096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.607885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.608338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.735316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lazy-loading 'services' on Instance uuid 8c1c1154-4869-49cb-87aa-799375f3b9f0 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:52:24.841572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c88ea8c-fdaa-46a0-8ece-3613a556701c tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments/ce9792b5-5699-4e73-8f1a-4e82d8c983fa" status: 202 len: 0 microversion: 2.1 time: 0.247303 Nov 06 20:52:24.842157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 946/1862] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 20:52:24 2021] DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments/ce9792b5-5699-4e73-8f1a-4e82d8c983fa => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:24.907432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:24.908242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:24.915349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.916589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.917326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.917769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.926857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Doing local delete in cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134828) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 06 20:52:24.927769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:24.928223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:24.931959 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 06 20:52:24.934641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] deallocate_for_instance() {{(pid=134828) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1675}} Nov 06 20:52:25.163680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:25.172135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-417d5d1e-88fe-41a7-9141-4d2c17aaa67f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1473 microversion: 2.1 time: 0.275848 Nov 06 20:52:25.172972 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 947/1863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:24 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:25.178955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:25.179886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.187126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.187889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.188967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.189658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.217038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:52:25.303136 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-481c4278-ec44-45d7-81ce-37bb814c4887 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 204 len: 0 microversion: 2.1 time: 0.128291 Nov 06 20:52:25.304088 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 948/1864] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:25 2021] DELETE /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:52:25.312570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:25.313629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.334034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.334703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.335491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.335921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.386122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b38c5fd4-f2eb-4815-ba08-7a05c0396358 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.080457 Nov 06 20:52:25.390083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 949/1865] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:25 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:25.391924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:25.392915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.399768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.400275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.401081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.401499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.456006 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21d63a29-4175-46e1-9e58-98caceafddfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.067584 Nov 06 20:52:25.460204 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 950/1866] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:25 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:25.462023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:25.463219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.470177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.470631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.471485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.471879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.533319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Updating instance_info_cache with network_info: [] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:52:25.628570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:25.636269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58c97921-7dfb-48a5-8522-25f0208726cd tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.178098 Nov 06 20:52:25.636898 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 951/1867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:25 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:25.641346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:25.641974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.648618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.649068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.650362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.650880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.800906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:25.814912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11202c19-002a-4559-b9bd-cd568b8172cd tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1664 microversion: 2.1 time: 0.176648 Nov 06 20:52:25.816337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 952/1868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:25 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:25.821073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c981da85-0aba-4c69-b55d-ca16c692f3ed req-302bab9e-70e1-4d92-8acf-6a117dc82c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392ca076-1799-441a-9449-9c6f872899d4", "name": "network-vif-deleted", "tag": "7bf13337-75ad-4296-b933-78a2962b57e9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:25.823074 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:25.823074 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:25.830385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c981da85-0aba-4c69-b55d-ca16c692f3ed req-302bab9e-70e1-4d92-8acf-6a117dc82c97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.830824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c981da85-0aba-4c69-b55d-ca16c692f3ed req-302bab9e-70e1-4d92-8acf-6a117dc82c97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.843801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.server_external_events [req-c981da85-0aba-4c69-b55d-ca16c692f3ed req-302bab9e-70e1-4d92-8acf-6a117dc82c97 service nova] Unable to find a host for instance 392ca076-1799-441a-9449-9c6f872899d4. Dropping event network-vif-deleted {{(pid=134827) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 06 20:52:25.845434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c981da85-0aba-4c69-b55d-ca16c692f3ed req-302bab9e-70e1-4d92-8acf-6a117dc82c97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027970 Nov 06 20:52:25.846422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 953/1869] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:25 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 06 20:52:25.848523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83b548e5-5a04-4f6f-9fb2-ae1f4a11e198 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 204 len: 0 microversion: 2.1 time: 1.424068 Nov 06 20:52:25.849269 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 917/1870] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:24 2021] DELETE /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 0 bytes in 1426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:52:25.855597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:25.856541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.857094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:25.857795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.863162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.863606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.864416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.864851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.870946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.872369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.873735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.874307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.893182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. Nov 06 20:52:25.893789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:25.894630 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8f98fd2-969c-4fad-9774-55a0438f099e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 404 len: 111 microversion: 2.1 time: 0.041436 Nov 06 20:52:25.895186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 918/1871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:25 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:52:25.911938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5b1d1d78-6e34-4392-8975-7dd5aa699d1f tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.061337 Nov 06 20:52:25.917681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 954/1872] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:25 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:25.968468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:25.969447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:25.975213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.975761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:25.976448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:25.976881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.000107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-443505024", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:26.010138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3eb81197-076a-4268-b881-3381fd6e880f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044823 Nov 06 20:52:26.012340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 919/1873] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:52:25 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:52:26.059037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:26.074420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.076394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.083018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.083560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.084396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.084844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.124497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-947a7ca5-aa7a-435f-97f1-d53ff53c9cba tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054500 Nov 06 20:52:26.124729 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 920/1874] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:52:26 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:52:26.185019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.186110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.192143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.192647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.193453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.194020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.220379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:52:26.298859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23908fd8-59f5-400b-b617-623956caf11f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 204 len: 0 microversion: 2.1 time: 0.118381 Nov 06 20:52:26.299519 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 921/1875] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:26 2021] DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:52:26.305084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.305998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.312421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.312882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.313674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.314115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.535592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:26.549758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8440a9a3-47c3-4cb9-aefb-14443e16d362 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1470 microversion: 2.1 time: 0.243885 Nov 06 20:52:26.549758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 922/1876] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:26 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:26.550561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.551165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.553781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:52:26.554792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:52:26.555511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:52:26.557462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:52:26.557885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.558656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.558798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:52:26.559484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.559987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.568712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.569167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.569982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.570637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.588020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:26.592747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:26.604983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:52:26.607582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:52:26.665002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee3fdbaa-8d90-4ca9-8778-8f3180403ae9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669356 Nov 06 20:52:26.671004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 955/1877] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:52:26.671488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:26.672734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.679923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.680430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.681920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.682417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.724794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:26.736646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-762edc6b-ce0b-4ac4-9465-ad2a64d09c5e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.066074 Nov 06 20:52:26.737832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 956/1878] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:26.750110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:26.750413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a4a0dce-65a0-477b-be9a-19570d650155 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1512 microversion: 2.1 time: 0.203335 Nov 06 20:52:26.751912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.752916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 923/1879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:26 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:26.762894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:26.763107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.769400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.770343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.771710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.772805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.777066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.778070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.779411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.780506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.825603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.826405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.830162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.830776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.831231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1f54e3a-383b-447a-a62a-64766942d59a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.090979 Nov 06 20:52:26.832525 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 957/1880] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:26 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:26.841855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.842799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:26.852698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.853883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.854760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:26.855313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:26.864614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for project acfc5ca1083f4131b1da0e5689218590. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:26.869394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for user 3ffff819b4c04c92a90993dcd4fa39c9 and project acfc5ca1083f4131b1da0e5689218590. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:26.990348 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-751b2b54-04e8-4fb2-9ad7-c199779f875d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428/action" status: 202 len: 0 microversion: 2.1 time: 0.234969 Nov 06 20:52:26.991126 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 924/1881] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:26 2021] POST /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:26.996490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4dcb5c00-dfba-495d-bd4a-7325ac9782c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:26.997488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4dcb5c00-dfba-495d-bd4a-7325ac9782c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.092132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4dcb5c00-dfba-495d-bd4a-7325ac9782c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:27.099472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4dcb5c00-dfba-495d-bd4a-7325ac9782c1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1214 microversion: 2.1 time: 0.107143 Nov 06 20:52:27.099993 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 925/1882] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:26 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:27.107918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:27.108957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.118649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.119358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.120463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.121140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.164990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:27.174041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-faf7044e-2b55-4e3b-a0d6-7dcd1c49d486 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.339961 Nov 06 20:52:27.183258 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 958/1883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:26 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:27.187770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:27.188880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.197212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.197753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.198771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.199435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.252723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c1e52b7-5e7d-481f-bca1-0218447eeb33 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.075767 Nov 06 20:52:27.253663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 959/1884] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:27 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:27.260019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:27.261100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.268563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.269016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.270090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.270799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.459701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:27.470809 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e62152f2-dfc0-46db-bcb0-ad0288799067 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1664 microversion: 2.1 time: 0.369245 Nov 06 20:52:27.477399 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 926/1885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:27 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1664 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:27.611102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:27.618501 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0501b89-d9b2-4083-b6c0-5389cc441d9d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1469 microversion: 2.1 time: 0.363528 Nov 06 20:52:27.619553 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 960/1886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:27 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:27.750435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:27.751573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.757766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.758329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.759117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.760105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.770728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:27.771421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.789854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.790309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.791275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.791555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.814443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8eb282e-2a78-4b63-a8f2-8cbe9369d90f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.067524 Nov 06 20:52:27.815827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 927/1887] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:27 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:27.843317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:27.844345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:27.852030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.852515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.853313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:27.853750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:27.904390 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1717a6ea-e86d-4de2-bf0d-337280ed0131 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.064900 Nov 06 20:52:27.905034 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 928/1888] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:27 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:28.122119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:28.123255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.130201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.130590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.131556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.132002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.195729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:28.217210 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cbab1da0-1c53-4e68-af52-2954fc4795c8 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1512 microversion: 2.1 time: 0.449895 Nov 06 20:52:28.217886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 961/1889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:27 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:28.222475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:28.223289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.229549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.229993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.230764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.231192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.246833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:28.264633 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-980b009e-b51c-4eba-9938-2c9aac746499 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1272 microversion: 2.1 time: 0.147070 Nov 06 20:52:28.265824 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 929/1890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:28 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:28.271189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:28.272747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.281431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.281882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.282685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.283121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.326707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd438a63-84de-43de-8ce1-e4e1d3577291 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.059356 Nov 06 20:52:28.330814 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 930/1891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:28 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:28.494186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:28.498349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.505816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.506374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.507265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.507744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.619596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:28.627134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9178fc9e-e2a3-464e-82b2-c0c44998b1c5 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1598 microversion: 2.1 time: 0.136860 Nov 06 20:52:28.627720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 931/1892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:28 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1598 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:28.641510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:28.642122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.648633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.649090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.650417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.650858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.737414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:28.743587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05691e4b-ba3a-4710-8bd5-f1e86586dc1b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1517 microversion: 2.1 time: 0.524390 Nov 06 20:52:28.744180 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 962/1893] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:28 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1517 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:28.827367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:28.828773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.834945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.835427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.836228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.837220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.891270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fc61880-52fd-4645-b31b-9b1f7c34a64f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.067795 Nov 06 20:52:28.892038 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 963/1894] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:28.916656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:28.917679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:28.925834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.926285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.927299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:28.927740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:28.972652 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-44647523-ec58-4a5b-869b-2ffb6f4c7dae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.060125 Nov 06 20:52:28.973313 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 964/1895] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:28 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:29.236963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:29.238791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.248571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.249347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.251410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.252268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.443756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:29.460988 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e514d98-453f-4918-a112-7075553b0def tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1469 microversion: 2.1 time: 0.822969 Nov 06 20:52:29.461593 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 932/1896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:28 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1469 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:29.466129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:29.467016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.485630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.486299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.487129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.488081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.503691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ba9c491fa948f3b57c84b232fb54e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669205b495ef4088b1d5dae005f87509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:29.517738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa71f44a-6419-474e-91fa-b9c15ef47fee tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 200 len: 1470 microversion: 2.1 time: 0.286110 Nov 06 20:52:29.518771 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 965/1897] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:29 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:29.531798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:29.536874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.560486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.561385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.566715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.573707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.595346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:29.606395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe14e4f6-560d-4381-b479-8dcb24f7cde7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1272 microversion: 2.1 time: 0.143511 Nov 06 20:52:29.615720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 933/1898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:29 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:29.641924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59494a73-3d9a-4ae9-a96b-cac98bb83d50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.120870 Nov 06 20:52:29.646429 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 966/1899] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:29 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:29.649649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3eccdd2f-73ef-48b2-8813-e874d42f5479 req-f3981201-056e-4c54-a765-c0ad0438f100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe417ed-b509-4da2-9cd8-d79891f228b7", "name": "network-vif-deleted", "tag": "c83693a3-2e65-4ffa-b0e0-7a93f6dabc38"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:29.659739 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:29.659739 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:29.678874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3eccdd2f-73ef-48b2-8813-e874d42f5479 req-f3981201-056e-4c54-a765-c0ad0438f100 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.681627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3eccdd2f-73ef-48b2-8813-e874d42f5479 req-f3981201-056e-4c54-a765-c0ad0438f100 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.708840 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3eccdd2f-73ef-48b2-8813-e874d42f5479 req-f3981201-056e-4c54-a765-c0ad0438f100 service nova] Creating event network-vif-deleted:c83693a3-2e65-4ffa-b0e0-7a93f6dabc38 for instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 on nch1-master-1 Nov 06 20:52:29.711597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a24c6934-36e1-40df-aaa5-5919e6da2176 req-8aef63dc-2ac9-4990-b2d0-706d98c40ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1c1154-4869-49cb-87aa-799375f3b9f0", "name": "network-vif-deleted", "tag": "90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:29.713583 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:29.713583 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:29.718057 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3eccdd2f-73ef-48b2-8813-e874d42f5479 req-f3981201-056e-4c54-a765-c0ad0438f100 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072793 Nov 06 20:52:29.718844 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 967/1900] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:29.725217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a24c6934-36e1-40df-aaa5-5919e6da2176 req-8aef63dc-2ac9-4990-b2d0-706d98c40ae5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.726008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a24c6934-36e1-40df-aaa5-5919e6da2176 req-8aef63dc-2ac9-4990-b2d0-706d98c40ae5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.729252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:29.729957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.736662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.737109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.737897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.738452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.742153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a24c6934-36e1-40df-aaa5-5919e6da2176 req-8aef63dc-2ac9-4990-b2d0-706d98c40ae5 service nova] Creating event network-vif-deleted:90be927e-0d19-4cf4-9b5f-dbcd4cb2b2fa for instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 on nch2-master-1 Nov 06 20:52:29.748248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a24c6934-36e1-40df-aaa5-5919e6da2176 req-8aef63dc-2ac9-4990-b2d0-706d98c40ae5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136715 Nov 06 20:52:29.749208 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 934/1901] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:29.762241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:29.763289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.769916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.770716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.771753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.772587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.774055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.774055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.774055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lazy-loading 'fault' on Instance uuid 8fe417ed-b509-4da2-9cd8-d79891f228b7 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:52:29.845956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817bcf8d2d284d21b41235651d678871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a00b3392ff344cca1531a676e30616a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:29.853847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ae39beb-78bb-4717-87b0-b379e9e99940 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 200 len: 1315 microversion: 2.1 time: 0.128774 Nov 06 20:52:29.854645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 968/1902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:29 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 1315 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:29.903367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:29.904540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:29.911815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.912488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.913356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:29.913858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:29.969775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8850c457-1421-4fc5-b653-64727eecfc43 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.070770 Nov 06 20:52:29.970993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 969/1903] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:29 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:52:29.993368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:29.994595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.001982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.002520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.003447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.003887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.054224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:30.066087 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1982dca-4405-4138-8292-c9b6d3439946 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.308344 Nov 06 20:52:30.067825 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 935/1904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:29 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:30.107850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6eb0835-d1ca-4515-a79f-242e73f3f9ce tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.125783 Nov 06 20:52:30.111601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 970/1905] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:29 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:30.382587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-plugged", "status": "completed", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:30.384930 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:30.384930 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:30.392444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.393175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.405414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] Creating event network-vif-plugged:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:52:30.412581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] Instance 0f449d21-9a2c-46a7-99aa-707210a04428 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:52:30.419177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-86951ac9-17fe-4b47-bf91-68cc664f307b req-706b4931-4e5b-4f3c-a4d9-53e7d1414019 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040155 Nov 06 20:52:30.419983 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 936/1906] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:30.485231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:30.488412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.496064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.496550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.497428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.497879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.536684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:30.538227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.550468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.550590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.551563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.551999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.576279 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] HTTP exception thrown: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. Nov 06 20:52:30.576969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Returning 404 to user: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:30.578697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e933424-42d0-4d6c-9aed-fd4a9326f35f tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 404 len: 111 microversion: 2.1 time: 0.047350 Nov 06 20:52:30.580551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 937/1907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:30 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:52:30.623941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:30.624678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.636480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.636812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.637863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.638483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.849600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:30.858914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23cd4a67-3dc6-4db5-89ed-05406c9821aa tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1469 microversion: 2.1 time: 0.384548 Nov 06 20:52:30.864213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 971/1908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:30 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1469 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:30.869504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:30.870417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.890581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.891171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.893933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.894684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.958877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68adc15b-4535-4c2c-812e-e83eeb05d544 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.092878 Nov 06 20:52:30.959817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 972/1909] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:30 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:30.966079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:30.967281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] [instance: 8fe417ed-b509-4da2-9cd8-d79891f228b7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:30.977311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.978622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.979828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:30.980325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:30.994510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:31.004381 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-621137f5-ad6f-40c7-b2b1-86a96d4373c2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.384666 Nov 06 20:52:31.004904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] HTTP exception thrown: Instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 could not be found. Nov 06 20:52:31.005391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Returning 404 to user: Instance 8fe417ed-b509-4da2-9cd8-d79891f228b7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:31.006426 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 938/1910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:30 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:31.007605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccb4d3bf-75f0-4193-ba98-d0b1804db112 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7" status: 404 len: 111 microversion: 2.1 time: 0.045282 Nov 06 20:52:31.012131 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 973/1911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:30 2021] GET /compute/v2.1/servers/8fe417ed-b509-4da2-9cd8-d79891f228b7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:52:31.012672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:31.013837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:31.018642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c8d2f1d-aea4-4029-8d6c-6541469c9fc9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] Calling method '.version_select at 0x7f671586a4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:31.022091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.022974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.024114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.024825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.044893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c8d2f1d-aea4-4029-8d6c-6541469c9fc9 tempest-ServersTestFqdnHostnames-1034438315 tempest-ServersTestFqdnHostnames-1034438315-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702371140" status: 202 len: 0 microversion: 2.1 time: 0.031425 Nov 06 20:52:31.050160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 974/1912] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 20:52:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702371140 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:31.078383 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb1a28ff-9f31-4f9f-80ea-6aa586e56f02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.070132 Nov 06 20:52:31.083477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 939/1913] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:31 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:31.087860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:31.088610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:31.101815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.103519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.104335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.104865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.122343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:31.123324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:31.142885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.143567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.144588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.145737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.231971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-272ebce5-30fb-43e4-9240-8c99d7ae2514 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.113737 Nov 06 20:52:31.233080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 940/1914] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:31 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:31.505208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:31.514865 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec713d7b-239b-49c2-aad8-71eab06ca0ea tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.431750 Nov 06 20:52:31.518268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 975/1915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:31 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:31.746018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-04e6422c-4960-490f-a8fc-dad60068436a req-bfcb01c8-39cb-42d7-af5d-0168ebc20f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b628d735-8393-4d0e-9126-37ca09231b4e", "tag": "41a8c318-4f4a-48fc-80b1-233aca022d86"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:31.749017 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:31.749017 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:31.758327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04e6422c-4960-490f-a8fc-dad60068436a req-bfcb01c8-39cb-42d7-af5d-0168ebc20f3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.758761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04e6422c-4960-490f-a8fc-dad60068436a req-bfcb01c8-39cb-42d7-af5d-0168ebc20f3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.773882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-04e6422c-4960-490f-a8fc-dad60068436a req-bfcb01c8-39cb-42d7-af5d-0168ebc20f3a service nova] Creating event network-changed:41a8c318-4f4a-48fc-80b1-233aca022d86 for instance b628d735-8393-4d0e-9126-37ca09231b4e on nch2-master-1 Nov 06 20:52:31.782860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-04e6422c-4960-490f-a8fc-dad60068436a req-bfcb01c8-39cb-42d7-af5d-0168ebc20f3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043348 Nov 06 20:52:31.783558 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 941/1916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:31.883309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:31.885199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:31.892462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.893168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.894159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.894793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.972688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:31.976537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:31.988548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.989332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:31.991396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:31.992680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.085866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-740c23e7-fd99-485d-87ff-4c5651927c1e tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.116208 Nov 06 20:52:32.087532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 942/1917] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:31 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:32.092814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:32.095273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.108997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.109854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.112104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.112908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.195369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:32.218278 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecb49415-dd2f-47ea-8e13-9f44232e7466 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1535 microversion: 2.1 time: 0.339423 Nov 06 20:52:32.230968 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 976/1918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:31 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1535 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:32.237401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:32.238522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.248456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.249336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.250908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.251841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.313539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4cc90bd2-09a5-487b-9859-fb0c43cf59f8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.079859 Nov 06 20:52:32.318136 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 977/1919] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:32 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:32.322707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:32.325368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.334486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.335223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.336388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.337356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.393615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c343874-2198-44c1-97ea-6c1e23f096f4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.076663 Nov 06 20:52:32.394490 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 978/1920] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:32 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:32.544049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:32.548504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:32.551086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.556881 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8cd3fe3-a98f-4321-8c09-a5af92051974 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.465496 Nov 06 20:52:32.559557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 943/1921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:32 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:32.571021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.571470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.572791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.573391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.577091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:32.578716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.585149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.586413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.588538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.589266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.609060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] HTTP exception thrown: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. Nov 06 20:52:32.610169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Returning 404 to user: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:32.611252 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ab746b3-460a-46bb-ab88-7ad325434625 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 404 len: 111 microversion: 2.1 time: 0.038291 Nov 06 20:52:32.612229 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 944/1922] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:32 2021] DELETE /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:52:32.621619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:32.622596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] [instance: 8c1c1154-4869-49cb-87aa-799375f3b9f0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:32.629744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.630663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.631583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:32.632133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:32.650206 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] HTTP exception thrown: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. Nov 06 20:52:32.650954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] Returning 404 to user: Instance 8c1c1154-4869-49cb-87aa-799375f3b9f0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:32.651905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05ae6a7e-d808-4ec6-9f73-6a24ec4f4473 tempest-AttachSCSIVolumeTestJSON-294316676 tempest-AttachSCSIVolumeTestJSON-294316676-project] 10.222.0.13 "GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0" status: 404 len: 111 microversion: 2.1 time: 0.035963 Nov 06 20:52:32.652846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 945/1923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:32 2021] GET /compute/v2.1/servers/8c1c1154-4869-49cb-87aa-799375f3b9f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:52:32.849385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:32.866747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e4f1d2e-aa88-4fb7-98ce-c0927da7d5c4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.333281 Nov 06 20:52:32.867562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 979/1924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:32 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:33.099135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:33.100210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.107464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.107916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.108776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.109252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.152970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-708c2916-3823-4985-816d-ff76148ce09c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.057706 Nov 06 20:52:33.154317 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 946/1925] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:33 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:33.238134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:33.239150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.245847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.246383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.247300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.247842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.328714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:33.330007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.338858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.339484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.340334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.340828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.394152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-077faec3-b73a-4faf-901c-85f844b73503 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.070745 Nov 06 20:52:33.394958 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 947/1926] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:33.407690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:33.409095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.421092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.421568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.422483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.423050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.426882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:33.435627 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e22a0a5f-f384-469e-83ab-4739661f1a64 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1535 microversion: 2.1 time: 0.202001 Nov 06 20:52:33.445833 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 980/1927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:33 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1535 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:33.475985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3b483d9-ac50-4702-a4b8-96146f3e0833 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.072505 Nov 06 20:52:33.480246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 948/1928] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:33 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:33.576534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:33.577563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.586404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.587168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.588317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.589136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.739989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:33.748704 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2c734c3-c134-46c9-90c1-b18d5bf731e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.178474 Nov 06 20:52:33.749265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 981/1929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:33 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:33.884788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:33.885741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:33.893799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.894181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:33.895077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:33.895557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.054716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:34.063903 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9cb2a540-3a0c-4d32-8777-205d4de387e2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.183386 Nov 06 20:52:34.074166 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 949/1930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:33 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:34.169344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:34.170812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:34.180284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.180844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.182569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.183227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.232670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de67fa5b-cf5f-48b7-af92-fc942f769348 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.070374 Nov 06 20:52:34.237213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 982/1931] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:34 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:34.367778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1b476e39-a01d-4a41-bf3f-2d5c9be1f22a req-f762f532-aac3-403f-8948-af930ae3a06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67451694-6fbf-4c87-996e-577bf998c9d8", "name": "network-vif-unplugged", "status": "completed", "tag": "3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:34.372029 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:34.372029 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:34.380229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1b476e39-a01d-4a41-bf3f-2d5c9be1f22a req-f762f532-aac3-403f-8948-af930ae3a06c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.381024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1b476e39-a01d-4a41-bf3f-2d5c9be1f22a req-f762f532-aac3-403f-8948-af930ae3a06c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.395356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1b476e39-a01d-4a41-bf3f-2d5c9be1f22a req-f762f532-aac3-403f-8948-af930ae3a06c service nova] Creating event network-vif-unplugged:3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d for instance 67451694-6fbf-4c87-996e-577bf998c9d8 on nch2-master-1 Nov 06 20:52:34.403741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1b476e39-a01d-4a41-bf3f-2d5c9be1f22a req-f762f532-aac3-403f-8948-af930ae3a06c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039876 Nov 06 20:52:34.405003 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 950/1932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:34.407833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:34.409126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:34.421545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.423012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.423533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.423824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.465091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:34.466229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:34.477095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de7cab65-026f-4d52-a61d-ce43deae5b8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.073849 Nov 06 20:52:34.478644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.479260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.481225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.482324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.483484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 983/1933] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:34 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:34.489605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:34.491455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:34.499697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.500240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.501144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.501651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.548524 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-069f2f3a-bb02-45a0-8616-05e36229f70c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.063111 Nov 06 20:52:34.552886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 984/1934] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:34 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:34.671076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:34.680035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9fca303c-53f6-4d8d-8c38-84a32011e0da tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1535 microversion: 2.1 time: 0.229325 Nov 06 20:52:34.680625 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 951/1935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:34 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:34.766428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:34.767783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:34.775253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.775534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.776097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:34.776563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:34.974385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:34.985306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8259045b-62e5-468c-baef-bff245e87f63 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.222473 Nov 06 20:52:34.988795 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 985/1936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:34 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:35.082496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:35.084158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:35.091412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.091954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.092952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.093713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.247512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:35.249295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:35.258755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.260357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.261219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.261666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.265271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:35.274466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32dc3b6f-86c9-4530-a78a-023247731974 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.196332 Nov 06 20:52:35.279610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 952/1937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:35 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:35.309086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2a00baa-a86c-4e8c-a46a-8b75e9ac8722 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.066618 Nov 06 20:52:35.313379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 986/1938] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:35 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:35.491321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:35.493134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:35.501276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.501811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.502604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.503345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.547675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e126cbb7-3b5b-45db-8e65-5ed5f64487b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.060406 Nov 06 20:52:35.548571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 953/1939] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:35 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:35.562921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:35.564077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:35.572737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.585073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.586028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.586487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.655926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f25eb65-5ce6-43a1-a7e5-7842d42efc26 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.097753 Nov 06 20:52:35.657047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 987/1940] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:35 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:35.700838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:35.707789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:35.712729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.713284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.714274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:35.714639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:35.878266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:35.886961 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88c9d0c1-4f16-4108-8769-55274e833021 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1535 microversion: 2.1 time: 0.192425 Nov 06 20:52:35.887878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 954/1941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:35 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1535 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:36.005238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:36.006214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.015196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.016077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.017108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.017615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.291158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:36.291968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.304118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.311801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.312769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.313276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.333806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:36.343507 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-777b83f9-b2a9-42be-bd23-b157a4a348e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.343908 Nov 06 20:52:36.347000 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 988/1942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:35 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:36.355746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:36.359545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.369869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.371835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.374057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.379883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.446023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd35661a-b866-4046-b97f-475ea009cd89 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.096226 Nov 06 20:52:36.448966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 989/1943] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:36 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:36.561686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:36.562978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.578920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.579350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.580240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.588728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.676011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2cb50f9-f9d0-4147-a568-05e82c77aa66 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.119461 Nov 06 20:52:36.681748 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 990/1944] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:36 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:36.688945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a4ce3e8f-0a43-45c8-8c5a-ed61abc28e86 req-3d663eef-5a2d-488a-b8f8-e386cbd8cf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-unplugged", "status": "completed", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:36.689545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:36.691828 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:36.691828 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:36.703383 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e508872-b550-4cb7-9f02-c95405941a6f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.415780 Nov 06 20:52:36.709759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a4ce3e8f-0a43-45c8-8c5a-ed61abc28e86 req-3d663eef-5a2d-488a-b8f8-e386cbd8cf06 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.710214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a4ce3e8f-0a43-45c8-8c5a-ed61abc28e86 req-3d663eef-5a2d-488a-b8f8-e386cbd8cf06 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.717368 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 955/1945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:36 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:36.733954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:36.736545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.739287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a4ce3e8f-0a43-45c8-8c5a-ed61abc28e86 req-3d663eef-5a2d-488a-b8f8-e386cbd8cf06 service nova] Creating event network-vif-unplugged:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:52:36.748346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a4ce3e8f-0a43-45c8-8c5a-ed61abc28e86 req-3d663eef-5a2d-488a-b8f8-e386cbd8cf06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066688 Nov 06 20:52:36.749809 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 991/1946] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:36.756606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.757290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.760883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.761727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.836410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40e97318-5858-4139-8d4f-cf826c41e00e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.112665 Nov 06 20:52:36.839372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 956/1947] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:36 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:36.920118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:36.929284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:36.948537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.949192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:36.951124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:36.952069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.344657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:37.355438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d21b6ac-2de6-4379-9125-32196756f491 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1535 microversion: 2.1 time: 0.451995 Nov 06 20:52:37.360582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 992/1948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:36 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1535 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:37.367037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:37.368253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:37.377730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.378374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.379495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.380159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.460235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:37.461362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:37.473092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.476479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.477878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.478707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.562426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-649a2573-a62f-46bc-bea3-ffeb4ffe41cf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.106042 Nov 06 20:52:37.567483 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 993/1949] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:37 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:37.691806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:37.693371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:37.702284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.703042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.703905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.704585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.755934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5e96888-6b81-4aba-8462-a6fe04621494 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.069344 Nov 06 20:52:37.760793 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 994/1950] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:37 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:37.766503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:37.767552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:37.775793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.776826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:37.778026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:37.778997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.286795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:38.307265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecd555ef-cff3-4da4-aeb2-ff4142edfeee tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.942922 Nov 06 20:52:38.309485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 957/1951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:37 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:38.317247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:38.318788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:38.331485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.332282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.333591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.334276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.399402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e2bff3e1-0ded-45c5-8556-6e5332eed3de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.087631 Nov 06 20:52:38.410265 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 958/1952] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:38 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:38.423719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:38.425938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:38.444941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.445692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.447455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.448282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.458105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:38.467426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b34cf494-751b-473c-ad3a-b61385008063 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.705106 Nov 06 20:52:38.468033 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 995/1953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:37 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:38.583487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:38.586111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:38.602212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.604193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.606581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.607952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.669422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-872f6ee7-2c94-48a5-a8d2-cefd613a64f0 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.095984 Nov 06 20:52:38.673474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 996/1954] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:38 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:38.675706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:38.686499 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43a1f0f9-d534-4ec7-97f0-61c63f08b288 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1528 microversion: 2.1 time: 0.272779 Nov 06 20:52:38.688051 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 959/1955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:38 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:38.708501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:38.709444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:38.722898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.723415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.726476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.727062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.769428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:38.770534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:38.792009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.792854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.815490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.815490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:38.925146 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-609d2f00-7076-45c1-9010-e9f264d3cc13 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.157703 Nov 06 20:52:38.931843 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 960/1956] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:38 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:38.945519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8627cf48-2a60-45d8-8506-072993c0d7ff req-1baea1f2-172b-4bf4-a535-ecf7a4c51768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67451694-6fbf-4c87-996e-577bf998c9d8", "name": "network-vif-plugged", "status": "completed", "tag": "3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:38.950882 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:38.950882 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:38.975803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8627cf48-2a60-45d8-8506-072993c0d7ff req-1baea1f2-172b-4bf4-a535-ecf7a4c51768 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:38.976386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8627cf48-2a60-45d8-8506-072993c0d7ff req-1baea1f2-172b-4bf4-a535-ecf7a4c51768 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:39.013429 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8627cf48-2a60-45d8-8506-072993c0d7ff req-1baea1f2-172b-4bf4-a535-ecf7a4c51768 service nova] Creating event network-vif-plugged:3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d for instance 67451694-6fbf-4c87-996e-577bf998c9d8 on nch2-master-1 Nov 06 20:52:39.026446 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8627cf48-2a60-45d8-8506-072993c0d7ff req-1baea1f2-172b-4bf4-a535-ecf7a4c51768 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087540 Nov 06 20:52:39.027505 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 961/1957] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:39.058903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:39.082395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe79f03b-4b75-40ac-aaef-065aa0636da2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1528 microversion: 2.1 time: 0.377844 Nov 06 20:52:39.083098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 997/1958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:38 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1528 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:39.103004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c58a5606-230f-4dd9-85a7-6c753505e3ec tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:39.106017 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:39.106017 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:39.129637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c58a5606-230f-4dd9-85a7-6c753505e3ec tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] HTTP exception thrown: Flavor 0e57ec4d-4acb-428a-ada1-7e558a737580 could not be found. Nov 06 20:52:39.144522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c58a5606-230f-4dd9-85a7-6c753505e3ec tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Returning 404 to user: Flavor 0e57ec4d-4acb-428a-ada1-7e558a737580 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:39.147180 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c58a5606-230f-4dd9-85a7-6c753505e3ec tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/0e57ec4d-4acb-428a-ada1-7e558a737580" status: 404 len: 109 microversion: 2.1 time: 0.051484 Nov 06 20:52:39.152682 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 962/1959] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:39 2021] DELETE /compute/v2.1/flavors/0e57ec4d-4acb-428a-ada1-7e558a737580 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:52:39.334954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:39.338664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1016991234", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:39.342256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:39.375306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:39.376210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:39.382042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:39.382797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:39.509464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:39.916442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:39.935287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3669aeb9-04eb-427b-9da1-05b1ca3ca75a tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.614138 Nov 06 20:52:39.937455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 998/1960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:39 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:39.949056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:39.951302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:39.962327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:39.963143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:39.965798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:39.966485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.050278 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2211b94-0ef5-485f-a9c5-659169c1c968 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.111006 Nov 06 20:52:40.051792 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 999/1961] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:39 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:40.064142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:40.066199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:40.076053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.077918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.078995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.079821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.154048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:52:40.154304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:52:40.154879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:52:40.155565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:52:40.156326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:52:40.176174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.177272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.178445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.179308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.208932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:40.217155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Getting quotas for user 3ffff819b4c04c92a90993dcd4fa39c9 and project acfc5ca1083f4131b1da0e5689218590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:40.235089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:52:40.238399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:52:40.307499 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb151bd9-25da-4d4f-b5e5-6156de87e047 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978197 Nov 06 20:52:40.308931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 963/1962] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:52:40.314735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:40.316116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:40.326708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.327564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.328896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.345710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.396018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61a58836-d6da-4269-abc4-366b289c0479 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.085297 Nov 06 20:52:40.396781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 964/1963] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:40 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:40.410908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:40.412770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:40.417732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:40.421833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.422413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.423381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.423997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.427243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a41e8e5a-53d2-437a-b90f-5478cedc1118 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1523 microversion: 2.1 time: 0.373848 Nov 06 20:52:40.428680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1000/1964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:40 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:40.435642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c23df192-5c5f-4087-af41-cd09f6228af8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:40.436714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c23df192-5c5f-4087-af41-cd09f6228af8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:40.485728 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad0544fe-832f-467e-a072-1aa31223fa4f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.087106 Nov 06 20:52:40.486303 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 965/1965] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:40 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:40.547929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c23df192-5c5f-4087-af41-cd09f6228af8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:40.559153 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c23df192-5c5f-4087-af41-cd09f6228af8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1213 microversion: 2.1 time: 0.129295 Nov 06 20:52:40.560502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1001/1966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:40 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:40.956375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:40.958010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:40.975611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.976078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:40.976953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:40.977397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.046664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-36458efb-7762-468d-a35d-73017380f128 req-53ff9778-e715-4706-ad19-8a0fb7e5b009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628d735-8393-4d0e-9126-37ca09231b4e", "name": "network-vif-plugged", "status": "completed", "tag": "41a8c318-4f4a-48fc-80b1-233aca022d86"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:41.049291 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:41.049291 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:41.079368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-36458efb-7762-468d-a35d-73017380f128 req-53ff9778-e715-4706-ad19-8a0fb7e5b009 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.080197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-36458efb-7762-468d-a35d-73017380f128 req-53ff9778-e715-4706-ad19-8a0fb7e5b009 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.098357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-36458efb-7762-468d-a35d-73017380f128 req-53ff9778-e715-4706-ad19-8a0fb7e5b009 service nova] Creating event network-vif-plugged:41a8c318-4f4a-48fc-80b1-233aca022d86 for instance b628d735-8393-4d0e-9126-37ca09231b4e on nch2-master-1 Nov 06 20:52:41.105030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-36458efb-7762-468d-a35d-73017380f128 req-53ff9778-e715-4706-ad19-8a0fb7e5b009 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063058 Nov 06 20:52:41.106405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1002/1967] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:41.114227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:41.115633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.125164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.125910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.127207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.127849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.195050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d513418c-5370-483a-9e3a-7e88ccdbe684 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.086314 Nov 06 20:52:41.196410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1003/1968] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:41 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:41.308695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:41.325887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f3619165-2b51-4349-8dbb-fdb063dc2dff tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.375466 Nov 06 20:52:41.336754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 966/1969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:40 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:41.409555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:41.410877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.427633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.428994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.431322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.431954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.447948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:41.449285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.460071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.465058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.466401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.467705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.502754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1df34a2d-938b-4f7f-8593-2ef15f1d7151 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.097140 Nov 06 20:52:41.516206 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1004/1970] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:41 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:41.527291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:41.528396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.550481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.550993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.551876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.552341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.631362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c052b58-9992-4928-8d78-203ec7045d9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.113582 Nov 06 20:52:41.632394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1005/1971] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:41.640224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:41.640971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.659508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.659932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.670431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.671232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.825481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:41.838817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-850be435-d62d-4c9a-9332-390ab76ab7a3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1265 microversion: 2.1 time: 0.204421 Nov 06 20:52:41.839822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:41.841243 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1006/1972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:41 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:41.860812 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c115da7b-52b2-46ed-9c14-6f6f9d1e3c70 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1508 microversion: 2.1 time: 0.416842 Nov 06 20:52:41.861618 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 967/1973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:41 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1508 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:41.883472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:41.885846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:41.894719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.896005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:41.897325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:41.898018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.140996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:42.161604 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91ddba09-b89c-4b19-a5e9-93a9cf232e77 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 200 len: 1508 microversion: 2.1 time: 0.282170 Nov 06 20:52:42.162227 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1007/1974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:41 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:42.183217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:42.183716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:42.193767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.194690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.196221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.197336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.212835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:42.215082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:42.233859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.236541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.238403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.240230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.286550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:52:42.326461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41aeb0a1-e506-4a36-8542-6eb93c63315f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.118882 Nov 06 20:52:42.327093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1008/1975] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:42 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:42.449159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac07c127-ffec-425c-9d3d-da5f1951f4bf tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 204 len: 0 microversion: 2.1 time: 0.270833 Nov 06 20:52:42.450065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 968/1976] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:52:42 2021] DELETE /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:52:42.456452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:42.460073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:42.486290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.487217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.489765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:42.491126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:42.621660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1779752541", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "4977b10a-52c3-4541-8eac-7469838a901a"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:42.716196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] validate_networks() for [('4977b10a-52c3-4541-8eac-7469838a901a', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:42.994520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:43.004801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16c8a122-22b2-47b0-9280-b4a0c37f7545 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1314 microversion: 2.1 time: 0.553384 Nov 06 20:52:43.005714 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 969/1977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:42 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:43.011735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:43.022245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:43.034018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.034500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.035372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.035920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.094402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b032ae0-5c65-42fa-8b41-ac2277849924 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.086072 Nov 06 20:52:43.095517 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 970/1978] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:43 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:43.101442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:43.102862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:43.111421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.111931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.113126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.113734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.186442 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e836c3e7-41a4-42b8-a272-701346c06113 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.088871 Nov 06 20:52:43.191283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 971/1979] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:43 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:43.208186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1719344328", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0e936355-eba9-4975-b6c7-019db9b3e654"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:43.307474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] validate_networks() for [('0e936355-eba9-4975-b6c7-019db9b3e654', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:43.533152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:52:43.533833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:52:43.534132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:52:43.534543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:52:43.534986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:52:43.556016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.556592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.557581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.558295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.590095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Getting quotas for project ab356678a1cc48d59b2b4e124f51db4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:43.600613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Getting quotas for user d06d6aff4a4e47d080bfbeebb2aee0ca and project ab356678a1cc48d59b2b4e124f51db4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:43.621019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:52:43.623836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:52:43.698384 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8cc5c1c-767d-4c66-b72c-adbdda94e626 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369458 Nov 06 20:52:43.707387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1009/1980] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:52:43.718661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:43.725367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:43.737852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.738307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:43.739120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:43.741860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.307992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:52:44.308603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:52:44.309338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:52:44.310141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:52:44.310941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:52:44.316556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:44.329317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.330675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.332243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.332961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.333408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1da3b63e-59a6-4bf3-b0ea-61b2f595cfdc tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.623057 Nov 06 20:52:44.339829 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1010/1981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:43 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:44.358183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1b0706e2-07ed-4ce7-a68a-7515f80836fb req-34367005-9b6c-409a-ac4d-6e261a5de454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-plugged", "status": "completed", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:44.364254 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:44.364254 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:44.365185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:44.374902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Getting quotas for user 251bfed29e8e448792810993d5d8742e and project 868bef14d4704704a6e56e88a220cc66. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:44.375583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b0706e2-07ed-4ce7-a68a-7515f80836fb req-34367005-9b6c-409a-ac4d-6e261a5de454 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.376264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b0706e2-07ed-4ce7-a68a-7515f80836fb req-34367005-9b6c-409a-ac4d-6e261a5de454 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.394716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:52:44.399554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:52:44.401204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1b0706e2-07ed-4ce7-a68a-7515f80836fb req-34367005-9b6c-409a-ac4d-6e261a5de454 service nova] Creating event network-vif-plugged:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:52:44.408437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1b0706e2-07ed-4ce7-a68a-7515f80836fb req-34367005-9b6c-409a-ac4d-6e261a5de454 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066699 Nov 06 20:52:44.411098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1011/1982] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:44.434508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:44.440395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:44.448597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.449413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.450659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.451414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.489789 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bb18275-5caa-4b76-b05d-7439ad12f2d2 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296966 Nov 06 20:52:44.490902 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 972/1983] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:52:44.502677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:44.503462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:44.511009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.511642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.512632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.513247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.612982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45c61be6-fe43-494e-8a14-bfb0ce0627b7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.182423 Nov 06 20:52:44.616741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1012/1984] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:44 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:44.624770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:44.625544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:44.651894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.657593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.658543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.659093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.731603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:44.744084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ced32ec-0eef-4a8a-92ac-89fbae64897b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1216 microversion: 2.1 time: 0.243740 Nov 06 20:52:44.748794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 973/1985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:44 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1216 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:44.756503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:44.758651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:44.767076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.767934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.768950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.769699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.830859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74c903a8-742c-4548-b096-1bd11a2b3317 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.080721 Nov 06 20:52:44.834268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 974/1986] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:44 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:44.849087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:44.852518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:44.872180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.872663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.876200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:44.876711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:44.955486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f21c7d6d-5ae7-4397-8cdb-6f66bf16500a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.118129 Nov 06 20:52:44.957198 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 975/1987] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:44 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:44.967093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6421fe81-23cf-44da-89e9-e1bd01f5b096 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:44.969019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6421fe81-23cf-44da-89e9-e1bd01f5b096 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:45.138082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6421fe81-23cf-44da-89e9-e1bd01f5b096 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:45.147112 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6421fe81-23cf-44da-89e9-e1bd01f5b096 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1218 microversion: 2.1 time: 0.188312 Nov 06 20:52:45.153197 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 976/1988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:44 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:45.203379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1f04e2c1-a0c4-44bb-8c74-866f7c1d4775 req-1ef95061-52e6-49b1-bf02-e44b49aa4faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67451694-6fbf-4c87-996e-577bf998c9d8", "name": "network-vif-deleted", "tag": "3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:45.206121 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:45.206121 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:45.218965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1f04e2c1-a0c4-44bb-8c74-866f7c1d4775 req-1ef95061-52e6-49b1-bf02-e44b49aa4faa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.219645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1f04e2c1-a0c4-44bb-8c74-866f7c1d4775 req-1ef95061-52e6-49b1-bf02-e44b49aa4faa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.240435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1f04e2c1-a0c4-44bb-8c74-866f7c1d4775 req-1ef95061-52e6-49b1-bf02-e44b49aa4faa service nova] Creating event network-vif-deleted:3dc8c3e7-10dc-42f8-aaa1-c2eeaf91d60d for instance 67451694-6fbf-4c87-996e-577bf998c9d8 on nch2-master-1 Nov 06 20:52:45.256950 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1f04e2c1-a0c4-44bb-8c74-866f7c1d4775 req-1ef95061-52e6-49b1-bf02-e44b49aa4faa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057507 Nov 06 20:52:45.260052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 977/1989] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:45.364663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:45.367413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:45.367588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:45.384938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fca36041-f74d-41b9-b058-0fd35c8a24b7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1502 microversion: 2.1 time: 0.764329 Nov 06 20:52:45.385686 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1013/1990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:44 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1502 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:45.392263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.393035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.395205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.396794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.405922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5cd2d303-aa31-4f88-b074-f88f7d17c02d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:45.425228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd2d303-aa31-4f88-b074-f88f7d17c02d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.425692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd2d303-aa31-4f88-b074-f88f7d17c02d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.617069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5cd2d303-aa31-4f88-b074-f88f7d17c02d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 20:52:45.729159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5cd2d303-aa31-4f88-b074-f88f7d17c02d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e/action" status: 202 len: 0 microversion: 2.1 time: 0.329661 Nov 06 20:52:45.730675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1014/1991] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:45 2021] POST /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:45.740823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:45.744708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:45.761689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.762624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.763670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.764821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.846418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6b1cae2-7419-4b13-a2a4-22c8f1ab1f4c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.112112 Nov 06 20:52:45.854040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1015/1992] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:45 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:45.866945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:45.870985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:45.895555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.896533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:45.897614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:45.900005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.275166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:46.280676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:46.293224 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d86bc3f-66d9-4a0d-8d0e-c9155321b0e4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.437472 Nov 06 20:52:46.296911 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3984c70e-98ec-4e32-a6ce-b88bd57f11c9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.946880 Nov 06 20:52:46.297894 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 978/1993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:45 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:46.302515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1016/1994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:45 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:46.312414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:46.313036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:46.331455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:46.332439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:46.334035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.334779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.335876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.337318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.344532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.345264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.345867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.349606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.420599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b95e2c6-576f-49d6-9ebf-ec610f504a76 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.116541 Nov 06 20:52:46.421244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1017/1995] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:46 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:46.433258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:46.434777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:46.458869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.460322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.463689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.466095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.612012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e357ec33-758c-4a08-aac4-a939f363eb6a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.189059 Nov 06 20:52:46.613274 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1018/1996] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:46 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:46.627852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:46.630777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:46.647779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:46.664813 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-586cc524-b9d8-49ab-bf22-056bde41576e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1270 microversion: 2.1 time: 0.363062 Nov 06 20:52:46.666260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.667082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.668303 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 979/1997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:46 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:46.668942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.669351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.799753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:46.810567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e430b12-5b89-42c1-b64d-0203e76a940b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1276 microversion: 2.1 time: 0.195649 Nov 06 20:52:46.815628 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1019/1998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:46 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:46.870427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:46.877721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:46.890765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.891650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.894860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:46.895572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:46.991230 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20ee969a-5027-4b4c-b088-4bc47d3db53d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.134786 Nov 06 20:52:46.992617 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 980/1999] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:46 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:47.156258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f9723940-2a21-4c09-af17-31b9b067c647 req-fb0ea8a1-82dd-43e6-81b8-747d691ad6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:47.156258 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:47.156258 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:47.170701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f9723940-2a21-4c09-af17-31b9b067c647 req-fb0ea8a1-82dd-43e6-81b8-747d691ad6f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.171149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f9723940-2a21-4c09-af17-31b9b067c647 req-fb0ea8a1-82dd-43e6-81b8-747d691ad6f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.192892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f9723940-2a21-4c09-af17-31b9b067c647 req-fb0ea8a1-82dd-43e6-81b8-747d691ad6f7 service nova] Creating event network-changed:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:52:47.197790 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f9723940-2a21-4c09-af17-31b9b067c647 req-fb0ea8a1-82dd-43e6-81b8-747d691ad6f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053509 Nov 06 20:52:47.199023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1020/2000] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:47.313291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:47.314402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:47.321335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:47.322044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:47.323991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.326135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.327065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.327737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.341095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.341642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.342409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.342848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.810753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:47.820802 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7211397f-a50e-4f32-9b6b-76c7e06d52c7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.512636 Nov 06 20:52:47.822115 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 981/2001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:47 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:47.827396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:47.828920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:47.839830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.843790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.844950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.845374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.904872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:47.922976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fefd5f6-92b4-4989-a468-bbb04a8eab27 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.606491 Nov 06 20:52:47.923198 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-387819d7-e828-4d0f-8960-ea8f2e2d6fb1 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.098637 Nov 06 20:52:47.925494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1021/2002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:47 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:47.927942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 982/2003] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:47 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:47.935330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:47.937615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:47.939945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:47.940971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:47.945679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.947719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.948665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.949333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.949915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.950544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:47.952227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:47.952868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.008768 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f00a0996-8d02-4aea-b36e-3962f8375eb4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.081008 Nov 06 20:52:48.011220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1022/2004] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:47 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:48.017493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:48.018427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:48.025860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.026487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.027334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.027882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.540761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:48.548875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:48.549552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a92d1ebb-3909-4f70-aeb6-f3bd89c0fe54 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.535998 Nov 06 20:52:48.550647 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1023/2005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:48 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:48.558125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:48.559327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:48.560612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ef259e8-1853-4606-9235-b0d6493cacbd tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.630882 Nov 06 20:52:48.561886 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 983/2006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:47 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:48.566579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-fb14ac5a-5ab1-48e7-aac1-68d6d53e5754 req-dfa49286-a85d-409d-bfe0-77b2c12bc85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d35112d-0d16-4351-abe6-64e3a92429a4", "tag": "bdacc087-627b-41dd-85c3-6084a1263f07"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:48.568430 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:48.568430 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:48.575947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.576688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.577680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.578275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.579684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fb14ac5a-5ab1-48e7-aac1-68d6d53e5754 req-dfa49286-a85d-409d-bfe0-77b2c12bc85f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.580136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fb14ac5a-5ab1-48e7-aac1-68d6d53e5754 req-dfa49286-a85d-409d-bfe0-77b2c12bc85f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.591488 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fb14ac5a-5ab1-48e7-aac1-68d6d53e5754 req-dfa49286-a85d-409d-bfe0-77b2c12bc85f service nova] Creating event network-changed:bdacc087-627b-41dd-85c3-6084a1263f07 for instance 6d35112d-0d16-4351-abe6-64e3a92429a4 on nch2-master-1 Nov 06 20:52:48.596698 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-fb14ac5a-5ab1-48e7-aac1-68d6d53e5754 req-dfa49286-a85d-409d-bfe0-77b2c12bc85f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033358 Nov 06 20:52:48.597644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 984/2007] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:48.635221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36a0e634-0226-4d71-86a9-5055ffcf3b05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.081908 Nov 06 20:52:48.637101 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1024/2008] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:48 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:48.840564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:48.841376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:48.847787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.848258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.849092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.849752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.938656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:48.939677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:48.948605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.948605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:48.948605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:48.958866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.006023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f499041f-7b88-466e-b64c-b36af52b967d tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.071286 Nov 06 20:52:49.010099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1025/2009] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:48 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:49.018975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:49.019689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:49.027145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.027602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.028628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.029228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.356262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:49.387011 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6be3c568-5190-4303-942a-a33a51ccf6d0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.550352 Nov 06 20:52:49.390069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 985/2010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:48 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:49.396726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:49.397912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:49.407886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.408843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.410454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.411394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.439142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:49.450798 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c52d7875-36ad-463d-8593-dbe240efcc33 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.438978 Nov 06 20:52:49.466283 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1026/2011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:49 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:49.481532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8fdb6cf7-5e97-46ab-b8bc-752e54e68d89 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.089437 Nov 06 20:52:49.482532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 986/2012] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:49 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:49.569309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:49.569739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:49.584388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.586503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.589523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:49.590967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.591874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:49.592357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.610240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.621086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.622331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.622626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.953749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:49.965690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c05c306b-fd9b-4286-a96d-62421d4b754b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.389138 Nov 06 20:52:49.966395 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 987/2013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:49 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:49.971846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:49.973100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:49.976208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:49.979924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.980547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.981454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:49.982168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:49.986399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c2220f6-82bb-4629-b6e2-1c0be0c4acc6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.422951 Nov 06 20:52:49.996642 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1027/2014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:49 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:50.032930 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-742f881f-b90b-49f3-aa6a-91608babe557 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.064858 Nov 06 20:52:50.033667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 988/2015] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:49 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:50.039569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:50.041381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:50.049187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.049646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.050623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.051254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.123160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5339a420-8c02-4ddc-8bd9-992c2b5c242a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.087519 Nov 06 20:52:50.127999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 989/2016] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:50 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:50.129431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-68a53b98-ba12-4a8a-a512-8165c98e32ea req-e23c79cd-9347-45f8-bbaf-806f1fab57ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4416b1b3-e45b-4838-be39-97e8cd950f80", "tag": "5b059de9-c748-4922-9c2e-f3b8afbefb51"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:50.130997 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:50.130997 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:50.139966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-68a53b98-ba12-4a8a-a512-8165c98e32ea req-e23c79cd-9347-45f8-bbaf-806f1fab57ae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.140576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-68a53b98-ba12-4a8a-a512-8165c98e32ea req-e23c79cd-9347-45f8-bbaf-806f1fab57ae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.141573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61ad47c4-fe9e-4258-9a25-7a833b9c664e tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:50.149968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61ad47c4-fe9e-4258-9a25-7a833b9c664e tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.151937 Nov 06 20:52:50.150700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1028/2017] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:52:49 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:50.167619 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-68a53b98-ba12-4a8a-a512-8165c98e32ea req-e23c79cd-9347-45f8-bbaf-806f1fab57ae service nova] Creating event network-changed:5b059de9-c748-4922-9c2e-f3b8afbefb51 for instance 4416b1b3-e45b-4838-be39-97e8cd950f80 on nch2-master-1 Nov 06 20:52:50.174579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-68a53b98-ba12-4a8a-a512-8165c98e32ea req-e23c79cd-9347-45f8-bbaf-806f1fab57ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049196 Nov 06 20:52:50.175360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 990/2018] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:50.405848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:50.406783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:50.414237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.415719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.416630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.417121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.471739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:50.472505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:50.480366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.480936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.481841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.482386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.759905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:50.767316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca21f79d-94c4-4d0c-a54a-ff7a14d5358b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.365178 Nov 06 20:52:50.767884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1029/2019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:50 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:50.782676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:50.783882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:50.784520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:50.791037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.791485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.792272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.792738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.794016 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d203c23f-7042-4cd9-a8d2-6d5d14055275 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.327707 Nov 06 20:52:50.794601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 991/2020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:50 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:50.799207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea45aa6b-2431-4c6f-b02c-cfed2253b988 tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1373865416", "imageRef": "2bdf81c4-acd2-47ce-b1c9-a7c2751f6949", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:50.848881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c10eec39-ef49-4ae3-97f4-1c5cb3c7365f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 24574 microversion: 2.42 time: 0.068652 Nov 06 20:52:50.850391 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1030/2021] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:50 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:50.851106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-ea45aa6b-2431-4c6f-b02c-cfed2253b988 tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:50.983564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:50.984265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:50.991151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.991802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:50.992619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:50.993094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.184821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ea45aa6b-2431-4c6f-b02c-cfed2253b988 tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 06 20:52:51.185494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea45aa6b-2431-4c6f-b02c-cfed2253b988 tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:52:51.186333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea45aa6b-2431-4c6f-b02c-cfed2253b988 tempest-FlavorsV2NegativeTest-192525247 tempest-FlavorsV2NegativeTest-192525247-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.390677 Nov 06 20:52:51.186894 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 992/2022] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:50 2021] POST /compute/v2.1/servers => generated 93 bytes in 392 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 20:52:51.192119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:51.192834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:51.199759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.200496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.201732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.202476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.241687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:51.250383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a4334d4-3131-4ad7-8c94-bfab2413e2f0 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.270738 Nov 06 20:52:51.251210 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1031/2023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:50 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:51.264538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:51.265609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:51.272549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.273234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.274919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.275448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.345033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa310850-a2dd-492b-8483-9a9ad07e8439 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.092367 Nov 06 20:52:51.349426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1032/2024] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:51 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:51.354934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:51.356375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:51.367347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.367798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.368655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.369252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.420855 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1243f378-a50e-406a-ab6c-6253cd8afa80 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.072888 Nov 06 20:52:51.428587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1033/2025] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:51 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:51.431050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:51.438924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6a1d9b0-c58f-4b1e-83ec-a0ce452b08eb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.250810 Nov 06 20:52:51.439483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 993/2026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:51 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:51.784571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:51.785275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:51.792519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.792968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.793966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.794188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.811320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:51.812094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:51.819200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.819925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:51.821133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:51.822277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.045885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:52.052272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:52.053428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d58ba6f3-0216-41aa-ae49-f7814bafa696 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.273056 Nov 06 20:52:52.053994 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1034/2027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:51 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:52.060264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:52.061202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:52.061898 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-168bbc06-f45b-4631-866e-ba1eb0afcf26 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.254114 Nov 06 20:52:52.062463 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 994/2028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:51 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:52.068336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.068787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.069797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.070231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.135158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2134185-8e42-4f4a-be1c-4baeffbe3f19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.079659 Nov 06 20:52:52.136736 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1035/2029] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:52 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:52.267066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:52.268548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:52.275317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.276096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.277030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.277540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.358733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:52.359777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:52.367505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.367996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.368854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.369301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.419537 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77abb4b0-2f0d-4ca3-907b-d75e0968bf49 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.065406 Nov 06 20:52:52.420431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1036/2030] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:52 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:52.421360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:52.428863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9781a228-df53-4771-aa31-c95f79f16d6f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.165396 Nov 06 20:52:52.429505 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 995/2031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:52 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:52.439011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:52.440011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:52.447081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.447532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.448359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.448799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.457231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:52.459463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:52.466351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.466823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.467663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:52.468369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:52.504231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56e46a74-48f1-44d4-a436-6864f0b99f6a tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.074921 Nov 06 20:52:52.505156 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1037/2032] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:52 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:52.612336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:52.619675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb682446-d942-4f9d-b3aa-ccfea88c47ff tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.167365 Nov 06 20:52:52.620333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 996/2033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:52 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:53.073755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:53.074500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.078798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:53.079516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.081405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.082624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.082949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.083479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.087722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.088802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.090148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.090486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.294240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:53.297134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:53.304512 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09af53b9-ad13-4d00-93e7-7c8844423f0b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.236534 Nov 06 20:52:53.305100 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1038/2034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:53 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:53.310602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:53.311663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.314949 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b37b059-6eff-4b56-a7ef-97d9c93956c5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.240205 Nov 06 20:52:53.315887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 997/2035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:53 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:53.318410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.318861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.319655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.320088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.365688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38e704e9-390d-4f1c-93ba-1ec3e5b1ff02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.059165 Nov 06 20:52:53.370314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1039/2036] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:53 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:53.431377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:53.432996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.439396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.440058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.441052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.441491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.446380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:53.447455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.454864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.455709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.456873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.457610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.489008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b39c15b-bab4-4404-bd80-36ff9d2f2b88 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.061015 Nov 06 20:52:53.490459 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 998/2037] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:53 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:53.517458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:53.518491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.526122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.526914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.527855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.528802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.590786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ac22a64-8e11-4de3-987c-d251ee6851e3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.076696 Nov 06 20:52:53.592069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 999/2038] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:53 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:52:53.615780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:53.628812 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d34ecaee-dc1d-400d-b1ad-9d3d5b69d0bb tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.186663 Nov 06 20:52:53.629740 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1040/2039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:53 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:53.639209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:53.639918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:53.646861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.647236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.648208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:53.648808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:53.799641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:53.807715 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50d92bfc-ca4b-4427-909d-56a1ef94cf4c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.172566 Nov 06 20:52:53.808283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1000/2040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:53 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:53.907165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-391694015", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8fbc16c6-4a6c-4b93-987f-9643b3a1da7e"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:53.959119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] validate_networks() for [('8fbc16c6-4a6c-4b93-987f-9643b3a1da7e', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:52:54.304580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:52:54.305198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:52:54.306075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:52:54.306518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:52:54.306928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:52:54.316458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.317283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.318097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.318610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.322944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:54.323730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.336148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:52:54.339276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.339836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.340734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for user 8b1ffd89193f4eb1b796c374eb2d26bf and project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:52:54.340885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.341329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.351547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:52:54.353928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:52:54.398307 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1121374-f2be-48ee-8305-cd8b58e658ee tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612250 Nov 06 20:52:54.404474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1041/2041] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:52:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:52:54.404474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:54.404742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.411954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.412681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.413757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.414626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.527042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:54.537785 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8f73c73-eacf-46dd-8b4b-f4068644dec0 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.219473 Nov 06 20:52:54.548425 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1001/2042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:54 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:54.553935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:54.554935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.561642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.562099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.562887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.563325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.587391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:54.594955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1655be7a-af6d-498b-a937-0ff20dc0b46a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.194678 Nov 06 20:52:54.595573 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1042/2043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:54 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:54.600784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1cd260b8-4a2b-4ef0-8308-73b9e66fe3fb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:54.601417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1cd260b8-4a2b-4ef0-8308-73b9e66fe3fb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.610690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a982153-a62b-4222-aeb8-8c462d1404de tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.060588 Nov 06 20:52:54.614924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1002/2044] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:54 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:54.619013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:54.620879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.629644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.630458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.631426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.631905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.659284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1cd260b8-4a2b-4ef0-8308-73b9e66fe3fb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:54.666492 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1cd260b8-4a2b-4ef0-8308-73b9e66fe3fb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1207 microversion: 2.1 time: 0.069874 Nov 06 20:52:54.667111 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1043/2045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:54 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:54.671747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:54.672807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.678660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.679108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.679889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.680532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.681636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd4f3dd3-de37-403c-a435-c813e7fe84b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.068152 Nov 06 20:52:54.682926 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1003/2046] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:54 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:54.688476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:54.689578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.695794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.696514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.697258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.698287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.730351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0871871-655e-40df-b992-d0aa08260619 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.061428 Nov 06 20:52:54.734515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1044/2047] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:54 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:54.827702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:54.828677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:54.838310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.838791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.839612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:54.840263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:54.849380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:54.857443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3aa9203f-5c31-48c3-8dc9-44753d32929b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.173124 Nov 06 20:52:54.867279 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1004/2048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:54 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:54.996739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:55.004086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9504df84-2b60-4621-bd66-1c261cbcbaca tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.182606 Nov 06 20:52:55.004681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1045/2049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:54 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:55.555008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:55.556283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.562430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.562926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.563715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.564161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.613137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:55.614312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.621431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.621927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.622823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.623561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.857334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:55.865815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-872a3820-b7d7-42d5-afbd-202402b9a87d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.314555 Nov 06 20:52:55.866536 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1005/2050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:55 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:55.871415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:55.872346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.878795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:55.886744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c1a7c3d-74f2-431f-be98-2dcf967cf3b4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.277280 Nov 06 20:52:55.886908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.887209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.887644 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1046/2051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:55 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:55.892228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:55.892924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.896921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.897468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.899112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.899751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.901407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.902015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.953751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d976f92-e27b-4b4a-b6ba-b4b0f117f484 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.085510 Nov 06 20:52:55.958311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1006/2052] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:55 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:55.960322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:55.961291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.968898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.969359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.970153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.970595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.975177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:55.981980 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-06e8d425-2e3e-411b-9929-ed8a925158c8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1265 microversion: 2.1 time: 0.093074 Nov 06 20:52:55.982839 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1047/2053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:55 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:55.987200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:55.988134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:55.996104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.996582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:55.998209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:55.998646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.013260 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a84b8cc2-d9cb-4946-b7c1-981f4544f338 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.056633 Nov 06 20:52:56.014909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1007/2054] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:55 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:56.020655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:56.021582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:56.029649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.030247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.030881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.031800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.044583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ac904ca-c198-4f81-bad8-52092c47a06b tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.060559 Nov 06 20:52:56.046478 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1048/2055] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:55 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:56.052376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:56.053436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:56.061348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.061817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.062603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.063064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.353310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:56.361253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:56.370509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f94888b-bf3d-4395-8ab6-93277887438f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.352691 Nov 06 20:52:56.370509 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1008/2056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:56 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:56.373029 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd678b8c-0bd8-4a34-a9f8-63f088ccec0e tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.325257 Nov 06 20:52:56.380732 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1049/2057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:56 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:56.405641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b0e2ad9e-dbe4-4b7a-a11b-311f6498c277 req-5b6679e6-4849-4622-86c8-efcdeb855ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-plugged", "status": "completed", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:56.407056 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:56.407056 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:56.419580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b0e2ad9e-dbe4-4b7a-a11b-311f6498c277 req-5b6679e6-4849-4622-86c8-efcdeb855ef2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.420237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b0e2ad9e-dbe4-4b7a-a11b-311f6498c277 req-5b6679e6-4849-4622-86c8-efcdeb855ef2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.435983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b0e2ad9e-dbe4-4b7a-a11b-311f6498c277 req-5b6679e6-4849-4622-86c8-efcdeb855ef2 service nova] Creating event network-vif-plugged:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:52:56.442741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b0e2ad9e-dbe4-4b7a-a11b-311f6498c277 req-5b6679e6-4849-4622-86c8-efcdeb855ef2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041849 Nov 06 20:52:56.443604 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1009/2058] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:56.882620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:56.883232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:56.890922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.890922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.891619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.892133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.905853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:56.906867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:56.913148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.913691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:56.914807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:56.915365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.234302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:57.239902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:57.243040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ead021e7-d625-419e-b40f-0729ba0091fe tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.363809 Nov 06 20:52:57.243618 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1050/2059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:56 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:57.249715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:57.250688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.254242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08dc6f09-c584-40bb-9c0e-541661ae3a3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.354691 Nov 06 20:52:57.264129 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1010/2060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:56 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:57.264555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.264555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.264555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.264555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.265154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:57.265154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.270881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.271314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.272467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.272900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.306240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04a08136-71bf-4498-9a6a-49798ddbbd02 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.060183 Nov 06 20:52:57.307108 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1051/2061] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:57 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:57.312684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:57.313883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.320997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.321453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.322819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.323257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.373519 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-490000ac-4217-4e0c-ac65-58379c2a57dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.064899 Nov 06 20:52:57.379372 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1052/2062] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:57 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:57.381258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:57.381258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.388869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.389320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.390114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.390546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.433602 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74214cea-6dab-451f-9953-dcd7b01907a5 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.057389 Nov 06 20:52:57.437935 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1053/2063] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:57 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:57.442332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:57.443354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.452812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.453325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.454240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.454694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.535509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:57.544756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a926050-f671-4093-bc2a-755a3025b666 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.288758 Nov 06 20:52:57.545775 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1011/2064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:57 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:57.555048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:57.555048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:57.557406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.557852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.558631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.559058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.735876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:57.745539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fe78c13-2fb0-44f6-aed8-caa23960216b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.309945 Nov 06 20:52:57.746151 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1054/2065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:57 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:57.750649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7b895e32-9d44-446c-acd0-07ba313b258e req-59b4994a-6c13-4239-8237-d13f65a54067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fbee84-0888-474a-a089-36a96efd162d", "tag": "9d0eeba9-6ff4-48d8-9007-9e377ba11bbf"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:57.752133 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:57.752133 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:52:57.762074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7b895e32-9d44-446c-acd0-07ba313b258e req-59b4994a-6c13-4239-8237-d13f65a54067 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:57.762880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7b895e32-9d44-446c-acd0-07ba313b258e req-59b4994a-6c13-4239-8237-d13f65a54067 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:57.775545 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7b895e32-9d44-446c-acd0-07ba313b258e req-59b4994a-6c13-4239-8237-d13f65a54067 service nova] Creating event network-changed:9d0eeba9-6ff4-48d8-9007-9e377ba11bbf for instance a2fbee84-0888-474a-a089-36a96efd162d on nch2-master-1 Nov 06 20:52:57.781724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7b895e32-9d44-446c-acd0-07ba313b258e req-59b4994a-6c13-4239-8237-d13f65a54067 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034189 Nov 06 20:52:57.782322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1055/2066] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:57.865413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:57.876660 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0dba63e1-4c32-4596-85ff-43a9b254df92 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.329713 Nov 06 20:52:57.886799 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1012/2067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:57 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:58.261555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:58.262396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.273227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.274091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.275158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.276272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.278679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:58.280173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.288008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.288939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.290465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.291745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.595023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:58.601704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:58.605930 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c17d0640-44ae-4df8-b835-7ed507a0947f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.349316 Nov 06 20:52:58.606736 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1056/2068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:58 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:58.611213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:58.612111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.617844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.618292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.618908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0dfc4c00-a101-485b-b2c6-efa9e530a33b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1313 microversion: 2.1 time: 0.347451 Nov 06 20:52:58.619125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.619517 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1013/2069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:58 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:58.619683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.624851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:58.626120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.632857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.633598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.634657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.635971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.674125 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef821070-3818-485e-8c2f-58b8857223c3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 32590 microversion: 2.42 time: 0.066144 Nov 06 20:52:58.678160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1057/2070] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:58 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 32590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:58.680355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:58.681476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.688848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.689303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.690101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.690535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.692073 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af1d9485-6037-40e5-bb50-988b007fd32a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.071157 Nov 06 20:52:58.697964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1014/2071] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:58 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:58.704336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6637bc7b-c5be-47f5-991d-151c1fd2d727 req-be36a927-ee25-493c-bdaa-eb193dbbdd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d35112d-0d16-4351-abe6-64e3a92429a4", "name": "network-vif-plugged", "status": "completed", "tag": "bdacc087-627b-41dd-85c3-6084a1263f07"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:58.705986 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:52:58.705986 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:52:58.714467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6637bc7b-c5be-47f5-991d-151c1fd2d727 req-be36a927-ee25-493c-bdaa-eb193dbbdd92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.715058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6637bc7b-c5be-47f5-991d-151c1fd2d727 req-be36a927-ee25-493c-bdaa-eb193dbbdd92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.727436 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6637bc7b-c5be-47f5-991d-151c1fd2d727 req-be36a927-ee25-493c-bdaa-eb193dbbdd92 service nova] Creating event network-vif-plugged:bdacc087-627b-41dd-85c3-6084a1263f07 for instance 6d35112d-0d16-4351-abe6-64e3a92429a4 on nch2-master-1 Nov 06 20:52:58.733064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1b1faae-ff35-4fc3-99e6-a84475caec95 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.056755 Nov 06 20:52:58.733918 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1058/2072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:58 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:58.738668 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6637bc7b-c5be-47f5-991d-151c1fd2d727 req-be36a927-ee25-493c-bdaa-eb193dbbdd92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 Nov 06 20:52:58.739100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:58.739992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.740932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1015/2073] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:52:58.747687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.748097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.749012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.749475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.764834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:58.765718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:58.774980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.776132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:58.777201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:58.777680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.381990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:59.390867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0287891f-1b80-4550-8751-7beb03e6f9f3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.655610 Nov 06 20:52:59.391455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1059/2074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:58 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:59.395787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:59.396417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.401723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:59.402237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.402504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.403285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.403720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.409085 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2922e692-7fd4-42b8-bb5a-0de096edb392 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.649897 Nov 06 20:52:59.409654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1016/2075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:58 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:59.537356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:59.545789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-559d4339-1f9c-4f16-b4cf-84a46c63c6c3 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.153325 Nov 06 20:52:59.546352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1060/2076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:59 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:59.623562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:59.624177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.630237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.630697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.631495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.631936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.635962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:59.636594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.642413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.642861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.643640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.644070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.828895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:59.832006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:52:59.836349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a54aaa8-36e3-445c-8181-271c682cddd8 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.217113 Nov 06 20:52:59.846408 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1017/2077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:59 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:52:59.846618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab8e942e-c0d6-4e8e-9b81-dc2077575326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1463 microversion: 2.1 time: 0.207698 Nov 06 20:52:59.846618 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1061/2078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:59 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1463 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:52:59.846848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:59.846848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.848819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.849353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.850203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.850715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.851002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:59.852059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.858821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.859273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.860063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.860531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.902919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53559632-4ec0-4e7c-a14a-0c9a9ce5b4be tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.060971 Nov 06 20:52:59.903789 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1062/2079] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:59 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:52:59.908519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:52:59.909529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.917011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.917464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.918259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.918692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.921703 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba854e0c-eeb2-4748-8a2c-2fc24b1de4cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.083425 Nov 06 20:52:59.923028 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1018/2080] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:52:59 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:52:59.927121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:52:59.927818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:52:59.934671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.935125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.935922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:52:59.936390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:52:59.960511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54c6b322-f5e3-416b-94de-cd00616afe22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.055397 Nov 06 20:52:59.964980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1063/2081] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:52:59 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:00.063987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff7654ba-ce40-4a04-880a-9fe129e5587d tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1614 microversion: 2.1 time: 0.140471 Nov 06 20:53:00.064582 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1019/2082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:52:59 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1614 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:00.080612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:00.081193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.088573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.089021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.089790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.090219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.116286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd09ded262e1b494a8e49659cd261b44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354efa8e67b248809969c1eff9dbd23a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:00.116886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] flavor_id is None. Assuming migration. {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 06 20:53:00.117320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 20:53:00.230560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46f526f6-b635-495a-91d8-5378fe1fd72f tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891/action" status: 202 len: 0 microversion: 2.1 time: 0.153982 Nov 06 20:53:00.232449 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1064/2083] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:00 2021] POST /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:00.239994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:00.240729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.247177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.247644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.248461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.248946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.402469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:00.407620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:00.408542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.410685 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e4effe9-35b5-4051-9d34-9d3f2f0b21cb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1472 microversion: 2.1 time: 0.175189 Nov 06 20:53:00.411485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1020/2084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:00 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:00.416542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.417103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.417998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.418536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.428473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:00.429125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.437772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.438407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.439280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.440241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.647984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:00.655239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:00.656185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c634721c-76f7-4f14-bf8c-1b92f600701d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.252435 Nov 06 20:53:00.657327 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1065/2085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:00 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:00.661828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:00.662838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.667403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b9b64f59-759c-4bcf-a4e0-032009ca4480 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1312 microversion: 2.1 time: 0.242591 Nov 06 20:53:00.667971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1021/2086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:00 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:00.669817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.670378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.671175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.671608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.756581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-90ed28c5-f483-4989-8904-55e17e8043c0 req-6de4bcb2-d9b0-4f56-9aba-59934e47bd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4416b1b3-e45b-4838-be39-97e8cd950f80", "name": "network-vif-plugged", "status": "completed", "tag": "5b059de9-c748-4922-9c2e-f3b8afbefb51"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:00.758147 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:00.758147 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:00.766159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-90ed28c5-f483-4989-8904-55e17e8043c0 req-6de4bcb2-d9b0-4f56-9aba-59934e47bd35 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.766643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-90ed28c5-f483-4989-8904-55e17e8043c0 req-6de4bcb2-d9b0-4f56-9aba-59934e47bd35 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.778345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-90ed28c5-f483-4989-8904-55e17e8043c0 req-6de4bcb2-d9b0-4f56-9aba-59934e47bd35 service nova] Creating event network-vif-plugged:5b059de9-c748-4922-9c2e-f3b8afbefb51 for instance 4416b1b3-e45b-4838-be39-97e8cd950f80 on nch2-master-1 Nov 06 20:53:00.784504 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-90ed28c5-f483-4989-8904-55e17e8043c0 req-6de4bcb2-d9b0-4f56-9aba-59934e47bd35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Nov 06 20:53:00.785261 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1022/2087] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:00.813101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:00.820766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3437739-7168-4c31-a920-c86771735fb1 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.162311 Nov 06 20:53:00.821516 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1066/2088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:00 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:00.853758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:00.854450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.860808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.861265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.862054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.862503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.914728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:00.915714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.922347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.922921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.923714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:00.924140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:00.970877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da8d7a23-d841-407e-a47d-1e92ac54ec58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.060359 Nov 06 20:53:00.974967 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1067/2089] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:00 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:00.977040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:00.978078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:00.999800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.000247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.001080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.001508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.063439 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-deba1bc0-c575-41aa-aaa3-8421e54c1ef9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.089949 Nov 06 20:53:01.064625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1068/2090] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:00 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:01.069520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:01.070527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:01.077751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.078234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.079020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.082098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:01.084787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.089530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01d3321d-18d7-4a93-96f4-0aa7e8a7b1b6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.239795 Nov 06 20:53:01.090104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1023/2091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:00 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:01.377014 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4421ed2-3acf-4dc2-ae87-504658fe9b50 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.310957 Nov 06 20:53:01.377692 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1069/2092] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:01 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:01.427939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:01.428561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:01.434808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.435258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.436025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.436484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.602323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:01.613091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b3d6908-24ba-4bf8-a164-e3f16bde8a3e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1472 microversion: 2.1 time: 0.188227 Nov 06 20:53:01.620239 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1024/2093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:01 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:01.674606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:01.675310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:01.682779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.683227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.684102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.684527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.686505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:01.686973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:01.693018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.693475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.694263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:01.694699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:01.997567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:02.004873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da8104f3-9611-4fd0-bc66-67c666e5ff56 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1497 microversion: 2.1 time: 0.324368 Nov 06 20:53:02.005626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1025/2094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:01 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:02.010268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.010875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.016499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.016957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.017352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:02.017744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.018185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.026244 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca22b69a-61de-4146-b65a-e08e2e260240 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.355627 Nov 06 20:53:02.027092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1070/2095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:01 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:02.040833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:02.041602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.048018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.048513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.049288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.049718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.098104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f07fe162-1761-48a5-b45b-ffb198bc59aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.061177 Nov 06 20:53:02.098973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1071/2096] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:02 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:02.104894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671586aca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.116517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.117069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.117859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.140903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.141372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.142185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.142618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.187660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.188416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.208882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.209579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.248881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:02.272083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4af58835-6f98-4d64-a443-b6dde0b5e94f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2032810601" status: 201 len: 0 microversion: 2.26 time: 0.171942 Nov 06 20:53:02.277991 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1072/2097] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Nov 6 20:53:02 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2032810601 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 06 20:53:02.283688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:02.285353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.295917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:02.296487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.297485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.298295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.299757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.308165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92778faa-caca-4b53-95d3-cc7ec05ab598 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1318 microversion: 2.1 time: 0.301651 Nov 06 20:53:02.309458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1026/2098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:02.325944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.326627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.336146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.336902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.338401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.338873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.359638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a05c45b-5979-4f0b-b72b-f988fb7f36a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.080218 Nov 06 20:53:02.364357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1073/2099] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:02 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:02.368768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9db2c189-1e31-45dc-bb28-1b3679519391 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671acf1670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.380126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9db2c189-1e31-45dc-bb28-1b3679519391 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.381167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9db2c189-1e31-45dc-bb28-1b3679519391 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.397477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9db2c189-1e31-45dc-bb28-1b3679519391 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2032810601" status: 204 len: 0 microversion: 2.26 time: 0.033586 Nov 06 20:53:02.400919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1074/2100] 10.222.0.13 () {60 vars in 1360 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2032810601 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:53:02.412127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:02.413239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.420461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.420900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.421695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.422135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.496969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4112ee1a-1504-4a38-88fb-53d298f58020 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.094541 Nov 06 20:53:02.500430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1075/2101] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:02 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:02.504958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f67157d1ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.514473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:02.515631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.516107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.516803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.522857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.523305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.523478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed9adc8f-7ab8-43c0-96bd-656d29f03912 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.212681 Nov 06 20:53:02.524087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1027/2102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:02.524212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.524592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.547686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.548159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.562629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:02.578254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9cf4a7e-841b-46c0-ac9c-1a500dbdb4b7 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 204 len: 0 microversion: 2.26 time: 0.079374 Nov 06 20:53:02.578856 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1076/2103] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Nov 6 20:53:02 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:53:02.589023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abf567dd-a446-410b-94cc-b7239eb6965f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f6715234310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.597313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abf567dd-a446-410b-94cc-b7239eb6965f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.597770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abf567dd-a446-410b-94cc-b7239eb6965f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.612866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abf567dd-a446-410b-94cc-b7239eb6965f tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 12 microversion: 2.26 time: 0.028335 Nov 06 20:53:02.613581 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1028/2104] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:02.624453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f67157d11f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.630783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.631358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.633774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.634369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.635430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.638847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.639364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.640166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.640709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.641931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.642405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.643226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.643745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.668670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.669227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.678510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.679107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.705884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:02.722534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e75b0f5-17f8-45bf-8650-bfe66bfc5e8a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-788973261" status: 201 len: 0 microversion: 2.26 time: 0.102794 Nov 06 20:53:02.723187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1077/2105] 10.222.0.13 () {62 vars in 1376 bytes} [Sat Nov 6 20:53:02 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-788973261 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 06 20:53:02.732025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3160d1fa-b5ad-4edf-a07c-073a0d79cf0e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f67157bf940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.741230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3160d1fa-b5ad-4edf-a07c-073a0d79cf0e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.741672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3160d1fa-b5ad-4edf-a07c-073a0d79cf0e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.753508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3160d1fa-b5ad-4edf-a07c-073a0d79cf0e tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 35 microversion: 2.26 time: 0.025090 Nov 06 20:53:02.754549 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1078/2106] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 35 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:02.765818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671ace0c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.777922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.778584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.779455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.787751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.788410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.789684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.790225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.794130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:02.803853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d3f0218-6e4d-457d-a290-a8dc152ffc9f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.177009 Nov 06 20:53:02.804474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1029/2107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:02.814448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.814900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.836434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:02.851234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-180e688c-9c9e-48a7-802f-0fb037f06431 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-788973261" status: 204 len: 0 microversion: 2.26 time: 0.090043 Nov 06 20:53:02.851858 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1079/2108] 10.222.0.13 () {60 vars in 1360 bytes} [Sat Nov 6 20:53:02 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-788973261 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 20:53:02.860216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d8c61c0-a39a-401e-b16a-bd987fc96dae tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671524b040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.868735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8c61c0-a39a-401e-b16a-bd987fc96dae tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.869704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8c61c0-a39a-401e-b16a-bd987fc96dae tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.882465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d8c61c0-a39a-401e-b16a-bd987fc96dae tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 12 microversion: 2.26 time: 0.026050 Nov 06 20:53:02.883073 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1030/2109] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:53:02 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:02.893538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f67157d1670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.901916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.902375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.902853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.908368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.908849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.909622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.910062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.935697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.936146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.947896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:02.961836 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7ad7256-3acd-4256-93ff-e357f1794646 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 204 len: 0 microversion: 2.26 time: 0.072279 Nov 06 20:53:02.962725 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1080/2110] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Nov 6 20:53:02 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:53:02.972564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f6715356670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:02.980638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.981080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.981550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:02.986526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.986969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:02.987820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:02.988262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.011868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.012319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.021010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.021450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.043838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.044480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.047160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:03.050430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.050923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.051711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.052153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.097467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-047519e1-3d38-4552-94ec-c6ed5f0e6e81 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-938719192" status: 201 len: 0 microversion: 2.26 time: 0.129097 Nov 06 20:53:03.098432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1031/2111] 10.222.0.13 () {62 vars in 1376 bytes} [Sat Nov 6 20:53:02 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-938719192 => generated 0 bytes in 131 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 06 20:53:03.108795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f6715215820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.117811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.118541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.119512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.125160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.125711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.126391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.127081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.152796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.153398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.163584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.163968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.188662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:03.204053 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-343d60e6-4bc0-4d4d-b6a4-b7a9a4368a43 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-1599484908" status: 201 len: 0 microversion: 2.26 time: 0.098566 Nov 06 20:53:03.204830 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1032/2112] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Nov 6 20:53:03 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-1599484908 => generated 0 bytes in 102 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 06 20:53:03.209745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:03.210404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:03.211502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.217439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.217964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.218801 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9319ea3-5da8-483c-9ac7-2d0adeb94a8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.179531 Nov 06 20:53:03.218966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.219850 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1081/2113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:03.219990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.224376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f6715394160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.233110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.233591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.234047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.240001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.240493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.241286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.241753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.265704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.266155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.270110 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b5bab0a-384f-47d7-9990-ebdf7872ce98 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.063926 Nov 06 20:53:03.272390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1033/2114] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:03 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:03.282338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:03.299337 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00455d26-2570-45ab-891c-70241215ed29 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 204 len: 0 microversion: 2.26 time: 0.078610 Nov 06 20:53:03.300068 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1082/2115] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Nov 6 20:53:03 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:53:03.310619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-987040d3-0c19-4d3c-9eae-e5b92a7bcab5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671525dee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.320777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-987040d3-0c19-4d3c-9eae-e5b92a7bcab5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.321000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-987040d3-0c19-4d3c-9eae-e5b92a7bcab5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.326436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.327063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.332865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-987040d3-0c19-4d3c-9eae-e5b92a7bcab5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 12 microversion: 2.26 time: 0.027116 Nov 06 20:53:03.333263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.333491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1034/2116] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:03.333743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.334504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.334946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.343210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671524b430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.352211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.352742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.353860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.359935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.360505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.361443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.362187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.398089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.398458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.410559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:03.434202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2edec69-098a-4913-8320-6e84730f310b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 204 len: 0 microversion: 2.26 time: 0.094630 Nov 06 20:53:03.435172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1035/2117] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Nov 6 20:53:03 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 20:53:03.440031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:03.441307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.447821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.448379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.449185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.449659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.510365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:03.519715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16b411b5-539d-48d0-8786-52fd04eee6e6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1508 microversion: 2.1 time: 0.197274 Nov 06 20:53:03.520504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1083/2118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:03.526392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f67151e85e0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.535445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.536002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.536520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.544516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.544898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.545706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.546139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.575878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.576277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.587613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.588178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.614247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:03.632157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3974e1b2-ba38-431b-bb53-aab6c8b2721b tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-1020853654" status: 201 len: 0 microversion: 2.26 time: 0.110300 Nov 06 20:53:03.633491 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1084/2119] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Nov 6 20:53:03 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-1020853654 => generated 0 bytes in 112 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 06 20:53:03.637953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:03.638930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.645141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.645629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.646560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.647023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.685314 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad0c4004-9c93-4770-ac16-6d88a75d973f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.248798 Nov 06 20:53:03.686227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1036/2120] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:03 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:03.691708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.692449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.696022 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4674b598-8ebb-4c84-9aee-66f937828fd3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.061857 Nov 06 20:53:03.696718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1085/2121] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:03 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:03.700865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.701325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.702149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.702592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.708112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.709285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.718346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.718817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.719955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.720460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.924871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:03.933559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f52937e-0b26-4478-9cd3-302493116159 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1508 microversion: 2.1 time: 0.246130 Nov 06 20:53:03.934190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:03.934356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1037/2122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:03.938900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671524be50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.942973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de35eec1-536a-4185-b77c-1ec51eec7e01 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.239601 Nov 06 20:53:03.952511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1086/2123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:03.952707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.952707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.952707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.953015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:03.953015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:03.955287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.955823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.956126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.956601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.956882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.957185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.957483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.958031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.981946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.982500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:03.995667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:03.996143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.020464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:04.037154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7c36232-2760-4191-a029-3dbac16a2eca tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2033835612" status: 201 len: 0 microversion: 2.26 time: 0.101748 Nov 06 20:53:04.037816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1038/2124] 10.222.0.13 () {62 vars in 1379 bytes} [Sat Nov 6 20:53:03 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags/tempest-tag-2033835612 => generated 0 bytes in 103 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 06 20:53:04.043478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.044785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.052398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.052988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.054363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.054981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.122982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.129638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c18575c-988e-416e-b4a6-a6823844c978 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "PUT /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1080 microversion: 2.1 time: 0.090367 Nov 06 20:53:04.130267 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1039/2125] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 20:53:04 2021] PUT /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1080 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.131275 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8cba36e-1bff-4274-92f6-bccfde80449e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.185067 Nov 06 20:53:04.134813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Action: 'update_all', calling method: .version_select at 0x7f6715228280>, body: {"tags": ["tempest-tag-1579502355", "tempest-tag-2047811543"]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.140893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1087/2126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:03 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.143880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.144379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.144995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.146272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.146917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.150682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.151139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.152324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.152447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.153308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.153861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.154770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.155240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.179203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.179607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.201999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:04.219888 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e53d598-f303-4f8e-95c9-d5bf929bc8d5 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 62 microversion: 2.26 time: 0.088487 Nov 06 20:53:04.220942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1040/2127] 10.222.0.13 () {62 vars in 1311 bytes} [Sat Nov 6 20:53:04 2021] PUT /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 62 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.231728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2519057-ccbd-4e31-af72-e665577fc7ef tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671524b280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.241821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2519057-ccbd-4e31-af72-e665577fc7ef tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.242347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2519057-ccbd-4e31-af72-e665577fc7ef tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.252961 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2519057-ccbd-4e31-af72-e665577fc7ef tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 200 len: 62 microversion: 2.26 time: 0.026089 Nov 06 20:53:04.258703 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1041/2128] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 62 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:04.258703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.259280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.268554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.269401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.270461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.271092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.314143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.321934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e88b95f2-8be3-42df-a8bd-f138e4b0af0c tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1506 microversion: 2.1 time: 0.179819 Nov 06 20:53:04.323011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1088/2129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.327128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '.version_select at 0x7f671ace0ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.334878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.335349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.335902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.342748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.343274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.344572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.345068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.371858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.372342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.388467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lazy-loading 'flavor' on Instance uuid 6d35112d-0d16-4351-abe6-64e3a92429a4 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:04.409479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-612c48ec-df95-4d7f-9d6a-99d512f15506 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags" status: 204 len: 0 microversion: 2.26 time: 0.084789 Nov 06 20:53:04.409479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1089/2130] 10.222.0.13 () {60 vars in 1294 bytes} [Sat Nov 6 20:53:04 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4/tags => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:53:04.420618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.421913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.429482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.429867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.430770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.431432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.434384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.442474 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cab6d0d0-4b49-4fc1-8cb3-23785b2d1b3f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.186918 Nov 06 20:53:04.443140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1042/2131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.455886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.456538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.464983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.466130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.466586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.466981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.483767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38bbabdf-d9a2-4d9d-8ad2-eff453ee3bc8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.073310 Nov 06 20:53:04.485697 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1090/2132] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:04 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:04.490164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.490780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.498877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.499724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.501002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.501518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.533493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:04.622747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.625209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-28b6371a-d712-417b-8dbd-dfe097b178cc tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 204 len: 0 microversion: 2.1 time: 0.138853 Nov 06 20:53:04.626125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1091/2133] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:04 2021] DELETE /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:04.631319 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11071f4e-b9b3-45ee-857b-be436cba6bb6 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1506 microversion: 2.1 time: 0.187080 Nov 06 20:53:04.636228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.637176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.642987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1043/2134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.644769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.645220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.645999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.646475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.648191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.649456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.656248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.656772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.657595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.658064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.726322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4846264-7797-43ae-92fb-f4cb99a49b6b tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "PUT /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1082 microversion: 2.1 time: 0.081519 Nov 06 20:53:04.727057 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1044/2135] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 20:53:04 2021] PUT /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1082 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:04.731611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.732553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.738744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.739249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.740049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.740517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.787879 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-949c6b3a-be5b-4cfa-aedd-b4b66671c563 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.059514 Nov 06 20:53:04.788555 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1045/2136] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:04 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:04.794514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:04.795566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.803490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.803993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.804987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.805430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.808987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.817547 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f371322-3fb8-475b-a97d-f84d703b5fe1 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1503 microversion: 2.1 time: 0.185954 Nov 06 20:53:04.827776 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1092/2137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:04.827776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.827776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.832075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.832661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.833523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.834030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.851247 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8542534-916a-48c0-bc19-6e96b45900ef tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.060483 Nov 06 20:53:04.853889 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1046/2138] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:04 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:04.960534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:04.961341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:04.971413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.973150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.973150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:04.973431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:04.981337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:04.989022 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20fe4108-4f4e-4d31-b097-4cbb5a9a6cde tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1508 microversion: 2.1 time: 0.169852 Nov 06 20:53:04.989906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1093/2139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:05.006611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.007278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.016483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.017197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.017813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.018332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.183865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:05.191640 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8bc177a-45ee-47ea-85bd-67ff7b4c85f9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.235180 Nov 06 20:53:05.192484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1047/2140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:04 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:05.196478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.197667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.204262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.204777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.205540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.205985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.236638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:05.246393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bac1c9b0-9257-49ec-9d54-4ea8ecd62a9f tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1508 microversion: 2.1 time: 0.243763 Nov 06 20:53:05.247054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1094/2141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:05 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:05.264374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.264996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.271665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.272164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.273095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.273562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.302015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:05.364185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:05.373953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-376fbbac-3876-4f4d-9d2c-802e84143579 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.180582 Nov 06 20:53:05.374789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1048/2142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:05 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:05.391179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-333b9a65-0568-475e-9f8c-1cd9293ea4a8 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 204 len: 0 microversion: 2.1 time: 0.131239 Nov 06 20:53:05.391794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1095/2143] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:05 2021] DELETE /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:05.404546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.405050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.411715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.412165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.413034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.413470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.447278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:05.461193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.462001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.469013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.469471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.470267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.470707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.497212 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Instance is already in deleting state, ignoring this request Nov 06 20:53:05.498107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75f5dbf9-7624-4d43-8d0f-53fda850ca3a tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 204 len: 0 microversion: 2.1 time: 0.098155 Nov 06 20:53:05.498697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1049/2144] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:05 2021] DELETE /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:05.506610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:05.507717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.514671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.515125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.515911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.516412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.561920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-802edaee-eaf3-4d61-80c7-29870e089f8d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.058740 Nov 06 20:53:05.566022 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1050/2145] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:05 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:05.567896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.568638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.576844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.577538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.578519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.578737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.639121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:05.646573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b10ba2f-ce2b-4118-a8f4-9b2974ee1f6b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.190074 Nov 06 20:53:05.647366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1096/2146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:05 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:05.735488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:05.743342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-934ab11e-7c7c-4225-b5f6-614c402b0985 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1514 microversion: 2.1 time: 0.179358 Nov 06 20:53:05.743964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1051/2147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:05 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:05.800579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:05.801507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.807733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.808254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.809056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.809659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.836406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:05.837440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.846254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.846850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.847939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.848490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.859820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb8f4b1a-bf51-4ce8-a1ec-119f43b6430b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.062781 Nov 06 20:53:05.864653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1097/2148] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:05 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:05.866069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:05.867301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:05.874172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.874618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.875408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:05.875840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:05.929503 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f614629-66f0-4f5d-9626-b833d625aeba tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.067459 Nov 06 20:53:05.933947 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1098/2149] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:05 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:05.994122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:06.001713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87501e74-252e-413f-98a6-9c8462e61d32 tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1503 microversion: 2.1 time: 0.170201 Nov 06 20:53:06.002323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1052/2150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:05 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:06.212232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:06.214198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.224789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.225463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.226456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.226895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.306970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e2ef0f84-f7a8-439f-99f7-e09785546c28 req-7e693a83-4c4b-4437-986e-199463d53a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fbee84-0888-474a-a089-36a96efd162d", "name": "network-vif-plugged", "status": "completed", "tag": "9d0eeba9-6ff4-48d8-9007-9e377ba11bbf"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:06.308914 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:06.308914 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:06.316347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e2ef0f84-f7a8-439f-99f7-e09785546c28 req-7e693a83-4c4b-4437-986e-199463d53a49 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.316802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e2ef0f84-f7a8-439f-99f7-e09785546c28 req-7e693a83-4c4b-4437-986e-199463d53a49 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.331281 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e2ef0f84-f7a8-439f-99f7-e09785546c28 req-7e693a83-4c4b-4437-986e-199463d53a49 service nova] Creating event network-vif-plugged:9d0eeba9-6ff4-48d8-9007-9e377ba11bbf for instance a2fbee84-0888-474a-a089-36a96efd162d on nch2-master-1 Nov 06 20:53:06.336612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e2ef0f84-f7a8-439f-99f7-e09785546c28 req-7e693a83-4c4b-4437-986e-199463d53a49 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033054 Nov 06 20:53:06.337501 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1053/2151] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:06.382059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:06.391257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d5dd7f1-093f-4568-ae03-05cd90f21995 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.185084 Nov 06 20:53:06.391888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:06.402624 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1099/2152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:06 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:06.402865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.402865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.402865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.402865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.402865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.575747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:06.577112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.584543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.585297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.586733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.587345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.605738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:06.613555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2860eb3-353a-4a69-a53a-52abe26b7637 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.225399 Nov 06 20:53:06.623578 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1054/2153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:06 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:06.648461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61cc80f2-36de-4938-91ca-7c83732c80bd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.077928 Nov 06 20:53:06.649253 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1100/2154] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:06 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:06.664178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:06.665186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.671328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.671883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.672853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.673370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.761527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:06.762239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.769326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.769784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.770579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.771024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.809404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:06.816698 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fbc9b71-a939-4025-b5ca-ee7dfde18d7e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.156088 Nov 06 20:53:06.817276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1055/2155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:06 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:06.871674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:06.876680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.879594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.880058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.880900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.881355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.916984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:06.925735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cebe1e77-7dae-4544-9a1e-863de00be1a3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.058165 Nov 06 20:53:06.925943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93abd13e-1b68-4fe9-a3f6-e09883fd09fb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1514 microversion: 2.1 time: 0.168747 Nov 06 20:53:06.926392 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1056/2156] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:06 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:06.935956 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1101/2157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:06 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:06.941393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:06.942410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:06.949709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.950168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.950960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:06.951409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:06.999975 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc31737c-ddeb-4b16-a7cd-ed482c39f2c3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.062296 Nov 06 20:53:07.000664 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1057/2158] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:06 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:07.021509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:07.022157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.028385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.028838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.029625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.030060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.070468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-919bc9a7-4c93-450c-a2db-9db721579c2f req-a1c4da8e-c15f-40da-8c81-ecbc68e9b5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d35112d-0d16-4351-abe6-64e3a92429a4", "name": "network-vif-deleted", "tag": "bdacc087-627b-41dd-85c3-6084a1263f07"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:07.072070 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:07.072070 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:07.080221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-919bc9a7-4c93-450c-a2db-9db721579c2f req-a1c4da8e-c15f-40da-8c81-ecbc68e9b5ee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.080803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-919bc9a7-4c93-450c-a2db-9db721579c2f req-a1c4da8e-c15f-40da-8c81-ecbc68e9b5ee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.092333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-919bc9a7-4c93-450c-a2db-9db721579c2f req-a1c4da8e-c15f-40da-8c81-ecbc68e9b5ee service nova] Creating event network-vif-deleted:bdacc087-627b-41dd-85c3-6084a1263f07 for instance 6d35112d-0d16-4351-abe6-64e3a92429a4 on nch2-master-1 Nov 06 20:53:07.097105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-919bc9a7-4c93-450c-a2db-9db721579c2f req-a1c4da8e-c15f-40da-8c81-ecbc68e9b5ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030547 Nov 06 20:53:07.097762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1058/2159] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:07.104212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d6aff4a4e47d080bfbeebb2aee0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab356678a1cc48d59b2b4e124f51db4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:07.111267 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4de92a8-798d-430e-a3df-9da6f585848a tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 200 len: 1461 microversion: 2.1 time: 0.094581 Nov 06 20:53:07.111825 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1102/2160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:07 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:07.411680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:07.412423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.419467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.419924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.420735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.421176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.552341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:07.559768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d6c3fd0-5539-4c8f-ba29-cab9f7b19d3c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.152612 Nov 06 20:53:07.560356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1059/2161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:07 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:07.630562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:07.631110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.637890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.638332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.639103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.639536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.659347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:07.660460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.667345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.667929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.668757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.669298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.714788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-112a0d4b-e36d-4851-9918-ac9513b9995a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.059110 Nov 06 20:53:07.716344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1060/2162] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:07 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:07.786330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:07.795120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-369e2231-6e6b-4478-825d-051d1a2c8c12 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.168177 Nov 06 20:53:07.795930 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1103/2163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:07 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:07.834834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:07.835550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.843568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.844025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.844835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.845271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.939482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:07.942307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:07.949092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.949631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:07.950511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:07.951166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.014227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:08.022285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81514ff7-8d26-4b1c-878c-5c798b0fce87 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.088082 Nov 06 20:53:08.023728 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1104/2164] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:07 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:08.033487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:08.034191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.039261 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18ef4aa5-09c1-46d4-916d-dfdaaf98e717 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1307 microversion: 2.1 time: 0.199166 Nov 06 20:53:08.040438 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1061/2165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:07 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:08.045546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:08.046486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.052519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.052971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.053716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.053859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.054225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.054351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.055563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.055692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.098229 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc01039c-16c5-4acc-9103-afe7e5284cff tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.056663 Nov 06 20:53:08.098888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1062/2166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:08 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:08.130699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:08.131667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] [instance: 6d35112d-0d16-4351-abe6-64e3a92429a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.141586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.142064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.143197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.143712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.166198 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] HTTP exception thrown: Instance 6d35112d-0d16-4351-abe6-64e3a92429a4 could not be found. Nov 06 20:53:08.167125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] Returning 404 to user: Instance 6d35112d-0d16-4351-abe6-64e3a92429a4 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:08.169500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc98b06e-9cc5-456d-8157-a1e284d6c99d tempest-ServerTagsTestJSON-1547146122 tempest-ServerTagsTestJSON-1547146122-project] 10.222.0.13 "GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4" status: 404 len: 111 microversion: 2.1 time: 0.042936 Nov 06 20:53:08.170547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1063/2167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:08 2021] GET /compute/v2.1/servers/6d35112d-0d16-4351-abe6-64e3a92429a4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:08.248620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bfed29e8e448792810993d5d8742e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868bef14d4704704a6e56e88a220cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:08.259386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c40b6ddf-a765-492f-a8b5-616c3721b5bb tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 200 len: 1514 microversion: 2.1 time: 0.235216 Nov 06 20:53:08.260624 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1105/2168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:08 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:08.576736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:08.577461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.583958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.584550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.585336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.585773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.726517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:08.727434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.734220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.734670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.735451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.735889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.779226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c0e3f97-1616-459c-9258-ba8b08c1072b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.056086 Nov 06 20:53:08.784111 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1106/2169] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:08 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:08.813971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:08.814809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:08.824460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.825897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.826850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:08.827409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:08.839790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:08.849869 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4efa3f4-a8fd-4bc6-8075-d21f9e813eb3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.275627 Nov 06 20:53:08.850665 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1064/2170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:08 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:08.999719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:09.007409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f1e7259-eebc-47ca-b85f-fb87b993327d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.198116 Nov 06 20:53:09.008179 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1107/2171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:08 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:09.034934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:09.035846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.042671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.043132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.043956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.044435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.056442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.057280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.065093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.065548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.066343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.066781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.090826 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b05d6c5-8238-47ff-afb8-282b09565728 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.059493 Nov 06 20:53:09.092374 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1065/2172] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:09.110629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:09.111795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.119819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.120316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.121117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.121562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.167468 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8ff4db4-d817-4529-8e75-95714cf53b21 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 32647 microversion: 2.1 time: 0.060581 Nov 06 20:53:09.168792 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1066/2173] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 32647 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:09.174888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ed0e8737-d45c-43ba-bc64-bfc1978d717a req-a7a09c51-8f87-47c5-bfbb-776ecfebf9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4416b1b3-e45b-4838-be39-97e8cd950f80", "name": "network-vif-deleted", "tag": "5b059de9-c748-4922-9c2e-f3b8afbefb51"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:09.177024 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:09.177024 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:09.185671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ed0e8737-d45c-43ba-bc64-bfc1978d717a req-a7a09c51-8f87-47c5-bfbb-776ecfebf9f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.186117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ed0e8737-d45c-43ba-bc64-bfc1978d717a req-a7a09c51-8f87-47c5-bfbb-776ecfebf9f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.198035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ed0e8737-d45c-43ba-bc64-bfc1978d717a req-a7a09c51-8f87-47c5-bfbb-776ecfebf9f5 service nova] Creating event network-vif-deleted:5b059de9-c748-4922-9c2e-f3b8afbefb51 for instance 4416b1b3-e45b-4838-be39-97e8cd950f80 on nch2-master-1 Nov 06 20:53:09.202931 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ed0e8737-d45c-43ba-bc64-bfc1978d717a req-a7a09c51-8f87-47c5-bfbb-776ecfebf9f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Nov 06 20:53:09.203526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1067/2174] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:09.232319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:09.239500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f237f133-c8ce-4c5f-891e-aea42664e84d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1486 microversion: 2.1 time: 0.186624 Nov 06 20:53:09.240062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1108/2175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1486 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:09.256901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:09.257670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.264388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.264853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.265646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.266108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.278522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.279246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 4416b1b3-e45b-4838-be39-97e8cd950f80] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.285448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.286036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.286926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.287812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.302231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] HTTP exception thrown: Instance 4416b1b3-e45b-4838-be39-97e8cd950f80 could not be found. Nov 06 20:53:09.303080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Returning 404 to user: Instance 4416b1b3-e45b-4838-be39-97e8cd950f80 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:09.304120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aa17ac4-58c7-40d3-9a6a-05efc67f9dbe tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80" status: 404 len: 111 microversion: 2.1 time: 0.030003 Nov 06 20:53:09.305135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1109/2176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/4416b1b3-e45b-4838-be39-97e8cd950f80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:09.312888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.313379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.319562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.320210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.321212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.321652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.336115 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] HTTP exception thrown: Instance 67451694-6fbf-4c87-996e-577bf998c9d8 could not be found. Nov 06 20:53:09.337138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Returning 404 to user: Instance 67451694-6fbf-4c87-996e-577bf998c9d8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:09.338782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c45b653-b01e-49ac-9f33-3632904a7542 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 404 len: 111 microversion: 2.1 time: 0.029321 Nov 06 20:53:09.339783 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1110/2177] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:09 2021] DELETE /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:09.347622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.348233 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fabe5c86-1653-4a5d-9b1e-8b8b7f70bb50 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d/action" status: 202 len: 0 microversion: 2.1 time: 0.095952 Nov 06 20:53:09.348548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 67451694-6fbf-4c87-996e-577bf998c9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.349648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1068/2178] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:09.355428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.356111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.357100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.357731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.360710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.362889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.370812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.371344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.372484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.373174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.373300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] HTTP exception thrown: Instance 67451694-6fbf-4c87-996e-577bf998c9d8 could not be found. Nov 06 20:53:09.374176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Returning 404 to user: Instance 67451694-6fbf-4c87-996e-577bf998c9d8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:09.375052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e7b5fb4-f590-44dd-b450-936fe1e2c1a4 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8" status: 404 len: 111 microversion: 2.1 time: 0.030959 Nov 06 20:53:09.376233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1111/2179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/67451694-6fbf-4c87-996e-577bf998c9d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:09.383675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.384173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.391257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.391767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.392597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.393040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.409822 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] HTTP exception thrown: Instance 270a8546-67d9-4233-977b-d8d71a4b3f51 could not be found. Nov 06 20:53:09.410471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Returning 404 to user: Instance 270a8546-67d9-4233-977b-d8d71a4b3f51 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:09.411313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f224e946-a97e-429c-9f4f-01a7d2281515 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "DELETE /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 404 len: 111 microversion: 2.1 time: 0.031310 Nov 06 20:53:09.412153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1112/2180] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:09 2021] DELETE /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:09.422864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.424908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] [instance: 270a8546-67d9-4233-977b-d8d71a4b3f51] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.435215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.436062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.437098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.437704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.453474 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] HTTP exception thrown: Instance 270a8546-67d9-4233-977b-d8d71a4b3f51 could not be found. Nov 06 20:53:09.455447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] Returning 404 to user: Instance 270a8546-67d9-4233-977b-d8d71a4b3f51 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:09.456684 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3b8795a-4c92-44f9-89c5-ff0cf7a71c85 tempest-ServerDiskConfigTestJSON-1546140118 tempest-ServerDiskConfigTestJSON-1546140118-project] 10.222.0.13 "GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51" status: 404 len: 111 microversion: 2.1 time: 0.039146 Nov 06 20:53:09.457734 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1113/2181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/270a8546-67d9-4233-977b-d8d71a4b3f51 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:09.529108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:09.537878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8af3a334-db22-4319-9361-b8ceaef1bb08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1491 microversion: 2.1 time: 0.182687 Nov 06 20:53:09.538987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1069/2182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1491 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:09.791189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:09.792312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.798404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.798924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.799832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.800482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.847468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04f025b5-572a-4eeb-ad73-5d0db848b467 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.059819 Nov 06 20:53:09.849223 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1114/2183] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:09.927854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:09.927854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:09.939365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.940150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:09.941114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:09.941625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.081515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Action: 'create', calling method: .version_select at 0x7f671ace0dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1480810017"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:10.096879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:10.105396 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-555585dc-7af7-402c-9587-1c1d5eca856d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.183244 Nov 06 20:53:10.106183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1070/2184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:09 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:10.111102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:10.111904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.118512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.119588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.120646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.121110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.306801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:10.315658 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-effd0eec-eeaa-46ec-afc1-d05722ee5db8 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.208294 Nov 06 20:53:10.316231 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1071/2185] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:10 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:10.321342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:10.322645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.328629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.329090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.329875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.330314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.375891 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29df5dc2-5e0e-4a35-bdb3-b498c2b91be9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.057967 Nov 06 20:53:10.377340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1072/2186] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:10 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:10.382776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:10.384048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.392679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.393150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.393949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.394424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.469286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cdc77ed-64fd-4154-87a4-230e816c9ddb tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action" status: 200 len: 40782 microversion: 2.1 time: 0.089229 Nov 06 20:53:10.470053 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1073/2187] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:10 2021] POST /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2/action => generated 40782 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:10.481568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:10.482571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.490267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.490947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.491824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.492271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.574800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.640475 Nov 06 20:53:10.575425 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1115/2188] 10.222.0.13 () {60 vars in 1154 bytes} [Sat Nov 6 20:53:09 2021] POST /compute/v2.1/os-volumes => generated 338 bytes in 642 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 06 20:53:10.580063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:10.580936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.593973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.594505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.595325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.595770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.705486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:10.724487 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76b35905-64ad-4273-a241-f87e20b2153c tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1708 microversion: 2.1 time: 0.244176 Nov 06 20:53:10.725403 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1074/2189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:10 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1708 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:10.731654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8dd66967-37ca-4260-8f84-128679fab3dc tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671539c550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:10.785957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:10.796374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54499bc4-4fc7-494e-a8bf-1cbf0d3f1de1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 200 len: 1471 microversion: 2.1 time: 0.219885 Nov 06 20:53:10.796966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1116/2190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:10 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:10.799791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8dd66967-37ca-4260-8f84-128679fab3dc tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 200 len: 338 microversion: 2.1 time: 0.072254 Nov 06 20:53:10.800533 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1075/2191] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:10 2021] GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 338 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:10.813840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-967350083"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:10.815075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.821698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.822916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.823847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.824538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.864351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:10.864351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:10.870348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.870944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.871845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:10.875052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:10.922603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81a961d4-bd82-42ca-bcdc-e522271c1106 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.066033 Nov 06 20:53:10.924333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1076/2192] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:10 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:11.116377 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0daa8f1-6d00-48f5-9541-9efdd8a15992 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d/action" status: 202 len: 0 microversion: 2.1 time: 0.306036 Nov 06 20:53:11.117176 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1117/2193] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:10 2021] POST /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:53:11.123484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.124766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.128049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5a50c5b-d732-4594-81e1-f6b3891b83a8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ad55160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.133470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.134428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.136202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.136739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.179289 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5a50c5b-d732-4594-81e1-f6b3891b83a8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.056047 Nov 06 20:53:11.180359 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1118/2194] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:11 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:11.279884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:11.287390 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-141524b3-9cae-4208-bbb5-50db810c73d3 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.168678 Nov 06 20:53:11.288178 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1077/2195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:11 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:11.332842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.333552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.340495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.340788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.341569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.342006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.388817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:11.389740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.395576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.396033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.396860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.397298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.443498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f673d866-d4a0-4288-8614-c64075a1e054 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.058845 Nov 06 20:53:11.444336 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1078/2196] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:11.453966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.454652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.461863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.462400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.463345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.463887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.485610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:11.493184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-118a4390-60ab-4455-9b13-61bbafc41586 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.164435 Nov 06 20:53:11.494339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1119/2197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:11 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:11.500255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:11.583652 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50411f46-bc26-40d1-ac17-a9aecc88c423 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 204 len: 0 microversion: 2.1 time: 0.133202 Nov 06 20:53:11.584529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1079/2198] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:11 2021] DELETE /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:11.593758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.594432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.600181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.600672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.601445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.601873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.743153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:11.752166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec8e46b7-bab8-4696-a8ff-bc51a0dda676 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1714 microversion: 2.1 time: 0.163216 Nov 06 20:53:11.752836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1120/2199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:11 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:11.811958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-838cf829-144b-4840-b849-3193026450ce tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671525aaf0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:11.866301 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-838cf829-144b-4840-b849-3193026450ce tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 200 len: 339 microversion: 2.1 time: 0.056289 Nov 06 20:53:11.866301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1080/2200] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:11 2021] GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 339 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:11.876404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40b5fb2d-18b5-4557-9e94-c3325cb693ac tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Action: 'create', calling method: .version_select at 0x7f671577ef70>, body: {"snapshot": {"volume_id": "d738ae4b-8b54-4896-8a4b-f641b20bff4f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1320983737"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:11.934312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:11.935370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:11.943074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.943527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.944431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:11.944973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:11.989898 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d211ef4-bb89-48ee-bf2f-9f81d3d5fe4b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.059131 Nov 06 20:53:11.990800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1081/2201] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:11 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:12.077583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40b5fb2d-18b5-4557-9e94-c3325cb693ac tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.205272 Nov 06 20:53:12.078199 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1121/2202] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Nov 6 20:53:11 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:12.092335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92432e23-0363-4483-88fe-50181888a27e tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f67152289d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.194256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19c7421f-0e17-4fdf-9540-3fc6cbbd0072 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ace0280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.262311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19c7421f-0e17-4fdf-9540-3fc6cbbd0072 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.072419 Nov 06 20:53:12.263922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1122/2203] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:12.308093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.308752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:12.313031 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92432e23-0363-4483-88fe-50181888a27e tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 200 len: 287 microversion: 2.1 time: 0.227622 Nov 06 20:53:12.320683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1082/2204] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 287 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:12.321304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.322307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.323770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.324328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.325838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-408ad505-9e4c-4cc9-9a31-d555a2487223 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671539c4c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.375218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-408ad505-9e4c-4cc9-9a31-d555a2487223 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050841 Nov 06 20:53:12.380631 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1083/2205] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:12.390962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9b5c50f-ff89-4679-bd72-a8f0ce377b0b tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f67152285e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.442505 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9b5c50f-ff89-4679-bd72-a8f0ce377b0b tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 200 len: 287 microversion: 2.1 time: 0.058327 Nov 06 20:53:12.443085 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1084/2206] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:12.455515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:12.456751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:12.464326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.465041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.465847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.466288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.487584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:12.496261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebcf16e0-3fe9-4eff-80a7-7c777bb0b509 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.195378 Nov 06 20:53:12.496969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1123/2207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:12.510741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.511348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:12.511612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdeae5d5-30a0-49a8-b901-de21b8bb26b2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.059698 Nov 06 20:53:12.512456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1085/2208] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:12 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:12.517397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.517853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.518653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.519096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.653661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:12.661456 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e2a8189-83a3-4ea7-9cc9-c2f3fa9e7326 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.154741 Nov 06 20:53:12.662022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1124/2209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:12.770816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:12.771681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:12.779009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.779807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.780812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:12.781307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:12.923974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:12.932996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3845a03-dc4b-4e23-9da0-d52ebac6bdb8 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1714 microversion: 2.1 time: 0.166275 Nov 06 20:53:12.933675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1086/2210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:12 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:13.002264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:13.003234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:13.010407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.011083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.011885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.012334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.051583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2aec108e-b055-48d8-b98a-c9dcbd6f6f97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.052798 Nov 06 20:53:13.055413 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1125/2211] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:12 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:13.275951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dee81589-8cac-4b67-a244-fc1e677bee08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67152283a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.327846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dee81589-8cac-4b67-a244-fc1e677bee08 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.055898 Nov 06 20:53:13.328527 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1087/2212] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:13.454036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fc9fa9d-ccd1-40c2-88f9-55601652c6ff tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671ac75310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.486100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fc9fa9d-ccd1-40c2-88f9-55601652c6ff tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 200 len: 288 microversion: 2.1 time: 0.035986 Nov 06 20:53:13.486861 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1126/2213] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:13.496955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-510ca294-faaf-48ef-95b6-0c762b2dbd2a tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f67152e4280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.512756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.513483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:13.520876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.521325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.522116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.522557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.565769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-510ca294-faaf-48ef-95b6-0c762b2dbd2a tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 202 len: 0 microversion: 2.1 time: 0.072387 Nov 06 20:53:13.566760 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1088/2214] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 20:53:13 2021] DELETE /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:13.577851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:13.579669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:13.588759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.589617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.590712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.591678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.655664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af4e9d54-2373-4fb5-885f-9c2b453738bc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.082206 Nov 06 20:53:13.657008 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1089/2215] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:13 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:13.667515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f2e347d-eae6-4b2b-b5bf-7c4efb641f1e tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671524b670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.706776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:13.719925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e702761d-a323-4e98-bcca-217ca1a36ca5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.211135 Nov 06 20:53:13.722473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f2e347d-eae6-4b2b-b5bf-7c4efb641f1e tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 200 len: 287 microversion: 2.1 time: 0.063870 Nov 06 20:53:13.727211 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1090/2216] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:13.732475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.733269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:13.741076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1127/2217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:13.742700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.743161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.744003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.744485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.895443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:13.904958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca6d6e71-0cf7-4e66-9a50-4c8b8e19027a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.176589 Nov 06 20:53:13.912831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1091/2218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:13.950951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:13.951903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:13.958468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.959011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:13.959895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:13.960447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.064344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:14.065519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:14.074226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.074741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.075607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.076071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.137697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32a37554-95cf-48a7-9995-7a3218dfa859 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.076769 Nov 06 20:53:14.143960 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1092/2219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:14 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:14.156315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:14.164436 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3623c514-e84b-4dff-8ec4-8fc797854d45 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1714 microversion: 2.1 time: 0.217887 Nov 06 20:53:14.165588 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1128/2220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:13 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1714 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:14.346592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f58a5216-d2fe-49e9-a66d-acb3b1681fa8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671539c160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.436356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f58a5216-d2fe-49e9-a66d-acb3b1681fa8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.098414 Nov 06 20:53:14.443285 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1093/2221] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:14 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:14.670515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:14.671486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:14.677938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.678390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.680057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.680555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.725304 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe3b7c1c-1f60-46d2-ab38-f1b1e926fa46 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.058190 Nov 06 20:53:14.725572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1129/2222] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:14 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:14.735796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b512399-8412-496e-8342-f507b04b8489 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671524b430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.754760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.755096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:14.764034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5b512399-8412-496e-8342-f507b04b8489 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] HTTP exception thrown: Snapshot 2ed49e19-a456-498f-968c-d9af37e6e98c could not be found. Nov 06 20:53:14.764906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b512399-8412-496e-8342-f507b04b8489 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Returning 404 to user: Snapshot 2ed49e19-a456-498f-968c-d9af37e6e98c could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:14.766206 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b512399-8412-496e-8342-f507b04b8489 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c" status: 404 len: 111 microversion: 2.1 time: 0.035558 Nov 06 20:53:14.766344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.766704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.767514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.767951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.768207 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1094/2223] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:14 2021] GET /compute/v2.1/os-snapshots/2ed49e19-a456-498f-968c-d9af37e6e98c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:14.778557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671539c9d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.896234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 202 len: 0 microversion: 2.1 time: 0.123915 Nov 06 20:53:14.896911 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1095/2224] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 20:53:14 2021] DELETE /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:14.908515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bf9bad7-8a85-4c48-baa3-78dc7655a51b tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f67152f6b80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.942659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:14.952197 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1522aadd-cb75-4789-bb0a-2da1abd17106 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.202584 Nov 06 20:53:14.953421 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1130/2225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:14 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:14.965981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:14.966889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:14.976617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.980451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:14.981189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:14.984246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.008340 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bf9bad7-8a85-4c48-baa3-78dc7655a51b tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 200 len: 338 microversion: 2.1 time: 0.106001 Nov 06 20:53:15.009924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1096/2226] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:14 2021] GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:15.153575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:15.155020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:15.160478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:15.167321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.167992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.168993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.169695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.178684 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8dbe278-ecf8-44fd-a08b-3c02dcde5e7b tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.220773 Nov 06 20:53:15.189487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1131/2227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:14 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:15.199925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:15.204048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:15.216380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.217029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.217852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.218506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.238821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e109a91a-0ad8-454f-a99f-51fcd12382cd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.091697 Nov 06 20:53:15.241467 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1097/2228] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:15 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:15.302468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:15.312831 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fafb938-d9c4-4c5f-b722-9744f67ce4bf tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1646 microversion: 2.1 time: 0.119213 Nov 06 20:53:15.313659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1132/2229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:15 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1646 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:15.456779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b7e1c0a-a273-4e74-bf51-ea0067e8d610 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67152f6b80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:15.568018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b7e1c0a-a273-4e74-bf51-ea0067e8d610 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.116493 Nov 06 20:53:15.574791 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1098/2230] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:15 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:15.750215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:15.751715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:15.763393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.764032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.765288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.765919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.916104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-616ca835-0744-4d34-ab4a-0e8bda5c8ce0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.178635 Nov 06 20:53:15.916104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1133/2231] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:15.923951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-82df26d0-bd8c-4f1c-9f96-c8ad5389b9f8 req-94872259-a9e7-49cb-b5f2-bc684b862084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c525837-e57b-4864-9ece-7aec3a941be2", "name": "network-vif-deleted", "tag": "1bb283d3-dee3-4b3b-b05d-39267648a295"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:15.925685 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:15.925685 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:15.934322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-82df26d0-bd8c-4f1c-9f96-c8ad5389b9f8 req-94872259-a9e7-49cb-b5f2-bc684b862084 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.934777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-82df26d0-bd8c-4f1c-9f96-c8ad5389b9f8 req-94872259-a9e7-49cb-b5f2-bc684b862084 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:15.953831 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-82df26d0-bd8c-4f1c-9f96-c8ad5389b9f8 req-94872259-a9e7-49cb-b5f2-bc684b862084 service nova] Creating event network-vif-deleted:1bb283d3-dee3-4b3b-b05d-39267648a295 for instance 6c525837-e57b-4864-9ece-7aec3a941be2 on nch2-master-1 Nov 06 20:53:15.964997 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-82df26d0-bd8c-4f1c-9f96-c8ad5389b9f8 req-94872259-a9e7-49cb-b5f2-bc684b862084 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045191 Nov 06 20:53:15.965922 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1099/2232] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:15.971244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:15.972056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:15.998580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:15.999038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.002470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.006990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.021926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-661aca7a-7966-40e1-b55f-55b57787d401 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671537e430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.083842 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-661aca7a-7966-40e1-b55f-55b57787d401 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] HTTP exception thrown: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. Nov 06 20:53:16.084486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-661aca7a-7966-40e1-b55f-55b57787d401 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Returning 404 to user: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:16.085393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-661aca7a-7966-40e1-b55f-55b57787d401 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 404 len: 109 microversion: 2.1 time: 0.068352 Nov 06 20:53:16.091413 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1100/2233] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:16 2021] GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:16.097066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8aeff971-98c1-4113-83cd-07ebebce7f36 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f671524b4c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.157650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-8aeff971-98c1-4113-83cd-07ebebce7f36 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] HTTP exception thrown: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. Nov 06 20:53:16.158265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8aeff971-98c1-4113-83cd-07ebebce7f36 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Returning 404 to user: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:16.159269 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8aeff971-98c1-4113-83cd-07ebebce7f36 tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 404 len: 109 microversion: 2.1 time: 0.066664 Nov 06 20:53:16.160141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1101/2234] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 20:53:16 2021] DELETE /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:16.176335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df4515bd-1eb2-40ea-8037-386f4e0e2eae tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Calling method '.version_select at 0x7f6715228e50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.209864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-df4515bd-1eb2-40ea-8037-386f4e0e2eae tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] HTTP exception thrown: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. Nov 06 20:53:16.210478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df4515bd-1eb2-40ea-8037-386f4e0e2eae tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] Returning 404 to user: Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:16.211324 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df4515bd-1eb2-40ea-8037-386f4e0e2eae tempest-VolumesSnapshotsTestJSON-1484662108 tempest-VolumesSnapshotsTestJSON-1484662108-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f" status: 404 len: 109 microversion: 2.1 time: 0.044285 Nov 06 20:53:16.213475 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1102/2235] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:16 2021] GET /compute/v2.1/os-volumes/d738ae4b-8b54-4896-8a4b-f641b20bff4f => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:16.222420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.226351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:16.241293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.244541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.246242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.246875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.288680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:16.302065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a5bf427-de59-4680-a3e6-6e0134ce1fb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1512 microversion: 2.1 time: 0.335005 Nov 06 20:53:16.306256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1134/2236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:15 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:16.311653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:16.312927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:16.319371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.320199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.321272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.321841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.380715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ff39705-e915-475a-8dc6-41dcc1ac62cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.072283 Nov 06 20:53:16.382677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1135/2237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:16 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:16.389386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.390708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:16.398759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.399710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.401580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.402479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.467323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.468027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.469091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lazy-loading 'fault' on Instance uuid 6c525837-e57b-4864-9ece-7aec3a941be2 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:16.555156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bc3358aaee478c9da0d68688f1a4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0376f3231e49d495f1777d2f774450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:16.564204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-229ce9c5-f52d-4893-8b53-b7160cbbc3a6 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 200 len: 1355 microversion: 2.1 time: 0.179812 Nov 06 20:53:16.571153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1136/2238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:16 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 1355 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:16.581433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-203a4637-dcfe-4f70-9dc2-bca987804527 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671acb4ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:16.632475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:16.640466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a8a3df2-e34e-455a-b2db-89cb14ddc08d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.425562 Nov 06 20:53:16.642360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1103/2239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:16 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:16.666453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-203a4637-dcfe-4f70-9dc2-bca987804527 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.088805 Nov 06 20:53:16.667024 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1137/2240] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:16 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:16.925884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:16.927201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:16.934256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.935004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:16.935997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:16.936638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.008061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a75075e2-8674-4a79-abde-94b50571d103 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.085669 Nov 06 20:53:17.016114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1104/2241] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:16 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:17.330285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:17.331535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:17.339088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.339808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.343208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.347128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.606854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1688099979", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ea78ef8-e148-4a0b-bb4c-92362a422eaa"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:17.653938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:17.668365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98327f86-2a83-449d-a8d4-330562cf1c09 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1489 microversion: 2.1 time: 0.350337 Nov 06 20:53:17.670817 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1105/2242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:17 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1489 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:17.691410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:17.696283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:17.710697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.714266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.715470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.716098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.721062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] validate_networks() for [('8ea78ef8-e148-4a0b-bb4c-92362a422eaa', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:53:17.776951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6643c7f6-5c0c-4969-9f23-7535e5299e6b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.103372 Nov 06 20:53:17.776951 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1106/2243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:17 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:17.791989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:17.792731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:17.806422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.806876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.808143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.812828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.839044 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. Nov 06 20:53:17.839642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:17.840792 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edc485b1-fb0f-4b7d-aaef-0ae71a09c5f3 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 404 len: 111 microversion: 2.1 time: 0.062711 Nov 06 20:53:17.841846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1107/2244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:17 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:17.847066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:17.847899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:17.856042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.856900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:17.857943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:17.858613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.243628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:18.253674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-055503f9-b919-48ab-885d-2b52d3e8805d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.410418 Nov 06 20:53:18.255409 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1108/2245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:17 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:18.266090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-352f81fb-9935-4cb6-b8ba-d650cedf9d96 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715215940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.353786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-352f81fb-9935-4cb6-b8ba-d650cedf9d96 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.096678 Nov 06 20:53:18.360154 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1109/2246] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:18 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:18.376035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.376593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:18.394521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.397762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.398628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.399077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.449333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:18.531516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:53:18.533009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:53:18.533700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:53:18.534408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:53:18.535229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:53:18.548342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.549200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.550259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.550907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.578573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Getting quotas for project 046b2d11820348118cbe7a156018a1a5. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:53:18.584166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Getting quotas for user 2db226fb557e4c0aa2e15fcc8d7a488d and project 046b2d11820348118cbe7a156018a1a5. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:53:18.604697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:53:18.607656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:53:18.626966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c015eae-a105-4eaa-9a18-5c252babb0dd tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 204 len: 0 microversion: 2.1 time: 0.265123 Nov 06 20:53:18.627558 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1110/2247] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:18 2021] DELETE /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:18.637309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.637920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:18.648946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.649509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.652588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.653244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.691810 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. Nov 06 20:53:18.692486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:18.693576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-feb46552-1f55-454d-a6ca-1e22c7337c22 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 404 len: 111 microversion: 2.1 time: 0.064942 Nov 06 20:53:18.694631 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1111/2248] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:18 2021] DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:18.699729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:18.701023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:18.707532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.707985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.718198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.718667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.735198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4b546c5-619b-4ad1-85f5-2dd3f5bc9baf tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.548888 Nov 06 20:53:18.736563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1138/2249] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:53:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:53:18.741867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-763d227f-15ff-4994-9bda-815f6f54fcfb req-46d28cf4-bad5-46e3-baf4-59bfcf16ab73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fbee84-0888-474a-a089-36a96efd162d", "name": "network-vif-plugged", "status": "completed", "tag": "9d0eeba9-6ff4-48d8-9007-9e377ba11bbf"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:18.743964 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:18.743964 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:18.753554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-763d227f-15ff-4994-9bda-815f6f54fcfb req-46d28cf4-bad5-46e3-baf4-59bfcf16ab73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.754398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-763d227f-15ff-4994-9bda-815f6f54fcfb req-46d28cf4-bad5-46e3-baf4-59bfcf16ab73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.773072 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-763d227f-15ff-4994-9bda-815f6f54fcfb req-46d28cf4-bad5-46e3-baf4-59bfcf16ab73 service nova] Creating event network-vif-plugged:9d0eeba9-6ff4-48d8-9007-9e377ba11bbf for instance a2fbee84-0888-474a-a089-36a96efd162d on nch2-master-1 Nov 06 20:53:18.788567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-763d227f-15ff-4994-9bda-815f6f54fcfb req-46d28cf4-bad5-46e3-baf4-59bfcf16ab73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050240 Nov 06 20:53:18.790116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1139/2250] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:18.801305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.802569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:18.811477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.812172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.813325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.813916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.816207 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0826339e-d318-4881-b869-66b4de6689a7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.120083 Nov 06 20:53:18.820919 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1112/2251] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:18.826866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.827779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:18.834774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.835490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.836546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:18.837160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:18.884870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. Nov 06 20:53:18.885513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:18.886436 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee2ccfd2-1ef1-42c3-9271-b0d570d5b6d2 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 404 len: 111 microversion: 2.1 time: 0.064034 Nov 06 20:53:18.896878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1113/2252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:18 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:18.910449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47954de2-59d9-47ff-81a3-999f7ee861b7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:18.911072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47954de2-59d9-47ff-81a3-999f7ee861b7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:19.034220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-47954de2-59d9-47ff-81a3-999f7ee861b7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:19.044791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47954de2-59d9-47ff-81a3-999f7ee861b7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1222 microversion: 2.1 time: 0.146657 Nov 06 20:53:19.047140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1114/2253] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:18 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:19.061227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:19.064797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:19.096997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:19.099399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:19.100729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:19.102469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:19.210567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbd393be-c427-46c2-ae0e-f42e097693c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.156827 Nov 06 20:53:19.218469 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1115/2254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:19 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:19.235966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1696cbda-1ee6-46fd-aa69-b109a3cab333 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '.version_select at 0x7f6715319790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:19.262735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:19.298768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1696cbda-1ee6-46fd-aa69-b109a3cab333 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085876697" status: 202 len: 0 microversion: 2.1 time: 0.074551 Nov 06 20:53:19.301469 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1116/2255] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 20:53:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085876697 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:19.322792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e416bc5-b484-4fa5-8f6e-541f89a608e7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1495 microversion: 2.1 time: 0.510508 Nov 06 20:53:19.338141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1140/2256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:18 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1495 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:19.351749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1945794134", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ea78ef8-e148-4a0b-bb4c-92362a422eaa"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:19.361133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:19.362051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:19.375479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:19.377340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:19.378493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:19.380734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:19.512907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] validate_networks() for [('8ea78ef8-e148-4a0b-bb4c-92362a422eaa', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:53:20.063619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:20.085478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7f70401-d707-48e0-bd53-fcb87879b842 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.744084 Nov 06 20:53:20.089422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1141/2257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:19 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:20.108088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ff0095e-023f-4ace-87fc-96a212c8e88c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67157d1310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:20.198924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ff0095e-023f-4ace-87fc-96a212c8e88c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.094535 Nov 06 20:53:20.204746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1142/2258] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:20 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:20.214855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:20.217385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:20.230192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.230646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.233013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.233652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.324605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6c0a30d-e061-49f2-9a31-9054dd3c2ccf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.120836 Nov 06 20:53:20.329579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1143/2259] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:20 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:20.336582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:20.338376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:20.346355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.347026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.348134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.348764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.424243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f47507a-c261-45fe-ac57-e130e86bcbfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.092877 Nov 06 20:53:20.429214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1144/2260] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:20 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:20.440245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:20.441141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:20.468425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.475625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.477487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.479165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.942545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:53:20.944559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:53:20.946327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:53:20.948755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:53:20.949598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:53:20.976181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.978030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:20.979296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:20.979997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.008060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Getting quotas for project 046b2d11820348118cbe7a156018a1a5. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:53:21.016835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Getting quotas for user 2db226fb557e4c0aa2e15fcc8d7a488d and project 046b2d11820348118cbe7a156018a1a5. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:53:21.031805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:53:21.034931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:53:21.105603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:21.113419 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da163917-e355-4a79-a793-de0de25537e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.808873 Nov 06 20:53:21.114397 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1117/2261] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:53:19 2021] POST /compute/v2.1/servers => generated 383 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:53:21.120169 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e330f02-c013-45ed-8a5b-8c18cd2e185e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1495 microversion: 2.1 time: 0.686601 Nov 06 20:53:21.120169 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1145/2262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:20 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1495 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:21.126412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:21.127276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:21.137167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.138060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.138574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c5b7777-272e-4fd0-8294-aa8fdff378de tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f67157d1310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:21.139480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.140566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.237791 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c5b7777-272e-4fd0-8294-aa8fdff378de tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/1b1324d3-1a5f-40dd-b5f5-3802531dd4f5" status: 200 len: 343 microversion: 2.1 time: 0.104743 Nov 06 20:53:21.238567 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1146/2263] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:21 2021] GET /compute/v2.1/os-volumes/1b1324d3-1a5f-40dd-b5f5-3802531dd4f5 => generated 343 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:21.243062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c4fdc4d-a759-42d5-9571-63babdf97974 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:21.244729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c4fdc4d-a759-42d5-9571-63babdf97974 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:21.358563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3c4fdc4d-a759-42d5-9571-63babdf97974 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:21.365482 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c4fdc4d-a759-42d5-9571-63babdf97974 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1222 microversion: 2.1 time: 0.125697 Nov 06 20:53:21.369399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1147/2264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:21 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:21.373812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-411cffdf-6b7a-4cec-aec0-479a8b56020d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac64160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:21.496385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-411cffdf-6b7a-4cec-aec0-479a8b56020d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.125728 Nov 06 20:53:21.496862 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1148/2265] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:21 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:21.518676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:21.551395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:21.594171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.608606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.610582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.613046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.798140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:21.814361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a375122a-c419-406e-8072-a354f34b5775 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.691893 Nov 06 20:53:21.821415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1118/2266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:21 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:21.846637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:21.852668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:21.863390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc564b7e-4ea8-498d-9467-7864e338045a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.361299 Nov 06 20:53:21.891336 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1149/2267] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:21.919699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.921084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:21.930763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:21.933215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:22.072678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3c33d1a-c872-4b7d-8452-af4307f6fa97 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.238033 Nov 06 20:53:22.074342 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1119/2268] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:21 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:22.136105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:22.138136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:22.159081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:22.162874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:22.163738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:22.164191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:22.600931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a46a2a6-488a-4b03-ad97-afab59b61c1b tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:22.602303 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:22.602303 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:22.653234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a46a2a6-488a-4b03-ad97-afab59b61c1b tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/41995773" status: 202 len: 0 microversion: 2.1 time: 0.757167 Nov 06 20:53:22.656931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1150/2269] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:53:21 2021] DELETE /compute/v2.1/flavors/41995773 => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:22.661984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:22.665870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:22.678541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:22.679235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:22.680415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:22.681038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:22.972088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:22.980047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:22.981072 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8fa35211-3823-402e-a3d6-48b26f36e606 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 200 len: 1453 microversion: 2.1 time: 0.850888 Nov 06 20:53:22.991440 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-830d22a2-6e08-4dcf-8c76-d03e9f80ed17 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1218 microversion: 2.1 time: 0.334641 Nov 06 20:53:22.994090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1151/2271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:22 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1218 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:23.002675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1120/2271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:22 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 1453 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:23.006738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3827272e-fa38-44a7-bbb3-4cc17a0199e2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671576bb80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.009519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6f16ed3f-e270-4a49-8f2f-6758b17427ef req-27d475ff-de4b-4108-8e09-5a1c21acfd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628d735-8393-4d0e-9126-37ca09231b4e", "name": "network-vif-deleted", "tag": "41a8c318-4f4a-48fc-80b1-233aca022d86"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:23.011448 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:23.011448 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:23.022541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f16ed3f-e270-4a49-8f2f-6758b17427ef req-27d475ff-de4b-4108-8e09-5a1c21acfd40 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.023287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f16ed3f-e270-4a49-8f2f-6758b17427ef req-27d475ff-de4b-4108-8e09-5a1c21acfd40 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.036733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6f16ed3f-e270-4a49-8f2f-6758b17427ef req-27d475ff-de4b-4108-8e09-5a1c21acfd40 service nova] Creating event network-vif-deleted:41a8c318-4f4a-48fc-80b1-233aca022d86 for instance b628d735-8393-4d0e-9126-37ca09231b4e on nch2-master-1 Nov 06 20:53:23.043595 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6f16ed3f-e270-4a49-8f2f-6758b17427ef req-27d475ff-de4b-4108-8e09-5a1c21acfd40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039362 Nov 06 20:53:23.045861 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1121/2272] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:23.061595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4fdabb1-32cf-4546-96bf-496809a3a3d4 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.076150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3827272e-fa38-44a7-bbb3-4cc17a0199e2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.080565 Nov 06 20:53:23.077053 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1152/2273] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:22 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:23.088451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4fdabb1-32cf-4546-96bf-496809a3a3d4 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.038902 Nov 06 20:53:23.100280 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1122/2274] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:23.100280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:23.100280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.104579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.105465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.106393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.106854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.107664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.108101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.122740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.123523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.124599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.125195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.155391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-984e694b-92bb-42eb-b569-d3a87ad6639c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.064613 Nov 06 20:53:23.159500 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1123/2275] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:23.161095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:23.172947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.179831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.180623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.181654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.182259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.238831 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46c44889-aa77-406b-a8fc-a008543a9c55 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.081154 Nov 06 20:53:23.239790 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1124/2276] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:23 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:23.249682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d63b298-8c94-45ab-abae-e15af8cf165f tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.252502 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:23.252502 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:23.292655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d63b298-8c94-45ab-abae-e15af8cf165f tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1494599763" status: 202 len: 0 microversion: 2.1 time: 0.051118 Nov 06 20:53:23.294290 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1125/2277] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 20:53:23 2021] DELETE /compute/v2.1/flavors/1494599763 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:23.305835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76722a91-d66a-4340-a1c2-d3588dee3116 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.352827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76722a91-d66a-4340-a1c2-d3588dee3116 tempest-ServersWithSpecificFlavorTestJSON-805627603 tempest-ServersWithSpecificFlavorTestJSON-805627603-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054468 Nov 06 20:53:23.354583 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1126/2278] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:23.359920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a349d53a-6530-4047-baf0-e6c84673c7b4 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f671539c4c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.484110 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a349d53a-6530-4047-baf0-e6c84673c7b4 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/24ef2805-6baf-498e-8cca-3f821c259823" status: 200 len: 343 microversion: 2.1 time: 0.128291 Nov 06 20:53:23.484728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1127/2279] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/os-volumes/24ef2805-6baf-498e-8cca-3f821c259823 => generated 343 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:23.498878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.499491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.507147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.507861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.509166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.509773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.543010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. Nov 06 20:53:23.545041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:23.547078 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7996331b-e9de-4273-8273-bef0d7be56bc tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 404 len: 111 microversion: 2.1 time: 0.060568 Nov 06 20:53:23.548116 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1128/2280] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:23 2021] DELETE /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:23.558769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.559674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 6c525837-e57b-4864-9ece-7aec3a941be2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.568442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.569188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.570105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.570657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.637074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. Nov 06 20:53:23.637862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 6c525837-e57b-4864-9ece-7aec3a941be2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:23.641459 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03bda07d-a80b-4dfe-8571-b215622ceede tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2" status: 404 len: 111 microversion: 2.1 time: 0.086312 Nov 06 20:53:23.642134 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1129/2281] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/servers/6c525837-e57b-4864-9ece-7aec3a941be2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:23.651173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.658038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.679558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.680028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.681018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.692961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.735554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. Nov 06 20:53:23.737627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:23.739677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-522fd9a5-279d-46b1-994b-150c05603e04 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 404 len: 111 microversion: 2.1 time: 0.091825 Nov 06 20:53:23.748710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1130/2282] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:23 2021] DELETE /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:23.761823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:23.762799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] [instance: 3bbc8ec1-8c19-4586-a720-c08f62c147ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:23.779092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.780064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.781846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:23.783663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:23.818193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] HTTP exception thrown: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. Nov 06 20:53:23.822152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] Returning 404 to user: Instance 3bbc8ec1-8c19-4586-a720-c08f62c147ba could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:23.824829 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-855dd5b2-0963-41ef-b6d4-7127d9d2c405 tempest-ServersWithSpecificFlavorTestJSON-160307547 tempest-ServersWithSpecificFlavorTestJSON-160307547-project] 10.222.0.13 "GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba" status: 404 len: 111 microversion: 2.1 time: 0.073341 Nov 06 20:53:23.834446 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1131/2283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/servers/3bbc8ec1-8c19-4586-a720-c08f62c147ba => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:23.930190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:23.940544 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42f34a5b-5b18-4998-bf98-642daf70dc11 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.856544 Nov 06 20:53:23.944117 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1153/2284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:23.999533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:24.000154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:24.010865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:24.011914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:24.020387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.021119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.025211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.028620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.029775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.030753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.035112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.037373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.106879 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. Nov 06 20:53:24.107478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:24.113291 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de0f15f0-573d-45d3-925c-08fb2d967358 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 404 len: 111 microversion: 2.1 time: 0.117444 Nov 06 20:53:24.114116 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1132/2285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:23 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:24.156598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3aa93390-f0e1-43c2-bf61-c1fc2bb6d787 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715370040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:24.173898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:24.181927 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c75d233a-1c52-4cc4-96b8-185725f4bdf7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1280 microversion: 2.1 time: 0.176452 Nov 06 20:53:24.199926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1154/2286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:24 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:24.204813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:24.219979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:24.234568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.242239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.243107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.250407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.255355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3aa93390-f0e1-43c2-bf61-c1fc2bb6d787 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.132854 Nov 06 20:53:24.256589 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1133/2287] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:24 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:24.270782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:24.274019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:24.289093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.290138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.294268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.295953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:24.325386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55ec07f5-eb10-4540-ac5f-55d974fea92d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.123939 Nov 06 20:53:24.330720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1155/2288] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:24 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:24.369297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b23cf3b9-5baf-4f77-84df-a5145dab6c81 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.110865 Nov 06 20:53:24.370226 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1134/2289] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:24 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:24.374724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-705400424", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "cf6dfc64-25a7-4971-95b2-b28cae749918"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:24.454766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] validate_networks() for [('cf6dfc64-25a7-4971-95b2-b28cae749918', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:53:24.969671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:24.973592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:24.994653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:24.995220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:25.001046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:25.001819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:25.655807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:25.686330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-789dfc88-ffef-40e4-86fb-dcd800634cd5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.729812 Nov 06 20:53:25.688997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1135/2290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:24 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:25.700587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f804f6e-55d3-48c6-8f83-2b9fa2c748d1 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f67152e4790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:25.780777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f804f6e-55d3-48c6-8f83-2b9fa2c748d1 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/cd43b0f1-d573-4b4e-809b-ce84a89e8c32" status: 200 len: 343 microversion: 2.1 time: 0.086500 Nov 06 20:53:25.781890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1136/2291] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 20:53:25 2021] GET /compute/v2.1/os-volumes/cd43b0f1-d573-4b4e-809b-ce84a89e8c32 => generated 343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:25.790008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:25.791395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:25.807653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:25.808272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:25.809261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:25.809762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:25.969279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:53:25.970166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:53:25.970844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:53:25.971281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:53:25.971871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:53:25.991539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:25.992336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:25.993159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:25.994182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.022797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:53:26.028529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Getting quotas for user 44347de86f1149a2b9288ca04ec59e13 and project 4e36c34c8ba54c99826390aff2abf4d7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:53:26.050629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:53:26.053906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:53:26.136155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f774168-e398-4715-9595-99315eafe4c4 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765931 Nov 06 20:53:26.137812 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1156/2292] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:53:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:53:26.144838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef07b5eb-2d66-43b3-b5ee-7683b030e0d6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac72160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.239343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef07b5eb-2d66-43b3-b5ee-7683b030e0d6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.099863 Nov 06 20:53:26.241360 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1157/2293] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:26.252224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:26.257154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:26.273471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.274125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.275647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.276248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.284042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:26.296618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81f44afc-6e35-438b-944b-247d66d8c427 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.513439 Nov 06 20:53:26.306639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1137/2294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:25 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:26.320135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:26.324914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:26.335468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.335937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.336793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.345049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.345382 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aa3366a-45e9-4f8a-b029-5d1c30b04ac6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.102447 Nov 06 20:53:26.348272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1158/2295] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:26.358021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da9aec66-89b0-4a16-afa2-e9bc1d25bcb8 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f671ac64a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.471137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e34e5fe0-3856-4555-b9b3-57143552fb76 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.163073 Nov 06 20:53:26.477702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1138/2296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:26 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:26.498232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19fa8c7f-b03e-4d2f-8325-c857c5937305 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.498487 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da9aec66-89b0-4a16-afa2-e9bc1d25bcb8 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.145030 Nov 06 20:53:26.499878 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1159/2297] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/os-volumes => generated 1012 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:26.506554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19fa8c7f-b03e-4d2f-8325-c857c5937305 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:26.514643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45da3f9f-5d30-4744-8368-3ae5094d9eab tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f671ac724c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.668224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-19fa8c7f-b03e-4d2f-8325-c857c5937305 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:26.676841 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19fa8c7f-b03e-4d2f-8325-c857c5937305 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1214 microversion: 2.1 time: 0.196625 Nov 06 20:53:26.692022 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1139/2298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:26.703964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-37250e44-1570-4935-877e-e124f2538668 req-17c87c40-f9d6-4bbb-b6cb-87cef3250128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d9c005-dc47-4fb6-ac23-fdeada22a300", "tag": "73c5bd90-3d67-4158-bff8-91e07f8a029b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:26.707622 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:26.707622 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:26.727839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-37250e44-1570-4935-877e-e124f2538668 req-17c87c40-f9d6-4bbb-b6cb-87cef3250128 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.728322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-37250e44-1570-4935-877e-e124f2538668 req-17c87c40-f9d6-4bbb-b6cb-87cef3250128 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.732092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45da3f9f-5d30-4744-8368-3ae5094d9eab tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.223037 Nov 06 20:53:26.733241 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1160/2299] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:26.738397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.739367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:26.758411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.761088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.761231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-37250e44-1570-4935-877e-e124f2538668 req-17c87c40-f9d6-4bbb-b6cb-87cef3250128 service nova] Creating event network-changed:73c5bd90-3d67-4158-bff8-91e07f8a029b for instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 on nch2-master-1 Nov 06 20:53:26.763672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:26.764392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:26.785508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-37250e44-1570-4935-877e-e124f2538668 req-17c87c40-f9d6-4bbb-b6cb-87cef3250128 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091653 Nov 06 20:53:26.786118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1140/2300] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:26.791732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed364a29-4ab6-4786-b5bd-bdedff32e2fa tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f6715215f70>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:26.960135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed364a29-4ab6-4786-b5bd-bdedff32e2fa tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.172724 Nov 06 20:53:26.961122 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1141/2301] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/os-volumes => generated 1012 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:26.972991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-207027e1-6a00-41a9-9aa8-565036f8b0c2 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f6715356700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.157500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-207027e1-6a00-41a9-9aa8-565036f8b0c2 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.188701 Nov 06 20:53:27.158724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1142/2302] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:27.177138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1360cdad-f57b-4b26-8eb1-5e8d822314da tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f6715356280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.298437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1360cdad-f57b-4b26-8eb1-5e8d822314da tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.127301 Nov 06 20:53:27.299632 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1143/2303] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:27.306938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5bcea646-aabc-4890-99de-710f98668601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715370550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.383793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5bcea646-aabc-4890-99de-710f98668601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.082816 Nov 06 20:53:27.402307 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1144/2304] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:27.414642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dea07470-072e-4a02-b781-447d4e1d1640 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f67152b4040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.429828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:27.465074 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91faf2e2-3690-4d1c-9d8d-2afedce67f85 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.727112 Nov 06 20:53:27.467012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1161/2305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:26 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:27.498373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.501206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:27.529955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.531527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.533822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.535490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.614387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dea07470-072e-4a02-b781-447d4e1d1640 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.210642 Nov 06 20:53:27.615507 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1145/2306] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:27.621083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:27.622518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:27.629729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.630436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.631570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.632404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.701549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00deeaa7-82fd-4f55-8a01-12c08a1796be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.084552 Nov 06 20:53:27.713318 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1146/2307] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:27 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:27.727251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:27.729940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:27.742534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.743359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.745263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.746209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.855368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b33927c1-bb38-4016-93a9-6975826b9be5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.139306 Nov 06 20:53:27.856069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1147/2308] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:27 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:27.880810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-aea51d09-9d05-45b2-ac43-3811e1f8a48f req-91e68600-28d0-41c0-8227-5a1925d08a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0814b2-5fff-4e39-99c9-479ea42beac3", "tag": "b8c16e54-38d3-4289-ad74-9c49e490aa25"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:27.883536 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:27.883536 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:27.900881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-aea51d09-9d05-45b2-ac43-3811e1f8a48f req-91e68600-28d0-41c0-8227-5a1925d08a34 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.901878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-aea51d09-9d05-45b2-ac43-3811e1f8a48f req-91e68600-28d0-41c0-8227-5a1925d08a34 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.919105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-aea51d09-9d05-45b2-ac43-3811e1f8a48f req-91e68600-28d0-41c0-8227-5a1925d08a34 service nova] Creating event network-changed:b8c16e54-38d3-4289-ad74-9c49e490aa25 for instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 on nch2-master-1 Nov 06 20:53:27.925663 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-aea51d09-9d05-45b2-ac43-3811e1f8a48f req-91e68600-28d0-41c0-8227-5a1925d08a34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068091 Nov 06 20:53:27.926623 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1148/2309] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:27.936587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:27.945605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5bffdf8a-e864-4837-befb-ec8b3f5073bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.462506 Nov 06 20:53:27.948471 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1162/2310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:27.956032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2c82c6f6-9d3b-40a5-82e0-bde974283421 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f6715215a60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.960854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:27.962796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:27.977325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.979281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:27.980590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:27.982054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:28.174286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2c82c6f6-9d3b-40a5-82e0-bde974283421 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.232245 Nov 06 20:53:28.175572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1149/2311] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:28.195378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a90c3d1-e901-490e-a3d4-2998514576c4 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] Calling method '.version_select at 0x7f671537e0d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:28.329421 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a90c3d1-e901-490e-a3d4-2998514576c4 tempest-VolumesTestJSON-1109118639 tempest-VolumesTestJSON-1109118639-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.138839 Nov 06 20:53:28.332343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1150/2312] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 20:53:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:28.432035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb9ab0e9-219b-485a-80d5-bfa9101c93a5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671524bd30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:28.521100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb9ab0e9-219b-485a-80d5-bfa9101c93a5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.108236 Nov 06 20:53:28.525894 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1151/2313] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:28 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:28.536766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:28.537813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:28.562018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:28.563492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:28.564614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:28.568105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:28.979371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:28.995346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34d49871-6299-4dc4-8e64-5f15ec0dd98d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1274 microversion: 2.1 time: 1.044852 Nov 06 20:53:28.998975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1163/2314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:27 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1274 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:29.003813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:29.011974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:29.025757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.026642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.035970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.036621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.101555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b465c50c-5cba-4bd7-8eaf-9177925ae0fa tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.100880 Nov 06 20:53:29.102852 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1164/2315] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:29.111425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:29.113271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:29.126099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.127957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.129482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.130362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.199695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-504f8615-7605-42cf-aaea-8002ea8efa03 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.093875 Nov 06 20:53:29.216744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1165/2316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:29 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:29.222357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:29.223093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:29.240597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.241049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.241855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:29.242288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:29.664944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:29.681994 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0fc6be64-2f21-40ac-a2c0-a1e173761884 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 1.151862 Nov 06 20:53:29.682596 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1152/2317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:28 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:29.697347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d81ac11e-f9b1-4c80-a671-fa889f5a38e7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671524b700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:29.801206 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d81ac11e-f9b1-4c80-a671-fa889f5a38e7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.117404 Nov 06 20:53:29.807490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1153/2318] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:29 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:29.973475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:29.984750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-151ad492-de01-4d8a-90d7-6af554b2bc5e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.766589 Nov 06 20:53:29.986578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1166/2319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:29 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:30.019251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:30.020101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:30.032734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.034666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.036345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.036345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.114858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:30.116198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:30.131721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.132319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.133275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.134702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.248971 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1fb946d-1bcf-4e64-95fc-ce794f18e54a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.132175 Nov 06 20:53:30.255558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1167/2320] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:30 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:30.272010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:30.275334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:30.285174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:30.293139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.296219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.297374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.299166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.309148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bd8e631-a5e3-4074-904e-4356e4dce77c tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1272 microversion: 2.1 time: 0.293890 Nov 06 20:53:30.311133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1154/2321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:30 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:30.425481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-080add0c-acfa-4b58-8f17-598686e4f71d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.165580 Nov 06 20:53:30.426858 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1168/2322] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:30 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:30.701433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:30.702327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:30.711677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.713048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.714109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:30.714765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:30.815568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88a4eefd-9a96-43f4-b525-7d04cf21fae5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671acf3280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:30.908979 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88a4eefd-9a96-43f4-b525-7d04cf21fae5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.097581 Nov 06 20:53:30.914637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1169/2323] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:30 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:31.003694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:31.011680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:31.024045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.024915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.030082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.030592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.090518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:31.099065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56e6568f-b5cb-4c6c-982e-b8d9c0e0e7a0 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.404018 Nov 06 20:53:31.100111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1155/2324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:30 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:31.266878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:31.268539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:31.276709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.277648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.278892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.279555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.350682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3ae3d9d-4b68-4866-8762-b47da2ad9c64 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.089008 Nov 06 20:53:31.356153 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1156/2325] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:31 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:31.370228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:31.372363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:31.373921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:31.384618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2851aad-d9fa-419c-9b86-32b05e81fac5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.383279 Nov 06 20:53:31.385591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1170/2326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:30 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:31.385739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.386105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.387731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.388829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.438477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:31.440686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:31.457719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.458766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.459864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:31.464355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:31.611321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b80e5ea-00e9-412a-948b-756307edb91e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.176754 Nov 06 20:53:31.612783 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1171/2327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:31 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:31.900455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:31.923199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d738d3a6-68b2-425f-a6ca-8f0110f8befa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac64280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:31.932972 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e08e295-aac5-4d1c-92b4-c4c1e1f3ab2e tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.557688 Nov 06 20:53:31.943431 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1157/2328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:31 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:32.003248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d738d3a6-68b2-425f-a6ca-8f0110f8befa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.085062 Nov 06 20:53:32.004890 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1172/2329] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:31 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:32.119561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:32.119561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:32.143008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.143500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.144700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.145175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.396729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:32.400195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:32.426726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.427451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.429977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.430746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.525899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37c8fc50-d999-409f-ae58-167722fd263b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.150961 Nov 06 20:53:32.527441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1173/2330] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:32 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:32.545526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:32.557339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:32.569290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.570610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.572044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.573572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.787712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:32.815644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34139c94-8023-4fd0-980f-58ad6e943102 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.701637 Nov 06 20:53:32.826559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1158/2331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:32 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:32.834890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:32.837599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:32.845524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.846247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.847363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.847962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.925081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9698301-f36b-4fd7-a232-8646fb360b31 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.087711 Nov 06 20:53:32.933149 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1159/2332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:32 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:32.958120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:32.959302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:32.975424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.975898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:32.981653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:32.983227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.119809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:33.136566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3799784a-c56f-4eff-9ce2-138e6917eae5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.607195 Nov 06 20:53:33.143576 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1174/2333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:32 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:33.148953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d4f8c144-3210-4d8b-b4ef-a045731ad8e6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671acb5280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:33.257918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d4f8c144-3210-4d8b-b4ef-a045731ad8e6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.112443 Nov 06 20:53:33.259309 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1175/2334] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:33 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:33.267288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6ba94cf6-eac1-484e-b6a8-f47172305fb2 req-90e80eac-4979-4789-bbf5-5b5b3d8f4a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20708bdc-f507-44fd-a579-76e5dcf84f7a", "tag": "ca70788c-4fdb-4374-8301-566c72ee62ea"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:33.269565 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:33.269565 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:33.280937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6ba94cf6-eac1-484e-b6a8-f47172305fb2 req-90e80eac-4979-4789-bbf5-5b5b3d8f4a2f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.281727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6ba94cf6-eac1-484e-b6a8-f47172305fb2 req-90e80eac-4979-4789-bbf5-5b5b3d8f4a2f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.306374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6ba94cf6-eac1-484e-b6a8-f47172305fb2 req-90e80eac-4979-4789-bbf5-5b5b3d8f4a2f service nova] Creating event network-changed:ca70788c-4fdb-4374-8301-566c72ee62ea for instance 20708bdc-f507-44fd-a579-76e5dcf84f7a on nch2-master-1 Nov 06 20:53:33.318579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6ba94cf6-eac1-484e-b6a8-f47172305fb2 req-90e80eac-4979-4789-bbf5-5b5b3d8f4a2f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056740 Nov 06 20:53:33.319627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1176/2335] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:33.444028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:33.458965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9927c38f-69c5-4ac9-86dd-c9a45cc23dbc tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.507248 Nov 06 20:53:33.459557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1160/2336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:32 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:33.538008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:33.539030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:33.554460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.554916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.556270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.556922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.645224 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c09fb16c-17eb-461a-9788-06f4933c1ac3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.111110 Nov 06 20:53:33.650414 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1177/2337] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:33.831927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:33.832577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:33.842494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.842917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.843752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.844336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.940656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:33.941731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:33.954894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.955357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:33.956159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:33.956630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.032851 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa8d3447-6b37-46fd-9078-871cf0fcac4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.097170 Nov 06 20:53:34.033506 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1178/2338] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:33 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:34.159831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:34.160642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:34.185855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.189216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.190492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.192185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.377521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:34.391639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bfe360af-00f4-4d21-bf4f-11a4c72f67d5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1477 microversion: 2.1 time: 0.563229 Nov 06 20:53:34.392893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1161/2339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:33 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1477 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:34.397901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42a831c5-4d54-435a-8ed1-00581153e83e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67152e98b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:34.463577 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42a831c5-4d54-435a-8ed1-00581153e83e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.067285 Nov 06 20:53:34.464840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1162/2340] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:34 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:34.485155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:34.485789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:34.504921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.505385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.506214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.506645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.708531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:34.730877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ae4b7fc-afa3-4445-9c92-8048d139e914 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.575178 Nov 06 20:53:34.741623 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1179/2341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:34 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:34.746684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:34.747887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:34.755324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.756001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.757037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:34.758258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:34.823851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:34.834519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c75c9b43-4e11-4651-a805-3133dd630c9f tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.361601 Nov 06 20:53:34.835092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1163/2342] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:34 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:34.859824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccfc7650-460b-447e-9d55-6d7d2b06bca5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.108982 Nov 06 20:53:34.862094 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1180/2343] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:34 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:35.044946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:35.047035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:35.061001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.062031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.064089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.065701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.145193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a32e297-145e-453f-babe-d791cbec1599 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.103852 Nov 06 20:53:35.152221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1164/2344] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:35 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:35.409713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:35.411404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:35.425826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.426512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.427501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.428103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.480718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7a2bd4d-7c17-49d1-a7e6-44788cc16818 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671525ddc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:35.566784 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7a2bd4d-7c17-49d1-a7e6-44788cc16818 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.092436 Nov 06 20:53:35.567931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1165/2345] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:35 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:35.750185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:35.750922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:35.763580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.764042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.765514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.765972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.831084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:35.861573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-399267f8-ae4b-4323-a71d-e1baeee4b5ce tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1476 microversion: 2.1 time: 0.445128 Nov 06 20:53:35.862245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1181/2346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:35 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:35.884648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:35.890483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:35.903526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.904234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:35.906070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:35.907139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.218353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:36.240108 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca57d4a4-5990-4b60-bde2-3ef56bb220a6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.374288 Nov 06 20:53:36.243803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:36.246823 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1182/2347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:35 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:36.260228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:36.262920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:36.263748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1506cfc9-a61f-4838-9cf0-ecd06b857cfc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.520701 Nov 06 20:53:36.264676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1166/2348] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:35 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:36.276925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.277615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.280493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.281146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.287694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:36.288802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:36.307532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.307993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.308828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.309267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.384852 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cafdece0-fa57-4c1e-a66f-8a181e498633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.129721 Nov 06 20:53:36.385587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1183/2349] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:36 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:36.402852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-unplugged", "status": "completed", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:36.408137 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:36.408137 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:36.420683 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1d069ec-40f6-4f17-b833-8bfc80152725 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.153985 Nov 06 20:53:36.421349 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1167/2350] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:36 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:36.424461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.424990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.486668 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] Creating event network-vif-unplugged:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch1-master-1 Nov 06 20:53:36.514386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:53:36.545332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b5f37529-5500-4ce1-81ba-e92d644baebd req-c8a8fee7-664c-4a18-9968-1a6a4d400ff2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151777 Nov 06 20:53:36.549021 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1184/2351] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:36.580713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-417c34a7-b973-4087-8e90-0bb65aeac554 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671539ce50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:36.679457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-417c34a7-b973-4087-8e90-0bb65aeac554 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.103437 Nov 06 20:53:36.680415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1168/2352] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:36 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:36.803482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6158c4e6-45be-48b5-9904-3d27ab81162a req-199867c2-d48c-4314-a04d-48ef0fb6bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d9c005-dc47-4fb6-ac23-fdeada22a300", "name": "network-vif-plugged", "status": "completed", "tag": "73c5bd90-3d67-4158-bff8-91e07f8a029b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:36.805051 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:36.805051 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:36.833646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6158c4e6-45be-48b5-9904-3d27ab81162a req-199867c2-d48c-4314-a04d-48ef0fb6bf31 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.834037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6158c4e6-45be-48b5-9904-3d27ab81162a req-199867c2-d48c-4314-a04d-48ef0fb6bf31 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.882785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:36.883523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:36.890687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6158c4e6-45be-48b5-9904-3d27ab81162a req-199867c2-d48c-4314-a04d-48ef0fb6bf31 service nova] Creating event network-vif-plugged:73c5bd90-3d67-4158-bff8-91e07f8a029b for instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 on nch2-master-1 Nov 06 20:53:36.892039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.892539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.893354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:36.893794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:36.909953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6158c4e6-45be-48b5-9904-3d27ab81162a req-199867c2-d48c-4314-a04d-48ef0fb6bf31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111043 Nov 06 20:53:36.918467 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1185/2353] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:37.264050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:37.264754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:37.285369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.293464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.299397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.302594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.589078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:37.605064 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9317605-991b-42b7-aa6c-940d5bf0befd tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1476 microversion: 2.1 time: 0.729360 Nov 06 20:53:37.607744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1169/2354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:36 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:37.620864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:37.624063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:37.639911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.645629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.647334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.654779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.766800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:37.778042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c46fe045-3c95-4d49-a735-4c48fbb0bd25 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.518396 Nov 06 20:53:37.792614 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1186/2355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:37 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:37.797300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:37.798240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:37.812198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.812677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.821621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.824158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.908539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24373b4e-4a4c-4a30-8170-aebdaefcc820 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.123377 Nov 06 20:53:37.912415 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1187/2356] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:37 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:37.920728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:37.928007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:37.951301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.953560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:37.956675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:37.957834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:38.017776 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17d7a406-c6d1-49b1-a96b-50a68ba212c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.103216 Nov 06 20:53:38.023609 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1188/2357] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:37 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:38.035008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b606589-8031-41f8-b4ea-e88ae384a546 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac75940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:38.070774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:38.081080 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52f9d1c9-caaf-4213-a2b0-bb7e7488c72b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.470679 Nov 06 20:53:38.085302 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1170/2358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:37 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:38.138046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b606589-8031-41f8-b4ea-e88ae384a546 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.112558 Nov 06 20:53:38.138638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1189/2359] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:38 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:38.601552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:38.604393 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:38.604393 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:38.626084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:38.626980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:38.632551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:38.632551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:38.637380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:38.638114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:38.639232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:38.639955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:38.682345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] Creating event network-changed:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch1-master-1 Nov 06 20:53:38.691116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:53:38.707467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2c45b6a1-697f-4b38-84b6-c8380560a978 req-48f7f52d-f49c-46be-b886-eea8ceeb2b27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111019 Nov 06 20:53:38.708843 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1171/2360] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:38.801229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:38.802337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:38.814703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:38.815407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:38.829369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:38.831956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.356941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:39.364984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a6d6df2-3436-4633-8497-a1da7ef42db7 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.568898 Nov 06 20:53:39.378771 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1172/2361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:38 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:39.388437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:39.392118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:39.419956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.420643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.421634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.422234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.506479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:39.507937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed9735b2-4fa1-4ea3-9a81-6e9c53bf7687 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.127546 Nov 06 20:53:39.509132 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1173/2362] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:39 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:39.515330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84d4a9ff-6145-43a4-91e0-671fc2f2d60f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1476 microversion: 2.1 time: 0.894448 Nov 06 20:53:39.518604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-449f2e17-b643-4e38-bcf6-8e7601c74dc4 req-6d9aaf1c-032d-4859-aab4-5e81c88e483f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0814b2-5fff-4e39-99c9-479ea42beac3", "name": "network-vif-plugged", "status": "completed", "tag": "b8c16e54-38d3-4289-ad74-9c49e490aa25"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:39.519833 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1190/2363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:38 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1476 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:39.520782 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:39.520782 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:39.535233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-449f2e17-b643-4e38-bcf6-8e7601c74dc4 req-6d9aaf1c-032d-4859-aab4-5e81c88e483f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.535978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-449f2e17-b643-4e38-bcf6-8e7601c74dc4 req-6d9aaf1c-032d-4859-aab4-5e81c88e483f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.537919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:39.539200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:39.551218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.556208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.558004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.560998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.584096 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-449f2e17-b643-4e38-bcf6-8e7601c74dc4 req-6d9aaf1c-032d-4859-aab4-5e81c88e483f service nova] Creating event network-vif-plugged:b8c16e54-38d3-4289-ad74-9c49e490aa25 for instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 on nch2-master-1 Nov 06 20:53:39.596521 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-449f2e17-b643-4e38-bcf6-8e7601c74dc4 req-6d9aaf1c-032d-4859-aab4-5e81c88e483f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083917 Nov 06 20:53:39.598139 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1174/2364] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:39.608152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:39.609641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:39.617151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.618064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.619033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:39.619633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:39.634675 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9ed9515-704a-4d84-b859-89fe01c30b6e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.113293 Nov 06 20:53:39.635616 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1191/2365] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:39 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:39.642547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0894bbca-544f-4608-95e3-0192c0ee18c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac88f70>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:39.716638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0894bbca-544f-4608-95e3-0192c0ee18c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1413 microversion: 2.1 time: 0.079244 Nov 06 20:53:39.718577 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1192/2366] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:39 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:40.072696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:40.084386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4984b3b9-d29f-4ee7-9e3b-bb86ecdab011 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.479008 Nov 06 20:53:40.085359 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1175/2367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:39 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:40.383210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:40.384594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:40.392044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.392816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.393808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.394439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.519885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:40.521444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:40.542366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.542735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.543539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.543969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.603187 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c37b15f5-5719-454a-9dc0-fc4be11e6581 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.086710 Nov 06 20:53:40.604617 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1176/2368] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:40 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:40.612139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:40.614151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:40.622814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.623445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.624282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.625075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.675758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:40.687375 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-192056b3-c033-4fd6-8225-e38dde4af671 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.308190 Nov 06 20:53:40.688027 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1193/2369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:40 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:40.692858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:40.694943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:40.701796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.702554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.703510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:40.704408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:40.756845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-646b3e51-6526-43e2-84f7-c2c7cae82085 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.067071 Nov 06 20:53:40.758344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1194/2370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:40 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:40.764250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df83a257-4992-4fb5-9863-1a22677cd417 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715b479d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:40.828078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df83a257-4992-4fb5-9863-1a22677cd417 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1422 microversion: 2.1 time: 0.067672 Nov 06 20:53:40.829141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1195/2371] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:40 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:40.842071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2f56800-f0ed-4897-bece-3008b2f4060a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671acf33a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:40.891042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2f56800-f0ed-4897-bece-3008b2f4060a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 200 len: 1422 microversion: 2.1 time: 0.054327 Nov 06 20:53:40.891723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1196/2372] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:53:40 2021] GET /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 1422 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:40.904373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1905173-e042-4296-867a-e7a90fb0928c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac954c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:40.992897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:41.007667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-854915bd-681b-466e-880c-15d8f752e8ab tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1474 microversion: 2.1 time: 0.401402 Nov 06 20:53:41.011205 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1177/2373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:40 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1474 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:41.101587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:41.102189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:41.112587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.113061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.114013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.114449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.347868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:41.356344 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d265edf-a5ac-4e12-bd6d-96a39cfd6325 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1322 microversion: 2.1 time: 0.258569 Nov 06 20:53:41.357648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1178/2374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:41 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:41.616047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:41.625656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:41.661012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.661826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.662898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.663563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.723781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26545f04-e93f-4ddd-ab81-f38a307ce53e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.112008 Nov 06 20:53:41.725015 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1179/2375] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:41.739254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:41.742300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:41.753140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.754097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.755925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.756952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.905249 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1905173-e042-4296-867a-e7a90fb0928c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 204 len: 0 microversion: 2.1 time: 1.004742 Nov 06 20:53:41.905901 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1197/2376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:40 2021] DELETE /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:41.913791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:41.916950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:41.937009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.937464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:41.939195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:41.941146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.013419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:42.019491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a96824b-fc59-43d4-bd00-22116d39c182 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.105557 Nov 06 20:53:42.025320 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1198/2377] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:41 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:42.028501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b97d0daa-b887-4e99-b127-040aafb9187d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.301734 Nov 06 20:53:42.029064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1180/2378] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:41 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:42.035693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:42.036325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:42.041706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:42.042512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:42.055882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.056388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.057195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.057635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.061990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.062462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.063731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.064189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.102035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:42.213420 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2269452-3569-4100-9b7b-5607f7376da3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 204 len: 0 microversion: 2.1 time: 0.178655 Nov 06 20:53:42.214647 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1199/2379] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:42 2021] DELETE /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:42.285451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:42.296489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-931e2f19-a387-4bf5-93a6-cc6cc2996323 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1474 microversion: 2.1 time: 0.266366 Nov 06 20:53:42.298907 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1181/2380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:42 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:42.375880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:42.376549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:42.386505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.387719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.388572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.389258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.422198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-435803310", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8fbc16c6-4a6c-4b93-987f-9643b3a1da7e"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:42.541574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] validate_networks() for [('8fbc16c6-4a6c-4b93-987f-9643b3a1da7e', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:53:42.734327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:42.757694 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41edb578-c3b3-4b7f-9def-54eab47b6452 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1515 microversion: 2.1 time: 0.386797 Nov 06 20:53:42.758221 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1200/2381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:42 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:42.772450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b6727fdb-4e55-48e4-887b-0f8bcc3c08c5 req-cb86a8ce-ac1d-473b-8ec2-7dc162e8915d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20708bdc-f507-44fd-a579-76e5dcf84f7a", "name": "network-vif-plugged", "status": "completed", "tag": "ca70788c-4fdb-4374-8301-566c72ee62ea"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:42.774771 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:42.774771 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:42.789124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b6727fdb-4e55-48e4-887b-0f8bcc3c08c5 req-cb86a8ce-ac1d-473b-8ec2-7dc162e8915d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.789707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b6727fdb-4e55-48e4-887b-0f8bcc3c08c5 req-cb86a8ce-ac1d-473b-8ec2-7dc162e8915d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.816573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b6727fdb-4e55-48e4-887b-0f8bcc3c08c5 req-cb86a8ce-ac1d-473b-8ec2-7dc162e8915d service nova] Creating event network-vif-plugged:ca70788c-4fdb-4374-8301-566c72ee62ea for instance 20708bdc-f507-44fd-a579-76e5dcf84f7a on nch2-master-1 Nov 06 20:53:42.831132 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b6727fdb-4e55-48e4-887b-0f8bcc3c08c5 req-cb86a8ce-ac1d-473b-8ec2-7dc162e8915d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070745 Nov 06 20:53:42.833435 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1201/2382] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:42.848867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:42.857303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:42.874216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.874983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.876563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:42.877161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:42.983739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0485dd9b-836b-4d20-a992-0edea52566fd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.148727 Nov 06 20:53:42.984522 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1202/2383] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:42 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:42.995080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:42.996102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.014560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.015019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.015840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.016923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.051160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'flavor' on Instance uuid 8d0814b2-5fff-4e39-99c9-479ea42beac3 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:43.156822 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b879e7f8-f2a6-4d74-827e-00c7e0cd26de tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action" status: 200 len: 32 microversion: 2.1 time: 0.166085 Nov 06 20:53:43.157924 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1203/2384] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:42 2021] POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:53:43.168880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:43.170139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.176668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.177409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.178285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.178791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.234628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:53:43.235368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:53:43.235558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:53:43.236101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:53:43.236957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:53:43.249479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.249927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.250739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.251181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.268136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:53:43.272421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for user 8b1ffd89193f4eb1b796c374eb2d26bf and project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:53:43.284520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:53:43.287002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:53:43.323092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4490f362-11aa-4fa2-a325-d8652f7651a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.163637 Nov 06 20:53:43.327131 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1204/2385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:43 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:43.330820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:43.333037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.340238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae3d66be-3905-4c7b-8bca-4624f4a5e3de tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922862 Nov 06 20:53:43.341129 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1182/2386] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:53:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:53:43.349138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.349736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.350622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.351172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.380422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:43.381324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.395726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.396445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.397426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.398036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.773004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:43.795015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:43.803812 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4bc87478-29e6-4d67-8bef-4fec4cc61d42 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.461515 Nov 06 20:53:43.805672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1183/2387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:43 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:43.811303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:43.812219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.818133 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cda046af-bb02-4f36-8240-6996be21b8bb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1314 microversion: 2.1 time: 0.492634 Nov 06 20:53:43.819629 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1205/2388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:43 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:43.827585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ba997d7-d24c-4c63-b604-5e3ad9e47747 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:43.830532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.831594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.831737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ba997d7-d24c-4c63-b604-5e3ad9e47747 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:43.833649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:43.834451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:43.928639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7ba997d7-d24c-4c63-b604-5e3ad9e47747 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:43.937418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ba997d7-d24c-4c63-b604-5e3ad9e47747 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1207 microversion: 2.1 time: 0.113441 Nov 06 20:53:43.940218 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1206/2389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:43 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1207 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:43.996311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:43.997495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.005397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.007658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.009877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.011086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.099337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:44.103320 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-befa512b-f20d-4d38-a652-735f847098c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.110541 Nov 06 20:53:44.104514 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1207/2390] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:43 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:44.119525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00792e25-f17f-40f9-b654-bf6f15943b41 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1471 microversion: 2.1 time: 0.310555 Nov 06 20:53:44.120194 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1184/2391] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:43 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:44.138094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:44.138793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.147037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.149635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.150912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.151596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.330462 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e2e58f8-7c62-4586-907e-14c642788165 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "POST /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891/action" status: 202 len: 0 microversion: 2.1 time: 0.197693 Nov 06 20:53:44.331530 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1208/2392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:44 2021] POST /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:44.338612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:44.345202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:44.347189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.350168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.359111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.359750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.361086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.362437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.365987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.368549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.370057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.371008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.436230 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3180aa66-aa0b-4b3f-b0f3-15e8f4ab259d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.105094 Nov 06 20:53:44.442844 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1185/2393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:44 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:44.616403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:44.626931 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a539432-b429-42b1-8099-87a4135f34a1 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.290971 Nov 06 20:53:44.637399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1209/2394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:44 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:44.829156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:44.840004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:44.842297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.842630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:44.891871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.892338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.901108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.903000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.903495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.904367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:44.905631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:44.909268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.407304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:45.418772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b30e37ea-a1e8-4035-aac2-e3d6c582ced6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.594644 Nov 06 20:53:45.419966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1186/2395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:44 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:45.422041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:45.429665 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-414fc3ae-218b-408d-92cb-b0ca37273de1 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1502 microversion: 2.1 time: 0.597443 Nov 06 20:53:45.433859 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1210/2396] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:44 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1502 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:45.438159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-92c85d75-4194-4a5f-8903-67c92dbbe5c8 req-3afe364c-9ff0-416a-9d45-40806376b195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fbee84-0888-474a-a089-36a96efd162d", "name": "network-vif-unplugged", "status": "completed", "tag": "9d0eeba9-6ff4-48d8-9007-9e377ba11bbf"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:45.441137 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:45.441137 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:45.448171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:45.449360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.460370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-92c85d75-4194-4a5f-8903-67c92dbbe5c8 req-3afe364c-9ff0-416a-9d45-40806376b195 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.460976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-92c85d75-4194-4a5f-8903-67c92dbbe5c8 req-3afe364c-9ff0-416a-9d45-40806376b195 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.465563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.466296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.467338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.473536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.489534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-92c85d75-4194-4a5f-8903-67c92dbbe5c8 req-3afe364c-9ff0-416a-9d45-40806376b195 service nova] Creating event network-vif-unplugged:9d0eeba9-6ff4-48d8-9007-9e377ba11bbf for instance a2fbee84-0888-474a-a089-36a96efd162d on nch2-master-1 Nov 06 20:53:45.498688 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-92c85d75-4194-4a5f-8903-67c92dbbe5c8 req-3afe364c-9ff0-416a-9d45-40806376b195 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075584 Nov 06 20:53:45.502663 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1187/2397] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:45.518433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:45.524677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.540286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.541083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.542520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.545547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.579470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:45.588228 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab340388-4aee-445d-b7e6-e22c62921f7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1265 microversion: 2.1 time: 0.152891 Nov 06 20:53:45.590033 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1211/2398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:45 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:45.603323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a331010b-8995-4de8-9c01-b41f3c5549b4 req-7a12a516-645f-4805-8ecd-60f524514a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fbee84-0888-474a-a089-36a96efd162d", "name": "network-vif-deleted", "tag": "9d0eeba9-6ff4-48d8-9007-9e377ba11bbf"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:45.605344 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebc80d97-41cb-41a1-8b46-1a82a0232937 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.097079 Nov 06 20:53:45.605546 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:45.605546 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:45.609400 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1188/2399] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:45 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:45.614165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a331010b-8995-4de8-9c01-b41f3c5549b4 req-7a12a516-645f-4805-8ecd-60f524514a00 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.614609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a331010b-8995-4de8-9c01-b41f3c5549b4 req-7a12a516-645f-4805-8ecd-60f524514a00 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.618600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:45.620827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.630700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a331010b-8995-4de8-9c01-b41f3c5549b4 req-7a12a516-645f-4805-8ecd-60f524514a00 service nova] Creating event network-vif-deleted:9d0eeba9-6ff4-48d8-9007-9e377ba11bbf for instance a2fbee84-0888-474a-a089-36a96efd162d on nch2-master-1 Nov 06 20:53:45.638660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.639370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.640506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.641232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.642170 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a331010b-8995-4de8-9c01-b41f3c5549b4 req-7a12a516-645f-4805-8ecd-60f524514a00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048672 Nov 06 20:53:45.649498 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1212/2400] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:45.655663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:45.657007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.676481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.677054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.677905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.678340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.689584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lazy-loading 'flavor' on Instance uuid 20708bdc-f507-44fd-a579-76e5dcf84f7a {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:53:45.750988 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b335b19-d7cb-4def-96a6-c1de0b51930d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.098606 Nov 06 20:53:45.751634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1213/2401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:45 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:45.758068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:45.762201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.771045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.771678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.774055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.774681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.828603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-367d85b7-e5bf-4c84-8870-8d678240fcb5 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "POST /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.217251 Nov 06 20:53:45.831640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1189/2402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:45 2021] POST /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:45.839351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:45.840480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:45.849725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.850831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:45.851893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:45.852623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.023912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:46.041037 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dbaa773b-30b6-4a58-b901-52ceda3bcadb tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.287353 Nov 06 20:53:46.042183 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1214/2403] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:45 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:46.087102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:46.097852 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58ddd6c4-9c13-4f76-9323-2c7319b8d281 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1510 microversion: 2.1 time: 0.264152 Nov 06 20:53:46.099319 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1190/2404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:45 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:46.434938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:46.435538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:46.449920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.450365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.451161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.451587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.606153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:46.607229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:46.613293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:46.617281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.618339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.619545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.619991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.622608 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55f48770-0dff-4c3a-8ebc-2b62d7ca3972 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.191504 Nov 06 20:53:46.632235 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1215/2405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:46 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:46.632531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:46.638948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:46.648618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.649444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.650464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.651447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.712019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-503a36ef-774a-4309-b546-1f179b007d8b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.087546 Nov 06 20:53:46.713596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1216/2406] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:46 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:46.840535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:46.864927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77ada98a-a739-4ff5-91c6-9c6b3c5765d0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.261677 Nov 06 20:53:46.865515 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1191/2407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:46 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:46.874748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:46.875730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:46.890938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.894089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.895146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:46.895930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:46.951547 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d05580f-e1ca-4e83-a9ed-efdc4dff2f54 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.080572 Nov 06 20:53:46.952532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1192/2408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:46 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:47.060629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.060853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.071048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.072269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.080085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f6715ada670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.081635 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.081635 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:47.084514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.084829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.085135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.086140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.104569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.105126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.116464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.117274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.124025 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07bbdd42-3c45-4c62-bf61-477dfe61950e tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.398340 Nov 06 20:53:47.125417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1217/2409] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:46 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:47.130298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.131391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.137920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.138661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.139725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.140533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.291389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:47.301079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c84e352-3c9a-4385-80f8-ffbcc802cb5a tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.244799 Nov 06 20:53:47.302079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1193/2410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:47.308904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f6715319670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.310048 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.310048 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.312078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.312579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.328973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.329667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.341450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.342176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.343359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:47.349197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cf00956-38a8-43ca-b85d-0fa6a7af9acd tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.045748 Nov 06 20:53:47.350232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1194/2411] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:47.357055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ca624e8-436a-464e-82c2-b43025e39f5d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1493 microversion: 2.1 time: 0.230285 Nov 06 20:53:47.360818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1218/2412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1493 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:47.364570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f67152284c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.365353 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.365353 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.367106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.367564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.372654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.373390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.379431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.379895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.380753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.381191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.385661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.386115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.406084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.406756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.407766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:47.432648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06c11d76-7cf6-4405-b31b-14df6f390052 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071522 Nov 06 20:53:47.433895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1195/2413] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:53:47.448431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f671539ca60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.451771 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.451771 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.454120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.454815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.476572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.479795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.487440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9cf9a2d-a0e9-4001-8a8f-481376c86c5a tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.047008 Nov 06 20:53:47.497004 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1196/2414] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.502366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2449663f-90a1-4529-9ea1-b6329236af8f tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f67154e9c10>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.503524 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.503524 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.505798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2449663f-90a1-4529-9ea1-b6329236af8f tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.506385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2449663f-90a1-4529-9ea1-b6329236af8f tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.521832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15d7c485-2b50-4f69-841b-662eb5148d42 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 204 len: 0 microversion: 2.1 time: 0.151668 Nov 06 20:53:47.522933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1219/2415] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:47 2021] DELETE /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:53:47.530205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-plugged", "status": "completed", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:47.531863 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.531863 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:47.534522 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2449663f-90a1-4529-9ea1-b6329236af8f tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 266 microversion: 2.1 time: 0.036233 Nov 06 20:53:47.535236 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1197/2416] 10.222.0.13 () {58 vars in 1178 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 266 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.542511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.542613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.542702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.542814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.549905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.550583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.551646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.552245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.555263 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] Creating event network-vif-plugged:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch1-master-1 Nov 06 20:53:47.561812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:53:47.577242 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-149e6a12-d0a3-4b03-898e-6075695fc192 req-1a79aecc-c89a-4320-a69c-84ddff264d64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052778 Nov 06 20:53:47.578945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1220/2417] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.589887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f671ac37040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.590952 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.590952 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:47.593200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.593660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.612431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.612893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.630002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.630458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.637387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7803868e-a55c-419e-98b4-5bc7f635e856 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057093 Nov 06 20:53:47.637998 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1221/2418] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.646174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.647026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.654023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.654552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.655523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.656180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.754350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:47.768784 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0777b62d-5588-4f56-9f17-6c661dec11e2 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1499 microversion: 2.1 time: 0.231219 Nov 06 20:53:47.771321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1198/2419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:47.776900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f67153709d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.784694 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.784694 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.789150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.792719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.812603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.813158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.819841 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86db409d-5a27-4092-92ba-85e5e2aa8b85 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.047338 Nov 06 20:53:47.821642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1199/2420] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.826228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-80d1f4e0-1583-4abf-95e6-54e622cabb5c req-29df52ab-0199-4da9-aef0-c69c192b18b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7007c97-5fa8-462d-8192-9bf343e58548", "tag": "809b9394-67e1-4318-9cc7-04a3de08ebc9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:47.828131 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.828131 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.835242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-80d1f4e0-1583-4abf-95e6-54e622cabb5c req-29df52ab-0199-4da9-aef0-c69c192b18b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.835928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-80d1f4e0-1583-4abf-95e6-54e622cabb5c req-29df52ab-0199-4da9-aef0-c69c192b18b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.859853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:47.860055 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-80d1f4e0-1583-4abf-95e6-54e622cabb5c req-29df52ab-0199-4da9-aef0-c69c192b18b0 service nova] Creating event network-changed:809b9394-67e1-4318-9cc7-04a3de08ebc9 for instance a7007c97-5fa8-462d-8192-9bf343e58548 on nch2-master-1 Nov 06 20:53:47.867251 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-80d1f4e0-1583-4abf-95e6-54e622cabb5c req-29df52ab-0199-4da9-aef0-c69c192b18b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044096 Nov 06 20:53:47.869146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1200/2421] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.871835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13a42d72-da16-42d2-9973-b4f281162504 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.231346 Nov 06 20:53:47.882605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:47.882605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.883174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1222/2422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:47.888775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f671add1c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.889777 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.889777 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:47.890008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.890335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.891139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.891570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.892563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.893013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.909342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.909785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.916776 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e9166d5-d7f5-4ef9-b7dd-5e683b631c90 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.031569 Nov 06 20:53:47.927257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1223/2423] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:47.928185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.928853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:47.935819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.936482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.937613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.938155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.952503 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a26f9b37-22fd-4029-aa98-9b50375207f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.076493 Nov 06 20:53:47.953633 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1201/2424] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:47 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:47.964016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Calling method '.version_select at 0x7f67152a0af0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:47.964916 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:47.964916 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:47.967027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.968368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.984507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.985235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:47.998076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:47.998539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.012877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e0db77b4-7477-459a-998d-709b7296cdf0 tempest-HypervisorAdminTestJSON-469208188 tempest-HypervisorAdminTestJSON-469208188-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.052388 Nov 06 20:53:48.019389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1202/2425] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:48.026186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:48.027705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:48.035073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.035525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.037319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.038443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.122757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5862f56b-f2a6-4e3f-8fc4-89b8530dffa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.101798 Nov 06 20:53:48.123603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1203/2426] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:48 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:48.158882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:48.169700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1870e422-0d7c-4207-9a16-c28321c4f3bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.247075 Nov 06 20:53:48.170508 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1224/2427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:47 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:48.320985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:48.321840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:48.329615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.330083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.330954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.331392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.495031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:48.502803 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5a210d3-4c75-4dc6-9757-81a8463c7175 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.187604 Nov 06 20:53:48.503622 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1204/2428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:48 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:48.790825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:48.792845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:48.803798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.804375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.805259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.805875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.890467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:48.891207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:48.897423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.897891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.898699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:48.899717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:48.982280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:48.990824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6c0bbe3a-09e1-4dfe-a84d-f30a013678c6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1499 microversion: 2.1 time: 0.206095 Nov 06 20:53:49.000779 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1225/2429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:48 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1499 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:49.020872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:49.022787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:49.032823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.034028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.035890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.036949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.105706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9b329c0-6901-4954-b1fa-1b0ff249f195 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.103415 Nov 06 20:53:49.106364 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1226/2430] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:49 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:49.141042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:49.142250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:49.161186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.161905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.163939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.167438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.215957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:49.224869 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50d4b9c8-a6e7-4639-9b50-6cf8b1fa74d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.338097 Nov 06 20:53:49.228991 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1205/2431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:48 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:49.250766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:49.251483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:49.256107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e58e3728-27c1-4fb8-9b65-698ec0c6121b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.124525 Nov 06 20:53:49.257595 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1227/2432] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:49 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:49.266194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.266645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.267451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.267977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.515897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:49.519902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:49.520826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:49.525148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-376f51d0-6fc2-4143-8c02-8128e65aaef6 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.283451 Nov 06 20:53:49.526826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1206/2433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:49 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:49.541436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.541877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.542678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.543113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.706981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:49.715702 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab7eacae-7a11-492d-aacc-afa89e820743 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.200401 Nov 06 20:53:49.716909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1228/2434] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:49 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:49.894023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-unplugged", "status": "completed", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}, {"name": "network-changed", "server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:49.896686 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:49.896686 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:49.905281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:49.905813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:49.918499 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Creating event network-vif-unplugged:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:53:49.919005 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Creating event network-changed:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:53:49.924822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 20:53:49.938701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-176bfe79-9860-4b6b-b870-63d3a4e0ace0 req-a3a99a7e-18bb-4d77-82d2-251ad6de0570 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049524 Nov 06 20:53:49.939671 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1207/2435] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:50.009059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:50.010070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.016770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.018242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.019052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.019882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.118461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:50.119509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.126970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.127443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.128302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.128757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.179118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec9b10c2-fee2-4aa2-9e53-5735527a4d6f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.065143 Nov 06 20:53:50.185371 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1208/2436] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:50 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:50.274696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:50.276423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.284915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.285793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.286852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.287557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.751594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44347de86f1149a2b9288ca04ec59e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e36c34c8ba54c99826390aff2abf4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:50.769196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc9ae052-f043-43e4-a1d2-b1dfcdfc7376 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 200 len: 1499 microversion: 2.1 time: 0.762529 Nov 06 20:53:50.779381 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1229/2437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:50 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 1499 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:50.787485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:50.790690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.821820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.825020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.826119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.827726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.915622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d718f87-d1a8-499d-b915-622afc11e4ae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.143518 Nov 06 20:53:50.919079 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1230/2438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:50 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:50.925365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:50.933053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:50.933842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.934376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea2c6d35-654f-4314-92c3-df5a29c645e5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.677050 Nov 06 20:53:50.936766 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1209/2439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:50 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:50.947307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.948162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.953037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.953304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:50.954030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.955986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:50.970415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.970861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:50.971843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:50.972742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.331824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:51.351198 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16eaa243-7dd3-4bba-94b6-6bee91274e21 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.401677 Nov 06 20:53:51.351696 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1210/2440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:50 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:51.356981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:51.358161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.365538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.366277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.367281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.368443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.372941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:51.384614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a94cc70-1195-4fa6-8724-f0999efa9e17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.463330 Nov 06 20:53:51.394564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1231/2441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:50 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:51.452345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ce28b47-5bf5-41af-8cd9-15208cde9d11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.098390 Nov 06 20:53:51.456847 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1211/2442] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:51 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:51.786956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.787631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.795409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.795987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.796801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.797344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.812200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. Nov 06 20:53:51.813173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:51.814264 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6945e96-1f8d-4553-8003-7ab23383b235 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 404 len: 111 microversion: 2.1 time: 0.031084 Nov 06 20:53:51.814762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1232/2443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:51 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:51.827299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.827899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.835833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.836969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.837856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.838309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.858341 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. Nov 06 20:53:51.859082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:51.860092 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c087201-d366-4fa0-ad2e-dcf01d908be9 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 404 len: 111 microversion: 2.1 time: 0.036894 Nov 06 20:53:51.861091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1212/2444] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:51 2021] DELETE /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:51.868937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.869854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 20708bdc-f507-44fd-a579-76e5dcf84f7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.876576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.877320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.878382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.879373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.896624 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. Nov 06 20:53:51.897665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 20708bdc-f507-44fd-a579-76e5dcf84f7a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:51.898696 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2da2a8f8-4e20-49e5-85cc-ef4c9fc7ec2d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a" status: 404 len: 111 microversion: 2.1 time: 0.033606 Nov 06 20:53:51.900027 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1233/2445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:51 2021] GET /compute/v2.1/servers/20708bdc-f507-44fd-a579-76e5dcf84f7a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:51.909039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.909838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.917484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.917947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.918751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.919197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.929482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:51.930507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.936452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.936914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.937706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.938145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.941175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. Nov 06 20:53:51.942324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:51.943445 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77989303-894b-4fb3-8450-839bddfff750 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 404 len: 111 microversion: 2.1 time: 0.038056 Nov 06 20:53:51.944192 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1213/2446] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:51 2021] DELETE /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:51.954032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.954769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:51.965898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.967145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.968104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:51.969027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:51.991967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ecc25ea-9fdc-4095-bb7c-6021f7df1004 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.065202 Nov 06 20:53:51.992852 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1234/2447] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:51 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:53:51.998722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:51.999495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: b628d735-8393-4d0e-9126-37ca09231b4e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.007131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.007661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.009153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.009657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.026875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. Nov 06 20:53:52.027564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance b628d735-8393-4d0e-9126-37ca09231b4e could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.028502 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d44d728-d21d-4259-ab99-1ea5cd334d93 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e" status: 404 len: 111 microversion: 2.1 time: 0.034510 Nov 06 20:53:52.032683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1235/2448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:51 2021] GET /compute/v2.1/servers/b628d735-8393-4d0e-9126-37ca09231b4e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.037427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7358411f-9974-4bff-9789-290e6b593c62 req-a36da23f-8954-492d-a1dc-41f1d8ad5345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20708bdc-f507-44fd-a579-76e5dcf84f7a", "name": "network-vif-deleted", "tag": "ca70788c-4fdb-4374-8301-566c72ee62ea"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:52.039199 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:52.039199 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:52.058936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7358411f-9974-4bff-9789-290e6b593c62 req-a36da23f-8954-492d-a1dc-41f1d8ad5345 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.059965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7358411f-9974-4bff-9789-290e6b593c62 req-a36da23f-8954-492d-a1dc-41f1d8ad5345 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.076647 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7358411f-9974-4bff-9789-290e6b593c62 req-a36da23f-8954-492d-a1dc-41f1d8ad5345 service nova] Creating event network-vif-deleted:ca70788c-4fdb-4374-8301-566c72ee62ea for instance 20708bdc-f507-44fd-a579-76e5dcf84f7a on nch2-master-1 Nov 06 20:53:52.083391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7358411f-9974-4bff-9789-290e6b593c62 req-a36da23f-8954-492d-a1dc-41f1d8ad5345 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049155 Nov 06 20:53:52.084563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1236/2449] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:52.092035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.092841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.100607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.101277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.102369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.103062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.117769 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. Nov 06 20:53:52.118299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.119284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1a2e374-a4c9-4178-88d5-8448df420e22 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 404 len: 111 microversion: 2.1 time: 0.033407 Nov 06 20:53:52.119839 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1237/2450] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:52 2021] DELETE /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.130613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:52.139009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0934f1a-4be5-452f-837b-4f6e3528ef4e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.189485 Nov 06 20:53:52.140136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1214/2451] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:51 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:52.145221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.146050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 392ca076-1799-441a-9449-9c6f872899d4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.154239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.154801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.155667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.156196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.170958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. Nov 06 20:53:52.171826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 392ca076-1799-441a-9449-9c6f872899d4 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.172774 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf6902ab-b152-41a1-9da3-ba89b6e43d24 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4" status: 404 len: 111 microversion: 2.1 time: 0.031465 Nov 06 20:53:52.173395 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1215/2452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/servers/392ca076-1799-441a-9449-9c6f872899d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.181418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.181988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.187868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.188487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.189376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.190058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.204134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. Nov 06 20:53:52.204904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.205860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed8bb293-30d3-42b1-9bcc-a64bce411f66 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 404 len: 111 microversion: 2.1 time: 0.028077 Nov 06 20:53:52.206503 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1216/2453] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:52 2021] DELETE /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:52.215675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.216427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 8178249b-6303-419f-b736-dd5b58d024cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.223492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.224821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.225643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.226685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.244413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. Nov 06 20:53:52.245125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 8178249b-6303-419f-b736-dd5b58d024cd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.246010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8e28ae5-6b4f-476b-a0c4-fb8c2dc209eb tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd" status: 404 len: 111 microversion: 2.1 time: 0.034816 Nov 06 20:53:52.248427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1217/2454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/servers/8178249b-6303-419f-b736-dd5b58d024cd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.255492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.256074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.276557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.277703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.279320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.279998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.300248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. Nov 06 20:53:52.300951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.302631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2be6e379-e2b8-4413-a920-00225ba1ecea tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 404 len: 111 microversion: 2.1 time: 0.051056 Nov 06 20:53:52.304490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1218/2455] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:52 2021] DELETE /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.313479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.314309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 73dd5f4c-bb98-45e4-941f-1245453637c1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.319233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Calling method '.version_select at 0x7f671ac750d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.320241 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:52.320241 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:52.322379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.323204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.323752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.324467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.324985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.325607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.344690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. Nov 06 20:53:52.345577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 73dd5f4c-bb98-45e4-941f-1245453637c1 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:52.346560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dfb41750-4c00-4246-a532-c87ae580947d tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1" status: 404 len: 111 microversion: 2.1 time: 0.037100 Nov 06 20:53:52.347161 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1219/2456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/servers/73dd5f4c-bb98-45e4-941f-1245453637c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:52.360775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.361412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.375185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.378259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.390610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.392252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.394891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.395367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.396220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.396698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.407639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecdb13a2-cf38-4da8-80d3-6dc8379943ec tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.286474 Nov 06 20:53:52.408405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1238/2457] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:52.418742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.421497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.431524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.434139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.436252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.437893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.705760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:52.708186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:52.715939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6efe6b8f-686c-4c44-8f11-a98ea386e136 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.349776 Nov 06 20:53:52.717067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1220/2458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:52.717930 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22f7731c-9440-46e0-b145-1211e887e1bc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.306174 Nov 06 20:53:52.718657 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1239/2459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:52.722979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Calling method '.version_select at 0x7f671525daf0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:52.724210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:52.724456 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:52.724456 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:52.725210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:52.726382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.727513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.734373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.734839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.735635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.736254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.745477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:52.745933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:52.752720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df9cab26-c785-4b6d-ad33-20cc525b27e3 tempest-HypervisorAdminV228Test-856667289 tempest-HypervisorAdminV228Test-856667289-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.034183 Nov 06 20:53:52.753663 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1221/2460] 10.222.0.13 () {60 vars in 1192 bytes} [Sat Nov 6 20:53:52 2021] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:52.796833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5995cede-040b-45db-b4c1-43772f3653c1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.076396 Nov 06 20:53:52.798480 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1240/2461] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:52 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:53.003321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:53.004253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.010747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.011202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.012002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.012471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.064300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c78c76f1-420e-45f3-9845-0cdc99a09995 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.064339 Nov 06 20:53:53.065130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1222/2462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:52 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:53.157280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.158297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.166715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.168098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.169263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.169900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.380641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:53.388372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2f1e754-41e5-4ef8-b32f-59c4c882d76c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.235729 Nov 06 20:53:53.389006 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1241/2463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:53 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:53.581011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.581851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.590428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.590895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.591698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.592455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.611164 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. Nov 06 20:53:53.612041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:53.613111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8085dea-67dd-4147-9532-6a8cd1badfd6 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 404 len: 111 microversion: 2.1 time: 0.036427 Nov 06 20:53:53.614044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1223/2464] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:53 2021] DELETE /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:53.621955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.623577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: 183e64a4-ecc9-4623-b4f8-72c80bfae9d8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.631295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.631756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.632646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.633612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.647280 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. Nov 06 20:53:53.647802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance 183e64a4-ecc9-4623-b4f8-72c80bfae9d8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:53.648664 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afc776f9-b525-413f-92b8-e20d7ecda721 tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8" status: 404 len: 111 microversion: 2.1 time: 0.030325 Nov 06 20:53:53.650042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1242/2465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:53 2021] GET /compute/v2.1/servers/183e64a4-ecc9-4623-b4f8-72c80bfae9d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:53.658350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.659009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.667187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.667926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.668745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.669246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.683810 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. Nov 06 20:53:53.684525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:53.685559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f22e352e-bede-48f1-a978-89242b0e180b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 404 len: 111 microversion: 2.1 time: 0.031085 Nov 06 20:53:53.686086 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1224/2466] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:53 2021] DELETE /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:53.694106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.694634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] [instance: d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.700975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.701432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.702217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.702935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.717139 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] HTTP exception thrown: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. Nov 06 20:53:53.717902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] Returning 404 to user: Instance d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:53.718791 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bfe47c6d-4125-44bd-a531-a10868f8c73b tempest-DeleteServersTestJSON-254142232 tempest-DeleteServersTestJSON-254142232-project] 10.222.0.13 "GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760" status: 404 len: 111 microversion: 2.1 time: 0.028458 Nov 06 20:53:53.719382 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1243/2467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:53 2021] GET /compute/v2.1/servers/d3dec4b5-5f2b-4e8a-a3d8-d4f288a0c760 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:53.735304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.735961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.736691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:53.737743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:53.744260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.744878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.745209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.745725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.746136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.746281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.747566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:53.748222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:53.990793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:54.001314 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d98c78ee-c260-44b4-adf6-5cbf1a0cec7a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.270097 Nov 06 20:53:54.003292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1244/2468] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:53 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:54.008975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:54.010204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:54.020549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.021294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.026039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.026039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.026215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:54.034112 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2c0f01e-0d26-4ede-b5dd-4c23481c5c0d tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1470 microversion: 2.1 time: 0.303019 Nov 06 20:53:54.034689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1225/2469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:53 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:54.076630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:54.077566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:54.085560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.086026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.086874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.087321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.090411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff708e9e-5c92-4768-beda-8b34b90f28d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.085380 Nov 06 20:53:54.091264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1245/2470] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:54 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:54.142442 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7fa9fe0-7202-44dc-a01c-899a78cd9efe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 32623 microversion: 2.1 time: 0.068932 Nov 06 20:53:54.143601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1226/2471] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:54 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 32623 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:54.407103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:54.407716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:54.427197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.427717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.428540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:54.429010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:54.618303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:54.630731 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cb6f5608-b771-486b-9f64-c94a93f7edec tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.228063 Nov 06 20:53:54.634385 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1246/2472] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:54 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:55.019116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.020212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.028785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.029959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.030849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.031459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.053557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.055244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.062514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.063328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.064558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.065813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.235656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:55.243142 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ead78cff-904f-4255-b759-6394fc7fd58f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.227964 Nov 06 20:53:55.252872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1227/2473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:55.253096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:55.254010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.274390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.274850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.275650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.276313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.292326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:55.303058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ced20b1-8689-4c86-a2ea-5dd9d8a1bc35 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1463 microversion: 2.1 time: 0.255890 Nov 06 20:53:55.319653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1247/2474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:55.327606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:55.334494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.344979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.345531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.346406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.346680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5db66678-cc37-461d-95e4-7ee22aaced94 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.101712 Nov 06 20:53:55.346840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.351221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1228/2475] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:55 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:55.354241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.355284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.366463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.367122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.368919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.369540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.452386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff1b3bd9-9119-4341-93ae-0888183c4b34 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 40774 microversion: 2.1 time: 0.129954 Nov 06 20:53:55.454449 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1248/2476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:55 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 40774 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:53:55.467979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.468788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.477839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.478645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.479787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.481124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.594528 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d8614ea-aa88-4f33-b473-8648736ee8f0 tempest-MigrationsAdminTest-1854011588 tempest-MigrationsAdminTest-1854011588-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1614 microversion: 2.1 time: 0.242969 Nov 06 20:53:55.595141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1229/2477] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1614 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:55.618166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.618678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.625832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.626315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.627110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.627551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.665531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:53:55.710613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:55.718963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b01c072-243e-4a47-9ae9-0a5b9df8deb4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.255087 Nov 06 20:53:55.725675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1249/2478] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:55.731025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.732065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.738751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.739400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.740410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.741017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.776485 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18477a42-e988-4add-a324-60e994b71c06 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 204 len: 0 microversion: 2.1 time: 0.161001 Nov 06 20:53:55.777538 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1230/2479] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:53:55 2021] DELETE /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:53:55.786223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1947118822"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:55.787890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.799545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.800263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.802136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.802679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.951047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:55.961919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f0799e1-5fa5-4f66-8ed2-43b9e9311286 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.233897 Nov 06 20:53:55.963598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1250/2480] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:55.969536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:55.970337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:55.977247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.978122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:55.979341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:55.980118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.140751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:56.148882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1469 microversion: 2.1 time: 0.183887 Nov 06 20:53:56.149846 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1251/2481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:55 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:56.168814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.389308 Nov 06 20:53:56.169823 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1231/2482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:53:55 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 06 20:53:56.231670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.232735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001357 Nov 06 20:53:56.233284 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1252/2483] 10.222.0.13 () {56 vars in 885 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 06 20:53:56.240133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.241689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-028cf176-2f54-49d4-a62c-4f405131b5b2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002277 Nov 06 20:53:56.242275 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1232/2484] 10.222.0.13 () {54 vars in 1034 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 06 20:53:56.248845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.249845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 06 20:53:56.250246 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1253/2485] 10.222.0.13 () {54 vars in 1040 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:56.257059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.259573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41c41c5c-885f-47a1-b56a-7a478bdfcdec tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002505 Nov 06 20:53:56.260616 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1254/2486] 10.222.0.13 () {56 vars in 885 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 06 20:53:56.268765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.268765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:56.272461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.273136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.274158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.274612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.363704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:56.365056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:56.395885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.398013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.399621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.401893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.459046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-365c3f78-32f6-49e5-9920-e3ef4292844b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.103132 Nov 06 20:53:56.460627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1255/2487] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:56 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:53:56.472208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:56.483420 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af2af54b-0b60-466e-8a53-5aeb263b0bc2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.226090 Nov 06 20:53:56.484460 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1233/2488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:56.547656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b71451b5-02a4-478d-811c-608b3e57721b req-6ed1890c-4080-415f-99d2-292be2e6fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7007c97-5fa8-462d-8192-9bf343e58548", "name": "network-vif-plugged", "status": "completed", "tag": "809b9394-67e1-4318-9cc7-04a3de08ebc9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:56.549575 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:56.549575 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:56.562172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b71451b5-02a4-478d-811c-608b3e57721b req-6ed1890c-4080-415f-99d2-292be2e6fe1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.562612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b71451b5-02a4-478d-811c-608b3e57721b req-6ed1890c-4080-415f-99d2-292be2e6fe1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.581161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b71451b5-02a4-478d-811c-608b3e57721b req-6ed1890c-4080-415f-99d2-292be2e6fe1e service nova] Creating event network-vif-plugged:809b9394-67e1-4318-9cc7-04a3de08ebc9 for instance a7007c97-5fa8-462d-8192-9bf343e58548 on nch2-master-1 Nov 06 20:53:56.588490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b71451b5-02a4-478d-811c-608b3e57721b req-6ed1890c-4080-415f-99d2-292be2e6fe1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044720 Nov 06 20:53:56.589152 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1256/2489] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:56.981429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:56.982935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:56.989531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.991213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:56.992550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:56.993153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.153681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:57.162991 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02667168-ee29-45bc-a8fe-d43e53e22da8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.186974 Nov 06 20:53:57.163712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1257/2490] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:57.176284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Calling method '.version_select at 0x7f6715414700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.176822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.177184 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:57.177184 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:57.177397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:57.178658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.179113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.184997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.187103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.188287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.189088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.193254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.193706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.205189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.205638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.214012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-559ee4c5-581a-4a64-8e13-70d4c438f8cc tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.343946 Nov 06 20:53:57.215091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1234/2491] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:56 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:57.355241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:57.363396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29c1abf3-4337-435b-9487-de61b5e89a86 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1469 microversion: 2.1 time: 0.198767 Nov 06 20:53:57.369551 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1258/2492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:57.470828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:57.471737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:57.478280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.478666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.479502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.479966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.494221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecc6afe4-38c8-4429-ad7b-c72a795a3ed8 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Calling method '.version_select at 0x7f67152f6d30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.495342 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:57.495342 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:57.502325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ecc6afe4-38c8-4429-ad7b-c72a795a3ed8 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4b755c5ea9364b4399e7204ec8f8abe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a76f761fc4c87a668f5ebd2ad9786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:57.503828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecc6afe4-38c8-4429-ad7b-c72a795a3ed8 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:57.505249 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecc6afe4-38c8-4429-ad7b-c72a795a3ed8 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.283767 Nov 06 20:53:57.506571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1235/2493] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:57.513153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.514078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:57.521084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.521612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.522606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.523226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.527528 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae4cdcad-4229-4982-a823-c3169d8fccd6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.060096 Nov 06 20:53:57.529267 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1259/2494] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:57 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:57.532975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Calling method '.version_select at 0x7f671ac958b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.533721 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:57.533721 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:57.535423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.535866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.543071 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 06 20:53:57.543683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:57.544520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18a1d061-ab48-46eb-a24d-2b3680ede202 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.015234 Nov 06 20:53:57.545194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1260/2495] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:57.555814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Calling method '.version_select at 0x7f671ac88b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.557167 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:57.557167 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:57.558903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.559565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.578705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.579373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.593217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.593217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.598888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-855a1caf-87d1-491e-9331-b7fb4401654f tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048329 Nov 06 20:53:57.604088 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1261/2496] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:57.608854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45ab09e8-ea26-4663-8e11-3c19a1e1da84 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Calling method '.version_select at 0x7f671acf3d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.609626 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:57.609626 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:57.610904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-45ab09e8-ea26-4663-8e11-3c19a1e1da84 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4b755c5ea9364b4399e7204ec8f8abe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a76f761fc4c87a668f5ebd2ad9786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:57.611544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45ab09e8-ea26-4663-8e11-3c19a1e1da84 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:57.612361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45ab09e8-ea26-4663-8e11-3c19a1e1da84 tempest-HypervisorAdminNegativeUnderV252Test-1569857079 tempest-HypervisorAdminNegativeUnderV252Test-1569857079-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.007122 Nov 06 20:53:57.612860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1262/2497] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:53:57.625443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Calling method '.version_select at 0x7f671ac97940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:57.628412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:57.628959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:57.637402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] HTTP exception thrown: No hypervisor matching 'cdd2a821-ee50-4372-8952-b305171e6eff' could be found. Nov 06 20:53:57.638003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] Returning 404 to user: No hypervisor matching 'cdd2a821-ee50-4372-8952-b305171e6eff' could be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:53:57.638883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ffac9bb-1175-4941-a648-ecb134ee1234 tempest-HypervisorAdminNegativeUnderV252Test-734831794 tempest-HypervisorAdminNegativeUnderV252Test-734831794-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/cdd2a821-ee50-4372-8952-b305171e6eff/servers" status: 404 len: 123 microversion: 2.1 time: 0.018560 Nov 06 20:53:57.639414 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1263/2498] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/os-hypervisors/cdd2a821-ee50-4372-8952-b305171e6eff/servers => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:53:57.696533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:57.704060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f679e73-7d7d-449b-aa49-8363d501a082 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.196318 Nov 06 20:53:57.704683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1236/2499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:57 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:58.180622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:58.182046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:58.195027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.195867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.198990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.199434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.408277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:58.418292 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69c5db4a-7cc1-41aa-b336-778ccd7551b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.241935 Nov 06 20:53:58.423134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1264/2500] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:58 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:58.540659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:58.541902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:58.548879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.549568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.550796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.551389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.631018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83ff1d9a-3721-407f-8020-9428f30c3ca6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094942 Nov 06 20:53:58.638613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1265/2501] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:58 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:58.654552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-471c997a-627c-4664-87db-06c3f5491206 req-2bc5e0cd-14ae-42c6-b8b6-45e1ec42c612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-plugged", "status": "completed", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:58.656151 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:58.656151 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:53:58.666877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-471c997a-627c-4664-87db-06c3f5491206 req-2bc5e0cd-14ae-42c6-b8b6-45e1ec42c612 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.667628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-471c997a-627c-4664-87db-06c3f5491206 req-2bc5e0cd-14ae-42c6-b8b6-45e1ec42c612 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.722549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-471c997a-627c-4664-87db-06c3f5491206 req-2bc5e0cd-14ae-42c6-b8b6-45e1ec42c612 service nova] Creating event network-vif-plugged:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:53:58.722749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:58.723370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:58.734725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.736669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.737600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.738931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.740449 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-471c997a-627c-4664-87db-06c3f5491206 req-2bc5e0cd-14ae-42c6-b8b6-45e1ec42c612 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095891 Nov 06 20:53:58.747091 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1266/2502] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:53:58.757448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:58.758758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:58.783598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.784683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:58.785698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:58.786657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.140637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:59.150046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b93e6ce-710c-4fab-83c2-7accce335a46 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1307 microversion: 2.1 time: 0.401042 Nov 06 20:53:59.150800 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1267/2503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:58 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:53:59.159691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:53:59.163493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2678609b-6019-47ff-80ec-78fc5267a0b9 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1469 microversion: 2.1 time: 0.787386 Nov 06 20:53:59.164136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1237/2504] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:58 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1469 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:53:59.443905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:53:59.444704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:59.468801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:59.469456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.470874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:59.471339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.650771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:59.661352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:53:59.677817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:59.678640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.679532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:59.680665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.749128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95dac97d-241b-4805-94ba-bde782608a6c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.109481 Nov 06 20:53:59.755330 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1238/2505] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:53:59 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:53:59.767844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c88d30a2-8c3a-437c-9b67-a7e4c734e40a req-215e5f66-c248-430f-8aa6-c93a6708be07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29b6c-141b-4d99-ac58-afea9e681891", "name": "network-vif-deleted", "tag": "f25c6c10-c18d-4b5f-be2f-383aaa3a514e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:53:59.779876 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:53:59.779876 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:53:59.790846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c88d30a2-8c3a-437c-9b67-a7e4c734e40a req-215e5f66-c248-430f-8aa6-c93a6708be07 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:53:59.791762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c88d30a2-8c3a-437c-9b67-a7e4c734e40a req-215e5f66-c248-430f-8aa6-c93a6708be07 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:53:59.814099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c88d30a2-8c3a-437c-9b67-a7e4c734e40a req-215e5f66-c248-430f-8aa6-c93a6708be07 service nova] Creating event network-vif-deleted:f25c6c10-c18d-4b5f-be2f-383aaa3a514e for instance 2ba29b6c-141b-4d99-ac58-afea9e681891 on nch2-master-1 Nov 06 20:53:59.819738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c88d30a2-8c3a-437c-9b67-a7e4c734e40a req-215e5f66-c248-430f-8aa6-c93a6708be07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062473 Nov 06 20:53:59.820516 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1239/2506] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:53:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:00.022462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:00.033381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f6d5773-dae6-48bd-8dfb-f95e0c00bb19 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.598196 Nov 06 20:54:00.035070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1268/2507] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:53:59 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:00.168327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:00.169192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:00.181049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:00.181909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:00.182063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.188409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.189414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.191341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.191937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.192932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.194005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.194452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.261099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.261573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.262010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lazy-loading 'fault' on Instance uuid 2ba29b6c-141b-4d99-ac58-afea9e681891 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:00.370044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:00.379914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65cade4c-f38d-4225-8b82-26bb06eb72a5 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 200 len: 1303 microversion: 2.1 time: 0.202420 Nov 06 20:54:00.381275 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1269/2508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:00 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 1303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:00.677069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:00.689567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fc752e6-5422-4b91-b51d-b8ca8876ed23 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1487 microversion: 2.1 time: 0.525055 Nov 06 20:54:00.692368 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1240/2509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:00 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1487 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:00.705816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ba426cd-345d-478e-b83a-b6659f9780c3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:00.713199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ba426cd-345d-478e-b83a-b6659f9780c3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.713895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ba426cd-345d-478e-b83a-b6659f9780c3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.739121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ba426cd-345d-478e-b83a-b6659f9780c3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 20:54:00.764542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:00.765733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:00.775244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.786193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.787078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.790717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.854810 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ba426cd-345d-478e-b83a-b6659f9780c3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548/action" status: 202 len: 0 microversion: 2.1 time: 0.152282 Nov 06 20:54:00.856231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1270/2510] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:00 2021] POST /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:00.889494 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1924eb4c-b38b-4ef8-889e-3fe2be75f139 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.130430 Nov 06 20:54:00.890004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:00.890181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1241/2511] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:00 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:00.893325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:00.907892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.908435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:00.910162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:00.910626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.052250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:01.053078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:01.066988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.067723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.069380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.072199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.483160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:01.497396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b4db379-fa75-45f5-9d26-514ad9c9f9b4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.624342 Nov 06 20:54:01.498047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1271/2512] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:00 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:01.503876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:01.504519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 2ba29b6c-141b-4d99-ac58-afea9e681891] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:01.521214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.521546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.522343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.522783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.552262 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] HTTP exception thrown: Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 could not be found. Nov 06 20:54:01.553559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Returning 404 to user: Instance 2ba29b6c-141b-4d99-ac58-afea9e681891 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:01.554989 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd9ed7f2-c226-4b85-aa18-55df56da4110 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891" status: 404 len: 111 microversion: 2.1 time: 0.055630 Nov 06 20:54:01.556098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1272/2513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:01 2021] GET /compute/v2.1/servers/2ba29b6c-141b-4d99-ac58-afea9e681891 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:54:01.564315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:01.567352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:01.580127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.581609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.582499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.584025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.610784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:01.622815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-268da894-86c6-4773-a0ab-689e44ff22a8 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.574219 Nov 06 20:54:01.623400 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1242/2514] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:01 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:01.641810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:54:01.784562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29a1070d-53cf-4df6-8c89-685c25802332 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 204 len: 0 microversion: 2.1 time: 0.223545 Nov 06 20:54:01.786808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1273/2515] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:54:01 2021] DELETE /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:54:01.796194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:01.796976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:01.807066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.807524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.808345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.811780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.904269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:01.908197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:01.921604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.922387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:01.924510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:01.925305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:02.004661 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3042123-35c6-4abc-9aed-77f52177a909 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.107514 Nov 06 20:54:02.005862 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1274/2516] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:01 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:54:02.088651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:02.097041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42ac780f-944d-4c9d-b8e1-4668598afa3c tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1534 microversion: 2.1 time: 0.304950 Nov 06 20:54:02.098271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1243/2517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:01 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1534 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:02.349198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6b5303c-2bef-45ce-9d4a-52655b54d62d tempest-InstanceUsageAuditLogTestJSON-345133452 tempest-InstanceUsageAuditLogTestJSON-345133452-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:02.350260 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:02.350260 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:02.384540 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6b5303c-2bef-45ce-9d4a-52655b54d62d tempest-InstanceUsageAuditLogTestJSON-345133452 tempest-InstanceUsageAuditLogTestJSON-345133452-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-06 20:54:02" status: 200 len: 318 microversion: 2.1 time: 0.202131 Nov 06 20:54:02.385420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1275/2518] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 20:54:02 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-06%2020%3A54%3A02 => generated 318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:02.418297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57214ea9-3e72-4d9c-acaa-de4b887abc1b tempest-InstanceUsageAuditLogTestJSON-345133452 tempest-InstanceUsageAuditLogTestJSON-345133452-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:02.421831 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:02.421831 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:02.473382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57214ea9-3e72-4d9c-acaa-de4b887abc1b tempest-InstanceUsageAuditLogTestJSON-345133452 tempest-InstanceUsageAuditLogTestJSON-345133452-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.077378 Nov 06 20:54:02.481145 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1244/2519] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 20:54:02 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:02.514991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:02.515915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:02.532332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:02.532883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:02.534455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:02.536032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:02.640812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:02.641497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:02.653757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:02.655582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:02.659005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:02.667216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:03.688548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:03.696894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-abe2f529-3814-4901-8bee-91435e217f3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 1.185809 Nov 06 20:54:03.697476 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1276/2520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:02 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:03.698436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:03.714295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c8b2813-03eb-4316-b88d-54a44c5be418 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 1.071985 Nov 06 20:54:03.715767 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1245/2521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:02 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:03.725581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f43f0278-67c9-423f-8563-0f916e391e81 req-ca2d6b2d-d90e-40a4-9882-999ff8cd518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-plugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:03.728092 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:03.728092 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:03.730685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:03.731686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:03.744947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:03.745511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f43f0278-67c9-423f-8563-0f916e391e81 req-ca2d6b2d-d90e-40a4-9882-999ff8cd518d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:03.745871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:03.746033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f43f0278-67c9-423f-8563-0f916e391e81 req-ca2d6b2d-d90e-40a4-9882-999ff8cd518d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:03.747042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:03.747655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:03.770750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f43f0278-67c9-423f-8563-0f916e391e81 req-ca2d6b2d-d90e-40a4-9882-999ff8cd518d service nova] Creating event network-vif-plugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:54:03.777909 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f43f0278-67c9-423f-8563-0f916e391e81 req-ca2d6b2d-d90e-40a4-9882-999ff8cd518d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075154 Nov 06 20:54:03.781084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1277/2522] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:03.800880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:03.801840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:03.806749 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-889af67b-c752-4e14-90f6-6d24cd2463ed tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.088050 Nov 06 20:54:03.810844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:03.811972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1246/2523] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:03 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:03.812740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:03.813717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:03.814308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:04.183217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:04.193699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11aab606-d251-492b-91da-55eecde2cb25 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1534 microversion: 2.1 time: 0.410164 Nov 06 20:54:04.194502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1278/2524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:03 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1534 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:04.714695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:04.715495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:04.731158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:04.731777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:04.740511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:04.743968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:04.744772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:04.745838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:04.746447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:04.747133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:04.761479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:04.761931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.120870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:05.128182 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c5210d1-97d6-47cc-8f4f-7ed5581ca4fc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.400580 Nov 06 20:54:05.134432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1279/2525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:04 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:05.157248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:05.158331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:05.176959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.177441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.178260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.178693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.323227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-736797e4-5a45-4dd5-ba15-98cffdf3b72c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.187247 Nov 06 20:54:05.329332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:05.333530 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1280/2526] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:05 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:05.345193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf4b7299-ddd6-4119-9f1f-170c8429d3b0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.630865 Nov 06 20:54:05.346240 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1247/2527] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:04 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:05.353047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:05.355145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:05.365607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b574be0e-2d45-4a86-a61b-9dbdd4faadcb req-60d20330-652c-4d67-961e-94dd64fbadf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f449d21-9a2c-46a7-99aa-707210a04428", "name": "network-vif-deleted", "tag": "f3bc0dd3-b09d-4857-859d-ac48eec07494"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:05.365960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.366532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.368094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.369263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.371604 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:05.371604 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:05.398146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b574be0e-2d45-4a86-a61b-9dbdd4faadcb req-60d20330-652c-4d67-961e-94dd64fbadf8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.399198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b574be0e-2d45-4a86-a61b-9dbdd4faadcb req-60d20330-652c-4d67-961e-94dd64fbadf8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.451305 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b574be0e-2d45-4a86-a61b-9dbdd4faadcb req-60d20330-652c-4d67-961e-94dd64fbadf8 service nova] Creating event network-vif-deleted:f3bc0dd3-b09d-4857-859d-ac48eec07494 for instance 0f449d21-9a2c-46a7-99aa-707210a04428 on nch2-master-1 Nov 06 20:54:05.466495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b574be0e-2d45-4a86-a61b-9dbdd4faadcb req-60d20330-652c-4d67-961e-94dd64fbadf8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115211 Nov 06 20:54:05.469508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1248/2528] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:05.489851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:05.490309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:05.490846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lazy-loading 'fault' on Instance uuid 0f449d21-9a2c-46a7-99aa-707210a04428 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:05.647660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:05.662035 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b5388b0-e57f-466d-8697-2f00892e33bf tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 200 len: 1368 microversion: 2.1 time: 0.325925 Nov 06 20:54:05.666275 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1281/2529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:05 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:06.151825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:06.152865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.159440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.159904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.160737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.161182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.335427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:06.336246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.345533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.346435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.348410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.351215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.384605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:06.393682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4be2957-9576-47a6-aa1c-3efde0778170 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.246363 Nov 06 20:54:06.404685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1249/2530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:06 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:06.410139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:06.411086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.419048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.419808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.420895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.421505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.461052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70b917dc-f79d-47c4-a461-2ed930936ed7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.129547 Nov 06 20:54:06.465206 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1282/2531] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:06 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:06.648162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:06.660810 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26dee622-f2fa-401d-b596-a0efea748b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.254248 Nov 06 20:54:06.663725 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1250/2532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:06 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:06.682546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:06.683263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: 0f449d21-9a2c-46a7-99aa-707210a04428] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.691151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.691685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.693126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.693569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.713978 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] HTTP exception thrown: Instance 0f449d21-9a2c-46a7-99aa-707210a04428 could not be found. Nov 06 20:54:06.714633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Returning 404 to user: Instance 0f449d21-9a2c-46a7-99aa-707210a04428 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:06.715972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7feb78b7-bf61-4a72-b57b-f4db806450e4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428" status: 404 len: 111 microversion: 2.1 time: 0.037333 Nov 06 20:54:06.718526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1283/2533] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:06 2021] GET /compute/v2.1/servers/0f449d21-9a2c-46a7-99aa-707210a04428 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:54:06.725787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:06.726425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.736781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.738113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.740470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.741717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.788152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:54:06.934944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62374862-0408-4ad9-be0c-04b6723e9be4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 204 len: 0 microversion: 2.1 time: 0.212025 Nov 06 20:54:06.936182 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1251/2534] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:54:06 2021] DELETE /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:54:06.946325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:06.947364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:06.972608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.975341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:06.977005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:06.978995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.190296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:07.198847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da3633b2-48f4-4eaa-a33b-11800033e453 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1467 microversion: 2.1 time: 0.258482 Nov 06 20:54:07.200013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1284/2535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:06 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1467 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:07.411560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:07.412227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:07.422088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.423497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.425016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.427168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.696916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:07.714212 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a236685-2756-44f6-835c-1ff52646cb40 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.305219 Nov 06 20:54:07.716565 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1285/2536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:07 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:07.734850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:07.738131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:07.761601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.762807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.764911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.767144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.874734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07d6cb18-8cc1-44ca-9d0d-f4388d2f14e2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.156224 Nov 06 20:54:07.877113 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1286/2537] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:07 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:07.890887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:07.895278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:07.918528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.920464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.925857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:07.927315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:07.974215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: .version_select at 0x7f671543c1f0>, body: {"keypair": {"name": "tempest-keypair-626765315"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:08.025516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:54:08.048764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:54:08.532613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:54:08.545679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:54:08.581207 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb74c455-2da9-411c-9b76-6fc7d95d7394 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.280123 Nov 06 20:54:08.583197 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1252/2538] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 20:54:07 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1283 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:54:08.594724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:08.597337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:08.614653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:08.616094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:08.618114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:08.621574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:08.806429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:08.823985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1277310-8d07-45bd-909c-9a41810998c9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.939008 Nov 06 20:54:08.826786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1287/2539] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:07 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:08.843864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:08.847187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:08.865108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:08.866650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:08.868769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:08.869405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:09.269411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:09.285560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3abfb26b-4940-4f3a-8a8c-a318894bdcf3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1467 microversion: 2.1 time: 0.698950 Nov 06 20:54:09.288636 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1253/2540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:08 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1467 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:09.301413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:09.307109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:09.324066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:09.324682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:09.325606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:09.326044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:09.410156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:09.426255 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da0f0d5f-a7ec-42ef-812f-9d8eea9b6b68 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.591697 Nov 06 20:54:09.426942 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1288/2541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:08 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:09.477395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44353d2d-da91-472c-bf14-64be18c9b9d2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.184652 Nov 06 20:54:09.480725 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1254/2542] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:09 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:09.842448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:09.843243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:09.858589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:09.859244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:09.862879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:09.864134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:10.305651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:10.306241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:10.320916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:10.323234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:10.326063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:10.327524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:10.428425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:10.450264 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c36c3136-70bf-49c1-9263-c6f3620f692e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.612324 Nov 06 20:54:10.450908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1289/2543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:09 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:10.489716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:10.494732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:10.509848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:10.511492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:10.512441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:10.512990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:11.756838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:11.774247 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b3f4784-dd0d-4bb0-99f4-771105d23d4e tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 200 len: 1467 microversion: 2.1 time: 1.473136 Nov 06 20:54:11.788613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1255/2544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:10 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 1467 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:11.813308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:11.816521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:11.859865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:11.861597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:11.862905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:11.863399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:11.922429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:11.931629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c26142c7-251e-4f4a-a0cd-9bee972dc0fd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 1.479668 Nov 06 20:54:11.939531 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1290/2545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:10 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:11.943300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e9f3218-2205-4a35-b790-a5476981c369 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.151456 Nov 06 20:54:11.947600 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1256/2546] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:11.959854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ac22ae2a-e1b6-44b7-9298-8fcb1e5b88e8 req-ea80d9ea-6c12-4a5b-a3d8-30d16bb96b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a5382c-8a7a-41d9-9f7d-81d8293d8a22", "name": "network-vif-deleted", "tag": "5c194b3b-7525-4372-a35e-31e481740efc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:11.964776 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:11.964776 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:11.982396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:11.984176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:11.985125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ac22ae2a-e1b6-44b7-9298-8fcb1e5b88e8 req-ea80d9ea-6c12-4a5b-a3d8-30d16bb96b80 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:11.986908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ac22ae2a-e1b6-44b7-9298-8fcb1e5b88e8 req-ea80d9ea-6c12-4a5b-a3d8-30d16bb96b80 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.006978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.010511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.013877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.015748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.067969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ac22ae2a-e1b6-44b7-9298-8fcb1e5b88e8 req-ea80d9ea-6c12-4a5b-a3d8-30d16bb96b80 service nova] Creating event network-vif-deleted:5c194b3b-7525-4372-a35e-31e481740efc for instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 on nch1-master-1 Nov 06 20:54:12.097821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ac22ae2a-e1b6-44b7-9298-8fcb1e5b88e8 req-ea80d9ea-6c12-4a5b-a3d8-30d16bb96b80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149770 Nov 06 20:54:12.103452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1291/2547] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:12.570175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:12.587552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31724348-8890-46a5-8336-00a9d00183ef tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.636356 Nov 06 20:54:12.590179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1257/2548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:11 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:12.801746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:12.803090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: f8a5382c-8a7a-41d9-9f7d-81d8293d8a22] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:12.827337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.839756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.841270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.841780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.879986 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] HTTP exception thrown: Instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 could not be found. Nov 06 20:54:12.881372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Returning 404 to user: Instance f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:12.885018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1f82b43-d498-417a-863c-808a2c2fb4d4 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22" status: 404 len: 111 microversion: 2.1 time: 0.085330 Nov 06 20:54:12.886839 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1292/2549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:12 2021] GET /compute/v2.1/servers/f8a5382c-8a7a-41d9-9f7d-81d8293d8a22 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:54:12.895748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:12.898103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:12.911256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.914139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.915433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.916395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.957644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:12.958994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:12.970899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.971730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:12.974162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:12.977979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:13.014805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:54:13.243716 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44115ff4-91c0-47d0-a0d7-9bf5412017c2 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 204 len: 0 microversion: 2.1 time: 0.351577 Nov 06 20:54:13.248429 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1258/2550] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:54:12 2021] DELETE /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:54:13.258666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:13.260665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:13.277037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:13.277633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:13.278932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:13.279299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:13.365382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a424527-d70b-4362-a6fa-49737b27d61c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.112973 Nov 06 20:54:13.368845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1259/2551] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:13 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:13.403681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:13.403681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:13.427069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:13.431831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:13.434853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:13.436704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:13.474714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:13.488713 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92923757-50d7-4bf3-8b2e-48ca1b5d9079 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.534482 Nov 06 20:54:13.490141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1293/2552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:12 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:13.603814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466551672", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cef188b-2bc9-450f-890b-1de92b2534d5"}], "security_groups": [{"name": "tempest-securitygroup--558580301"}], "key_name": "tempest-keypair-626765315", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:14.035205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:14.055664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33255e23-8ad1-4e5a-92be-be86a7e0f48f tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1469 microversion: 2.1 time: 0.679733 Nov 06 20:54:14.055986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] validate_networks() for [('3cef188b-2bc9-450f-890b-1de92b2534d5', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:54:14.068274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1260/2553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:13 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1469 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:14.075956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:14.076945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:14.086092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:14.086963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:14.088694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:14.089618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:14.479803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:14.493456 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03e76827-6d33-4218-bf34-d128ef871b65 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.421670 Nov 06 20:54:14.500347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1261/2554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:14 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:14.905490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:54:14.908332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:54:14.909098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:54:14.909701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:54:14.910130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:54:14.950529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:14.951248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:14.954415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:14.956701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1370924214", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "d7f41d40-db54-4294-8f8b-5894f0c36960"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:14.957315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:14.989946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:54:14.994986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:54:15.021127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:54:15.028123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:54:15.125917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] validate_networks() for [('d7f41d40-db54-4294-8f8b-5894f0c36960', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:54:15.156818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ce18d85-50a7-4453-aa2b-17b705a8bb93 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.559812 Nov 06 20:54:15.159009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1294/2555] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:54:13 2021] POST /compute/v2.1/servers => generated 401 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:54:15.167123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:15.169186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:15.177812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.178839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:15.179941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.180789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:15.246039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7761f35c-f743-4678-8781-0c29d4217a6d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.081574 Nov 06 20:54:15.246733 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1295/2556] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:15.274916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:15.277760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:15.306351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.309427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:15.313272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.318769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:15.796388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:15.824276 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e9397ef-3066-421b-a243-9b7a98e286d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.565690 Nov 06 20:54:15.831499 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1296/2557] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:15 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:15.850594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:15.854047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:15.875198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.875653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:15.877208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:15.877846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.154796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:54:16.156278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:54:16.158087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:54:16.158718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:54:16.159898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:54:16.200006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.200931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.217337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.220024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.260986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ffff819b4c04c92a90993dcd4fa39c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc5ca1083f4131b1da0e5689218590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:16.282340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:54:16.283467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55ef0078-16d7-494b-ad83-164d195ec708 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 200 len: 1469 microversion: 2.1 time: 0.449807 Nov 06 20:54:16.284777 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1297/2558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:15 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:16.296646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for user 2b4178344ec541bb964ed60d977eff68 and project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:54:16.310689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:16.315757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:16.322532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:54:16.325632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:54:16.349300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.349996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.350973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.351518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.392102 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33b19f78-eda6-40d9-9e7a-ebdc71559498 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.894590 Nov 06 20:54:16.393971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1262/2559] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:54:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:54:16.399538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:16.400481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:16.408232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.409178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.410721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.411536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.646726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:16.655883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:16.666698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:16.667845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2154f6ba-cbdd-4b40-8528-b72e90e5c007 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1332 microversion: 2.20 time: 0.380649 Nov 06 20:54:16.668430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1298/2560] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:16 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1332 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:16.688625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-35329b3c-fed6-4270-b3ec-f5b4618a6b23 req-4680e740-33b8-4406-8d14-ced2ed25387a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26d50be-c69a-406f-a982-b6afbc265cfc", "name": "network-vif-deleted", "tag": "8f1f4c54-7fec-4fe1-86c7-874b082456e6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:16.690203 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:16.690203 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:16.748196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-35329b3c-fed6-4270-b3ec-f5b4618a6b23 req-4680e740-33b8-4406-8d14-ced2ed25387a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.748677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-35329b3c-fed6-4270-b3ec-f5b4618a6b23 req-4680e740-33b8-4406-8d14-ced2ed25387a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.813008 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-35329b3c-fed6-4270-b3ec-f5b4618a6b23 req-4680e740-33b8-4406-8d14-ced2ed25387a service nova] Creating event network-vif-deleted:8f1f4c54-7fec-4fe1-86c7-874b082456e6 for instance d26d50be-c69a-406f-a982-b6afbc265cfc on nch1-master-1 Nov 06 20:54:16.851097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-35329b3c-fed6-4270-b3ec-f5b4618a6b23 req-4680e740-33b8-4406-8d14-ced2ed25387a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165769 Nov 06 20:54:16.860992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1299/2561] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:16.878826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:16.879883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:16.919242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.920237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.921647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:16.924436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:16.937701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:16.950580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c58b6a7c-20c4-4511-89a7-6084f4f123cd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.555362 Nov 06 20:54:16.951165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1263/2562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:16 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:16.963897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:16.964935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:17.002326 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fed26b5e-9732-4f3a-b209-d7ee67934380 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.139731 Nov 06 20:54:17.004410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1300/2563] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:16 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:17.017185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:17.020181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:17.059432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.060103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.061567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.062251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.091056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.105244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.111068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.112479 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a7b8294-b0de-49a7-b39b-cb1981107ff0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1262 microversion: 2.25 time: 0.152323 Nov 06 20:54:17.113333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1264/2564] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:16 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:17.305602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:17.309161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] [instance: d26d50be-c69a-406f-a982-b6afbc265cfc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:17.334970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.338102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.340158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.341512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.389214 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] HTTP exception thrown: Instance d26d50be-c69a-406f-a982-b6afbc265cfc could not be found. Nov 06 20:54:17.398082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] Returning 404 to user: Instance d26d50be-c69a-406f-a982-b6afbc265cfc could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:17.401040 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd7bcb79-2085-44d9-9c3a-c42d27de96e3 tempest-MigrationsAdminTest-1759449884 tempest-MigrationsAdminTest-1759449884-project] 10.222.0.13 "GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc" status: 404 len: 111 microversion: 2.1 time: 0.101701 Nov 06 20:54:17.402228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1265/2565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:17 2021] GET /compute/v2.1/servers/d26d50be-c69a-406f-a982-b6afbc265cfc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:54:17.428356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.442561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b01300c-3864-47da-aac7-e75aa6b8d662 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.436573 Nov 06 20:54:17.453640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1301/2566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:17 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:17.688791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:17.689439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:17.707084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.713214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.717023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.718999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.819524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.832389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.836225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:17.837762 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5476b009-2c80-4df5-9e2e-ef29b743b38e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1338 microversion: 2.20 time: 0.154640 Nov 06 20:54:17.838946 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1266/2567] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:17 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1338 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:17.967869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:17.968408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:17.974605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.983562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:17.987017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:17.989754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.015957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:18.017268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:18.058967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.059450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.060386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.067149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.154775 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-acfa449a-5aff-4518-b1b2-3d7cd8a60549 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.142972 Nov 06 20:54:18.160905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1267/2568] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:54:18.167333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:18.168314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:18.181693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.184337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.187045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.189009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.347844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:18.360427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:18.362588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:18.368230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:18.368891 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-350550e7-6337-4d00-ae76-b7c4be0254bb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.405146 Nov 06 20:54:18.376386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-533a2439-0c4f-4e6b-9e6d-b8bae26cf7ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1314 microversion: 2.25 time: 0.208694 Nov 06 20:54:18.377287 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1268/2569] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:18 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:18.384680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1302/2570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:17 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:18.482202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:18.497412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:18.531819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.532248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.539437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.541013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.861178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:18.862416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:18.876063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.877586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.881073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:18.881454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:18.932765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:18.944257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86427857-3e5c-4589-b18f-8d76ff6a05d4 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1521 microversion: 2.1 time: 0.482766 Nov 06 20:54:18.945613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1269/2571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:18 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:19.051859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.068637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.071345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.073114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f4f9df9-b383-4c29-b1c7-e28ea0f2ab6e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1338 microversion: 2.20 time: 0.217993 Nov 06 20:54:19.074328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1303/2572] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:18 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:19.172077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:19.173388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:19.194776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.197225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.201860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.204610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.263413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c354307b-4fc3-4a67-9c90-36607c2a8988 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.098603 Nov 06 20:54:19.268853 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1270/2573] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:19 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:19.403002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:19.407307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:19.408210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:19.410326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:19.422859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.424018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.425142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.426166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.426830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.427487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.429896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.430575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.553871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.569565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.573296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.575109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e5c0928-2a47-4d46-ba79-923cd59397ef tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1320 microversion: 2.25 time: 0.177040 Nov 06 20:54:19.578497 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1304/2574] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:19 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:19.671360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:19.681348 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-adef1ab2-487f-41f1-b4a4-f74b9317d185 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.283422 Nov 06 20:54:19.682995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1271/2575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:19 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:19.963308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:19.964379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:19.978926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.981176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:19.982219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:19.984282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.093675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:20.094328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:20.103975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.104471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.105276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.105711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.644187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.656925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-645c8d0b-59c8-405e-a522-afcf50a432c9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1501 microversion: 2.1 time: 0.697626 Nov 06 20:54:20.669239 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1305/2576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:19 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1501 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:20.679483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:20.680794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:20.688525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.689445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.690417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.691019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.756154 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-abfef6b9-d1df-4390-b1e2-796e037f569c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.084801 Nov 06 20:54:20.758612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1306/2577] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:20 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:20.764327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:20.765320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:20.772807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.774131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.775255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.775871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.834216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.842943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.853854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.855389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf5641f0-32bc-4b95-a5c0-1f6e7eff390f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.767516 Nov 06 20:54:20.856458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1272/2578] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:20 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:20.869873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:20.870689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:20.884632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.891472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.894516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.895944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.898954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.901145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.905846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:20.907374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c225d15-c062-476c-8935-a6ad03d613d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1320 microversion: 2.25 time: 0.147400 Nov 06 20:54:20.908212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1307/2579] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:20 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:20.919085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:20.919955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:20.935832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.936836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:20.938117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:20.939316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.225716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:21.234592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9cec821f-baf7-44bf-952f-a2792c3e4925 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1515 microversion: 2.1 time: 0.376969 Nov 06 20:54:21.238598 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1273/2580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:20 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:21.274051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f848af0-788d-4195-895e-7eda4af8d0f7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:21.275806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f848af0-788d-4195-895e-7eda4af8d0f7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 08c776a0-4450-4205-86a2-ff10cb73e69f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:21.282817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:21.289953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6f848af0-788d-4195-895e-7eda4af8d0f7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Instance 08c776a0-4450-4205-86a2-ff10cb73e69f could not be found. Nov 06 20:54:21.291076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f848af0-788d-4195-895e-7eda4af8d0f7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 404 to user: Instance 08c776a0-4450-4205-86a2-ff10cb73e69f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:21.292210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f848af0-788d-4195-895e-7eda4af8d0f7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/08c776a0-4450-4205-86a2-ff10cb73e69f/action" status: 404 len: 111 microversion: 2.1 time: 0.035999 Nov 06 20:54:21.293367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1274/2581] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:21 2021] POST /compute/v2.1/servers/08c776a0-4450-4205-86a2-ff10cb73e69f/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:54:21.309914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d62dd38d-c476-4686-8d76-f49420e3328b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.400292 Nov 06 20:54:21.310886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1308/2582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:20 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:21.313664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:21.314531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:21.345809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.347902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.348826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.349276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.567969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-457384a7-ec65-43fb-ae5d-efc87ab257b1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 202 len: 0 microversion: 2.1 time: 0.267435 Nov 06 20:54:21.571371 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1275/2583] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:21 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:21.578761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:21.579908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:21.594013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.595029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.599027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.599752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.770211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:21.771299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:21.782278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.791469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.792724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.793422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.911444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed3aa102-000b-4722-a2a4-072d3cf9e7e1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.144565 Nov 06 20:54:21.915921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1276/2584] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:21.924153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:21.934448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:21.957270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.958053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:21.958992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:21.964481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:22.005333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.015926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b1f7091-97aa-476d-825f-ba424b64077d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1520 microversion: 2.1 time: 0.440847 Nov 06 20:54:22.022338 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1309/2585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:21 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:22.031578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:22.034854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:22.056830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:22.067044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:22.070915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:22.072770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:22.361569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.371018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.383109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.384622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91727422-25bc-41b5-bc8d-8dd6188826e6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.466515 Nov 06 20:54:22.385497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1277/2586] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:21 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:22.489567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.502218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.506782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:22.513822 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d6a6c9d-d760-4bf5-92dd-f246ab4213f7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.489861 Nov 06 20:54:22.514816 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1310/2587] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:22 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:22.523684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:22.527592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:22.542833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:22.545405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:22.546536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:22.547230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:22.724117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-391180964", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:22.864869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:54:23.237283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:23.245448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26f69698-9ddc-48f7-ae0e-808181acfa30 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.727995 Nov 06 20:54:23.256681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1311/2588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:22 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:23.262143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b8979ecb-e189-4751-b43a-cc38cd9c71c6 req-32ee4bfd-818b-4d12-8be4-17c6af075e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:23.263974 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:23.263974 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:23.271236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b8979ecb-e189-4751-b43a-cc38cd9c71c6 req-32ee4bfd-818b-4d12-8be4-17c6af075e99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.271949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b8979ecb-e189-4751-b43a-cc38cd9c71c6 req-32ee4bfd-818b-4d12-8be4-17c6af075e99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.284941 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b8979ecb-e189-4751-b43a-cc38cd9c71c6 req-32ee4bfd-818b-4d12-8be4-17c6af075e99 service nova] Creating event network-changed:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:54:23.290589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b8979ecb-e189-4751-b43a-cc38cd9c71c6 req-32ee4bfd-818b-4d12-8be4-17c6af075e99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031787 Nov 06 20:54:23.291447 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1312/2589] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:23.296678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:23.298878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:23.306807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.307491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.308497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.309106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.357283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5521077-d98f-4767-b3cb-117ad238de4a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.064148 Nov 06 20:54:23.362747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1313/2590] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:23.372632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:23.373800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:23.381728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.383300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.384497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.385191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.415999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:54:23.416540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:54:23.416975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:54:23.420690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:54:23.421459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:54:23.443448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.444252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.445548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.446162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.471352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Getting quotas for project 0225cbcb2bad437d8687f9024d57918d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:54:23.487803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Getting quotas for user be5bb7487cbd4a6fac7bdfac7189c8ce and project 0225cbcb2bad437d8687f9024d57918d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:54:23.518869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:54:23.521670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:54:23.592058 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b979d1b-472d-4802-a17d-921aedd30efa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205220 Nov 06 20:54:23.600067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1278/2591] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:54:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:54:23.618128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:23.620659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:23.631623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.633874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.635123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.636733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.781190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:23.789925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ea64865-b945-4051-b992-9f19b6f741bb tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1500 microversion: 2.1 time: 0.424964 Nov 06 20:54:23.794631 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1314/2592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:23 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1500 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:23.807375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:23.818518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:23.827338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.828564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.829320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:23.829710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:23.963807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:23.972049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:23.973590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:23.979506 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f271dd15-399f-4c93-936a-1f9ce665d838 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.378212 Nov 06 20:54:23.982013 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1279/2593] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:23 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:23.997865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a421ad1-5577-45e4-a613-3666ddac1907 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:24.000410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a421ad1-5577-45e4-a613-3666ddac1907 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.114718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a421ad1-5577-45e4-a613-3666ddac1907 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:24.130496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a421ad1-5577-45e4-a613-3666ddac1907 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1222 microversion: 2.1 time: 0.137198 Nov 06 20:54:24.131391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1280/2594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:23 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:24.145348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:24.146695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.163230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.163947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.164999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.165722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:24.166522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.178414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:24.186491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:24.187670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb646c1d-8b72-4389-9ddf-d35c2fbce820 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.391603 Nov 06 20:54:24.189202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1315/2595] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:23 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:24.201312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'flavor' on Instance uuid 02d9c005-dc47-4fb6-ac23-fdeada22a300 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:24.203960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Cannot 'rescue' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state paused Nov 06 20:54:24.204625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 409 to user: Cannot 'rescue' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state paused {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:24.205453 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8e767b8-9de3-4a48-af5b-e9cc0e9f003f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 409 len: 144 microversion: 2.1 time: 0.072973 Nov 06 20:54:24.206032 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1281/2596] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:24 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 144 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:54:24.215493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:24.216026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.229810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.230274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.231082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.247774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.263800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:24.270775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.281927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.284032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.285807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.290829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.413508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0588238f-2ee2-4ca7-a18f-d5908791e5cd tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 202 len: 0 microversion: 2.1 time: 0.202540 Nov 06 20:54:24.416376 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1316/2597] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:24 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:24.424141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:24.427495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.436706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.437576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.438843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.439729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.501102 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-624462c3-97d4-468a-b3c4-3c151bf06332 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.080838 Nov 06 20:54:24.502149 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1317/2598] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:24 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:24.511033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:24.512124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:24.519937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.520767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:24.522220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:24.524198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.070989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.080839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d3ca452-5c95-451a-b13f-a696a381f348 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.820559 Nov 06 20:54:25.088380 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1282/2599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:24 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:25.114891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.123742 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0aa840aa-a6ee-481f-9c5d-9b4dc905450f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1507 microversion: 2.1 time: 0.619743 Nov 06 20:54:25.126771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:25.127828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:25.136507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1318/2600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:24 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:25.146460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.147465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.149972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.150651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.154194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:25.156244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:25.180560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.181113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.181985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.182490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.300751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.310599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91ceac46-c917-4511-9ab3-cfe424307c6e tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1218 microversion: 2.1 time: 0.165338 Nov 06 20:54:25.316024 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1319/2601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:25 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:25.328044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:25.334223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:25.356822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.357666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.358731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.359368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.432968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.446246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.453956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.458842 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b081338-89be-4a4b-8e5a-7c2715de8b24 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.366004 Nov 06 20:54:25.459458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1283/2602] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:25 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:25.483814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6d339549-7687-4eac-a41a-1e10fbf32e10 req-01c11ede-2922-47fe-a1f5-669d95d8e5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b", "tag": "924c058a-77c0-4dc6-a5e1-a65e4c088faa"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:25.486393 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:25.486393 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:25.512082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d339549-7687-4eac-a41a-1e10fbf32e10 req-01c11ede-2922-47fe-a1f5-669d95d8e5b9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.512901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d339549-7687-4eac-a41a-1e10fbf32e10 req-01c11ede-2922-47fe-a1f5-669d95d8e5b9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.541769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6d339549-7687-4eac-a41a-1e10fbf32e10 req-01c11ede-2922-47fe-a1f5-669d95d8e5b9 service nova] Creating event network-changed:924c058a-77c0-4dc6-a5e1-a65e4c088faa for instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b on nch2-master-1 Nov 06 20:54:25.548160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6d339549-7687-4eac-a41a-1e10fbf32e10 req-01c11ede-2922-47fe-a1f5-669d95d8e5b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087504 Nov 06 20:54:25.549173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1284/2603] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:25.555420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:25.556850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:25.566094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.566556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.571992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:25.573741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:25.603709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.615185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.615185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:25.616164 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12d8c972-2626-48b7-bb69-a340cf8d745f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.297716 Nov 06 20:54:25.617006 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1320/2604] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:25 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:25.640442 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6618679-d2ac-49c5-bc99-fccfe6d90c57 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.088940 Nov 06 20:54:25.641782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1285/2605] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:25 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:26.105924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:26.106901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:26.113058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.113523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.115376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.115987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.144080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:26.144811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:26.152074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.152427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.153218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.153655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.322312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.330755 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ceda889c-af8e-4f4b-97ed-ffe1902409ba tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.230519 Nov 06 20:54:26.331341 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1321/2606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:26 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:26.340353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:26.340951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:26.354382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.354843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.355651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.356086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.464132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.478324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.486327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93b5c613-62f6-4810-a46a-994669f83779 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1274 microversion: 2.1 time: 0.139674 Nov 06 20:54:26.488627 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3227e041-05c3-48a7-9e77-3ac0d5160b08 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1515 microversion: 2.1 time: 0.348164 Nov 06 20:54:26.488870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1322/2607] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:26 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:26.489958 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1286/2608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:26 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1515 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:26.503696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:26.508695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:26.519669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.523222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.527249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.528075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.635749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:26.637597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:26.656106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.663310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.664403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:26.666633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:26.958370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.971804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.977200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:26.983809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5206d9f-5770-47ff-b7d5-6d909d2865e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.487626 Nov 06 20:54:26.984709 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1323/2609] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:26 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:26.993670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:26.995074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:27.003560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.004145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.005087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.005630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.063058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd493310-99c1-4b1e-985e-c282390846e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.073940 Nov 06 20:54:27.070535 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1324/2610] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:27.097599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:27.107895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:27.110295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:27.111734 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79668ea6-66c8-4d38-a53b-fd18001056bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.480862 Nov 06 20:54:27.121916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1287/2611] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:26 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:27.349471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:27.350170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:27.362428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.364441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.365723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.367159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.527745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:27.530864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:27.549425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.550886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.551998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:27.553762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:27.656267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:27.668204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f880c199-51a7-40f0-986c-dce89f31b451 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1280 microversion: 2.1 time: 0.153366 Nov 06 20:54:27.675732 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1288/2612] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:27 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:27.701063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:27.708811 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13748296-17ce-42e0-b2a3-62ea8b5c787c tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.363418 Nov 06 20:54:27.711620 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1325/2613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:27 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:28.007823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:28.008364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.015781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.016243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.022504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.023533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.077071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:28.078392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.086832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.087293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.088380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.088827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.144940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b24b3f3-e2d4-4ec7-9e9a-5e79af68c633 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.070923 Nov 06 20:54:28.147887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1326/2614] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:54:28.164163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:28.166186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.174341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.174801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.175605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.176048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.602188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.610320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.611850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.612999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82467e9b-aa34-4937-9107-a6fa188d0805 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.609683 Nov 06 20:54:28.613565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1289/2615] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:28 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:28.629725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:28.634144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.642018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.646151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.650268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.651384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.652006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.653165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.654871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:28.656313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24a11a01-913c-4fe4-a44a-fe8c3c207081 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.505139 Nov 06 20:54:28.658325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1327/2616] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:28 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:28.686819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:28.690767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.697480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.698207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.701147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.702061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.715523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'flavor' on Instance uuid 02d9c005-dc47-4fb6-ac23-fdeada22a300 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:28.926409 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be2e7a53-7f7a-48bb-af8b-91fd98541431 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 200 len: 32 microversion: 2.1 time: 0.305089 Nov 06 20:54:28.930667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1290/2617] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:28 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:54:28.943392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:28.944202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:28.960967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.963415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:28.965639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:28.966128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.000833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:29.008680 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e82c557b-0663-4fc1-89f1-df64064354e3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1280 microversion: 2.1 time: 0.325694 Nov 06 20:54:29.010674 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1328/2618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:28 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:29.015792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:29.016856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:29.050024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.050936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.052190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.052900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.237415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:29.262721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-791ed26b-aa90-4b82-948f-c9aef6006601 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.329968 Nov 06 20:54:29.279648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1291/2619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:28 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:29.307753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:29.309600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:29.321924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.322626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.323640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.324260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.355198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:29.365140 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a208639-2ba2-4c7c-8a4e-1b4ab84198c7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.353108 Nov 06 20:54:29.376234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1329/2620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:29 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:29.391061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bfc2fb4a-96cc-43d7-b6c5-5b4287d5352b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.087601 Nov 06 20:54:29.395126 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1292/2621] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:29 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:29.631009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:29.631638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:29.639043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.639501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.641239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.641622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.676226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:29.678174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:29.685533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.686044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:29.686960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:29.687413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.025087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.036677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.039093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.047540 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6487266-bcbd-4b82-90d0-6d4fa40c616d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.414137 Nov 06 20:54:30.059393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.061982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.063080 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1330/2622] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:29 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:30.064929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.066516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60625676-b6e2-49da-a643-1c9892f1d5fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.395331 Nov 06 20:54:30.067295 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1293/2623] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:29 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:30.068561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:30.070321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:30.073492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:30.074367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:30.077863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.078464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.079546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.080395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.082050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.082515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.084700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.085201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.409776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.418330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33fba772-cb44-4c81-8a9f-75bca6a5ab7b tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.349557 Nov 06 20:54:30.424219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1294/2624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:30 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:30.432736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:30.433651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:30.447062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.447282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.448175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.449242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.449864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.455603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01ac3cf9-5ffe-4868-b5f5-d7cea9264aed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.392043 Nov 06 20:54:30.456178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1331/2625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:30 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:30.471758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:30.472715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:30.483884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.484363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.487963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.488456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.873956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.881944 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd2b88be-e0e8-447a-8211-6e0a5b7a60e4 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1497 microversion: 2.1 time: 0.456595 Nov 06 20:54:30.883656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1295/2626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:30 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1497 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:30.896617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:30.897764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:30.901089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:30.910169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.911210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.914187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ace33a12-83a0-479e-a47f-ab46b224a9d1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.448933 Nov 06 20:54:30.914187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1332/2627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:30 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:30.915805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.916526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.927359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-84dbd754-6df4-4f29-b0d4-ced492aaf0bd req-0e14e34d-1495-49e1-b8e5-219477090ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31879e23-36bf-4231-988b-2e013a223d7e", "tag": "87be1463-955f-49f0-89e1-709c7e033ec9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:30.929279 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:30.929279 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:30.939008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-84dbd754-6df4-4f29-b0d4-ced492aaf0bd req-0e14e34d-1495-49e1-b8e5-219477090ab9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:30.939818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-84dbd754-6df4-4f29-b0d4-ced492aaf0bd req-0e14e34d-1495-49e1-b8e5-219477090ab9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:30.965185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-84dbd754-6df4-4f29-b0d4-ced492aaf0bd req-0e14e34d-1495-49e1-b8e5-219477090ab9 service nova] Creating event network-changed:87be1463-955f-49f0-89e1-709c7e033ec9 for instance 31879e23-36bf-4231-988b-2e013a223d7e on nch2-master-1 Nov 06 20:54:30.966367 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4984bae2-43bc-4305-98f9-2b0919c1024d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.073190 Nov 06 20:54:30.967542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1296/2628] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:30 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:30.973428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-84dbd754-6df4-4f29-b0d4-ced492aaf0bd req-0e14e34d-1495-49e1-b8e5-219477090ab9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049309 Nov 06 20:54:30.974690 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1333/2629] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:31.067440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:31.068129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:31.076488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.076945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.077961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.078574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.086480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:31.087855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:31.095339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.095823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.096974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.097410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.314049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.323076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.325914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.326103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.327298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-348c83a7-1861-4bcf-b452-ad5c746bfe6d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.265074 Nov 06 20:54:31.328177 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1297/2630] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:31.340538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.342250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.343477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21a30d99-aa8d-4878-8748-b0b10915d2f1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.261916 Nov 06 20:54:31.344146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1334/2631] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:31.435051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:31.435662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:31.442178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.442634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.443424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.443865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.473528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:31.474074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:31.480855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.481448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.482404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:31.482845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:31.982387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.990794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:31.991267 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e537be84-c5f1-42cb-8bb8-7d099a4dabe1 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.559523 Nov 06 20:54:31.992522 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1298/2632] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:31.997179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:31.997873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:31.998721 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-482efbcf-dec2-4d65-98ec-1abd4585f14b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.529089 Nov 06 20:54:31.999282 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1335/2633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:32.006752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:32.009605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.017190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.018153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.018914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.019347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.019534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.019859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.020131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.027437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.233288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:32.241849 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7a8bd78b-9afb-4af0-b8b1-ff0dbd32aef0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 200 len: 1474 microversion: 2.1 time: 0.247520 Nov 06 20:54:32.242459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:32.242970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1299/2634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 1474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:32.247786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:32.248854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.255366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.256129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.257926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.258576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.261792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f946a04-d2e1-45d5-b8e8-028c881114a7 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.261441 Nov 06 20:54:32.262363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1336/2635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:31 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:32.267380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-529459722"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:32.268740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.275332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.275784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.276700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.277321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.314204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2c2c966c-9df4-406c-8f0e-4203ada4073e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.069323 Nov 06 20:54:32.315351 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1300/2636] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:32 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:32.321519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1021360372"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:32.322638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.330967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.331430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.332217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.332685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.659107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-028f119d-31e4-40d8-840d-431385c976ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.395241 Nov 06 20:54:32.660518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1337/2637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:32 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 06 20:54:32.668224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e242ac7a-6866-43b5-be35-b1dcd1dc547f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548/action" status: 202 len: 0 microversion: 2.1 time: 0.351473 Nov 06 20:54:32.669774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1301/2638] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:32 2021] POST /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:54:32.689081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:32.690118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:32.690629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.694941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:32.704482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.705022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.706027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.706868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.716412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.718474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.719505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:32.721416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:32.963222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:32.974756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:32.976821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:32.979276 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a94b9b3e-a975-4acf-8020-4aeb8dc644af tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.307656 Nov 06 20:54:32.980918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1302/2639] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:32 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:32.986966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2711beab-986f-4d00-91d4-04432603f2a0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715422e50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:33.026243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:33.035923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:33.037646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:33.039110 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ee0adc7-cb72-40d2-837f-4d7d11f580c7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.377015 Nov 06 20:54:33.039745 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1338/2640] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:32 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:33.044935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-bcbc89f2-2f53-4fe1-a324-0c67a005e922 req-63318201-3692-4b89-9def-3576c7d143e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b", "name": "network-vif-plugged", "status": "completed", "tag": "924c058a-77c0-4dc6-a5e1-a65e4c088faa"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:33.046428 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:33.046428 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:33.049374 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2711beab-986f-4d00-91d4-04432603f2a0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.067114 Nov 06 20:54:33.050174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1303/2641] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:32 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:33.054395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bcbc89f2-2f53-4fe1-a324-0c67a005e922 req-63318201-3692-4b89-9def-3576c7d143e5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.054911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bcbc89f2-2f53-4fe1-a324-0c67a005e922 req-63318201-3692-4b89-9def-3576c7d143e5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.059320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:33.059897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:33.068058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-bcbc89f2-2f53-4fe1-a324-0c67a005e922 req-63318201-3692-4b89-9def-3576c7d143e5 service nova] Creating event network-vif-plugged:924c058a-77c0-4dc6-a5e1-a65e4c088faa for instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b on nch2-master-1 Nov 06 20:54:33.073690 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-bcbc89f2-2f53-4fe1-a324-0c67a005e922 req-63318201-3692-4b89-9def-3576c7d143e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032477 Nov 06 20:54:33.074439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1339/2642] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:33.076496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.077364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.078424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.078946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.249088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:33.258934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43be6f12-80c2-4862-8e39-77d9c55798c9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.207183 Nov 06 20:54:33.259797 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1304/2643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:33 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:33.279770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:33.281500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:33.287618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.288078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.289774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.290526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.326705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:33.327820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:33.334759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.335253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.336057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:33.336567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:33.432445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:33.440450 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b03968a-122b-4123-972e-eb55003cfbf3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.165109 Nov 06 20:54:33.441179 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1340/2644] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:33 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:33.593803 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39ae7977-2c70-43f2-a6b6-ab4a25d731fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.270595 Nov 06 20:54:33.595573 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1305/2645] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:54:33.998250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:33.999164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:34.005368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.005819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.006608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.007591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.063371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76e67b3f-5c4e-410a-a97c-6f4009f18a92 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671543c430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:34.114317 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76e67b3f-5c4e-410a-a97c-6f4009f18a92 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.055018 Nov 06 20:54:34.115246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1306/2646] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:34 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:34.120143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:34.121434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:34.128185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.128683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.129465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.130168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.288697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.297368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.299299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.300626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49f071f0-e514-409c-a315-a171095bb966 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.306203 Nov 06 20:54:34.301296 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1341/2647] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:33 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:34.306211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:34.307088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:34.314202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.314808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.315641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.316157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.360968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.372698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.374485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.375775 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fde1df58-d185-4b72-bb8c-00089b730ca6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.259633 Nov 06 20:54:34.387793 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1307/2648] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:34 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:34.461689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:34.462521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:34.469315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.470373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.471362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.471986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.585119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.593734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5ba027e-5714-4305-8cd0-d1244109035c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.291349 Nov 06 20:54:34.594910 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1342/2649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:34 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:34.608200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:34.609658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:34.615961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.617204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.618147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:34.618584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:34.669681 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c58a6826-a356-4155-8169-2502a8a7e40d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066384 Nov 06 20:54:34.674658 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1343/2650] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:34 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:34.744195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:34.758114 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7560f44-fdc1-4583-8cf1-1e2e80ee469e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.302274 Nov 06 20:54:34.758876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1308/2651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:34 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:35.091874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "name": "network-vif-plugged", "status": "completed", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}, {"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-unplugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:35.093762 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:35.093762 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:35.102863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.103317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.117962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] Creating event network-vif-plugged:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:54:35.118497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] Creating event network-vif-unplugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:54:35.127722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be66b387-5ae9-47c4-af1e-2ff9812bea81 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715414af0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:35.137455 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e2a6685e-7ce8-406e-af87-df97e1293181 req-6bf47eb0-8e3a-4e31-a9a0-13c6a6951a20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050503 Nov 06 20:54:35.138683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1344/2652] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:35 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:35.189752 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be66b387-5ae9-47c4-af1e-2ff9812bea81 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.065523 Nov 06 20:54:35.190327 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1309/2653] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:35 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:35.320692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:35.321399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:35.329586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.330393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.331636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.333222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.394127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:35.394739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:35.401959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.404600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.404600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.404600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.653186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.662186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.663932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.665117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-472b4cae-eb42-4c9d-a729-1b9079353027 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1362 microversion: 2.25 time: 0.349680 Nov 06 20:54:35.665928 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1345/2654] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:35 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:35.671580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:35.672545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:35.679358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.680136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.681152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.681875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.740739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.748747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.750582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.752236 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa5e0777-906c-4c98-8fe9-c8f7980a79d5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.361314 Nov 06 20:54:35.753052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1310/2655] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:35 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:35.758347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:35.759524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:35.767446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.768287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.771241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.771848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.834347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24ff5231-c093-457c-be86-18f19324c5e5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.079769 Nov 06 20:54:35.835346 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1311/2656] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:35 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:35.840635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:35.841341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:35.848683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.849144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.849933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:35.850369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:35.989371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:35.997430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0706fe64-c778-4fc1-81ba-fd1a11bf67e2 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.330139 Nov 06 20:54:35.998012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1346/2657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:35 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:36.128831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:36.137534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6490fd2e-32b0-4afd-9d96-8c2eae51d141 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.300457 Nov 06 20:54:36.138532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1312/2658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:35 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:36.208689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe5d8286-e73d-453a-852a-8b4ad2791bbb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac75700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:36.260365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe5d8286-e73d-453a-852a-8b4ad2791bbb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.060772 Nov 06 20:54:36.261323 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1347/2659] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:36 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:36.684039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:36.684609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:36.693700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:36.694628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:36.697375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:36.698342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:36.776153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:36.776902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:36.783269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:36.783825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:36.784869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:36.785517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:36.975513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:36.983826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:36.985385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:36.986593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77057ff2-50b9-4629-8d1e-5e70a45eb743 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1557 microversion: 2.25 time: 0.306519 Nov 06 20:54:36.990218 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1313/2660] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:36 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1557 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:36.997649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:36.998765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:37.004970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.005423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.006221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.006658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.056452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88a80df0-7adb-4986-873c-a4fc723f9caf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.064292 Nov 06 20:54:37.057724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1314/2661] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:36 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:37.159250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:37.168809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:37.170578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:37.171893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b242ef5-2f3f-4efd-a7e5-265197bbc609 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1405 microversion: 2.20 time: 0.400680 Nov 06 20:54:37.183537 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1348/2662] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:36 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:37.188420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:37.189922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:37.196852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.197553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.198536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.199154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.276602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:37.277158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:37.284453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.284913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.285871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.286320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.445846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:37.454288 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a013adcb-76b2-41ce-8653-4938148053f7 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.269328 Nov 06 20:54:37.454871 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1349/2663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:37 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:37.480930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:37.481733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:37.500654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.502737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.505570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.508052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.551858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:37.656606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a6a0292-9e2a-4d40-8866-f07a45270886 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 2050 microversion: 2.25 time: 0.597226 Nov 06 20:54:37.657807 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1315/2664] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:37 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 2050 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:37.674037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c82f66c5-6b5d-4aa4-b376-0b7836468427 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715ad6700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:37.739134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c82f66c5-6b5d-4aa4-b376-0b7836468427 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.079928 Nov 06 20:54:37.746744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1316/2665] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:37 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:37.750557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:37.753121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:37.754446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:37.758548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f984fd82-b8bb-4afe-851f-61e9be108ad5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.297140 Nov 06 20:54:37.762617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.763412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.764654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:37.765343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:37.779078 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1350/2666] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:37 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:37.977138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:37.993119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09ab6084-9976-4ee1-bfb7-9dffd4b0cb87 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 2050 microversion: 2.25 time: 0.244710 Nov 06 20:54:37.993948 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1317/2667] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:37 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 2050 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:38.010306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:38.011799 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:38.011799 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:38.013524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.014052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.014967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.015519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.040640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-efccb0ac-ccaa-4ec6-bd71-a3a04326b622 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033733 Nov 06 20:54:38.041331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1351/2668] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Nov 6 20:54:38 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:54:38.053710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:38.055378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:38.062590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.063306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.064686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.065515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.074673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:38.075768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:38.086595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.087436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.088428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.089023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.144239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7647a19-c006-48c6-b5aa-67284b4020ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.075164 Nov 06 20:54:38.144928 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1352/2669] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:38 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:38.151041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'flavor' on Instance uuid bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:38.191029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:38.191738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:38.198896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.200350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.201635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.202283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.203084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:54:38.446261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:38.479741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:38.482273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:38.483706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87a9f4b4-7eae-4b66-bf7e-19872cb679d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1596 microversion: 2.20 time: 0.297573 Nov 06 20:54:38.485079 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1353/2670] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:38 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1596 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:54:38.501017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:38.501967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:38.509960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.510634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:38.512260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:38.514012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.082996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:39.093358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4dd068f-6ccd-45da-8155-3172df693e53 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.606905 Nov 06 20:54:39.093951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1354/2671] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:38 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:39.099152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:39.100228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:39.107990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.109265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.110443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.111129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.272918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55264ef7-71ef-4754-8b9b-1c64940938e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177216 Nov 06 20:54:39.273621 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1355/2672] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 20:54:39 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:54:39.278472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3ae1d42-5f99-4a5e-be71-ca04de9f2e9b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac72ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:39.370359 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3ae1d42-5f99-4a5e-be71-ca04de9f2e9b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.095389 Nov 06 20:54:39.372972 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1356/2673] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:39 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:39.380339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:39.381329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:39.393799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.394365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.395253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.396192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.662965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:39.674103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b777763a-ad28-4ac0-a2cb-773fa2189bd0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.299809 Nov 06 20:54:39.674991 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1357/2674] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:39 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:39.687568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-02f435cf-9d25-42b4-bd7d-01dedb76d8a2 req-5620a113-a44d-439e-8533-470939d284e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31879e23-36bf-4231-988b-2e013a223d7e", "name": "network-vif-plugged", "status": "completed", "tag": "87be1463-955f-49f0-89e1-709c7e033ec9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:39.689198 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:39.689198 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:39.696284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-02f435cf-9d25-42b4-bd7d-01dedb76d8a2 req-5620a113-a44d-439e-8533-470939d284e4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.697015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-02f435cf-9d25-42b4-bd7d-01dedb76d8a2 req-5620a113-a44d-439e-8533-470939d284e4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.709295 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-02f435cf-9d25-42b4-bd7d-01dedb76d8a2 req-5620a113-a44d-439e-8533-470939d284e4 service nova] Creating event network-vif-plugged:87be1463-955f-49f0-89e1-709c7e033ec9 for instance 31879e23-36bf-4231-988b-2e013a223d7e on nch2-master-1 Nov 06 20:54:39.715214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-02f435cf-9d25-42b4-bd7d-01dedb76d8a2 req-5620a113-a44d-439e-8533-470939d284e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038838 Nov 06 20:54:39.716061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1358/2675] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:39.721654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:39.722749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:39.738216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.740621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.742704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:39.743243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:39.797041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48e10c97-046a-443f-ac32-9bd86909f1d6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.078700 Nov 06 20:54:39.799464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1359/2676] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:39 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:40.113135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:40.113887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:40.123555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.124223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:40.125063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.125956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:40.436766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:40.445992 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35229cd4-3bbc-4458-a00f-9a27d4bc9ea6 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.338701 Nov 06 20:54:40.456661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1360/2677] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:40 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:40.461719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2af848d8-ed2c-434f-9de0-102a9ff9ec51 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac72d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:40.523256 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2af848d8-ed2c-434f-9de0-102a9ff9ec51 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.065200 Nov 06 20:54:40.523829 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1361/2678] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:40 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:40.690773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:40.691716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:40.696511 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae073e61-fe52-4e8e-90d0-3935cc629d63 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b/action" status: 202 len: 0 microversion: 2.25 time: 2.641878 Nov 06 20:54:40.700721 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1318/2679] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:38 2021] POST /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b/action => generated 0 bytes in 2653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:54:40.703729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.704491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:40.705647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.706262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:40.706535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:40.707157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:40.715288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.716536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:40.717437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:40.717909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.148346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:41.159686 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-beb7a77b-ecea-4795-8069-2d8f6d184b18 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.472130 Nov 06 20:54:41.180470 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1362/2680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:40 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:41.187865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:41.189071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:41.205130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.205857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.207073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.207682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.209484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:41.220288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:41.222115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:41.223687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf596b5d-57de-4fe2-8d5a-a2a72418ce03 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.521809 Nov 06 20:54:41.224979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1319/2681] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:40 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:41.240590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-93d829a7-6f90-4e1d-bbe1-600a20a1fdb5 req-f06a8f31-664e-4c44-9e17-3fc08007fbbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:41.242702 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:41.242702 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:41.253108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-93d829a7-6f90-4e1d-bbe1-600a20a1fdb5 req-f06a8f31-664e-4c44-9e17-3fc08007fbbb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.253870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-93d829a7-6f90-4e1d-bbe1-600a20a1fdb5 req-f06a8f31-664e-4c44-9e17-3fc08007fbbb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.272162 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-93d829a7-6f90-4e1d-bbe1-600a20a1fdb5 req-f06a8f31-664e-4c44-9e17-3fc08007fbbb service nova] Creating event network-changed:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:54:41.277727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-93d829a7-6f90-4e1d-bbe1-600a20a1fdb5 req-f06a8f31-664e-4c44-9e17-3fc08007fbbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050689 Nov 06 20:54:41.278325 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1320/2682] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:41.291323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:41.292656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:41.298752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.299214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.300332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.300472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.351085 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a9fcdfc-2028-449b-8aad-8fcbbe5fbf5d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.165750 Nov 06 20:54:41.352167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1363/2683] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:41.360200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9addc98-450d-439d-8555-f013e0e37d85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.075995 Nov 06 20:54:41.366061 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1321/2684] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:41 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:41.465855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:41.467601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:41.478423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.479767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.481267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.481891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.537646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e359de55-0127-4dbc-b413-452b2b1f72fd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715422310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:41.605297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e359de55-0127-4dbc-b413-452b2b1f72fd tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.072252 Nov 06 20:54:41.607135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1322/2685] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:41 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:41.730698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7007c97-5fa8-462d-8192-9bf343e58548", "name": "network-vif-plugged", "status": "completed", "tag": "809b9394-67e1-4318-9cc7-04a3de08ebc9"}, {"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-plugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:41.733921 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:41.733921 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:41.742960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:41.743415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:41.756572 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] Creating event network-vif-plugged:809b9394-67e1-4318-9cc7-04a3de08ebc9 for instance a7007c97-5fa8-462d-8192-9bf343e58548 on nch2-master-1 Nov 06 20:54:41.757721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] Creating event network-vif-plugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:54:41.767604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-fcc0624b-c9d0-4118-b4b7-69d207977754 req-5e059de3-f0c5-48bd-80d3-8f2790067a73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040412 Nov 06 20:54:41.774697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1323/2686] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:54:41.874595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:41.888024 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-246a2b61-30ee-4855-b5ef-004fe45118aa tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1322 microversion: 2.1 time: 0.428754 Nov 06 20:54:41.890632 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1364/2687] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:41 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:42.181503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:42.182862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:42.194524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.194987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.195918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.205106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.243273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:42.244703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:42.257612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.258072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.266198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.266666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.747305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:42.756543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:42.761755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:42.767556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:42.771311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5afe52a3-1a45-47ac-8031-8a0227afb2ab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.533088 Nov 06 20:54:42.773086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1365/2688] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:42 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:42.783398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bee1a66-05bc-41f6-8eee-57f46e81082e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.606477 Nov 06 20:54:42.783995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1324/2689] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:42 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:42.787927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:42.791340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:42.810257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.810723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.811533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.812184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.815269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:42.816515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:42.823448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.824164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.825639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.826386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.871111 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9e866d6-2194-4993-a6c0-8c12d976a0bf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.096538 Nov 06 20:54:42.872623 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1366/2690] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:42 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:42.881470 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b9afee9-f068-41ea-9a60-50699f567e85 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.070790 Nov 06 20:54:42.882702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1325/2691] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:42 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:42.886457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef531479-595d-4f83-bf9c-9e6f59492c76 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715b47af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:42.911190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:42.913055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:42.923513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.924133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.925053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:42.925500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:42.961167 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef531479-595d-4f83-bf9c-9e6f59492c76 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1414 microversion: 2.1 time: 0.086172 Nov 06 20:54:42.961746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1367/2692] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:42 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:43.294035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2663c4bc-236b-42ba-8928-3f0faccfa7df req-bc5f1327-e887-44b0-89ee-9c4e05249d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b", "name": "network-vif-unplugged", "status": "completed", "tag": "924c058a-77c0-4dc6-a5e1-a65e4c088faa"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:43.295640 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:43.295640 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:43.306931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2663c4bc-236b-42ba-8928-3f0faccfa7df req-bc5f1327-e887-44b0-89ee-9c4e05249d1a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.307383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2663c4bc-236b-42ba-8928-3f0faccfa7df req-bc5f1327-e887-44b0-89ee-9c4e05249d1a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.321581 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2663c4bc-236b-42ba-8928-3f0faccfa7df req-bc5f1327-e887-44b0-89ee-9c4e05249d1a service nova] Creating event network-vif-unplugged:924c058a-77c0-4dc6-a5e1-a65e4c088faa for instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b on nch2-master-1 Nov 06 20:54:43.323768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:43.327341 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2663c4bc-236b-42ba-8928-3f0faccfa7df req-bc5f1327-e887-44b0-89ee-9c4e05249d1a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039113 Nov 06 20:54:43.328619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1368/2693] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:43.335046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eaf9d62c-904d-4bc0-97ab-d3c63f04c333 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1472 microversion: 2.1 time: 0.429146 Nov 06 20:54:43.348794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1326/2694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:42 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1472 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:43.358331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:43.358331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:43.372038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.373139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.374504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.375134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.413768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:43.416316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:43.418150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23088bd2-6867-49d0-8402-4377554ff024 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.066951 Nov 06 20:54:43.431419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:43.441502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:43.450268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1369/2695] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 20:54:43 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e/diagnostics => generated 117 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:54:43.456156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.456883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.458033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.458667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.498702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:54:43.608625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e8bc6e6-6eb4-4805-a85f-80deb110c0b9 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 204 len: 0 microversion: 2.1 time: 0.182660 Nov 06 20:54:43.609215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1327/2696] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:54:43 2021] DELETE /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:54:43.621037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:43.621756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:43.630261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.631768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.633406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.634086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.798557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:43.800036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:43.810328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.811892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:43.815456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:43.816280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.164708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:44.176201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e3499af-01de-41b3-af6c-e9421430505c tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1478 microversion: 2.1 time: 0.561825 Nov 06 20:54:44.189041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1370/2697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:43 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1478 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:44.194586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:44.195451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:44.203368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.204106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.205228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.205849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.311441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:44.341952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:44.351797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:44.356892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d8176e3-448b-4052-97ce-6b11c35f1393 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.567911 Nov 06 20:54:44.357502 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1328/2698] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:43 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:44.375073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:44.402100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:44.423963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.429405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.431000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.432918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.519720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87a006d2-265a-41bc-a29a-c631f8c1d397 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.154515 Nov 06 20:54:44.520967 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1329/2699] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:44 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:44.544893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:44.553402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:44.562778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.563691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.565215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:44.565912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:44.669176 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e3a5421-5638-48fb-88ab-bb46c103767d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.146637 Nov 06 20:54:44.675521 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1330/2700] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:44 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:44.683259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41327274-5f3e-47b8-a519-46b91fb1f044 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715422ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:44.723825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:44.740553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6eef6482-453a-4b06-8536-b8ea1fa27e93 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.549612 Nov 06 20:54:44.742100 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1371/2701] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:44 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:45.196554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:45.197938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:45.208570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:45.212122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:45.215316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:45.216520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:45.570289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:45.583986 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0af371a8-6636-49e5-856d-6b899e4f0cbc tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1478 microversion: 2.1 time: 0.391673 Nov 06 20:54:45.584946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1372/2702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:45 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1478 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:45.595753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f34071f7-762d-4f84-a790-b3d856884de1 req-14646ecb-bc24-4d18-b6d6-2eaca039333e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b", "tag": "924c058a-77c0-4dc6-a5e1-a65e4c088faa"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:45.603052 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:45.603052 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:45.620553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f34071f7-762d-4f84-a790-b3d856884de1 req-14646ecb-bc24-4d18-b6d6-2eaca039333e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:45.621304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f34071f7-762d-4f84-a790-b3d856884de1 req-14646ecb-bc24-4d18-b6d6-2eaca039333e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:45.644081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f34071f7-762d-4f84-a790-b3d856884de1 req-14646ecb-bc24-4d18-b6d6-2eaca039333e service nova] Creating event network-changed:924c058a-77c0-4dc6-a5e1-a65e4c088faa for instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b on nch2-master-1 Nov 06 20:54:45.653983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f34071f7-762d-4f84-a790-b3d856884de1 req-14646ecb-bc24-4d18-b6d6-2eaca039333e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066326 Nov 06 20:54:45.658480 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1373/2703] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:45.663734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:45.667947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:45.682630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:45.683483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:45.686739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:45.687406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.228149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:46.288130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:46.288130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:46.298900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b8851b0-1b32-4cfa-ab06-3deb2741cc10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.630491 Nov 06 20:54:46.298900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1374/2704] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:45 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:46.304492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:46.311147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:46.386977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.396366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.396366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.396366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.526712 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d417751-49ad-4543-bb2d-ff0ebe58a3b6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.232569 Nov 06 20:54:46.528160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1375/2705] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:46 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:46.537348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:46.544210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:46.556865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.557328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.558315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.558758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.627723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eec56359-6d97-46a4-9ff6-518598129f61 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.097786 Nov 06 20:54:46.629009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1376/2706] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:46 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:46.653182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:46.654712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:46.681945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.682998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:46.684022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:46.684666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:47.165045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:47.183939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0d01981-9ef1-48a8-a2bb-d041f5756a80 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.553668 Nov 06 20:54:47.192751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1377/2707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:46 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:47.207028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:47.211064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:47.233749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:47.238937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:47.249226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:47.251490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:47.501652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5bb7487cbd4a6fac7bdfac7189c8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225cbcb2bad437d8687f9024d57918d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:47.524469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08d81974-f5d8-4181-8368-fcd4034458c3 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 200 len: 1436 microversion: 2.1 time: 0.330184 Nov 06 20:54:47.525081 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1378/2708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:47 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 1436 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:47.554223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:47.555688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:47.572397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:47.575335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:47.576435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:47.582082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.000979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:48.011803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:48.017126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:48.018348 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a309932-38f6-4d98-a66d-81878e53b124 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.492320 Nov 06 20:54:48.019114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1379/2709] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:47 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:48.026630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-983b1da4-4c3c-4c40-9591-2540e78acf6b req-b82329bd-9527-4d3a-a5d8-7c8efe16fdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31879e23-36bf-4231-988b-2e013a223d7e", "name": "network-vif-deleted", "tag": "87be1463-955f-49f0-89e1-709c7e033ec9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:48.028135 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:48.028135 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:54:48.055775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-983b1da4-4c3c-4c40-9591-2540e78acf6b req-b82329bd-9527-4d3a-a5d8-7c8efe16fdf5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.056227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-983b1da4-4c3c-4c40-9591-2540e78acf6b req-b82329bd-9527-4d3a-a5d8-7c8efe16fdf5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.086345 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-983b1da4-4c3c-4c40-9591-2540e78acf6b req-b82329bd-9527-4d3a-a5d8-7c8efe16fdf5 service nova] Creating event network-vif-deleted:87be1463-955f-49f0-89e1-709c7e033ec9 for instance 31879e23-36bf-4231-988b-2e013a223d7e on nch2-master-1 Nov 06 20:54:48.098100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-983b1da4-4c3c-4c40-9591-2540e78acf6b req-b82329bd-9527-4d3a-a5d8-7c8efe16fdf5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077858 Nov 06 20:54:48.099585 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1380/2710] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:54:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:54:48.110338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:48.114524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.136758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.137226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.138044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.138478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.262250 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4dae524-53d0-41f9-a8fd-c2dd43f0ac9a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.158128 Nov 06 20:54:48.267395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1381/2711] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:48 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:48.275079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:48.276543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.285178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.285636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.286479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.287078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.364058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea38e69c-4e81-47ee-bb64-dc41f5353913 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.094601 Nov 06 20:54:48.365014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1382/2712] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:48 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:48.371302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:48.372101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.392819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.393257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.394203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.403690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.688724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:48.700428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4ac6f47-50a6-45c5-9025-8ee329c8bb1d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1501 microversion: 2.1 time: 0.331237 Nov 06 20:54:48.700428 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1383/2713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:48 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1501 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:48.703268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:48.703882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] [instance: 31879e23-36bf-4231-988b-2e013a223d7e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.710368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.710827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.711628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.712072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.734901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] HTTP exception thrown: Instance 31879e23-36bf-4231-988b-2e013a223d7e could not be found. Nov 06 20:54:48.734901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] Returning 404 to user: Instance 31879e23-36bf-4231-988b-2e013a223d7e could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:48.735583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f85d6872-fbf3-4093-98f3-04487220c669 tempest-ServerDiagnosticsNegativeTest-1586823696 tempest-ServerDiagnosticsNegativeTest-1586823696-project] 10.222.0.13 "GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e" status: 404 len: 111 microversion: 2.1 time: 0.035682 Nov 06 20:54:48.736864 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1384/2714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:48 2021] GET /compute/v2.1/servers/31879e23-36bf-4231-988b-2e013a223d7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:54:48.753493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e85e14ab-0ae2-4153-91b2-021a2ea6c996"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:48.754568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.771568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.772028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.775858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.776343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.837126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Cannot 'attach_volume' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state rescued Nov 06 20:54:48.843822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 409 to user: Cannot 'attach_volume' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state rescued {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:54:48.846346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86ca9782-bb66-4e57-8662-6f12c303b404 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109058 Nov 06 20:54:48.847950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1385/2715] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 20:54:48 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:54:48.856615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:48.879397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:48.888916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.889890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:48.891293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:48.891966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:49.002920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ede4e80b-70e4-4c8e-8c5f-1267328dee95 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 202 len: 0 microversion: 2.1 time: 0.149595 Nov 06 20:54:49.004142 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1386/2716] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:54:48 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:49.013378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:49.014493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:49.022564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:49.023407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:49.024497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:49.025168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:49.317265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:49.332171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80357bb8-c75f-4746-834d-060fcf53c70c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1509 microversion: 2.1 time: 0.322546 Nov 06 20:54:49.345040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1387/2717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:49 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:49.356796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:49.359465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:49.378756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:49.379247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:49.380075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:49.386296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:49.948033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:49.957085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:49.958638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:49.970687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4cd7c59e-7366-40f8-8d57-664d52481a01 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.624076 Nov 06 20:54:49.982483 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1388/2718] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:49 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:50.339974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:50.341000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:50.355138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.358517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:50.360335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.360335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:50.467237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afa9531f-a67a-4ef6-99ac-c9daee0790f7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.483294 Nov 06 20:54:50.470291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1389/2719] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:49 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:50.485195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:50.489999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:50.508223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.514062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:50.514928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.515351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:50.616823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8de2272f-5ff5-495f-8de4-347dc6e12ad9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.143577 Nov 06 20:54:50.617458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1390/2720] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:50 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:50.624846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:50.626596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:50.650369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.651287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:50.655539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:50.656365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.344134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:51.354845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03ce6d4f-4dc8-4a9b-8223-9b781058521b tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1509 microversion: 2.1 time: 0.736185 Nov 06 20:54:51.356532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1391/2721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:50 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1509 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:51.386466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:51.386687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:51.394176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.394687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.395503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.395947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.768743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:51.779898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:51.781506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:51.782718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56ce81fa-9845-4bc8-8624-4467f840814a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.426363 Nov 06 20:54:51.798382 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1392/2722] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:51 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:51.811155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:51.812163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:51.822270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.825288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.829095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.833621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.906838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24c4d05a-f636-40d4-8b59-9ee9d84271cc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.106589 Nov 06 20:54:51.907795 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1393/2723] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:51 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:51.914070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:51.926245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:51.940674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.941528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.942618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:51.943269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:51.989088 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecb5f8c1-04df-4a47-8acd-b7ae666229ac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.079447 Nov 06 20:54:51.993539 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1394/2724] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:51 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:52.384888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:52.385615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:52.403320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:52.403776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:52.404601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:52.405068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:52.699515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:52.729690 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1ab879b-b07a-4e24-9f44-baf6da71d323 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1509 microversion: 2.1 time: 0.359914 Nov 06 20:54:52.731532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1395/2725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:52 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:52.805854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:52.806496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:52.822337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:52.822799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:52.828606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:52.830082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.270349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:53.279023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:53.280553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:53.281719 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25ad559e-a4da-449a-8b6c-c5c0ddb9e742 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.484532 Nov 06 20:54:53.291367 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1396/2726] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:52 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:53.307880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:53.319739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:53.360894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.363085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.364062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.368751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.481548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f5932f5-a0e1-4966-a3bc-5ea71aeed07b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.186651 Nov 06 20:54:53.484223 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1397/2727] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:53 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:53.499823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:53.505557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:53.533394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.533781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.534679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.535080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.696200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97d4032c-f202-4d72-8ef3-869fea3417f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 14 microversion: 2.20 time: 0.210404 Nov 06 20:54:53.705925 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1398/2728] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:53 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:53.748699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:53.749900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:53.779358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.780315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:53.781793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:53.788442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:54.648533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:54.672761 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62e3cb74-505d-494b-8631-1e9f52bc1630 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1509 microversion: 2.1 time: 0.926270 Nov 06 20:54:54.676827 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1399/2729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:53 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1509 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:54.686528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:54.692919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:54.713355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:54.717706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:54.721599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:54.723942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.225952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:55.238664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:55.240273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:55.243889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9209705e-4e72-46c1-bfdf-c3d55b726cdf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1567 microversion: 2.25 time: 0.565752 Nov 06 20:54:55.248509 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1400/2730] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:54 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1567 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:55.254400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:55.255589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:55.274084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.274563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.275365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.276769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.363109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eec4a2bd-4761-4de9-8a41-933a9ec52474 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.116132 Nov 06 20:54:55.364221 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1401/2731] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:55 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:55.369218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:55.370212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:55.394584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.395435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.396621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.397867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.487393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a39ed302-a44b-405a-bdd5-e9daa7220a38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 16368 microversion: 2.20 time: 0.121743 Nov 06 20:54:55.491405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1402/2732] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:55 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 16368 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:55.696126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:55.697252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:55.712733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.717141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:55.719191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:55.720909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:56.968443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:56.983227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d12204fd-5f8e-4743-b33b-94332043f548 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1515 microversion: 2.1 time: 1.286864 Nov 06 20:54:56.985411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1403/2733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:55 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1515 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:54:57.004654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:57.009631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:57.038935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:57.045249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:57.046222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:57.046770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.136158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:58.145475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:58.152119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:58.155985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0b81da1-e55b-428b-ad62-31e285b0f3d1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1557 microversion: 2.25 time: 1.169329 Nov 06 20:54:58.156873 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1404/2734] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:56 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1557 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:58.165896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:58.171880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:58.183845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.184463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.185332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.185847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.238159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2840592-156e-41fb-b422-036112fa9bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.076924 Nov 06 20:54:58.238686 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1405/2735] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:58 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:58.272517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:58.273619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:58.298890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.303622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.308696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.309995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.328647 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41327274-5f3e-47b8-a519-46b91fb1f044 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1423 microversion: 2.1 time: 13.650808 Nov 06 20:54:58.330649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1331/2736] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:44 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1423 bytes in 13654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:58.339388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48230e2e-ffaf-43cc-a0a4-af6859d815bc tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '.version_select at 0x7f67155415e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:58.354502 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:54:58.354502 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:54:58.358041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48230e2e-ffaf-43cc-a0a4-af6859d815bc tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.361388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48230e2e-ffaf-43cc-a0a4-af6859d815bc tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.389020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48230e2e-ffaf-43cc-a0a4-af6859d815bc tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.056936 Nov 06 20:54:58.397366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1332/2737] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Nov 6 20:54:58 2021] GET /compute/v2.1/os-migrations => generated 680 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:54:58.417593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd06f081-085b-475f-956e-11f08db7f79d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715ad68b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:58.448586 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cd0a3ef-8b76-4ec9-8702-f4059874c4be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 16368 microversion: 2.20 time: 0.200939 Nov 06 20:54:58.451143 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1406/2738] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:58 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 16368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:58.461142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:58.463993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:58.493490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd06f081-085b-475f-956e-11f08db7f79d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 200 len: 1423 microversion: 2.1 time: 0.094710 Nov 06 20:54:58.494326 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1333/2739] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:54:58 2021] GET /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:58.505896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.506669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.507672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:58.508282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:58.511709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae99a9cb-744e-49e3-bc15-63ac31cbd7f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671539cd30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:58.870704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:54:59.023385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c528208a-9be3-4d55-bf0d-085c0a4a4d59 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 2050 microversion: 2.25 time: 0.570883 Nov 06 20:54:59.023978 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1407/2740] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:54:58 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 2050 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:54:59.036740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:54:59.036740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:59.036740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.036740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.037259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.037937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.295851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:54:59.307903 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23e057aa-1ee3-40a5-81fb-d7ebb8f2537e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1515 microversion: 2.1 time: 0.282765 Nov 06 20:54:59.309256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1408/2741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:59 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:54:59.318384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:59.322284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:59.337478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.338605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.339336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.339774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.422847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eeb27766-52f5-4126-ac45-b228b6240d05 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.110541 Nov 06 20:54:59.431975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1409/2742] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:54:59 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:54:59.448953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1202685181", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "d7f41d40-db54-4294-8f8b-5894f0c36960"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:59.822273 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae99a9cb-744e-49e3-bc15-63ac31cbd7f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 204 len: 0 microversion: 2.1 time: 1.319832 Nov 06 20:54:59.822846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1334/2743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:54:58 2021] DELETE /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 0 bytes in 1321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:54:59.829446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea858d8a-67d5-493c-a315-e50ce7efcabe"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:54:59.830639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:54:59.854477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.854952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.855770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:54:59.856213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:54:59.927240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] validate_networks() for [('d7f41d40-db54-4294-8f8b-5894f0c36960', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:00.469437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b251765d-714b-4531-952d-37dd6dffb88f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643683 Nov 06 20:55:00.470613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1335/2744] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 20:54:59 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:00.524974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:00.529176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:00.554887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.555352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.556183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.567455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.717418 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7ad1af2-6e13-4bbf-9c28-994e3b5cd2ce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.243838 Nov 06 20:55:00.730710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1336/2745] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:00 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:00.742006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:00.750525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:00.772258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.775391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.781066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.786329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.790733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:00.791193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:00.791625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:00.792037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:00.793671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:00.807279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.810254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.811631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.812426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.844083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:00.851114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for user 2b4178344ec541bb964ed60d977eff68 and project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:00.868926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:00.873145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:00.917629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:55:00.937033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79640287-c217-47f9-b5d9-31177fe8b0a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.503070 Nov 06 20:55:00.937911 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1410/2746] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:54:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:55:00.949519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:00.950976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:00.960273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.966245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:00.970932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:00.971565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:01.051753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-182f99b4-5e17-4212-a7f0-116ac3b2fbdb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.112299 Nov 06 20:55:01.054461 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1411/2747] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:00 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:01.070966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:01.072050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:01.237394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:01.251402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:01.256076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6a6a39c-ccda-4438-8815-ee16e1f480b1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 204 len: 0 microversion: 2.1 time: 0.523526 Nov 06 20:55:01.261131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1337/2748] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:55:00 2021] DELETE /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:01.261642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:01.266210 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb052349-4e88-432f-a04b-245ef101b2d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1262 microversion: 2.25 time: 0.209248 Nov 06 20:55:01.279443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1412/2749] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:01 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1262 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:01.433630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1401553582", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8fbc16c6-4a6c-4b93-987f-9643b3a1da7e"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:01.557594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] validate_networks() for [('8fbc16c6-4a6c-4b93-987f-9643b3a1da7e', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:01.740228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:01.741755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:01.751464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:01.751923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:01.752763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:01.757442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:01.872004 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9341edaa-5998-4402-b340-d3f099e6cc4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.135279 Nov 06 20:55:01.876383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1413/2750] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:01 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:02.066525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:02.067469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:02.085092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.093017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:02.094164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.094786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:02.225621 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b73d9a4b-53a1-4706-8648-96ba2c10223a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.162968 Nov 06 20:55:02.226316 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1414/2751] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:02 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:02.307838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:02.308891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:02.317765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.332988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:02.333871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.334351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:02.580454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:02.605452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:02.607278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:02.608743 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25c2b183-586b-4adc-86f8-b1c8e50bfd49 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1258 microversion: 2.25 time: 0.306447 Nov 06 20:55:02.611245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1415/2752] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:02 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1258 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:02.885676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:02.886771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:02.907945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.909944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:02.912239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:02.916288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:03.116857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4197df73-9c18-4007-86d8-798602926d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.234880 Nov 06 20:55:03.118855 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1416/2753] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:02 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:03.139441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f08d5c11-a4ca-4980-9d64-7d3b97f24110 req-83fb381a-c528-44ae-8320-db962273c13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7007c97-5fa8-462d-8192-9bf343e58548", "name": "network-vif-unplugged", "status": "completed", "tag": "809b9394-67e1-4318-9cc7-04a3de08ebc9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:03.152420 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:03.152420 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:03.185687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f08d5c11-a4ca-4980-9d64-7d3b97f24110 req-83fb381a-c528-44ae-8320-db962273c13a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:03.186233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f08d5c11-a4ca-4980-9d64-7d3b97f24110 req-83fb381a-c528-44ae-8320-db962273c13a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:03.263692 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f08d5c11-a4ca-4980-9d64-7d3b97f24110 req-83fb381a-c528-44ae-8320-db962273c13a service nova] Creating event network-vif-unplugged:809b9394-67e1-4318-9cc7-04a3de08ebc9 for instance a7007c97-5fa8-462d-8192-9bf343e58548 on nch2-master-1 Nov 06 20:55:03.273908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f08d5c11-a4ca-4980-9d64-7d3b97f24110 req-83fb381a-c528-44ae-8320-db962273c13a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148129 Nov 06 20:55:03.277239 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1417/2754] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:03.298781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:03.299815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:03.346441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:03.354044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:03.360252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:03.361346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:03.507701 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea023d08-f491-4b7a-b8f9-26b31e825c19 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.219742 Nov 06 20:55:03.514393 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1418/2755] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:03 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:03.630964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:03.631717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:03.641790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:03.642246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:03.663205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:03.663770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.026349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:04.027671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:04.027895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:04.030767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:04.031563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:04.033755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:04.069573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:04.077262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.077940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:04.078465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.080384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.082435 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-226f206d-f657-42fb-aa62-f7ac5c34bccd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1320 microversion: 2.25 time: 0.453861 Nov 06 20:55:04.083073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.087025 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1419/2756] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:03 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:04.130056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:04.132402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:04.153202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.154899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.156961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.160537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:04.161320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.178255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for user 8b1ffd89193f4eb1b796c374eb2d26bf and project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:04.233998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:04.236841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:04.269107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be20d72c-dd5b-46b7-85ad-c0807d82efce tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.143600 Nov 06 20:55:04.273708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1420/2757] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:04 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:04.341124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c01e8a4e-2aa9-4e17-b9d8-ec36fefd5cd7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.912242 Nov 06 20:55:04.343466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1338/2758] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:55:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:55:04.353918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-efc5383f-99c1-4575-87e6-7fd9698664aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:04.354790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-efc5383f-99c1-4575-87e6-7fd9698664aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:04.521529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:04.522965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:04.535587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.541184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.544892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:04.551607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:04.582403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-efc5383f-99c1-4575-87e6-7fd9698664aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:04.595040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-efc5383f-99c1-4575-87e6-7fd9698664aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1208 microversion: 2.1 time: 0.245172 Nov 06 20:55:04.595751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1421/2759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:04 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1208 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:04.711233 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3255aea6-9ed5-4f65-9450-29f342f0d540 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.193309 Nov 06 20:55:04.712427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1339/2760] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:04 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:05.106499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:05.108090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:05.128341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.130682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.134430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.135252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.241118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:05.242827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:05.250517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.251187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.252176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.252814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.286582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'flavor' on Instance uuid 02d9c005-dc47-4fb6-ac23-fdeada22a300 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:05.655648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e877602c-7d4c-401f-99dc-03a64b5144f1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 200 len: 32 microversion: 2.1 time: 0.400244 Nov 06 20:55:05.667538 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1340/2761] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:05 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:55:05.692332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:05.696891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:05.712653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.716078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.717119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.717855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.811372 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-888ce838-a0e3-402a-9f64-0d520e02f265 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.138924 Nov 06 20:55:05.818681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1341/2762] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:05 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:05.824423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3545dddf-e58d-4ae6-8aa4-8144d89e9f1e req-4c3ed6f8-22b4-4ed6-ade0-341f230ab6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7007c97-5fa8-462d-8192-9bf343e58548", "name": "network-vif-deleted", "tag": "809b9394-67e1-4318-9cc7-04a3de08ebc9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:05.825942 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:05.825942 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:05.848873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3545dddf-e58d-4ae6-8aa4-8144d89e9f1e req-4c3ed6f8-22b4-4ed6-ade0-341f230ab6f8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.848873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3545dddf-e58d-4ae6-8aa4-8144d89e9f1e req-4c3ed6f8-22b4-4ed6-ade0-341f230ab6f8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.898427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3545dddf-e58d-4ae6-8aa4-8144d89e9f1e req-4c3ed6f8-22b4-4ed6-ade0-341f230ab6f8 service nova] Creating event network-vif-deleted:809b9394-67e1-4318-9cc7-04a3de08ebc9 for instance a7007c97-5fa8-462d-8192-9bf343e58548 on nch2-master-1 Nov 06 20:55:05.905815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3545dddf-e58d-4ae6-8aa4-8144d89e9f1e req-4c3ed6f8-22b4-4ed6-ade0-341f230ab6f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085339 Nov 06 20:55:05.907005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1342/2763] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:05.912919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:05.913670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:05.936067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.936581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:05.937413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:05.937843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:06.169339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:06.178302 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50ec4a16-db4a-4fad-ab40-ad80f5554a3e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1204 microversion: 2.1 time: 0.269921 Nov 06 20:55:06.179614 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1343/2764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:05 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1204 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:06.184268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:06.191112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:06.203418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:06.204117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:06.205284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:06.205913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:06.976072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:06.987355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:06.995550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:07.003207 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f6212bd-1442-4afe-86f8-4c4e5030d1de tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 1.898587 Nov 06 20:55:07.003865 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1422/2765] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:05 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:07.012047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:07.013728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:07.027323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.028107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.029233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.031301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.042694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:07.055205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-534546f2-f78c-4487-b1df-75c6ff92707a tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.874130 Nov 06 20:55:07.075053 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1344/2766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:06 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:07.097889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:07.098524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:07.108798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.109603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.110604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.111478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.125972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6249e5f-a83e-4fe3-8e11-cb50247580ab tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.118063 Nov 06 20:55:07.129468 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1423/2767] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:07 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:07.143891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:07.151043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:07.161308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.162828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.164761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.165782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.250725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df1c5e31-0606-4418-ba76-b7915917a634 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.115774 Nov 06 20:55:07.251432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1424/2768] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:07 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:07.262503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:07.265588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:07.279501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.280165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.281099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.281753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.425386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:07.444344 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83a71d65-f873-4822-9bd7-1f4d863635ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1266 microversion: 2.1 time: 0.191241 Nov 06 20:55:07.445342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1425/2769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:07 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:07.792765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:07.806870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2341e024-5940-4754-a8d2-5a05219652b9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.727952 Nov 06 20:55:07.810403 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1345/2770] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:07 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:07.828165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-361159595"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:07.829447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:07.840334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.843410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:07.844258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:07.844731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:08.025560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:08.026177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:08.040764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:08.041513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:08.042507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:08.043115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:08.357874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a875c11-1c77-47d8-b36d-33bbd3ddd07c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.531988 Nov 06 20:55:08.359625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1426/2771] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:07 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 06 20:55:08.373461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:08.376208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:08.392455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:08.394669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:08.395622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:08.398634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:08.946721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:08.964550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:08.976102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:08.981751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc41ea5c-c1a0-47e9-9d84-4cadf6274d7b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.960463 Nov 06 20:55:08.986606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1346/2772] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:08 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:09.000317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:09.004855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:09.017828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.018886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.023056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.025423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.121439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3914245-8e81-427b-b872-e1769fe640dc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.131593 Nov 06 20:55:09.122583 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1347/2773] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:08 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:09.127937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-228e1d49-07f4-45eb-980a-c2feae91ba5d req-67cc994d-bf07-4fd8-9c75-c52b6446bd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81864163-41d3-46b9-b9bb-3bb2b1ef142d", "tag": "42df9c2c-9b18-42f4-91c3-d59e5082f301"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:09.129596 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:09.129596 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:09.138667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-228e1d49-07f4-45eb-980a-c2feae91ba5d req-67cc994d-bf07-4fd8-9c75-c52b6446bd50 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.139118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-228e1d49-07f4-45eb-980a-c2feae91ba5d req-67cc994d-bf07-4fd8-9c75-c52b6446bd50 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.161926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-228e1d49-07f4-45eb-980a-c2feae91ba5d req-67cc994d-bf07-4fd8-9c75-c52b6446bd50 service nova] Creating event network-changed:42df9c2c-9b18-42f4-91c3-d59e5082f301 for instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d on nch2-master-1 Nov 06 20:55:09.168354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-228e1d49-07f4-45eb-980a-c2feae91ba5d req-67cc994d-bf07-4fd8-9c75-c52b6446bd50 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044356 Nov 06 20:55:09.169703 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1348/2774] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:09.175055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:09.176415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:09.186224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.187204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.188210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.188866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.240338 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c85368c1-7d68-4319-b2c9-70a006d20a13 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.068954 Nov 06 20:55:09.246348 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1349/2775] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:09 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:09.255250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:09.260332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:09.280061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.281331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.284990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.285454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.314144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:09.325990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a95ba86b-6d8d-48de-ab95-86f56a7312ae tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.963336 Nov 06 20:55:09.327641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1427/2776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:08 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:09.345860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:09.346750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:09.363207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.364401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.366040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:09.366677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:09.638863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:09.649136 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96a553c8-869b-48c9-b5f1-74facb988644 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.309708 Nov 06 20:55:09.650350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1428/2777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:09 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:09.901486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:09.907627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-714210894", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "236e0dda-9020-42e2-aa5c-87655d068d49"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:09.927687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c5e02e5-fce5-468a-a24e-e712d8d97f1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.679914 Nov 06 20:55:09.928646 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1350/2778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:09 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:10.008540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:10.011906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:10.017616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] validate_networks() for [('236e0dda-9020-42e2-aa5c-87655d068d49', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:10.021029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.022210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.023728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.024384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.523135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:10.533451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:10.536908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:10.540009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a1f65e3-d92a-4bad-b32d-a9a893391436 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.540729 Nov 06 20:55:10.555438 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1351/2779] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:09 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:10.560705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:10.569325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:10.582932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.590445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.591510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.592138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.650246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e4b73cc-67ba-4dcb-90da-0eab53382dc9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.093073 Nov 06 20:55:10.651595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1352/2780] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:10 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:10.659115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:10.660619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:10.669990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.670498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.671579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.672239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.719525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d0acc89-d454-4598-98d1-af41614fc29c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.066252 Nov 06 20:55:10.723966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1353/2781] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:10 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:10.742267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:10.742267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:10.747083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.747864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:10.749076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:10.749737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.108239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:11.108766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:11.109259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:11.109672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:11.110091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:11.122758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.123212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.124032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.124517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.149627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Getting quotas for project 5c1824b1585947c2ad050b80ae52d273. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:11.153344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:11.155617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Getting quotas for user 023f3a867df148ec83a4a74419dc34d8 and project 5c1824b1585947c2ad050b80ae52d273. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:11.165096 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14100fc9-a771-438e-8dc1-23e33d5d43b0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.436767 Nov 06 20:55:11.166228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1354/2782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:10 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:11.172641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:11.174319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:11.175131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:11.175270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:11.182786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.183573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.184826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.185487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.251005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b8339617-eb6b-436d-8d06-60b6a4f9bac3 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599252 Nov 06 20:55:11.256634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1429/2783] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:55:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:55:11.262387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:11.263010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:11.269129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.269586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.270381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.270820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.463182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:11.475927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be4839bf-76d1-49e8-9218-876b699ccfb8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.308116 Nov 06 20:55:11.476560 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1355/2784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:11 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:11.497077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-bb45c722-1b78-4b37-8ad2-aabec069448b req-4996bd15-6566-46fc-b331-736154943800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-unplugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:11.509452 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:11.509452 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:11.534440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bb45c722-1b78-4b37-8ad2-aabec069448b req-4996bd15-6566-46fc-b331-736154943800 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.535023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bb45c722-1b78-4b37-8ad2-aabec069448b req-4996bd15-6566-46fc-b331-736154943800 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.591566 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-bb45c722-1b78-4b37-8ad2-aabec069448b req-4996bd15-6566-46fc-b331-736154943800 service nova] Creating event network-vif-unplugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:55:11.612593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-bb45c722-1b78-4b37-8ad2-aabec069448b req-4996bd15-6566-46fc-b331-736154943800 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118484 Nov 06 20:55:11.619668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1356/2785] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:11.637890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a2b562e3-2227-4338-a1e4-52ecb8903902 req-14f6bf39-3026-420d-9326-98914a3059fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042a28ad-9bf3-438e-b5a1-9f84e65b443f", "tag": "e2aa14a3-a87c-41ea-b3d8-7324c7216df6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:11.639784 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:11.639784 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:11.664940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a2b562e3-2227-4338-a1e4-52ecb8903902 req-14f6bf39-3026-420d-9326-98914a3059fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.665946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a2b562e3-2227-4338-a1e4-52ecb8903902 req-14f6bf39-3026-420d-9326-98914a3059fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.678504 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a2b562e3-2227-4338-a1e4-52ecb8903902 req-14f6bf39-3026-420d-9326-98914a3059fe service nova] Creating event network-changed:e2aa14a3-a87c-41ea-b3d8-7324c7216df6 for instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f on nch2-master-1 Nov 06 20:55:11.683869 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a2b562e3-2227-4338-a1e4-52ecb8903902 req-14f6bf39-3026-420d-9326-98914a3059fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062388 Nov 06 20:55:11.685050 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1357/2786] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:11.690243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aaf2775a-d831-4539-9aaa-427836fcfdba tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:11.692021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aaf2775a-d831-4539-9aaa-427836fcfdba tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:11.708638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:11.734740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19ff6501-9ece-44a3-9681-cde0b6dff490 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.476139 Nov 06 20:55:11.735990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1430/2787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:11 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:11.749571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:11.750517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:11.777726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.778585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.788817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.789508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.834204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aaf2775a-d831-4539-9aaa-427836fcfdba tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:11.841411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aaf2775a-d831-4539-9aaa-427836fcfdba tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1231 microversion: 2.1 time: 0.155017 Nov 06 20:55:11.844008 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1358/2788] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:11 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1231 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:11.863237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:11.864793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:11.891400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.891893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.892736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:11.895619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:11.977601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c249cf0e-3953-4ef1-8d88-70c6f4807fcf tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.131293 Nov 06 20:55:11.978893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1359/2789] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:11.992056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:11.993776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:12.008545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.009229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.010227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.011027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.066083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-322e973e-6665-465d-979b-250394cef720 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.083779 Nov 06 20:55:12.071183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1360/2790] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:11 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:12.080036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.095219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.098031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.099418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85d8cd48-ec95-4362-9084-da18ee9f3382 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.361896 Nov 06 20:55:12.111468 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1431/2791] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:11 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:12.183414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:12.184124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:12.196458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.197207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.198204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.198649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.466996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.482480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56611018-1c47-4cdb-9671-2fcd6f3fa5d5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.303579 Nov 06 20:55:12.483222 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1361/2792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:12 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:12.498395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:12.499011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:12.507863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.508594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.509675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.510294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.739067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.747771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-732ddc6f-9437-4c29-9d3c-f365d05ed096 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.252850 Nov 06 20:55:12.748996 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1432/2793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:12 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:12.760747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:12.761434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:12.768742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.769413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.770408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.770926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.859640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:12.860275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:12.867039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.867847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.868862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:12.869870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:12.975497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:12.985505 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8585ef2-53ab-4db9-a57f-1242d100aae1 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1283 microversion: 2.1 time: 0.129186 Nov 06 20:55:12.995858 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1433/2794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:12 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:13.000689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:13.001447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:13.002668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:13.010230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.010407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbe47ca2-20bf-4f32-a4c2-b2c25df8228a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1687 microversion: 2.1 time: 0.253385 Nov 06 20:55:13.010856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1362/2795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:12 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:13.011199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.012245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.013259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.073361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c974ab6-359e-4b3b-b0e1-a6d3047ddaf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.075351 Nov 06 20:55:13.080897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:13.082631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:13.090170 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1434/2796] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:12 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:13.092903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.093812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.095627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.096332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.118968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:13.119810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:13.137935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.138610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.139605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.153000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.156752 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d555df73-8ba2-4eea-9b27-c81575403884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.081176 Nov 06 20:55:13.157448 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1363/2797] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:13 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:13.404341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:13.417026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:13.418692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:13.419828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f2c28a1-9dab-410e-81c5-cd31a1233193 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.306041 Nov 06 20:55:13.420413 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1435/2798] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:13 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:13.500182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:13.501314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:13.510357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.511008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.511931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.513288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.765488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:13.766516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:13.774323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.775428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.776652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:13.777897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:13.826377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:13.835074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13e4df5c-30a1-496a-9a5f-65f8754be057 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.338783 Nov 06 20:55:13.835654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1364/2799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:13 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:14.006133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:14.006862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.016274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.017596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.018727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.019340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.084677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.092128 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7be705e0-f44a-4bb3-9cfb-e2dcd0e72063 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.331605 Nov 06 20:55:14.092735 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1436/2800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:13 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:14.097475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:14.098313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.104833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.105284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.106076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.106507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.554206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.563680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3493070-9219-4e26-b182-86ef6c67683f tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.564642 Nov 06 20:55:14.565238 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1365/2801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:13 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:14.573514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:14.574734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.582745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.584193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.585143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.585962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.639131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf330240-4ff5-432b-bf0e-c90f168cdc47 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.072006 Nov 06 20:55:14.640799 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1366/2802] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:14 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:14.647969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:14.654269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.663233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.664695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49cafdc1-1a5a-4a5a-8e0a-be687e156124 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1687 microversion: 2.1 time: 0.570717 Nov 06 20:55:14.666044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1437/2803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:14 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1687 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:14.671642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:14.672556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.679657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.680614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.681623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.682234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.691574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.692080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.693487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.693947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.749380 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2531f4ae-58e7-4eb4-97bc-4b26e779a069 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.106491 Nov 06 20:55:14.750179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1367/2804] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:14 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:14.755588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-60a36a88-fdaa-4565-9175-6c205181864a req-5f9a7d19-ac3d-4a9d-bcff-c44f46a9b192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcd375a-c384-43a3-8893-4628f25ccf28", "tag": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:14.758247 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:14.758247 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:14.775073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60a36a88-fdaa-4565-9175-6c205181864a req-5f9a7d19-ac3d-4a9d-bcff-c44f46a9b192 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.776578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60a36a88-fdaa-4565-9175-6c205181864a req-5f9a7d19-ac3d-4a9d-bcff-c44f46a9b192 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.794848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-60a36a88-fdaa-4565-9175-6c205181864a req-5f9a7d19-ac3d-4a9d-bcff-c44f46a9b192 service nova] Creating event network-changed:c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 for instance 9fcd375a-c384-43a3-8893-4628f25ccf28 on nch2-master-1 Nov 06 20:55:14.803602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-60a36a88-fdaa-4565-9175-6c205181864a req-5f9a7d19-ac3d-4a9d-bcff-c44f46a9b192 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051559 Nov 06 20:55:14.806174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1368/2805] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:14.855337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:14.857889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:14.881209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.885120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.886746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:14.887773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:14.926947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.940599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.943057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:14.945147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79438582-0da8-437f-adf9-6b07a13b77eb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.277333 Nov 06 20:55:14.946875 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1438/2806] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:14 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:15.109733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:15.110581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.118035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.118556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.119481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.119925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.160030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:15.171153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b85515f-47da-4085-ab0c-7d3efc03b7c1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.322281 Nov 06 20:55:15.172176 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1369/2807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:14 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:15.331276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:15.340717 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e020fdc1-118f-45d8-9a5a-da2a50e9a252 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.234557 Nov 06 20:55:15.341529 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1439/2808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:15 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:15.583580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:15.585507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.596792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.597802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.599216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.600608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.652592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:15.654354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.661340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.661798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.662620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.663051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.709441 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e041a8e-d8de-4b78-aa5b-fd2245d27e11 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.060963 Nov 06 20:55:15.710109 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1440/2809] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:15.715384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:15.716085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.722886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.723333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.724112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.724624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.858153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:15.867046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31132b89-e517-46df-8aac-95df17e969b6 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.289619 Nov 06 20:55:15.867725 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1370/2810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:15 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:15.882891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:15.883816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.890197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.890663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.891455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.891897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.932992 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f334302-f9a7-42fb-8a31-1f9a2f12108e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.054162 Nov 06 20:55:15.933969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1371/2811] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:15 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:15.963301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:15.964055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:15.970870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.971327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:15.972121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:15.972591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.006540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.014231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8d53eb8-0c0e-4434-9a66-7ae0d526cbe1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1687 microversion: 2.1 time: 0.302633 Nov 06 20:55:16.014810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1441/2812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:15 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1687 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:16.189621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:16.190400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:16.198939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.211628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.213474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.214325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.215175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.215788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbdc3dfd-48db-4744-b5cd-869ae30e44a3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.256567 Nov 06 20:55:16.216927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.217668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.228650 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1372/2813] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:15 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:16.357737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:16.358384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:16.365386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.366214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.367337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.367789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.466607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.474393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec3d9910-cad8-41b7-a37a-959b7e164140 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.289205 Nov 06 20:55:16.484193 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1442/2814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:16 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:16.586857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:16.594895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee34143e-3f0f-4e31-bb54-bea85ec96798 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.240175 Nov 06 20:55:16.605366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1373/2815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:16 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:16.721415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:16.722596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:16.728625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.729082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.729876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.730314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.785543 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a0c8b36-d64d-42d2-9544-4d399db41892 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.067649 Nov 06 20:55:16.786458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1443/2816] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:16 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:16.883726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:16.884791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:16.890733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.891180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.891957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.892418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.945648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:16.946747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:16.953700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.954151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.954951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:16.955386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:16.998415 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1b8d75b-456a-4cc0-8116-0e5a5345d7ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.056666 Nov 06 20:55:16.999331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1444/2817] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:16 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:17.031510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:17.032391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:17.039818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.040270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.041345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.041791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.145619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:17.157835 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84ce42a9-5837-4e8f-9282-0092b50218bd tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.278123 Nov 06 20:55:17.167862 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1374/2818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:16 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:17.235717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:17.236662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:17.244082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.244890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.249283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.250062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.301724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:17.311976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-920618b6-6cc0-444d-bda6-a7b62d8baec1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1687 microversion: 2.1 time: 0.284524 Nov 06 20:55:17.313177 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1445/2819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:17 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1687 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:17.491806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:17.492850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:17.499845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.500701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.501764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.502446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.539673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:17.547803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:17.549362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:17.550481 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9b973d0-a75d-4129-af44-aaf7132f60f3 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.319927 Nov 06 20:55:17.551443 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1375/2820] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:17 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:17.611916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:17.612607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:17.619279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.619729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:17.620533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:17.620976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.034599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.043735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a911580d-8ed7-475b-8348-cdc462eaa4d9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.556565 Nov 06 20:55:18.044474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1446/2821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:17 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:18.048910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:18.050003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:18.055882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.056548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.057343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.057785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.103577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbf695a8-24c6-49c4-a0be-b00d2297a242 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.057799 Nov 06 20:55:18.104778 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1447/2822] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:18.109272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:18.110270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:18.117271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.117733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.118552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.118990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.138696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.146337 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a10f176-016c-49d5-bd23-2d3d09dda5fa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.537982 Nov 06 20:55:18.147537 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1376/2823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:17 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:18.160547 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a30560a9-1217-4db0-8740-923d3a640f92 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.054826 Nov 06 20:55:18.161428 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1448/2824] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:18 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:18.174479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:18.175099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:18.180899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.181616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.182408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.182853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.333544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:18.334902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:18.346919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.347457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.348275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.348745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.515719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.523772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b29eafee-acb9-40ca-ad01-6084e72e7c99 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.352830 Nov 06 20:55:18.524351 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1377/2825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:18 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:18.571710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:18.572474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:18.578240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.578701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.579492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.579940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.639292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.646839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-506a0352-75f2-4995-8cc5-b780e17cf88a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1687 microversion: 2.1 time: 0.317424 Nov 06 20:55:18.647415 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1449/2826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:18 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1687 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:18.809853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.819376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.820985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:18.822177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3cac31c-6924-4cd8-b3ad-a652ce2655bb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.254736 Nov 06 20:55:18.826824 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1378/2827] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:18 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:18.831641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-caf67260-2d9f-4178-a95a-2bd1f41edcfc req-c8ff21d7-02c4-4def-a3f6-474130c7cc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-plugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:18.833269 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:18.833269 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:18.841224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-caf67260-2d9f-4178-a95a-2bd1f41edcfc req-c8ff21d7-02c4-4def-a3f6-474130c7cc46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:18.842257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-caf67260-2d9f-4178-a95a-2bd1f41edcfc req-c8ff21d7-02c4-4def-a3f6-474130c7cc46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:18.854339 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-caf67260-2d9f-4178-a95a-2bd1f41edcfc req-c8ff21d7-02c4-4def-a3f6-474130c7cc46 service nova] Creating event network-vif-plugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:55:18.860104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-caf67260-2d9f-4178-a95a-2bd1f41edcfc req-c8ff21d7-02c4-4def-a3f6-474130c7cc46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Nov 06 20:55:18.861242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1450/2828] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:19.061557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:19.062169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.069868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.070809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.071999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.072542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.116838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:19.118500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.125480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.125928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.126717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.127155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.173944 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edc17d9a-4a50-4c9c-a6ff-9152fe93dbcd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.061655 Nov 06 20:55:19.175592 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1451/2829] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:19 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:19.182485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:19.183830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.193624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.194394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.195420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.195946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.348406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:19.355399 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c92aee6-a737-42fa-a243-64905ef85a60 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.297828 Nov 06 20:55:19.356042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1379/2830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:19 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:19.360943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:19.362115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.368448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.368899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.369702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.370132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.539573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:19.547687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8c71dd3-f322-43a4-90c5-a7cd08e7b8db tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.369779 Nov 06 20:55:19.548256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1452/2831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:19 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:19.553674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:19.554469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.565219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d991816-7503-4a45-8b90-e59b911264f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.207686 Nov 06 20:55:19.567163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.567766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.569014 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1380/2832] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:19 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:19.572964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.573422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.667137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:19.668899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.676911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.678306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.679518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.680328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.789855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:19.798446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-690a9453-c356-42df-8bd4-3ad64c24d35d tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.248719 Nov 06 20:55:19.805663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1453/2833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:19 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:19.840770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:19.841712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:19.848737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.849260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.850781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:19.851229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:19.895114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:19.907880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b35c8dcf-7ec9-4a9c-ad39-a74b3079a5d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.245911 Nov 06 20:55:19.908864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1381/2834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:19 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:20.006919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:20.020940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:20.024173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:20.025638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72fc7f92-064d-4665-8754-70c8c699db2f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.189144 Nov 06 20:55:20.026723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1454/2835] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:19 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:20.186540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:20.187455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.204910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.205667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.206936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.207548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.273786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19f5b7b2-235c-4645-8345-ade91bdf0f9e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.090853 Nov 06 20:55:20.275275 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1382/2836] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:20 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:20.372368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:20.373603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.381601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.382349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.383201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.383683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.551483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:20.566496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:20.567909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.568136 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9b3f955-0985-438c-a3a5-15f344ab44fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.193412 Nov 06 20:55:20.578166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.578554 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1455/2837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:20 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:20.579389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.580237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.581521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.584239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:20.585465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.591599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.592319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.593324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.593786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.647577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1fe8bc62-03bf-4cc9-9569-66a6aa076739 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.067225 Nov 06 20:55:20.651673 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1456/2838] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:20 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:20.764999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:20.777601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd44454e-e0c2-476b-b7f7-27fa1ed36010 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.214578 Nov 06 20:55:20.788551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1383/2839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:20 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:20.819651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:20.820879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.837354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.840237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.842768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.843400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.926915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:20.928040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:20.941617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.944880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:20.945906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:20.953907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.162928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.178426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b3c4121-4776-47dc-b15d-761af9b57598 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.361578 Nov 06 20:55:21.179547 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1457/2840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:20 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:21.190878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:21.192453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:21.204812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.206124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.213701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.214460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.316240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.326511 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42982834-b016-4b38-a112-26bc2d4d87ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.403160 Nov 06 20:55:21.332345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1384/2841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:20 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:21.344453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ebb03b69-120e-48f7-b826-4e4e32d5b283 req-28083358-e361-447d-a6ab-df73c4a7636d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042a28ad-9bf3-438e-b5a1-9f84e65b443f", "name": "network-vif-plugged", "status": "completed", "tag": "e2aa14a3-a87c-41ea-b3d8-7324c7216df6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:21.351885 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:21.351885 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:21.375610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ebb03b69-120e-48f7-b826-4e4e32d5b283 req-28083358-e361-447d-a6ab-df73c4a7636d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.378299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ebb03b69-120e-48f7-b826-4e4e32d5b283 req-28083358-e361-447d-a6ab-df73c4a7636d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.428128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ebb03b69-120e-48f7-b826-4e4e32d5b283 req-28083358-e361-447d-a6ab-df73c4a7636d service nova] Creating event network-vif-plugged:e2aa14a3-a87c-41ea-b3d8-7324c7216df6 for instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f on nch2-master-1 Nov 06 20:55:21.439947 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ebb03b69-120e-48f7-b826-4e4e32d5b283 req-28083358-e361-447d-a6ab-df73c4a7636d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107779 Nov 06 20:55:21.440592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1385/2842] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:21.481109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:21.482393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:21.491783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.492594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.493715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.494610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.581389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7321eccf-1734-433b-b58c-c195a04cb37a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.131174 Nov 06 20:55:21.585104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1386/2843] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:21.590218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.592684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:21.594531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:21.605865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.613975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.620257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ef7e2e5-e647-4549-987b-b5c536dd628c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.437123 Nov 06 20:55:21.623770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.624443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.625505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.627022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.635459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1458/2844] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:21 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:21.661132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:21.662490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:21.678557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.679179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.683964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.685014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.760470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8b8b09f-2742-4012-90b4-f4676d48fef8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.103866 Nov 06 20:55:21.763037 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1459/2845] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:21 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:21.800338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:21.801805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:21.817390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.818753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.821679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:21.822209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:21.972528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:21.984555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6014a6d-c5d8-4d2d-ad21-5d87da8d4a71 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.397396 Nov 06 20:55:21.989136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1387/2846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:21 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:22.094626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.104625 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b389e3d-80dd-4024-9e17-a119b6953fcc tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.311522 Nov 06 20:55:22.105826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1460/2847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:21 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:22.195415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:22.196063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:22.206179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.207412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.208656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.209338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.349021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:22.350259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:22.368039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.371775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.373164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.375311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.379045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.387266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82c335d6-24b4-4718-b2a0-33503761a7fb tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.195954 Nov 06 20:55:22.388890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1388/2848] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:22 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:22.570726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.579184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a8ba24d-25b1-40ec-a4ba-88bc97355e11 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.234107 Nov 06 20:55:22.579941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1461/2849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:22 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:22.595036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:22.596022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:22.602907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.603398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.604195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.605081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.639799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:22.640590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:22.650976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.651446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.653837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.655607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.661424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2ee0439-bdd9-4889-bf15-af2e1cc644b1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.069832 Nov 06 20:55:22.669294 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1389/2850] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:22 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:22.775491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:22.776905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:22.793533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.794283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.795089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:22.795531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:22.846122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38991240-1438-44bb-9c1a-e9839b93c652 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.075271 Nov 06 20:55:22.849710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1390/2851] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:22 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:22.916000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.941846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.944035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:22.953111 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-651e5f23-4faf-4df8-a376-a6b7dad13da1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.317888 Nov 06 20:55:22.967408 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1462/2852] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:22 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:23.016019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:23.016775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.025180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.025716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.026461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.026887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.123048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:23.123664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.134151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.134607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.135641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.136279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.249770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:23.258213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-960be43a-4495-4a4c-9ea0-0e6cd2ba1481 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.250914 Nov 06 20:55:23.268127 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1391/2853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:23 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:23.374454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:23.384989 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-276a4c92-e33e-41fd-9af0-9dcb5ad682f1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1308 microversion: 2.1 time: 0.265397 Nov 06 20:55:23.395514 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1463/2854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:23 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:23.406264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:23.406891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.413484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.414334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.415359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.416245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.508515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-39fcf17b-c8c0-40f4-9b10-b15c72dd4c6f req-34051f4f-16d3-44e2-9898-694c0956ae3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81864163-41d3-46b9-b9bb-3bb2b1ef142d", "name": "network-vif-plugged", "status": "completed", "tag": "42df9c2c-9b18-42f4-91c3-d59e5082f301"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:23.510176 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:23.510176 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:23.518017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39fcf17b-c8c0-40f4-9b10-b15c72dd4c6f req-34051f4f-16d3-44e2-9898-694c0956ae3f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.518473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39fcf17b-c8c0-40f4-9b10-b15c72dd4c6f req-34051f4f-16d3-44e2-9898-694c0956ae3f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.553355 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-39fcf17b-c8c0-40f4-9b10-b15c72dd4c6f req-34051f4f-16d3-44e2-9898-694c0956ae3f service nova] Creating event network-vif-plugged:42df9c2c-9b18-42f4-91c3-d59e5082f301 for instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d on nch2-master-1 Nov 06 20:55:23.559468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-39fcf17b-c8c0-40f4-9b10-b15c72dd4c6f req-34051f4f-16d3-44e2-9898-694c0956ae3f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055567 Nov 06 20:55:23.565167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1464/2855] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:23.602393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:23.604015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.612558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.613140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.614036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.615637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.627406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:23.638037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fbb2b10b-c2c0-4cce-8319-2a93fe42b425 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.235992 Nov 06 20:55:23.644345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1392/2856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:23 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:23.674916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:23.676268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.688096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.688925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.689998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.690617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.745797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24851f27-4907-47ed-b76a-8c8e8787b2c0 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.074781 Nov 06 20:55:23.746926 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1393/2857] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:23.860393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:23.874400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:23.903147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.914233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:23.916641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:23.917313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.004865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.014483 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01447d0c-6d9f-4163-8527-36b0e2d768e4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.420393 Nov 06 20:55:24.027281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1465/2858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:23 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:24.033419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:24.034323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:24.042727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.043177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-026da7a0-45a2-4f70-a513-10aa20c31146 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.186592 Nov 06 20:55:24.043653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.044677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.044812 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1394/2859] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:23 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:24.045430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.254849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.281048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.292363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:24.293886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:24.294164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.297437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dfd490a7-c9fa-4c96-b1c1-b814d76e799c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.267318 Nov 06 20:55:24.302242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1466/2860] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:24 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:24.317815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.318802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.319668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.320137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.404933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:24.405545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:24.419396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.420225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.421424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.422435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.689894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.711382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4dd810d1-a36e-4938-9192-ac4de18fe7c0 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.429223 Nov 06 20:55:24.723367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1395/2861] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:24 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:24.723367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:24.723367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:24.728394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.728394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.728394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.728394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.958382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:24.965984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc97121d-0973-4c64-9baa-5b2950794915 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1487 microversion: 2.1 time: 0.565693 Nov 06 20:55:24.977329 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1467/2862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:24 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1487 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:24.986600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:24.988149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:24.995645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.996512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:24.997711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:24.998380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.066019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49b8a5b5-eac9-481e-b3b8-86659bb41ad6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.083008 Nov 06 20:55:25.066684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1468/2863] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:24 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:25.076319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:25.077797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:25.092792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.093249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.094055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.094491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.155134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lazy-loading 'flavor' on Instance uuid 042a28ad-9bf3-438e-b5a1-9f84e65b443f {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:25.209028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:25.221505 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd2b1dd3-23b9-449b-8218-88a593d41107 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.507164 Nov 06 20:55:25.230032 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1396/2864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:24 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:25.243288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:25.244798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:25.263618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.264905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.265924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.268450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.310787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c54eda5d-c5fc-4194-9f9d-9bc469c99e5a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f/action" status: 202 len: 0 microversion: 2.1 time: 0.242430 Nov 06 20:55:25.312012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1469/2865] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:25 2021] POST /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:25.318310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:25.319438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:25.326890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.327397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.328487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.329028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.403363 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15dde30c-d50d-44a7-88e3-c7d1ffcf880a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.088585 Nov 06 20:55:25.407418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1470/2866] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:25 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:25.414841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:25.415940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:25.423471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.423700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:25.424942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:25.425386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.171271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.178830 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54a28d8f-967b-4df2-b4c2-100e96bdefed tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.947029 Nov 06 20:55:26.186752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1397/2867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:25 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:26.192019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:26.192984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:26.210294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.212022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.213156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.213794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.256174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.266274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.273735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.276260 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fb5adf9-2d8b-41c6-90b4-27e0e38b310f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1362 microversion: 2.25 time: 0.867609 Nov 06 20:55:26.278931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1471/2868] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:25 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1362 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:26.296285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2616b312-2321-44a3-9972-34b08dba5f53 req-1f8d0f0f-2c1c-4035-a739-f10191cc2623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcd375a-c384-43a3-8893-4628f25ccf28", "name": "network-vif-plugged", "status": "completed", "tag": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:26.300567 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:26.300567 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:26.318026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2616b312-2321-44a3-9972-34b08dba5f53 req-1f8d0f0f-2c1c-4035-a739-f10191cc2623 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.318476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2616b312-2321-44a3-9972-34b08dba5f53 req-1f8d0f0f-2c1c-4035-a739-f10191cc2623 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.331489 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2616b312-2321-44a3-9972-34b08dba5f53 req-1f8d0f0f-2c1c-4035-a739-f10191cc2623 service nova] Creating event network-vif-plugged:c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 for instance 9fcd375a-c384-43a3-8893-4628f25ccf28 on nch2-master-1 Nov 06 20:55:26.337900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2616b312-2321-44a3-9972-34b08dba5f53 req-1f8d0f0f-2c1c-4035-a739-f10191cc2623 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055676 Nov 06 20:55:26.338743 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1472/2869] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:26.349690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:26.350457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:26.358598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.359040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.360138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.360626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.641087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.653384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12c25c39-cad5-4ee0-bea2-95d94cb47dff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1495 microversion: 2.1 time: 0.463033 Nov 06 20:55:26.654750 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1398/2870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:26 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1495 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:26.665951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:26.668164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:26.682608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.684600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.686790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.688783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.718136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:26.728446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a609a165-9bd1-403f-9a9a-040fcaa866f6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.388550 Nov 06 20:55:26.729280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1473/2871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:26 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:26.734698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:26.735630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:26.743406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.744216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:26.745298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:26.745961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.007899 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a008bc89-4e93-49a3-ab80-9cdf7f6d6121 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.348980 Nov 06 20:55:27.011902 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1399/2872] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:27.031932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:27.045922 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1cdaef4e-9de7-4e4b-835a-7f5ad3ab3f8b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1331 microversion: 2.1 time: 0.315122 Nov 06 20:55:27.046522 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1474/2873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:26 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1331 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:27.047583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:27.050069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:27.071943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.072770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.073684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.074411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.141467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-803b604e-3493-4144-81fe-e80f4ceaad19 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.126703 Nov 06 20:55:27.142237 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1400/2874] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:27 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:27.197539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:27.198803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:27.214866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.216009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.217216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.217776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.298409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:27.305796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:27.324400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.325414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.326215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.326827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.671074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:27.684406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e6e7309-55f9-4d60-9e5b-397e1b1b9ea7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.487702 Nov 06 20:55:27.700357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1475/2875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:27 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:27.706681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:27.707334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:27.718099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.718735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.719633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.720131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.734360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:27.749986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:27.751623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:27.752856 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a839b7b1-954e-472b-93d9-9cb943fd3373 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1558 microversion: 2.25 time: 0.459336 Nov 06 20:55:27.753976 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1401/2876] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:27 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1558 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:27.760325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:27.764056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:27.774655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.775111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:27.775913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:27.776391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.035755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:28.044009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acb84f72-adb8-491d-ac6c-a7716235828e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 200 len: 1478 microversion: 2.1 time: 0.343515 Nov 06 20:55:28.056324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1476/2877] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:27 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 1478 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:28.056324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:28.056324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.075824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.076277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.078117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.078117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.282563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:28.341604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cea02d44-a532-4502-a2ee-47bfd3a55c5d tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.578188 Nov 06 20:55:28.354472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1402/2878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:27 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:28.363749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:28.370136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.398388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.406267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.407432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.412071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.528870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78c4f713-38a2-487c-be8c-ea534897ee98 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.170845 Nov 06 20:55:28.536406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1403/2879] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:28.545421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:28.546268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.554692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.555143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.555936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.556551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.758484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:28.795130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a86d2ef-1e1e-4862-8fde-63d3297cacf3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 2051 microversion: 2.25 time: 0.749419 Nov 06 20:55:28.796061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1477/2880] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:28 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 2051 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:28.801327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-475325846"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:28.803957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.813827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.819191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.820078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.820656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.855664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:28.867411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45f884bd-ee80-444b-81fe-6b492901db57 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1536 microversion: 2.1 time: 0.329608 Nov 06 20:55:28.880095 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1404/2881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:28 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1536 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:28.885100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:28.894163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.902385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.903184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.904202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.904896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.959820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48c7115d-b562-45e1-89cc-48cb843cbea7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.078087 Nov 06 20:55:28.967450 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1405/2882] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:28 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:28.968654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:28.969346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:28.977302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.977764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:28.978613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:28.979047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:29.186969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07c884a2-20c8-4e5a-92ec-89947854a8d3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f/action" status: 202 len: 0 microversion: 2.1 time: 0.389265 Nov 06 20:55:29.188412 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1478/2883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:28 2021] POST /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:55:29.198628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:29.212438 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c644dde-7080-45bf-9bfd-b5d17d348f94 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.249916 Nov 06 20:55:29.222319 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1406/2884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:28 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:29.222569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:29.222704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5719116-57d7-4c79-963c-c8dcb6177e39 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'create', calling method: .version_select at 0x7f671ad44670>, body: {"pool": "1cd440a1-6c1d-4164-9378-c5efd9c6801b"} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:29.222810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:29.237793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:29.243089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:29.244418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:29.244949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:29.804851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:29.836505 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f685ca9-8989-4d1b-95e5-74156779a8a3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 2051 microversion: 2.25 time: 0.629574 Nov 06 20:55:29.837574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1479/2885] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:29 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 2051 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:29.845355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd57f62b-9d58-473c-b321-4abddbf98ccb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715745940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:29.940464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd57f62b-9d58-473c-b321-4abddbf98ccb tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.101531 Nov 06 20:55:29.941704 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1480/2886] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:29 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:29.946892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:29.947768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:29.955217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:29.956391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:29.957451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:29.958109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.262987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:30.271353 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e99fbad-cb2a-4dd2-b929-12e8f6fb200c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.328381 Nov 06 20:55:30.276286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1481/2887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:29 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:30.288681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:30.290066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:30.297684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.298545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.300241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.300960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.367984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6af505e0-7f11-4498-97f1-d4bc1e5c10db tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.089990 Nov 06 20:55:30.369886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1482/2888] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:30 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:30.375357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:30.377323 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:30.377323 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:30.379656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.380525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.381693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.382669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.417892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-daaa8787-2216-4bc9-827c-2a2bf2be3ac2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046337 Nov 06 20:55:30.419322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1483/2889] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Nov 6 20:55:30 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:55:30.424952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:30.426266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:30.435267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.436168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.437366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.438405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.505745 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b444fb9-98cc-4a6e-ab33-0a3b1cc71786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.084585 Nov 06 20:55:30.507024 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1484/2890] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:30 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:30.514927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:30.516844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:30.524801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.525593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.526877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.527538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.854895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:30.894685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d5c6c38-9007-44f3-80ef-e635241b372a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.386058 Nov 06 20:55:30.901143 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1485/2891] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:30 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:30.907047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:30.918576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:30.935585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.936363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:30.940770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:30.941857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.051357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0647c595-d417-45f2-ba8c-41fcfd9ad431 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d/action" status: 202 len: 0 microversion: 2.25 time: 0.148086 Nov 06 20:55:31.052012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1486/2892] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:30 2021] POST /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:31.062959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd0c8bdc-9fe1-4b44-9254-3c484242e1c0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67159004c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:31.137271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd0c8bdc-9fe1-4b44-9254-3c484242e1c0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.079370 Nov 06 20:55:31.138511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1487/2893] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:31 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:31.147484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:31.148637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:31.157201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.158096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.159944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.160839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.445983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:31.468932 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-39f776f8-cadd-4123-b60f-14fb6a6d5078 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 2056 microversion: 2.25 time: 0.325997 Nov 06 20:55:31.476784 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1488/2894] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:31 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 2056 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:31.484157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:31.485483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:31.497275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.498098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.500548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.501235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.760585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:31.773141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cc2007e-1403-45d0-9539-2a0c41d31ffe tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1567 microversion: 2.1 time: 0.293928 Nov 06 20:55:31.774934 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1489/2895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:31 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:31.785044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:31.787587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:31.794381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.794946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.795853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.796409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.870497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-236288d8-6ead-49b2-b0a8-6bdfcf0b0613 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094252 Nov 06 20:55:31.871174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1490/2896] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:31 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:31.879894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:31.880716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:31.913969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.916793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.917850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:31.919023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:31.989030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62868693-26ff-42e6-87bf-f4303f8992eb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.116224 Nov 06 20:55:31.990464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1491/2897] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:31 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:31.996640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:31.997667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:32.007789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.008653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.009838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.010526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.611960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:32.620101 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74464ff4-6bf1-47d0-87cc-4566ac23d898 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.627927 Nov 06 20:55:32.623913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1492/2898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:31 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:32.639959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79cb30b8-8f09-48fa-b095-34e64985bb4d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715254310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:32.641518 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5719116-57d7-4c79-963c-c8dcb6177e39 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.426354 Nov 06 20:55:32.649872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1407/2899] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:55:29 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:32.663197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:32.663825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:32.679664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.680135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.686148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.687465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.714100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79cb30b8-8f09-48fa-b095-34e64985bb4d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.088738 Nov 06 20:55:32.714777 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1493/2900] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:32 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:32.722363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.177"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:32.728684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:32.738887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.742081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.742081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:32.742081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:32.774249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Acquired lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:55:33.071588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:33.085783 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28cd688f-82aa-4f99-a026-1481228279f2 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 2036 microversion: 2.25 time: 0.434591 Nov 06 20:55:33.086972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1408/2901] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:32 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 2036 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:33.092222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:33.096545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:33.105580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.106467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.107506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.108163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.393620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:33.404994 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-389e80b2-91ff-4d16-ab94-1fadfae53b9e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1547 microversion: 2.1 time: 0.316595 Nov 06 20:55:33.405882 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1409/2902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:33 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1547 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:33.415289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:33.418337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:33.434005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.436674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.437725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.440716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.522264 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c72f66b0-5089-461a-83d7-e588b07fc639 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.112893 Nov 06 20:55:33.523271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1410/2903] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:33.530475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:33.534106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:33.550576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.552583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.553478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.556560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.632099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b12eab4-4055-4d77-aacb-18d677d8511f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.106505 Nov 06 20:55:33.636113 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1411/2904] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:33 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:33.648216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:33.650532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:33.664324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.667537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.672482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:33.673242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:33.725242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'flavor' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:33.755191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:55:35.072567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Building network info cache for instance {{(pid=134827) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:55:35.726422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29728547-099d-447f-a45d-082106dde02d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d/action" status: 202 len: 0 microversion: 2.25 time: 2.088509 Nov 06 20:55:35.727364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1412/2905] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:33 2021] POST /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d/action => generated 0 bytes in 2090 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:35.734463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:35.735428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:35.759626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:35.768626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:35.774129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:35.779305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.016349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Updating instance_info_cache with network_info: [{"id": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37", "address": "fa:16:3e:f0:1f:0d", "network": {"id": "236e0dda-9020-42e2-aa5c-87655d068d49", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1907625821-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5c1824b1585947c2ad050b80ae52d273", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc57f5cd1-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134827) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:55:36.035332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Releasing lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:55:36.036710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a02090a-be3a-4084-a835-a0b7a76b82f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 202 len: 0 microversion: 2.1 time: 3.320347 Nov 06 20:55:36.040997 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1494/2906] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:32 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 0 bytes in 3324 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:55:36.063515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:36.064687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:36.088150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.092127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.093146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.095220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.214306 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Cannot 'detach_volume' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state rescued Nov 06 20:55:36.216098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 409 to user: Cannot 'detach_volume' instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 while it is in vm_state rescued {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:36.218745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6dfcd2e9-a213-42cf-9235-afbb32f43451 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments/ea858d8a-67d5-493c-a315-e50ce7efcabe" status: 409 len: 152 microversion: 2.1 time: 0.489350 Nov 06 20:55:36.225917 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1413/2907] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 20:55:35 2021] DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments/ea858d8a-67d5-493c-a315-e50ce7efcabe => generated 152 bytes in 497 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:55:36.242836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0becef55-eaf9-4ee5-93a6-94301f6a6b80 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715319c10>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:36.478084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0becef55-eaf9-4ee5-93a6-94301f6a6b80 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.250633 Nov 06 20:55:36.478644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1414/2908] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:36 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:36.486822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:36.486822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:36.500860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.501316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.502103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.504348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.573947 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-284829a9-8696-45ca-9d14-598504f3d159 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.093809 Nov 06 20:55:36.574916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1415/2909] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:36 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:36.589633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:36.592105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:36.606062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.606728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.607678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.608219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.670555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5687c7b0-f229-4f0f-934f-ed3e6e5bd478 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.093737 Nov 06 20:55:36.675121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1416/2910] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:36 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:36.687481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ca31a8bb-3015-4cfb-9c60-1af7bd84d251 req-c35606a6-2b3b-4218-b359-6ab12c4d33ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcd375a-c384-43a3-8893-4628f25ccf28", "tag": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:36.692986 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:36.692986 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:36.712917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ca31a8bb-3015-4cfb-9c60-1af7bd84d251 req-c35606a6-2b3b-4218-b359-6ab12c4d33ab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.713618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ca31a8bb-3015-4cfb-9c60-1af7bd84d251 req-c35606a6-2b3b-4218-b359-6ab12c4d33ab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.730883 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ca31a8bb-3015-4cfb-9c60-1af7bd84d251 req-c35606a6-2b3b-4218-b359-6ab12c4d33ab service nova] Creating event network-changed:c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 for instance 9fcd375a-c384-43a3-8893-4628f25ccf28 on nch2-master-1 Nov 06 20:55:36.738631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ca31a8bb-3015-4cfb-9c60-1af7bd84d251 req-c35606a6-2b3b-4218-b359-6ab12c4d33ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061705 Nov 06 20:55:36.739697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1417/2911] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:36.746074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3447402d-b7ee-48a0-bdea-85cb78515561 req-3a6b7a2e-5cb2-4d50-9faa-174b65e17c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042a28ad-9bf3-438e-b5a1-9f84e65b443f", "name": "network-vif-plugged", "status": "completed", "tag": "e2aa14a3-a87c-41ea-b3d8-7324c7216df6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:36.747947 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:36.747947 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:36.777519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3447402d-b7ee-48a0-bdea-85cb78515561 req-3a6b7a2e-5cb2-4d50-9faa-174b65e17c83 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.778054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3447402d-b7ee-48a0-bdea-85cb78515561 req-3a6b7a2e-5cb2-4d50-9faa-174b65e17c83 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.793376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3447402d-b7ee-48a0-bdea-85cb78515561 req-3a6b7a2e-5cb2-4d50-9faa-174b65e17c83 service nova] Creating event network-vif-plugged:e2aa14a3-a87c-41ea-b3d8-7324c7216df6 for instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f on nch2-master-1 Nov 06 20:55:36.800208 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3447402d-b7ee-48a0-bdea-85cb78515561 req-3a6b7a2e-5cb2-4d50-9faa-174b65e17c83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058871 Nov 06 20:55:36.801667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1418/2912] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:36.813647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:36.814610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:36.821956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.822483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.823282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:36.823960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:36.889356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:36.898709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c178f234-2d76-4563-a70e-4187586e7df1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1682 microversion: 2.1 time: 0.850209 Nov 06 20:55:36.900109 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1495/2913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:36 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1682 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:36.907939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5ac5065-07cc-4b25-ada0-e3c4ff063a29 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'create', calling method: .version_select at 0x7f671ac64820>, body: {"pool": "1cd440a1-6c1d-4164-9378-c5efd9c6801b"} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:37.715608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:37.724629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:37.726144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:37.737880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6e1e25d-fa8a-41d3-8c12-af33040dd7bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.934601 Nov 06 20:55:37.751245 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1419/2914] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:36 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:37.761665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:37.762603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:37.775325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:37.781255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:37.784936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:37.786274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:37.941417 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-128db969-655c-4ba4-b75f-1f15404681e1 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action" status: 202 len: 0 microversion: 2.1 time: 0.188801 Nov 06 20:55:37.943609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1420/2915] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:37 2021] POST /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:37.952078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d5a0916-3963-4ac5-ad14-3967bd8a8934 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67152b4040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:38.501714 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d5a0916-3963-4ac5-ad14-3967bd8a8934 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.555995 Nov 06 20:55:38.514162 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1421/2916] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:37 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:38.519276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:38.520676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:38.530297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.530979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:38.532137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.532787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:38.616150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b967f59f-0feb-4ffe-97f0-15d95a8f5071 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.099292 Nov 06 20:55:38.620405 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1422/2917] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:38 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:38.626864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:38.628759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:38.640689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.641447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:38.642442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.642973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:38.725143 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bcc702a0-db82-4d7f-8b84-33881ee57e20 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.106076 Nov 06 20:55:38.725943 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1423/2918] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:38 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:38.734384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:38.736867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:38.744385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.745635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:38.746700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:38.747382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:39.301310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:39.313570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-365bed58-70c7-4858-80c7-8623a2ec9635 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.586352 Nov 06 20:55:39.337967 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1424/2919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:38 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:39.361117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:39.364188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:39.389557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:39.390855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:39.391060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:39.391578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.066564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:40.077276 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f4e687a-cb4c-4a0f-895e-8fbda46c8108 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1555 microversion: 2.1 time: 0.729755 Nov 06 20:55:40.081064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1425/2920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:39 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1555 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:40.086460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:40.087269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:40.095477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.096427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.097395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.098007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.580604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:40.599963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:40.601495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:40.602969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42e90b68-eb9d-4f21-81ff-d82d5962719a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.520496 Nov 06 20:55:40.604679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1426/2921] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:40 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:40.610767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e660865e-c4bd-43c7-a6fa-05d66bd4ba76 req-63474d87-db82-4b82-8f35-b01291ecd070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81864163-41d3-46b9-b9bb-3bb2b1ef142d", "name": "network-vif-unplugged", "status": "completed", "tag": "42df9c2c-9b18-42f4-91c3-d59e5082f301"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:40.612993 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:40.612993 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:40.622074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e660865e-c4bd-43c7-a6fa-05d66bd4ba76 req-63474d87-db82-4b82-8f35-b01291ecd070 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.622867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e660865e-c4bd-43c7-a6fa-05d66bd4ba76 req-63474d87-db82-4b82-8f35-b01291ecd070 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.640943 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e660865e-c4bd-43c7-a6fa-05d66bd4ba76 req-63474d87-db82-4b82-8f35-b01291ecd070 service nova] Creating event network-vif-unplugged:42df9c2c-9b18-42f4-91c3-d59e5082f301 for instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d on nch2-master-1 Nov 06 20:55:40.649061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e660865e-c4bd-43c7-a6fa-05d66bd4ba76 req-63474d87-db82-4b82-8f35-b01291ecd070 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042087 Nov 06 20:55:40.652534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1427/2922] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:40.667818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:40.679134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:40.686514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.687276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.688280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.689076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.895352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5ac5065-07cc-4b25-ada0-e3c4ff063a29 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.993934 Nov 06 20:55:40.908670 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1496/2923] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 20:55:36 2021] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:40.919420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-956142b7-2348-4804-bfdc-90f8e88d53ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715adaee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:40.975879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-956142b7-2348-4804-bfdc-90f8e88d53ff tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.061077 Nov 06 20:55:40.977169 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1497/2924] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:40 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:40.984022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:40.985290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:40.992390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.993098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:40.994094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:40.994699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.058630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:41.073569 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4f3a165-6ac8-4172-b562-4416d883b0e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094876 Nov 06 20:55:41.074935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec8eaa3d-09a5-4a7e-9ccd-bf4c8f1b7347 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.420716 Nov 06 20:55:41.076305 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1428/2925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:40 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:41.088895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1498/2926] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:40 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:41.088895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.4"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:41.088895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:41.095311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.095938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.097362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.097929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.119467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:41.121205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:41.142019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.143350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.144155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.144626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.163258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Acquired lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:55:41.231486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b8e447f-e396-442c-b191-c1169bb3c3c0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.153651 Nov 06 20:55:41.236110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1429/2927] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:41 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:41.242032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b557e469-3cca-4e75-9694-1253077a9b17 req-ed6437fe-b0fb-4543-8063-45a86f845ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-unplugged", "status": "completed", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:41.246446 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:41.246446 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:41.255720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b557e469-3cca-4e75-9694-1253077a9b17 req-ed6437fe-b0fb-4543-8063-45a86f845ffe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.256603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b557e469-3cca-4e75-9694-1253077a9b17 req-ed6437fe-b0fb-4543-8063-45a86f845ffe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.279751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b557e469-3cca-4e75-9694-1253077a9b17 req-ed6437fe-b0fb-4543-8063-45a86f845ffe service nova] Creating event network-vif-unplugged:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 20:55:41.285215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b557e469-3cca-4e75-9694-1253077a9b17 req-ed6437fe-b0fb-4543-8063-45a86f845ffe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047573 Nov 06 20:55:41.287427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1430/2928] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:41.297076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:41.298004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:41.331249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.331704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:41.341634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:41.342099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:42.106089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:42.121095 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78a5d137-285b-4ce6-8687-69865f11a632 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1555 microversion: 2.1 time: 0.828268 Nov 06 20:55:42.124632 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1431/2929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:41 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1555 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:42.141202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:42.142082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:42.153452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:42.154269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:42.155363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:42.157212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:42.703410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.0.4 (0d46cd2b-4d99-40d4-a330-cbc5003ffb12) with port c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1cd440a1-6c1d-4164-9378-c5efd9c6801b.", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 20:55:42.704194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Releasing lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:55:42.704594 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] HTTP exception thrown: Cannot associate floating IP 172.35.0.4 (0d46cd2b-4d99-40d4-a330-cbc5003ffb12) with port c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1cd440a1-6c1d-4164-9378-c5efd9c6801b. Nov 06 20:55:42.704594 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-d9bc2366-fda4-4bb8-9f46-acf905fa1436'] Nov 06 20:55:42.711536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Returning 400 to user: Cannot associate floating IP 172.35.0.4 (0d46cd2b-4d99-40d4-a330-cbc5003ffb12) with port c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1cd440a1-6c1d-4164-9378-c5efd9c6801b. Nov 06 20:55:42.711536 ncdv-master-1 devstack@n-api.service[134827]: Neutron server returns request_ids: ['req-d9bc2366-fda4-4bb8-9f46-acf905fa1436'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:42.712516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-977d86d7-6eec-4139-8f87-9dee92b25ee9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 400 len: 380 microversion: 2.1 time: 1.631220 Nov 06 20:55:42.714985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1499/2930] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:41 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 380 bytes in 1634 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:55:42.725487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1b368b1-9b0b-4bb5-9485-a51fc546acd9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac375e0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:42.859800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:42.880769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:42.882606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:42.883582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50b4114d-bdd6-4dfb-9da1-9a62739da5a7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.757718 Nov 06 20:55:42.886131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1432/2931] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:42 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:42.900656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:42.901903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:42.909017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:42.909549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:42.910507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:42.911196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:42.987196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53ec7afe-6570-46d7-8f79-e97d91d44bc5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.090044 Nov 06 20:55:42.993234 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1433/2932] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:42 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:43.001601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:43.003419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:43.014304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.015184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.017068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.017655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.071099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21d2f1cb-923a-43cb-94af-bbf5d33bb6ed tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.076371 Nov 06 20:55:43.073334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1434/2933] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:42 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:43.081678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4eba6803-a846-4e46-93aa-969f417700af req-de872d12-bc89-4f15-a476-23fb1e4dd5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81864163-41d3-46b9-b9bb-3bb2b1ef142d", "tag": "42df9c2c-9b18-42f4-91c3-d59e5082f301"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:43.085106 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:43.085106 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:43.094515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4eba6803-a846-4e46-93aa-969f417700af req-de872d12-bc89-4f15-a476-23fb1e4dd5cb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.094978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4eba6803-a846-4e46-93aa-969f417700af req-de872d12-bc89-4f15-a476-23fb1e4dd5cb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.107190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4eba6803-a846-4e46-93aa-969f417700af req-de872d12-bc89-4f15-a476-23fb1e4dd5cb service nova] Creating event network-changed:42df9c2c-9b18-42f4-91c3-d59e5082f301 for instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d on nch2-master-1 Nov 06 20:55:43.113530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4eba6803-a846-4e46-93aa-969f417700af req-de872d12-bc89-4f15-a476-23fb1e4dd5cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 Nov 06 20:55:43.114974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1435/2934] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:43.121771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f91bf639-0826-4b18-8940-f8c92f0da34c tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '.version_select at 0x7f671adb01f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:43.389820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1b368b1-9b0b-4bb5-9485-a51fc546acd9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.673499 Nov 06 20:55:43.390950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1500/2935] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:42 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:43.402469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:43.403452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:43.410200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.410999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.412109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.412840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.850842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:43.871422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f4a76b4-5688-4ea0-a4f5-55fe7bdd7543 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1561 microversion: 2.1 time: 0.477420 Nov 06 20:55:43.892470 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1501/2936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:43 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1561 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:43.912972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:43.921577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:43.934747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.935225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:43.937431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:43.937883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.400786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:44.410167 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10f4ac9c-80d6-4236-a48e-9afcec9fd3c8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.508662 Nov 06 20:55:44.421306 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1502/2937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:43 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:44.424323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:44.424967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:44.431648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.432572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.433661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.434171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.767181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:44.784326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f91bf639-0826-4b18-8940-f8c92f0da34c tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/0d46cd2b-4d99-40d4-a330-cbc5003ffb12" status: 202 len: 0 microversion: 2.1 time: 1.667465 Nov 06 20:55:44.788254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1436/2938] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:55:43 2021] DELETE /compute/v2.1/os-floating-ips/0d46cd2b-4d99-40d4-a330-cbc5003ffb12 => generated 0 bytes in 1669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:44.788649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:44.788649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:44.790328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c42f4d3b-bdaa-46ed-8e73-1a7384910ffa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.376730 Nov 06 20:55:44.791733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:44.802574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1503/2939] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:44 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:44.802802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:44.802934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:44.802934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:44.805843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.806374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.810172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.811098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.811655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.812108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.813210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.814415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.888406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-781f14fa-61d9-4dde-a371-6eeefcf1b4ef tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094127 Nov 06 20:55:44.893045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1504/2940] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:44 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:44.907746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:44.910280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:44.921647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.928223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.930233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:44.931062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:44.949016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'services' on Instance uuid 02d9c005-dc47-4fb6-ac23-fdeada22a300 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:45.013703 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8d30ab0-ad96-4de2-b549-6dfce29e1337 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.117862 Nov 06 20:55:45.024681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1505/2941] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:44 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:45.031151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0a3c9d0-ca7e-4d71-9217-b4d9f8a1e8c0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67153b7ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:45.112333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-829c11e0-b913-4910-9808-87341e226884 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments/ea858d8a-67d5-493c-a315-e50ce7efcabe" status: 202 len: 0 microversion: 2.1 time: 0.326358 Nov 06 20:55:45.115148 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1437/2942] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 20:55:44 2021] DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments/ea858d8a-67d5-493c-a315-e50ce7efcabe => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:45.140223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:45.141732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:45.141863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0a3c9d0-ca7e-4d71-9217-b4d9f8a1e8c0 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.115281 Nov 06 20:55:45.148569 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1506/2943] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:45 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:45.154661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.155108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.156682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.177"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:45.158324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.158829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.254617 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6686b303-5068-47db-81b2-903d5a94bf07 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.137646 Nov 06 20:55:45.256181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1438/2944] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:45 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:45.277578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:45.282040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:45.294488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.295380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.296601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.297388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.346940 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bdc2e10b-3018-427c-a2a0-ee046c6581a3 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088881 Nov 06 20:55:45.349393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1439/2945] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:55:45 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:45.356597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:45.357510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:45.366483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.367332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.368378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.369011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.480604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:45.491285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.492042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.493053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.493662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.695759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:45.707740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84126a18-a326-4235-b93d-57a77fa76ed5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1671 microversion: 2.1 time: 0.355416 Nov 06 20:55:45.711026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1440/2946] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:45 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:45.814636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:45.817808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:45.830604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.831370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:45.840889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:45.841696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.018590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Acquired lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:55:46.407707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:46.423638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:46.425431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:46.427977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-259fd84f-5650-464d-a1fa-2bb04be80eaa tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.620616 Nov 06 20:55:46.429497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1441/2947] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:45 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:46.437128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:46.438617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:46.448846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.449883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.450951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.451790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.528525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1478dfd-48ab-45c4-b921-638410801bf7 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.097417 Nov 06 20:55:46.535743 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1442/2948] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:46 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:46.546145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:46.549944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:46.568635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.569438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.570447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.573029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.658007 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7f07040-b88e-49e4-9d03-6b25fd638f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.120357 Nov 06 20:55:46.659345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1443/2949] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:46 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:46.668315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8b897c4-9bd8-4058-8a99-482fcbb8c7f8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ad859d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:46.751326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8b897c4-9bd8-4058-8a99-482fcbb8c7f8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.090505 Nov 06 20:55:46.759348 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1444/2950] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:46 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:46.770361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:46.772011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:46.789612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.790357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.791609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.797299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.891214 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a62ec424-c74d-4686-8895-f932e04fec54 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129959 Nov 06 20:55:46.895621 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1445/2951] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 20:55:46 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:55:46.928052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:46.931108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:46.950579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.951363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:46.953988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:46.954662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.289057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:47.300824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92f83ff2-e548-4d68-9d6d-5342cfeede1c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1671 microversion: 2.1 time: 0.401925 Nov 06 20:55:47.310898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1446/2952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:46 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1671 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:47.315662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:47.316692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:47.326762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.327227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.328072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.328583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.367401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Cannot 'reboot' instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 while it is in vm_state rescued Nov 06 20:55:47.368339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 409 to user: Cannot 'reboot' instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 while it is in vm_state rescued {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:47.369177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2da598e8-6072-486b-8872-33dc552db64c tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action" status: 409 len: 145 microversion: 2.1 time: 0.057160 Nov 06 20:55:47.370011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1447/2953] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:47 2021] POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action => generated 145 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:55:47.380910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:47.382530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:47.390182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.390738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.391739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.392404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.426770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Cannot 'rebuild' instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 while it is in vm_state rescued Nov 06 20:55:47.427668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 409 to user: Cannot 'rebuild' instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 while it is in vm_state rescued {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:47.428703 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4dd893b-a75f-4654-b881-f765bdae5137 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action" status: 409 len: 146 microversion: 2.1 time: 0.053075 Nov 06 20:55:47.429725 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1448/2954] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:47 2021] POST /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3/action => generated 146 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:55:47.456879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:47.457501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:47.467397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.467848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.468790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:47.469229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:47.953702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Building network info cache for instance {{(pid=134827) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 20:55:48.131130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:48.145980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:48.148123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:48.156262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ea06734-c22c-490c-9178-8a493563b9a5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.709354 Nov 06 20:55:48.157377 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1449/2955] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:47 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:48.166931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:48.168203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:48.187366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.188948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.196602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.198040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.294006 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd3d686b-b9f9-4d87-941d-77599ddf7c1c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.135001 Nov 06 20:55:48.298434 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1450/2956] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:48 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:48.311143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:48.316184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:48.340846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.341777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.344353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.352077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.455820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf840ce1-7bd4-4323-b806-f6bc353552ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.158471 Nov 06 20:55:48.457215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1451/2957] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:48 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:48.475932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9de4127d-00d2-4fac-bdf2-fbaffd256433 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ad280d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:48.569682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9de4127d-00d2-4fac-bdf2-fbaffd256433 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.107153 Nov 06 20:55:48.571091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1452/2958] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:48 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:48.578291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-71e09533-587a-4b1f-bb80-f7fbe17df9d6 req-8f1f62c1-9a8e-4cd3-a2a0-172f6a14c170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcd375a-c384-43a3-8893-4628f25ccf28", "tag": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:48.588219 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:48.588219 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:48.603618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-71e09533-587a-4b1f-bb80-f7fbe17df9d6 req-8f1f62c1-9a8e-4cd3-a2a0-172f6a14c170 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.604600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-71e09533-587a-4b1f-bb80-f7fbe17df9d6 req-8f1f62c1-9a8e-4cd3-a2a0-172f6a14c170 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.622557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-71e09533-587a-4b1f-bb80-f7fbe17df9d6 req-8f1f62c1-9a8e-4cd3-a2a0-172f6a14c170 service nova] Creating event network-changed:c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 for instance 9fcd375a-c384-43a3-8893-4628f25ccf28 on nch2-master-1 Nov 06 20:55:48.630509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-71e09533-587a-4b1f-bb80-f7fbe17df9d6 req-8f1f62c1-9a8e-4cd3-a2a0-172f6a14c170 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056889 Nov 06 20:55:48.631267 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1453/2959] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:48.639408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:48.640338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:48.648634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.649096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:48.650996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:48.651457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:49.538651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:49.550095 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ea9dc19-04f3-4f3b-83a9-4be2045b1607 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.917504 Nov 06 20:55:49.553490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1454/2960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:48 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:49.559705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:49.565477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:49.584044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:49.589190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:49.592313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:49.596886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:49.980944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:49.990038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:49.994762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:49.997608 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9889bb43-b38c-451c-bd6d-350e29a1b41e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1568 microversion: 2.25 time: 0.442851 Nov 06 20:55:50.001294 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1455/2961] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:49 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:50.006764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:50.010387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:50.029875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.035674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.036838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.037485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.114831 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-105f6ed3-f41c-45dc-93e3-d4a2a1177ef1 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.111012 Nov 06 20:55:50.119065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1456/2962] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:50 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:50.128847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:50.130632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:50.143262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.150837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.152268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.152268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.232973 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0333e596-fac5-4de0-8032-daacd590520b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.115520 Nov 06 20:55:50.234431 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1457/2963] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:50 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:50.331023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Updating instance_info_cache with network_info: [{"id": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37", "address": "fa:16:3e:f0:1f:0d", "network": {"id": "236e0dda-9020-42e2-aa5c-87655d068d49", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1907625821-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5c1824b1585947c2ad050b80ae52d273", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc57f5cd1-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134827) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 20:55:50.346470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Releasing lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:55:50.347616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-633ba70a-cb68-4f0d-be1b-258dcaec48c9 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 202 len: 0 microversion: 2.1 time: 5.197374 Nov 06 20:55:50.349605 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1507/2964] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:45 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 0 bytes in 5200 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 20:55:50.361887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7806b6df-7249-42fa-b29d-e2337029bb4a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715602ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:50.461290 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7806b6df-7249-42fa-b29d-e2337029bb4a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.107705 Nov 06 20:55:50.464847 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1508/2965] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:50 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:50.487154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:50.487718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:50.509345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.509802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.510611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.511091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.586412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:50.591534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:50.600938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.601716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.602775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.603042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:55:50.603663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.682480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4be0290-1de5-48f9-9261-5aa5b00e091e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 324 microversion: 2.1 time: 0.446691 Nov 06 20:55:50.687551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1458/2966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:50 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:50.694532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ef935ee-d8dd-49b8-95cb-064087fa7a11 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '.version_select at 0x7f671ad66310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:50.831470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ebc36db-b337-4c36-b3c5-07b5fc16a0b6 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 204 len: 0 microversion: 2.1 time: 0.364956 Nov 06 20:55:50.835231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1509/2967] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:55:50 2021] DELETE /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:50.853425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:50.855067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:50.888840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.890679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:50.893314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:50.894949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:51.402083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:51.410982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88fcf606-210d-4e11-9cac-1f8760d82e47 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.573238 Nov 06 20:55:51.411568 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1510/2968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:50 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:51.419495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:51.421423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:51.437657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:51.439317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:51.444831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:51.446314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:51.691874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:51.716352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acdb23d7-f099-4503-b446-b7749de1b6fa tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1507 microversion: 2.1 time: 0.300763 Nov 06 20:55:51.719463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1511/2969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:51 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:51.728127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:51.729047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:51.736731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:51.737564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:51.738640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:51.739803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.002596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:52.019277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:52.036514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:52.038143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15c573f3-d569-4852-8691-e4544238f3fb tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1543 microversion: 2.25 time: 0.317456 Nov 06 20:55:52.038963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1512/2970] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:51 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1543 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:52.043992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:52.045284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:52.057755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.063720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.071645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.078674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.167250 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0d3d236-95ba-4721-a217-ae3e25ec69fe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.125897 Nov 06 20:55:52.179244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1513/2971] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:52 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:52.188117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:52.189419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:52.198084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.198803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.199770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.200400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.272008 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9daa15b-2914-4ed5-84d1-b1a19aabc6aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.090650 Nov 06 20:55:52.272988 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1514/2972] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:52 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:52.280340 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ef935ee-d8dd-49b8-95cb-064087fa7a11 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/10ef1a46-8fc8-4585-914a-703cd4ec2713" status: 202 len: 0 microversion: 2.1 time: 1.591053 Nov 06 20:55:52.281202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:52.281647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1459/2973] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 20:55:50 2021] DELETE /compute/v2.1/os-floating-ips/10ef1a46-8fc8-4585-914a-703cd4ec2713 => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:52.282564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:52.289736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebfd71ae-8bf3-417b-b71f-e1fabb9e7cbe tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac391f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:52.291763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.292429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.293753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.294359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.378786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebfd71ae-8bf3-417b-b71f-e1fabb9e7cbe tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1439 microversion: 2.1 time: 0.096018 Nov 06 20:55:52.379286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1460/2974] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:52 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:52.390357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d6b5af4-ce0a-4ad4-96c8-d9be803def0d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '.version_select at 0x7f671ac90550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:52.397075 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:52.397075 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:52.399377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6b5af4-ce0a-4ad4-96c8-d9be803def0d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.400079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6b5af4-ce0a-4ad4-96c8-d9be803def0d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.414196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d6b5af4-ce0a-4ad4-96c8-d9be803def0d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.028416 Nov 06 20:55:52.422381 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1461/2975] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Nov 6 20:55:52 2021] GET /compute/v2.1/os-migrations => generated 856 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:55:52.428207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d8fcde6-be33-40d6-ab8a-9bceb6f251f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:52.430049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d8fcde6-be33-40d6-ab8a-9bceb6f251f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:52.431185 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d8fcde6-be33-40d6-ab8a-9bceb6f251f8 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 400 len: 142 microversion: 2.1 time: 0.007559 Nov 06 20:55:52.432048 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1462/2976] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:52 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 142 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:55:52.442074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:52.443235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:52.451323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.452144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.453305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.453996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.593035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:52.602731 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-465e07fd-86f1-4b3f-876a-887f77b9d2ba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.326235 Nov 06 20:55:52.612813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1515/2977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:52 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:52.634154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:52.635520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:52.642349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.643073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.644060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:52.644697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:52.692643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:55:52.704396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Acquired lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:55:52.736939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5605d4d6-63b3-472e-9b9c-dca8a5b0ab19 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 2036 microversion: 2.25 time: 0.298519 Nov 06 20:55:52.747625 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1463/2978] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:52 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 2036 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:52.765230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1886181773", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "eb18f83c-d18b-4a29-9010-a6e673304a12"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:52.888284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] validate_networks() for [('eb18f83c-d18b-4a29-9010-a6e673304a12', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:53.038253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Releasing lock "refresh_cache-9fcd375a-c384-43a3-8893-4628f25ccf28" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:55:53.039544 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] HTTP exception thrown: floating IP not found Nov 06 20:55:53.042436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Returning 404 to user: floating IP not found {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:53.043853 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59b73da7-30dc-426a-a6e7-be7e5702010a tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 404 len: 67 microversion: 2.1 time: 0.429740 Nov 06 20:55:53.046879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1516/2979] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:52 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 67 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:55:53.058549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:53.059584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:53.067917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.068175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.069150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.069808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.365215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:53.397475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-935a319a-dd43-4e7b-809e-1f88e47928b5 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1507 microversion: 2.1 time: 0.349199 Nov 06 20:55:53.404937 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1517/2980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:53 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:53.411220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-255806843", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "d7f41d40-db54-4294-8f8b-5894f0c36960"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:53.495767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] validate_networks() for [('d7f41d40-db54-4294-8f8b-5894f0c36960', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:53.596748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:53.597273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:53.597888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:53.599141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:53.599800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:53.618467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.629036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.630599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.631535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.654278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:53.658818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:53.672866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:53.675585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:53.737529 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bf7a72f-3595-46b1-bb78-988e0eed4a1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988151 Nov 06 20:55:53.738172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1464/2981] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:55:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:55:53.743729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4653effe-f44a-414c-8a96-a767938a8666 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:53.819410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4653effe-f44a-414c-8a96-a767938a8666 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 06 20:55:53.820192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4653effe-f44a-414c-8a96-a767938a8666 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:53.821108 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4653effe-f44a-414c-8a96-a767938a8666 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action" status: 404 len: 88 microversion: 2.1 time: 0.081692 Nov 06 20:55:53.821694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1465/2982] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:55:53 2021] POST /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28/action => generated 88 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:55:53.831359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:53.832134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:53.841788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.842540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.843753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.844408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.936996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-726336b4-e406-4740-8baa-908d1e739249 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.109990 Nov 06 20:55:53.944170 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1466/2983] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:53 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:53.951426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:53.952606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:53.960972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.961673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:53.962736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:53.963302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.025433 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-754c5c59-ab10-4d34-84c6-2094b2ca161e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.077468 Nov 06 20:55:54.025980 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1467/2984] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:53 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:54.031658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a9c9e51-6576-4177-85c0-8c302fea11a7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac1d940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.087476 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a9c9e51-6576-4177-85c0-8c302fea11a7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1448 microversion: 2.1 time: 0.059933 Nov 06 20:55:54.088565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1468/2985] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1448 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:54.093243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7eaaa373-344a-4bed-9689-02a4e0242707 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.094335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7eaaa373-344a-4bed-9689-02a4e0242707 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:54.104767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:54.106412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:54.107076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:54.109007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:54.109347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:54.124476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.124990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.125826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.126754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.152888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:54.158117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for user 2b4178344ec541bb964ed60d977eff68 and project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:54.165211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7eaaa373-344a-4bed-9689-02a4e0242707 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.171641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:54.174364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:54.175364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7eaaa373-344a-4bed-9689-02a4e0242707 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1215 microversion: 2.1 time: 0.085720 Nov 06 20:55:54.176597 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1469/2986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:54.182729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.183839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:54.194841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.195401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.196750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.197319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.230332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:55:54.234630 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b9d00c9-410f-40aa-85a5-fe3b913582d9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.827877 Nov 06 20:55:54.240823 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1518/2987] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:55:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:55:54.245499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b259532-54ec-4442-b366-d73c15783f88 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671add19d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.324483 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b259532-54ec-4442-b366-d73c15783f88 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 200 len: 1448 microversion: 2.1 time: 0.082462 Nov 06 20:55:54.326172 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1519/2988] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 1448 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:54.331082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.332134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:54.377189 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4ce7743-f550-470e-b070-be287435fb88 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 204 len: 0 microversion: 2.1 time: 0.194480 Nov 06 20:55:54.378519 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1470/2989] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:55:54 2021] DELETE /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:54.385190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e83be13-58a6-4737-82b4-01397cb5e47b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac1de50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.418219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.429497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.432101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.433814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9a08010-3a0b-4ae8-bba6-b58222b9d6fd tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1261 microversion: 2.25 time: 0.106129 Nov 06 20:55:54.445612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1520/2990] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:54.452123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.453403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:54.464417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.465210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.466858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.467531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.721029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.731554 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ef0c8dd-eae3-46e9-9832-d647143dc1a0 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1542 microversion: 2.1 time: 0.281132 Nov 06 20:55:54.732427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1521/2991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:54.740658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:54.745384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:54.753015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.753668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.755628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:54.756421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:54.984541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:54.995232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2523a539-380d-4993-9421-c3b9ca97a18e tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 200 len: 1465 microversion: 2.1 time: 0.261632 Nov 06 20:55:54.995821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1522/2992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:54 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 1465 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:55.002232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-517164bf-48b6-4156-a5c9-ab00763b0f94 req-8ad032d0-fde1-4274-bbb3-569a1a6121aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0814b2-5fff-4e39-99c9-479ea42beac3", "name": "network-vif-deleted", "tag": "b8c16e54-38d3-4289-ad74-9c49e490aa25"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:55.004579 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:55.004579 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:55.014000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-517164bf-48b6-4156-a5c9-ab00763b0f94 req-8ad032d0-fde1-4274-bbb3-569a1a6121aa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.014603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-517164bf-48b6-4156-a5c9-ab00763b0f94 req-8ad032d0-fde1-4274-bbb3-569a1a6121aa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.026528 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-517164bf-48b6-4156-a5c9-ab00763b0f94 req-8ad032d0-fde1-4274-bbb3-569a1a6121aa service nova] Creating event network-vif-deleted:b8c16e54-38d3-4289-ad74-9c49e490aa25 for instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 on nch2-master-1 Nov 06 20:55:55.033009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-517164bf-48b6-4156-a5c9-ab00763b0f94 req-8ad032d0-fde1-4274-bbb3-569a1a6121aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 Nov 06 20:55:55.033951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1523/2993] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:55.039640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:55.040678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.047270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.047983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.049009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.049617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.100123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-adf648cb-b815-4a31-9d9c-17f73f7aee7f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.064786 Nov 06 20:55:55.102064 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1524/2994] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:55 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:55.108373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:55.110183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.118462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.119249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.120317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.120978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.175417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-774b0d57-aea5-4d47-8f52-9bae906fd3d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.071683 Nov 06 20:55:55.181400 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1525/2995] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:55 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:55.196200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:55.199171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.200073 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e83be13-58a6-4737-82b4-01397cb5e47b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 204 len: 0 microversion: 2.1 time: 0.819381 Nov 06 20:55:55.203994 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1471/2996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:54 2021] DELETE /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:55.208539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:55.209303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.217715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.218211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.219007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.219474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.227917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.228412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.229429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.230109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.281020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:55:55.322082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:55.332141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32fa81a5-a3a6-4f4b-8b2e-8c8c3b1f80e7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1267 microversion: 2.1 time: 0.142818 Nov 06 20:55:55.339145 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1526/2997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:55 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:55.430315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34f389f3-7215-47a0-83a5-f152a8940ad8 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 204 len: 0 microversion: 2.1 time: 0.224859 Nov 06 20:55:55.431490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1472/2998] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:55:55 2021] DELETE /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:55:55.452102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:55.453115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.460692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.461552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.468480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.469061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.561784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:55.571166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:55.575352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1910655523", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8fbc16c6-4a6c-4b93-987f-9643b3a1da7e"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:55.576864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:55.578247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8bda700-a548-410c-a8e3-1f1841b5fef8 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1257 microversion: 2.25 time: 0.129890 Nov 06 20:55:55.580483 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1527/2999] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:55 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1257 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:55.664720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] validate_networks() for [('8fbc16c6-4a6c-4b93-987f-9643b3a1da7e', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:55:55.749782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:55.750783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:55.763274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.763796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:55.765775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:55.766277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.156689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.167387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59263284-ecc5-4b36-9255-ed5e937dfb15 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1542 microversion: 2.1 time: 0.421665 Nov 06 20:55:56.169243 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1528/3000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:55 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1542 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:56.182859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.183542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 8d0814b2-5fff-4e39-99c9-479ea42beac3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.189889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.190890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.193559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.194519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.212663 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 could not be found. Nov 06 20:55:56.213691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 404 to user: Instance 8d0814b2-5fff-4e39-99c9-479ea42beac3 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:55:56.214813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bac2ab8-6ca5-41cf-8976-062987ef3688 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3" status: 404 len: 111 microversion: 2.1 time: 0.044302 Nov 06 20:55:56.215971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1529/3001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:56 2021] GET /compute/v2.1/servers/8d0814b2-5fff-4e39-99c9-479ea42beac3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:55:56.222038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:56.223429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.229629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.230171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.231042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.231557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.294054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c98f642a-de78-4d80-b257-d250e3bd08b3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.076204 Nov 06 20:55:56.298466 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1530/3002] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:56 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:56.306256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:56.307598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.309991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:55:56.310725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:55:56.311223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:55:56.311637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:55:56.313389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:55:56.318655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.320138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.321189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.321826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.326660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.327175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.329710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.330426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.366151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:55:56.370187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Getting quotas for user 8b1ffd89193f4eb1b796c374eb2d26bf and project 5de129bacdaf410c9d891738fc1181f8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:55:56.381976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:55:56.384548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:55:56.392072 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a456cd44-2929-46f5-b602-e54be5207097 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.094386 Nov 06 20:55:56.396790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1531/3003] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:56 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:56.411235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.413127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.427142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.427641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.428510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.428961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.447475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4417f8aa-a931-4102-b6a7-3a257e12fc14 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877876 Nov 06 20:55:56.448856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1473/3004] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:55:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:55:56.453574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.454579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.465948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.467055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.468412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.469077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.471222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:55:56.600632 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db6bd6fc-8a0f-4423-98b8-252527fd1703 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 204 len: 0 microversion: 2.1 time: 0.202210 Nov 06 20:55:56.608473 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1532/3005] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:55:56 2021] DELETE /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:55:56.620682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfa79a84-a3d6-475e-b149-24c5b74bdc68 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.621983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bfa79a84-a3d6-475e-b149-24c5b74bdc68 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.732401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bfa79a84-a3d6-475e-b149-24c5b74bdc68 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.763821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bfa79a84-a3d6-475e-b149-24c5b74bdc68 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1208 microversion: 2.1 time: 0.151911 Nov 06 20:55:56.766865 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1533/3006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:56 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1208 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:56.781021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.781207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.781791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.791500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb2dc62b-66f8-4748-b643-3dc1fbde02b0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.338948 Nov 06 20:55:56.792106 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1474/3007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:56 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:56.797983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.798360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.799289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.799915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.801829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:56.803400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:56.814023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.814650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.815621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:56.816631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:56.942431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.953440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.954957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:56.956099 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a22bdcc6-36fe-4c1d-82ff-3e61ebea4500 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1319 microversion: 2.25 time: 0.187047 Nov 06 20:55:56.962868 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1534/3008] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:56 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:57.097078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f3e17ac3-b480-4bd1-a5a7-e097a9c26dcc req-a9c3c738-9964-4f8b-9973-78822eb89d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042a28ad-9bf3-438e-b5a1-9f84e65b443f", "name": "network-vif-unplugged", "status": "completed", "tag": "e2aa14a3-a87c-41ea-b3d8-7324c7216df6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:57.099700 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:57.099700 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:55:57.105555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:57.117966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f16676a4-4f3e-4579-abe7-e0affdd7a5cc tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.324380 Nov 06 20:55:57.119431 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1475/3009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:56 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:57.134327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f3e17ac3-b480-4bd1-a5a7-e097a9c26dcc req-a9c3c738-9964-4f8b-9973-78822eb89d1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.134777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f3e17ac3-b480-4bd1-a5a7-e097a9c26dcc req-a9c3c738-9964-4f8b-9973-78822eb89d1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.156370 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f3e17ac3-b480-4bd1-a5a7-e097a9c26dcc req-a9c3c738-9964-4f8b-9973-78822eb89d1e service nova] Creating event network-vif-unplugged:e2aa14a3-a87c-41ea-b3d8-7324c7216df6 for instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f on nch2-master-1 Nov 06 20:55:57.179281 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f3e17ac3-b480-4bd1-a5a7-e097a9c26dcc req-a9c3c738-9964-4f8b-9973-78822eb89d1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086818 Nov 06 20:55:57.186288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:57.187463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:57.188913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1535/3010] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:57.197066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.197770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.199297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.200551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.306772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:57.308024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:57.317894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.318814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.319816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.320252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.376364 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-924c4b74-5564-4f31-a194-6a59bcad5e5a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.073689 Nov 06 20:55:57.384584 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1536/3011] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:57 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:55:57.404995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:57.406609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:57.415647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.417032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.418146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.419274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.459204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:57.469645 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7eda91c3-70cf-4940-ab10-bf7675edc43b tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1542 microversion: 2.1 time: 0.288034 Nov 06 20:55:57.470563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1476/3012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:57 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:57.492138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5499972b-7b9c-4bd1-98c5-f88b5524cfaa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.090084 Nov 06 20:55:57.495005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1537/3013] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:57 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:57.784328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:57.785004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:57.794467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.794851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.795664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.796369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.811768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:57.813132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:57.825826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.827144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:57.829239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:57.830303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.154131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.162231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ee3bdf2-ec78-4d55-b4ba-071571f31553 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1260 microversion: 2.1 time: 0.382844 Nov 06 20:55:58.172131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1477/3014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:57 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1260 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:58.177810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:58.178713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:58.184751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.185205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.185992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.186663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.283756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.294865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.296663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.298207 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a0fc4e9-7767-494a-8357-a60a45e9af5b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1319 microversion: 2.25 time: 0.124706 Nov 06 20:55:58.299388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1478/3015] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:58 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:55:58.304016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:58.304742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:58.318440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.318902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.320311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.320748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.521721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.552700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c690513-31cd-4cc6-816c-613915eb18fe tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.746759 Nov 06 20:55:58.554229 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1538/3016] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:57 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:58.560599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:58.562011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:58.571271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.571938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.572823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.573431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.698438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcede925-4941-4758-8552-aaf6221ce840 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.141732 Nov 06 20:55:58.704689 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1539/3017] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:58 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:58.713919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:58.716184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:58.722116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.726121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.726777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.728067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.728717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.730185 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a291ac5e-c3c0-47f1-aff8-303420e06477 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.429494 Nov 06 20:55:58.733829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1479/3018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:58 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:58.745761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:58.746758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:58.761091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.761552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.762367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.762814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.832169 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29d690d4-747b-434f-9401-8dd9dd60c366 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.097070 Nov 06 20:55:58.836847 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1480/3019] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:58 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:58.840235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ae0e2f15-65b0-4d89-93e4-f6c780b4b6cc req-52dcfc8e-c4cc-4662-bb4e-de1f498fccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcd375a-c384-43a3-8893-4628f25ccf28", "name": "network-vif-deleted", "tag": "c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:58.841752 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:58.841752 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:58.861213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ae0e2f15-65b0-4d89-93e4-f6c780b4b6cc req-52dcfc8e-c4cc-4662-bb4e-de1f498fccd2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:58.865578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ae0e2f15-65b0-4d89-93e4-f6c780b4b6cc req-52dcfc8e-c4cc-4662-bb4e-de1f498fccd2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:58.885557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ae0e2f15-65b0-4d89-93e4-f6c780b4b6cc req-52dcfc8e-c4cc-4662-bb4e-de1f498fccd2 service nova] Creating event network-vif-deleted:c57f5cd1-9fa1-4e80-9bf4-acc0c2463b37 for instance 9fcd375a-c384-43a3-8893-4628f25ccf28 on nch2-master-1 Nov 06 20:55:58.903849 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ae0e2f15-65b0-4d89-93e4-f6c780b4b6cc req-52dcfc8e-c4cc-4662-bb4e-de1f498fccd2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067403 Nov 06 20:55:58.904702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1481/3020] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:58.922825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023f3a867df148ec83a4a74419dc34d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1824b1585947c2ad050b80ae52d273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:58.931619 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21ee9c78-cd12-4932-be34-0be46633a6ff tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 200 len: 1500 microversion: 2.1 time: 0.224180 Nov 06 20:55:58.932672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1540/3021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:58 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 1500 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:55:59.180174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:59.180857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:59.181708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7a09aaae-86a7-4c7a-9b42-2236da3cbfe7 req-c01facdb-bf2c-44c0-aa71-760c7fb47442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670bffa6-96e9-4c87-bbe6-fce23ab52b97", "tag": "2d733483-6477-4ae9-8e46-4f85e80f4465"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:59.185572 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:55:59.185572 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:55:59.189476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.189821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.190623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.191058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.201438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7a09aaae-86a7-4c7a-9b42-2236da3cbfe7 req-c01facdb-bf2c-44c0-aa71-760c7fb47442 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.202545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7a09aaae-86a7-4c7a-9b42-2236da3cbfe7 req-c01facdb-bf2c-44c0-aa71-760c7fb47442 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.221452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7a09aaae-86a7-4c7a-9b42-2236da3cbfe7 req-c01facdb-bf2c-44c0-aa71-760c7fb47442 service nova] Creating event network-changed:2d733483-6477-4ae9-8e46-4f85e80f4465 for instance 670bffa6-96e9-4c87-bbe6-fce23ab52b97 on nch2-master-1 Nov 06 20:55:59.229013 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7a09aaae-86a7-4c7a-9b42-2236da3cbfe7 req-c01facdb-bf2c-44c0-aa71-760c7fb47442 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062049 Nov 06 20:55:59.230060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1482/3022] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:55:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:55:59.320234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:59.320985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:59.336895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.337386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.339079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.342564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.709491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:59.717717 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d2b4858-8c70-4f25-a9f8-c22c396895d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.542474 Nov 06 20:55:59.718990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1541/3023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:59 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:55:59.724118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:59.724819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:59.731679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.732469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.733848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.734686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.761914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:59.773459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:59.775398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:55:59.787069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72e18140-851f-453d-aa4b-de8e6a25acbc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.474913 Nov 06 20:55:59.788651 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1483/3024] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:55:59 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:55:59.794409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:55:59.796470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:59.803790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.805225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.810116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.810712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.859737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a80a3d2-cd48-4c62-90c6-7a952de1698c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.069603 Nov 06 20:55:59.861030 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1484/3025] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:55:59 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:55:59.866637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:55:59.867472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:55:59.880701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.881169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:55:59.881979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:55:59.882457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.078329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:00.087468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87a706dd-4832-4aa3-98ae-dbc0013c8897 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.367239 Nov 06 20:56:00.088378 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1542/3026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:59 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:00.095308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:00.096619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:00.103406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.104013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.104961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.105596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.157871 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33a46403-3b6f-4f1f-b275-8af6636658fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.067989 Nov 06 20:56:00.162001 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1543/3027] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:00 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:00.167172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:00.168798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:00.170265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] [instance: 9fcd375a-c384-43a3-8893-4628f25ccf28] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:00.175799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3468fb41-6e4b-4554-b4fc-cef44d951ef9 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.313222 Nov 06 20:56:00.180333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1485/3028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:55:59 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:00.185711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.186396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.187811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.188268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.213666 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] HTTP exception thrown: Instance 9fcd375a-c384-43a3-8893-4628f25ccf28 could not be found. Nov 06 20:56:00.214508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] Returning 404 to user: Instance 9fcd375a-c384-43a3-8893-4628f25ccf28 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:00.215496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a34ddc11-b31c-4a6e-9a64-dd6a11d120ea tempest-FloatingIPsAssociationNegativeTestJSON-1671089268 tempest-FloatingIPsAssociationNegativeTestJSON-1671089268-project] 10.222.0.13 "GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28" status: 404 len: 111 microversion: 2.1 time: 0.055732 Nov 06 20:56:00.216365 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1544/3029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:00 2021] GET /compute/v2.1/servers/9fcd375a-c384-43a3-8893-4628f25ccf28 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:00.739755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:00.740745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:00.757022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.757764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.759567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.760459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.807767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:00.810678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:00.819645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.820723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:00.821635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:00.822360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.324840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:01.334370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a14b115-4e14-4fbc-8f7a-a2e0b88c1c86 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.600256 Nov 06 20:56:01.344097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:01.344773 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1486/3030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:00 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:01.350080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:01.351327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:01.354553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:01.357859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.358598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.359661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.360072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:01.360626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.364460 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ee5a73b-6f6b-4e1e-9317-8f85983e9efc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.561004 Nov 06 20:56:01.367649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1545/3031] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:00 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:01.377684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d744886e-61fe-477c-b4cd-1b774e88911f req-ccc3af3a-2976-4192-93f7-96d19813da73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58d9109-b635-447f-add3-72030026b61f", "tag": "6a116836-c0c2-4ec1-a32f-6ce08a64fad9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:01.381975 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:01.381975 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:01.398798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d744886e-61fe-477c-b4cd-1b774e88911f req-ccc3af3a-2976-4192-93f7-96d19813da73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.399672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d744886e-61fe-477c-b4cd-1b774e88911f req-ccc3af3a-2976-4192-93f7-96d19813da73 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.416451 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d744886e-61fe-477c-b4cd-1b774e88911f req-ccc3af3a-2976-4192-93f7-96d19813da73 service nova] Creating event network-changed:6a116836-c0c2-4ec1-a32f-6ce08a64fad9 for instance c58d9109-b635-447f-add3-72030026b61f on nch2-master-1 Nov 06 20:56:01.430100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e1c7f63-dc5d-41a0-9d02-a0569e9c5dac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.083716 Nov 06 20:56:01.430854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1487/3032] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:01 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:01.437996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:01.440015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d744886e-61fe-477c-b4cd-1b774e88911f req-ccc3af3a-2976-4192-93f7-96d19813da73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071111 Nov 06 20:56:01.441045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:01.442721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1546/3033] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:01.453454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:01.454747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:01.458473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.459238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.460030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.460676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.462082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.462645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.463544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.464087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.516117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a28322cb-e31c-4e4c-aef5-8929a397428f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 24542 microversion: 2.20 time: 0.066596 Nov 06 20:56:01.517280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1547/3034] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:01 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 24542 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:01.525258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:01.526110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:01.534468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.534921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:01.536040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:01.536783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.217937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.226039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29bc4bfe-395e-4417-b194-d991219e04a9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.793428 Nov 06 20:56:02.227092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1488/3035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:01 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:02.231856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042a28ad-9bf3-438e-b5a1-9f84e65b443f", "name": "network-vif-deleted", "tag": "e2aa14a3-a87c-41ea-b3d8-7324c7216df6"}, {"name": "network-changed", "server_uuid": "bacbb840-9952-44fa-a73b-0c020a3c93ba", "tag": "e871ba32-0d46-454a-a9b6-d59321c47280"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:02.233574 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:02.233574 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:02.243079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.243665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.256062 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] Creating event network-vif-deleted:e2aa14a3-a87c-41ea-b3d8-7324c7216df6 for instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f on nch2-master-1 Nov 06 20:56:02.256695 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] Creating event network-changed:e871ba32-0d46-454a-a9b6-d59321c47280 for instance bacbb840-9952-44fa-a73b-0c020a3c93ba on nch2-master-1 Nov 06 20:56:02.263803 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3687884d-dfaa-43a1-b8c7-8e8d743800fd req-9460adb7-b43a-40ba-a6f9-97e2146c8699 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035152 Nov 06 20:56:02.265058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1489/3036] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:02.267049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.279431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d057a63a-cabc-48b6-8f13-197adbb6c089 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.759570 Nov 06 20:56:02.280089 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1548/3037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:01 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:02.352955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:02.353674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:02.360466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.361215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.362395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.363403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.385338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:02.385949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:02.396213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.396696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.397485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.397909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.769713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.778220 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d83c1877-4406-4bee-9ca8-18731dd69303 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.430842 Nov 06 20:56:02.789281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1490/3038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:02 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:02.789529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.794616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:02.795777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:02.802802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.803158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.803721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.804818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.806098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.808018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:02.810043 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af96273e-f5a6-46bb-a812-a5452b635f96 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.428455 Nov 06 20:56:02.813707 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1549/3039] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:02 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:02.824014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:02.825963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:02.832928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.833663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.834848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:02.835494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:02.905705 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c4b23a6-d1f2-47c8-bd29-e910ab1f3beb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090401 Nov 06 20:56:02.907129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1550/3040] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:02 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:02.916323 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf18a54f-a300-45c8-a5b2-654da5c46db6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.125038 Nov 06 20:56:02.917638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1491/3041] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:02 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:03.245167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:03.246279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:03.256072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.256580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.257383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.260984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.297190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:03.298126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:03.333749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.334663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.335900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.336560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.744656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:03.756086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85653428-fcc2-4644-ae49-a877bbe200e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.515088 Nov 06 20:56:03.758434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1551/3042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:03 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:03.774082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:03.783621 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb8a137b-acf3-44cb-ae6b-de548119884f tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1521 microversion: 2.1 time: 0.490601 Nov 06 20:56:03.797566 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1492/3043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:03 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:03.801239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:03.802057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:03.810874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.812008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.813179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.813877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.831557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:03.832939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:03.841753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.844768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:03.845794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:03.846327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.104044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:04.114946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a35ba5d-ac5f-4716-b8d6-5f40fa79b031 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.317765 Nov 06 20:56:04.125645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1552/3044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:03 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:04.134021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:04.135586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:04.145444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.147084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.148782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.149444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.154734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:04.168844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:04.170352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:04.171465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0b7fdc8-168b-4490-82c7-fc57a4eba44b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.343975 Nov 06 20:56:04.175005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1493/3045] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:03 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:04.190517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:04.191494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:04.199656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aabb40c1-a670-4b1b-bf5e-3ad33a2ccf1a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.072285 Nov 06 20:56:04.200135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.200757 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1553/3046] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:04 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:04.204623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.205783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.206535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.265978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-695f1c9e-2a39-4316-8fbe-b842d82365bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.079170 Nov 06 20:56:04.267405 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1494/3047] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:04 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:04.342326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-549927de-9da4-47d8-809d-0d62e67c0433 req-5e848105-db85-43dd-910c-fc73aa981862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d9c005-dc47-4fb6-ac23-fdeada22a300", "name": "network-vif-deleted", "tag": "73c5bd90-3d67-4158-bff8-91e07f8a029b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:04.343893 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:04.343893 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:04.359089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-549927de-9da4-47d8-809d-0d62e67c0433 req-5e848105-db85-43dd-910c-fc73aa981862 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.359730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-549927de-9da4-47d8-809d-0d62e67c0433 req-5e848105-db85-43dd-910c-fc73aa981862 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.373843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-549927de-9da4-47d8-809d-0d62e67c0433 req-5e848105-db85-43dd-910c-fc73aa981862 service nova] Creating event network-vif-deleted:73c5bd90-3d67-4158-bff8-91e07f8a029b for instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 on nch2-master-1 Nov 06 20:56:04.380209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-549927de-9da4-47d8-809d-0d62e67c0433 req-5e848105-db85-43dd-910c-fc73aa981862 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042324 Nov 06 20:56:04.381409 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1554/3048] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:04.774336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:04.775662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:04.783307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.784037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.785045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.785795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.803325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:04.804679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:04.818366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.819133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.820141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.823816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.874643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:04.875410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:04.876047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lazy-loading 'fault' on Instance uuid 02d9c005-dc47-4fb6-ac23-fdeada22a300 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:04.943986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db226fb557e4c0aa2e15fcc8d7a488d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046b2d11820348118cbe7a156018a1a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:04.953775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12a3fd5b-005a-4626-b647-6c8269dc0d12 tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 200 len: 1312 microversion: 2.1 time: 0.154804 Nov 06 20:56:04.971576 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1555/3049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:04 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:05.134586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:05.135635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:05.143906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.144986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.146047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.146816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.462488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:05.481080 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64e21b6f-a75b-4add-9884-185fbac200b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.711159 Nov 06 20:56:05.482864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1495/3050] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:04 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:05.487613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:05.490059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:05.501147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.504958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.506158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.509423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.647360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:05.655143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eaac6794-a229-453e-ae86-e2c78458d2f2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.525702 Nov 06 20:56:05.656196 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1556/3051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:05 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:05.661615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:05.662740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:05.669288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.669963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.671054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.671636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.747926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7de1cba-a84b-465b-bc2b-083884eeca8a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090190 Nov 06 20:56:05.754832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1557/3052] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:05 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:05.763844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:05.765201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:05.775550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.776973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.777970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.778649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.797007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:05.805793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:05.809630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:05.812235 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5e7b037-d2d1-4821-bb88-7e990735d06e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.328156 Nov 06 20:56:05.814657 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1496/3053] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:05 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:05.843381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b4791c8-7783-41a4-9be2-a65a5eb10117 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.086399 Nov 06 20:56:05.844627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1558/3054] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:05 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:05.972433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:05.973819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] [instance: 02d9c005-dc47-4fb6-ac23-fdeada22a300] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:05.983465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.990199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:05.991133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:05.991584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.010934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] HTTP exception thrown: Instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 could not be found. Nov 06 20:56:06.011565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] Returning 404 to user: Instance 02d9c005-dc47-4fb6-ac23-fdeada22a300 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:06.012792 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9561bdb1-2858-46cb-97ac-bdbea88918df tempest-ServerRescueNegativeTestJSON-1374481399 tempest-ServerRescueNegativeTestJSON-1374481399-project] 10.222.0.13 "GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300" status: 404 len: 111 microversion: 2.1 time: 0.043622 Nov 06 20:56:06.013567 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1497/3055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:05 2021] GET /compute/v2.1/servers/02d9c005-dc47-4fb6-ac23-fdeada22a300 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:06.499377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:06.500239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:06.507395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.507851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.508668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.509102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.674150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:06.675029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:06.685318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.686250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.687960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.690347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.853465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:06.875653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5291a84-ba6d-434c-b11d-ad7ab18ed01c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.379615 Nov 06 20:56:06.877002 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1559/3056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:06 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:06.886673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:06.890510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:06.900313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.901933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.903050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.903829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.974526 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b1eebd3-4099-489c-acee-b9b9155f64b6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.094400 Nov 06 20:56:06.976732 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1560/3057] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:06 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:06.985248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:06.986970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:06.997340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:06.998424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:06.999530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:07.001569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:07.183875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:07.210116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53a6d100-0918-43a5-8ebd-bd3d983acc21 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.540505 Nov 06 20:56:07.211406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1498/3058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:06 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:07.216091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:07.217396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:07.225306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:07.225987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:07.226593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:07.227955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:07.280123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37539637-4c5c-42c2-8cb6-65dd6ea2e3f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066871 Nov 06 20:56:07.288903 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1499/3059] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:07 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:07.369072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:07.377562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:07.379245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:07.380443 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d5a4b70-c3b3-4e76-9633-08988d5bc6b2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.402204 Nov 06 20:56:07.391439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1561/3060] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:06 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:07.894348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:07.895295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:07.906579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:07.907317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:07.908488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:07.909197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:07.987384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:07.989984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:08.003181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.004131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.005245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.006631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.079575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad53cc93-b621-4e01-bcf6-8e6a945b0578 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090907 Nov 06 20:56:08.080634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1562/3061] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:07 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:08.230258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:08.230961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:08.238118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.243723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:08.251727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa0106a1-8ba5-41b1-996a-23f0ef8fee21 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.361544 Nov 06 20:56:08.252047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.263398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.264243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.264697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1500/3062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:07 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:08.295460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:08.296765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:08.308814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.309547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.310560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.311172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.372283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ae655d1-3a4c-4831-aae3-f7974321771c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.080270 Nov 06 20:56:08.377923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1501/3063] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:08 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:08.400077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:08.400732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:08.409967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.409967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.411227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:08.411680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:08.724411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:08.739195 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89773a73-40ec-4665-94ae-b34be1fd2685 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.511088 Nov 06 20:56:08.741040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1563/3064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:08 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:08.799858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:08.819581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:08.822872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:08.825361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b1d2a3e-380a-4efa-b995-1e48face0d15 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.429531 Nov 06 20:56:08.837905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1502/3065] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:08 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:09.098881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:09.100822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:09.146849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.147650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.148701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.149310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.210006 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d62f2928-008a-468f-a62f-e9e7f05af27b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.120045 Nov 06 20:56:09.211527 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1564/3066] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:09 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:09.271058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:09.274910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:09.286366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.289633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.290492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.291378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.397223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:09.400283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:09.418107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.420346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.424637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.425355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.652107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ab897cd-b92e-445f-bf4a-a3890421dfce tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.266231 Nov 06 20:56:09.654824 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1565/3067] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:09 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:09.663420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-88f1b361-04a1-431c-a6b0-aaef32fc4dc7 req-429cf68e-33c7-4a01-aa3b-2808b432e357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670bffa6-96e9-4c87-bbe6-fce23ab52b97", "name": "network-vif-plugged", "status": "completed", "tag": "2d733483-6477-4ae9-8e46-4f85e80f4465"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:09.665479 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:09.665479 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:09.682299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-88f1b361-04a1-431c-a6b0-aaef32fc4dc7 req-429cf68e-33c7-4a01-aa3b-2808b432e357 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.683501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-88f1b361-04a1-431c-a6b0-aaef32fc4dc7 req-429cf68e-33c7-4a01-aa3b-2808b432e357 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.703617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-88f1b361-04a1-431c-a6b0-aaef32fc4dc7 req-429cf68e-33c7-4a01-aa3b-2808b432e357 service nova] Creating event network-vif-plugged:2d733483-6477-4ae9-8e46-4f85e80f4465 for instance 670bffa6-96e9-4c87-bbe6-fce23ab52b97 on nch2-master-1 Nov 06 20:56:09.720797 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-88f1b361-04a1-431c-a6b0-aaef32fc4dc7 req-429cf68e-33c7-4a01-aa3b-2808b432e357 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061062 Nov 06 20:56:09.748949 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1566/3068] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:09.787756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:09.791673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:09.826032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.826867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.828687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.829640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.909293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:09.918408 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ede1386b-e520-4aa6-8477-7e9452a32b72 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.651114 Nov 06 20:56:09.919351 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1503/3069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:09 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:09.935742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:09.937281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:09.946912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.948442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:09.949631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:09.950860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.213100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:10.242907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-437fbb99-a3ea-4af1-b343-d5c5113937ea tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.476704 Nov 06 20:56:10.256407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1567/3070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:09 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:10.264795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:10.270451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:10.289999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.290742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.291873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.292397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.356398 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-939aa079-b2e0-4a41-9f66-03960b009c5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.107035 Nov 06 20:56:10.357317 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1568/3071] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:10 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:10.403407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:10.414067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:10.416608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:10.417935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3525e720-2631-4772-a627-d01300e9c32c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.497647 Nov 06 20:56:10.419143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1504/3072] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:09 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:10.550231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2143459535", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:10.613817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:10.668212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:10.669918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:10.684793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.685842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.686930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.687762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.758128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e8a6de6-53e6-4699-850a-2198ba5685a2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.089226 Nov 06 20:56:10.758128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1505/3073] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:10 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:10.937407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:10.938518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:10.946450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.947281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:10.948329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:10.949051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.105606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:11.106431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:11.107423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:11.108199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:11.111810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:11.123917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.125406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.126625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.127798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.150692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Getting quotas for project bc42ff18c5cc4af1bad1e1d62c7c5f18. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:11.157636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Getting quotas for user 3f844077aaaf4d1cab10136ac329c358 and project bc42ff18c5cc4af1bad1e1d62c7c5f18. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:11.189915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:11.192912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:11.219233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:11.227837 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f5b0399-a5d6-410f-8e46-06f0d0f1dc69 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1315 microversion: 2.1 time: 0.294709 Nov 06 20:56:11.229995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1506/3074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:10 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:11.268375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:11.269278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:11.293478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.293938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.294742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.295183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.306809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f44b979-b339-4afd-b65c-030c77abc107 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927440 Nov 06 20:56:11.310041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1569/3075] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:56:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:56:11.323185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-227315a6-8309-47e4-b4bb-2a667af2a101 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:11.324281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-227315a6-8309-47e4-b4bb-2a667af2a101 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:11.432550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-227315a6-8309-47e4-b4bb-2a667af2a101 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:11.440081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-227315a6-8309-47e4-b4bb-2a667af2a101 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1216 microversion: 2.1 time: 0.125633 Nov 06 20:56:11.443804 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1570/3076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:11 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:11.455920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:11.458453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:11.467872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.468146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.469611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.470116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.542826 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0cd72a3f-7f74-4dbc-8906-be2042ccbab9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.097373 Nov 06 20:56:11.546919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1571/3077] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:11 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:11.562353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:11.567825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:11.585065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.585522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.586353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.586882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.675799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:11.683556 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-240747b5-53f1-4d8b-99ef-f586616bc4aa tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.421734 Nov 06 20:56:11.694353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1507/3078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:11 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:11.769666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:11.771438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:11.788730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.792783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.794441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.794781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.884629 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd1dbbf6-a0a9-4b70-8279-cc015c2aeca2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.121495 Nov 06 20:56:11.890609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1508/3079] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:11.899488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58d9109-b635-447f-add3-72030026b61f", "name": "network-vif-plugged", "status": "completed", "tag": "6a116836-c0c2-4ec1-a32f-6ce08a64fad9"}, {"server_uuid": "bacbb840-9952-44fa-a73b-0c020a3c93ba", "name": "network-vif-plugged", "status": "completed", "tag": "e871ba32-0d46-454a-a9b6-d59321c47280"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:11.906155 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:11.906155 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:11.924041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:11.924620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:11.967755 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] Creating event network-vif-plugged:6a116836-c0c2-4ec1-a32f-6ce08a64fad9 for instance c58d9109-b635-447f-add3-72030026b61f on nch2-master-1 Nov 06 20:56:11.968186 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] Creating event network-vif-plugged:e871ba32-0d46-454a-a9b6-d59321c47280 for instance bacbb840-9952-44fa-a73b-0c020a3c93ba on nch2-master-1 Nov 06 20:56:11.975500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-76c7c4e8-bff2-4a39-b8e1-133b667dfb67 req-26db9069-722d-4f37-9832-746babb28cee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083333 Nov 06 20:56:11.976820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1509/3080] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:11 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:12.207029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:12.220139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:12.222481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:12.225091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b842527e-a6a1-4a07-9791-ca33a797f80c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.675066 Nov 06 20:56:12.237403 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1572/3081] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:11 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:12.247280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:12.247987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:12.254939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.255404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.256215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.256711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.451876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:12.458873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:12.460237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:12.464020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b6d4a52-58b0-4424-9e56-55281ec8698a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1501 microversion: 2.1 time: 0.221225 Nov 06 20:56:12.468668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1510/3082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:12 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1501 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:12.469748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.470456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.471538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.473974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.481293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4c157ba-a346-45f0-9660-406094e8ac1b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:12.490442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c157ba-a346-45f0-9660-406094e8ac1b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.490914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4c157ba-a346-45f0-9660-406094e8ac1b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.559169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:12.567107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa36122d-2114-453b-afef-544d82ac4aad tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1212 microversion: 2.1 time: 0.111859 Nov 06 20:56:12.577441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1573/3083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:12 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1212 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:12.578033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4c157ba-a346-45f0-9660-406094e8ac1b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Going to try to stop instance {{(pid=134828) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 20:56:12.584232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:12.585580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:12.592911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.593436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.595563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.595563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.637787 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4c157ba-a346-45f0-9660-406094e8ac1b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97/action" status: 202 len: 0 microversion: 2.1 time: 0.160059 Nov 06 20:56:12.639571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1511/3084] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:56:12 2021] POST /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:12.765537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-628919319", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": "none"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:12.821940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:12.822441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:12.822910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:12.823589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:12.824237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:12.835845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.836500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9926612e-7566-48e3-93e5-5dcecea88ff8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.266701 Nov 06 20:56:12.837225 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1574/3085] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:12 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:12.837783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.838979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.839648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.845888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:12.851225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:12.861525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Getting quotas for project 4661d53a03444645b01499f756e32627. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:12.866148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Getting quotas for user f0a7b03418f54292ab9e70a1a36622ba and project 4661d53a03444645b01499f756e32627. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:12.877773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:12.880934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:12.883325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.883790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.884624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.885303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.943762 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-711115db-d283-49e9-9ae9-0fcbce554e9e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.302515 Nov 06 20:56:12.945322 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1512/3086] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:56:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:56:12.951738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:12.952803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:12.962327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.963168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:12.964266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:12.965130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.124666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.138099 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-839d1db4-1df2-4c7d-bade-f6f144a6abb2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.299327 Nov 06 20:56:13.139194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1575/3087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:12 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:13.157422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:13.158622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:13.167118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.167592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.168577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.169127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.198619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.206986 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f4fe5a1-582c-438d-b523-68dfffcc1392 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.259594 Nov 06 20:56:13.208343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1513/3088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:12 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:13.217371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:13.217371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:13.234914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f2ec074-dbd8-4fdc-b1b5-ae7c29bbe41b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094258 Nov 06 20:56:13.239908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1576/3089] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:13 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:13.246678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:13.248446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:13.257857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.258298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.259314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.259944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.296736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.304378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.305904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.307098 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a76676f-b8ef-4432-b861-c29bdeb22248 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1277 microversion: 2.57 time: 0.097651 Nov 06 20:56:13.318888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1514/3090] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:13 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:13.446245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.461102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.464846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.467389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d478a21b-4695-43ef-bf10-9526c348bfc1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1361 microversion: 2.25 time: 0.225973 Nov 06 20:56:13.468009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1577/3091] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:13 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:13.591337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:13.593180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:13.614082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.615137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.617036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.618406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.767187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:13.776665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b7d664d-fb2f-4536-af55-8ab482ba3dc6 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1286 microversion: 2.1 time: 0.194230 Nov 06 20:56:13.791925 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1515/3092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:13 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:13.849893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:13.852541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:13.870428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.873544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.874571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:13.875132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:13.934021 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd29816b-9fba-4eca-a21f-3a3e195d154e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.088825 Nov 06 20:56:13.934684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1578/3093] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:13 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:14.157241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:14.158196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.167128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.167634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.168506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.169173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.226373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:14.227334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.243173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.254084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.255280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.255912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.456788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.467452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c68f4d69-0391-4c1c-9008-8c4f9cee0acd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.314721 Nov 06 20:56:14.468956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1516/3094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:14 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:14.482550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:14.484201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.498962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.500990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.502103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.502770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.573304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.584702 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac983846-071f-4fce-8268-87d81d59fc17 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1308 microversion: 2.1 time: 0.363312 Nov 06 20:56:14.598558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1579/3095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:14 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:14.604137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:14.604926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.613294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.613759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.614695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.615194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.691947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.701284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.704032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.705439 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e6a872b-522f-4859-94c2-7ddf0c117869 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1335 microversion: 2.57 time: 0.105532 Nov 06 20:56:14.706182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1580/3096] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:14 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:14.718358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:14.719242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.733561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.734013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.734878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.735236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.812274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-027b7eab-18ad-47f2-9e6b-bf7882895649 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.340621 Nov 06 20:56:14.823832 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1517/3097] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:14 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:14.830856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:14.832534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.844235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.844853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.845781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.846329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.938024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.953921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.955550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:14.957110 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff1f556d-b0f5-44d9-afb3-ffb8c8439fd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1556 microversion: 2.25 time: 0.249007 Nov 06 20:56:14.957667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1581/3098] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:14 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:14.976584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:14.977830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:14.986217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.986782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:14.987457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:14.987898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.059023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18c940dc-169b-486a-b74f-3fbc12bb9b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.088822 Nov 06 20:56:15.060695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1582/3099] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:14 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:15.066957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:15.067919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:15.071239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.075581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.076270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.077832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.078306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.078985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b2fe6ed-ff82-4df6-92f7-b4388fc86f58 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.253103 Nov 06 20:56:15.088425 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1518/3100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:14 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:15.296092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:15.312393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7fcdd0e-d9ee-41d5-a66c-4032514ff30f tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 2048 microversion: 2.25 time: 0.249929 Nov 06 20:56:15.325117 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1583/3101] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:15 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 2048 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:15.329834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:15.331478 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:15.331478 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:15.333830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.334300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.335288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.335775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.370412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-748e7a1d-fc2d-4c7c-bb3b-9f250d01c87d tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044591 Nov 06 20:56:15.370997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1519/3102] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Nov 6 20:56:15 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:56:15.487515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:15.488779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:15.498024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.498481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.499838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.500286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.616233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:15.618490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:15.632842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.633657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.634683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.635420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.755771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.763965 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27955d80-7974-4444-8c9c-e8613cdf69f0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.281724 Nov 06 20:56:15.765220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1584/3103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:15 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:15.770478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:15.772166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:15.781193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.781915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.783089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.783755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.898205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.910977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90c567e0-9d89-41a5-9658-96d8fbf24e43 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1487 microversion: 2.1 time: 0.309248 Nov 06 20:56:15.911913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1520/3104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:15 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1487 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:15.916996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:15.922312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.931444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:15.932948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.935232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:15.945947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c42db13f-59a2-412f-b842-d45ef5d0190e tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1335 microversion: 2.57 time: 0.170381 Nov 06 20:56:15.950328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.950794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.955250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.955752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.959292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1585/3105] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:15 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1335 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:15.967610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d426c88d-a388-4997-8fe3-cb32de01d7dd req-201efb3d-0186-4abc-b221-ea973c0789f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0996b95-7820-4da7-ac82-6c25563512ed", "tag": "1ff5f294-9386-44eb-971a-6cfc9daf261b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:15.969617 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:15.969617 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:15.977516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d426c88d-a388-4997-8fe3-cb32de01d7dd req-201efb3d-0186-4abc-b221-ea973c0789f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:15.978251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d426c88d-a388-4997-8fe3-cb32de01d7dd req-201efb3d-0186-4abc-b221-ea973c0789f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:15.994922 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d426c88d-a388-4997-8fe3-cb32de01d7dd req-201efb3d-0186-4abc-b221-ea973c0789f2 service nova] Creating event network-changed:1ff5f294-9386-44eb-971a-6cfc9daf261b for instance f0996b95-7820-4da7-ac82-6c25563512ed on nch2-master-1 Nov 06 20:56:16.001176 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d426c88d-a388-4997-8fe3-cb32de01d7dd req-201efb3d-0186-4abc-b221-ea973c0789f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040636 Nov 06 20:56:16.002536 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1586/3106] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:16.010632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1587941924"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:16.012354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:16.015312 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fbc85628-fb6e-4ee3-b92d-767b3c77e082 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.101710 Nov 06 20:56:16.016087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1521/3107] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:16.018995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.020280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.021128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.021567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.073632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:16.076154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:16.092055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.093829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.094948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.096080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.159122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d81fb8d5-a696-4350-9de8-db1c0871700a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090603 Nov 06 20:56:16.163301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1522/3108] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:16 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:16.166166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.167488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:16.175867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.176610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.177669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.178285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.348418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:16.351669 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ea9fdc8-586f-4472-b4eb-7b577063d0c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "POST /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f/action" status: 202 len: 0 microversion: 2.1 time: 0.347154 Nov 06 20:56:16.356357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1587/3109] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:56:16 2021] POST /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:56:16.362887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5a13c62-b501-48f4-a3ff-f50d0afd900c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.201184 Nov 06 20:56:16.364508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1523/3110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:16.373802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be451f81-5438-4f45-8aa6-c7bbd38ee2b2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6716558b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.409731 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be451f81-5438-4f45-8aa6-c7bbd38ee2b2 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d" status: 200 len: 1414 microversion: 2.1 time: 0.051125 Nov 06 20:56:16.410508 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1588/3111] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d => generated 1414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:16.423026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92b3433c-7a40-459f-a78a-bf3d4ae364f7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ac44d30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.479188 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92b3433c-7a40-459f-a78a-bf3d4ae364f7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d" status: 200 len: 1414 microversion: 2.1 time: 0.059396 Nov 06 20:56:16.479783 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1524/3112] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:16.492359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7065763c-73b8-4be1-bbd6-686e6660a42f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67151c51f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.657301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7065763c-73b8-4be1-bbd6-686e6660a42f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d" status: 204 len: 0 microversion: 2.1 time: 0.169734 Nov 06 20:56:16.661831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1589/3113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:16 2021] DELETE /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:16.667365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2254383-4f6b-4ab8-9dd2-adf22c2606f5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671ad2c4c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.689604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b2254383-4f6b-4ab8-9dd2-adf22c2606f5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Image not found. Nov 06 20:56:16.690299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2254383-4f6b-4ab8-9dd2-adf22c2606f5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:16.691965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2254383-4f6b-4ab8-9dd2-adf22c2606f5 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d" status: 404 len: 62 microversion: 2.1 time: 0.029129 Nov 06 20:56:16.692789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1525/3114] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 20:56:16.701018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.701826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:16.710218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.710768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.711635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.712163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.784681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:16.785817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:16.793770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.794231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:16.795025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:16.795462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.069294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.078445 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56fbd5f6-a5ce-4cda-95ab-e301643bf346 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1499 microversion: 2.1 time: 0.380150 Nov 06 20:56:17.079619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1590/3115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1499 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:17.086675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa98b723-a4ea-4a19-a28c-a7cff197c3af", "device": "/dev/xvdb"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:17.089798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:17.096331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.097119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.098937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.099530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.155125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.168768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b6aed1b-88ea-469a-bf70-ac73fb18c1cf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.389719 Nov 06 20:56:17.171515 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1526/3116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:16 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:17.177575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:17.178463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:17.185908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.186382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.187440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.187965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.270709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.280502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.282139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.283306 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f805e99d-1592-4338-aeef-e40d2e3d5bf9 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1335 microversion: 2.57 time: 0.110232 Nov 06 20:56:17.284766 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1527/3117] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:17 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:17.290015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:17.291473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:17.298380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.298836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.299668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.300201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.344671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9477fb7-7731-4da4-b3a6-2dcd63bd9940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.057677 Nov 06 20:56:17.350900 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1528/3118] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:17 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:17.357002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:17.358037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:17.365649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.366220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.367064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.367623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.372752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "POST /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.290267 Nov 06 20:56:17.374650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1591/3119] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Nov 6 20:56:17 2021] POST /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:56:17.393901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:17.395527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:17.402243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.403207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.404174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:17.405083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:17.425687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-955824bd-486a-4a8c-bde9-5f13b8bd67af tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.072943 Nov 06 20:56:17.430644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1529/3120] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:17 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:17.660808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:17.670631 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24e19d37-4fa7-4452-90fb-c8e6b4290c0e tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.283287 Nov 06 20:56:17.671679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1592/3121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:17 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:18.097005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:18.098394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.105790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.106616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.107544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.108378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.187514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:18.188165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.194834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.195296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.196091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.196570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.380079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.392588 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-442248bd-ac85-4e18-b898-abac11da09ec tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1499 microversion: 2.1 time: 0.299374 Nov 06 20:56:18.393523 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1530/3122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:18 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1499 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:18.403829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:18.405004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.411913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.412406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.413220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.413665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.434979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.443587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68b4de41-82b0-4c5b-be44-5172b5190128 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.259728 Nov 06 20:56:18.444168 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1593/3123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:18 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:18.462087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:18.463520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.472996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.473461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.474262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.474702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.493643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.501770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.506727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.507993 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-938df72f-ac32-4c55-9eb2-43b604370761 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1335 microversion: 2.57 time: 0.113138 Nov 06 20:56:18.508566 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1531/3124] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:18 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:18.520486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:18.521467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.523562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34de2cad-e5de-4ac6-b63d-8906cb62a363 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066090 Nov 06 20:56:18.524784 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1594/3125] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:18.529038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.529497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.530303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.530746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.629739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f14aa09-dc90-4056-9fd2-63c098ba8482 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.119193 Nov 06 20:56:18.633776 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1532/3126] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:18 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:18.687285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:18.687982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:18.695500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.695960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.696770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:18.697213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:18.843017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:18.851252 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04328292-58e2-464b-b73c-f323b7cb9341 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.167975 Nov 06 20:56:18.861181 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1595/3127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:18 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:19.411058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:19.411989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.419801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.420254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.421067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.421503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.460626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:19.461442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.470773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.471406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.472273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.473382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.623789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:19.632906 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd9cae41-9977-42a5-85e0-8ee85928ba75 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1505 microversion: 2.1 time: 0.226423 Nov 06 20:56:19.635114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1533/3128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:19 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:19.641037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:19.642430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.650358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.650947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.651850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.652421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.690922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:19.700723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26f4743b-3efe-4862-9635-69c52230e9ac tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.244184 Nov 06 20:56:19.701991 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1596/3129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:19 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:19.716079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:19.717385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.725222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.725997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.727126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.727795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.734630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:19.761610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:19.763258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:19.764891 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45398e9a-a6e1-4c53-90bc-9a055536c8cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1335 microversion: 2.57 time: 0.128082 Nov 06 20:56:19.765518 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1534/3130] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:19 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:19.771149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:19.772174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.782128 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-addd90c6-5c8f-43de-a675-0ac650adcac8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.078574 Nov 06 20:56:19.783046 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1597/3131] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:19 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:19.783718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.784181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.785090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.785532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.828089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4dd35f5-dab7-4fc4-a25c-7bea7891051e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.060979 Nov 06 20:56:19.828929 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1535/3132] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:19 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:19.874735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:19.875526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:19.883256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.883707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:19.884529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:19.884961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.047092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:20.057379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-44aaea92-49db-4b4f-9158-72cc5e0fda5c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.188353 Nov 06 20:56:20.058412 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1598/3133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:19 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:20.654452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:20.655154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:20.664030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.664776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.665803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.666915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.693954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:20.695528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:20.703182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.703654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.704936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.705581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.870178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:20.878669 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df561ad7-f194-4c92-b31f-3f047d8a5461 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1505 microversion: 2.1 time: 0.228260 Nov 06 20:56:20.881485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1536/3134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:20 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:20.888113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:20.889090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:20.897564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.898905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.900900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.901697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.942012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:20.984050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91db13a4-bf9f-4a74-9210-dedd26ec5200 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 2126 microversion: 2.25 time: 0.287281 Nov 06 20:56:20.985294 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1599/3135] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:20 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 2126 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:20.990236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:20.990904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:20.997216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.997670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:20.998470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:20.998956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.118402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:21.135034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:21.142586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:21.143842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7acb84d-6a7b-488f-b3b0-99c1e24a114c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1356 microversion: 2.57 time: 0.157690 Nov 06 20:56:21.157464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1600/3136] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:20 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:21.157464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:21.157464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.168253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.168894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.173153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.175032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.184505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:21.197533 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b34be499-7b81-4764-b151-d61639227854 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.313179 Nov 06 20:56:21.198580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1537/3137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:20 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:21.209839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:21.213167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.226422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.227396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.227729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.228506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.275120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-013c3e92-8f05-4bf7-a448-851fa46776bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.127806 Nov 06 20:56:21.276597 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1601/3138] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:21.282497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9c43b58-006c-4442-aa18-68ceeddf050a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.082394 Nov 06 20:56:21.287038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1538/3139] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:21 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:21.287215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:21.287215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.294617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.295447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.296551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.296890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:21.297656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.297790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.317904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.318378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.319196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.319643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.353696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'flavor' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:21.389780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Going to try to live migrate instance to nch1-master-1 {{(pid=134827) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:56:21.506059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:21.516005 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4ed0658-378f-4cf3-b364-4f5914c16c22 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.227090 Nov 06 20:56:21.517021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1539/3140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:21 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:21.525561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:21.530005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.539410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.541255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.542824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.543525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.655468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:21.656004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:21.656400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:21.656811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:21.657219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:21.746133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.753355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.754802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.757165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.761382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.825783 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78170380-5c9c-491a-a7b7-eed01b6f3ad1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "POST /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405/action" status: 202 len: 1137 microversion: 2.57 time: 0.307548 Nov 06 20:56:21.826644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1540/3141] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Nov 6 20:56:21 2021] POST /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405/action => generated 1137 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 06 20:56:21.846620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-952ad951-2515-44b9-aa03-45a0c9d3bedd req-6b0fb4a4-eba5-46c2-9e6b-bf4d177b6390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58d9109-b635-447f-add3-72030026b61f", "name": "network-vif-plugged", "status": "completed", "tag": "6a116836-c0c2-4ec1-a32f-6ce08a64fad9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:21.856221 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:21.856221 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:21.874127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-952ad951-2515-44b9-aa03-45a0c9d3bedd req-6b0fb4a4-eba5-46c2-9e6b-bf4d177b6390 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.876194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-952ad951-2515-44b9-aa03-45a0c9d3bedd req-6b0fb4a4-eba5-46c2-9e6b-bf4d177b6390 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.900166 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-952ad951-2515-44b9-aa03-45a0c9d3bedd req-6b0fb4a4-eba5-46c2-9e6b-bf4d177b6390 service nova] Creating event network-vif-plugged:6a116836-c0c2-4ec1-a32f-6ce08a64fad9 for instance c58d9109-b635-447f-add3-72030026b61f on nch2-master-1 Nov 06 20:56:21.922174 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-952ad951-2515-44b9-aa03-45a0c9d3bedd req-6b0fb4a4-eba5-46c2-9e6b-bf4d177b6390 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093461 Nov 06 20:56:21.925846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1541/3142] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:21.936668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:21.940984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:21.955935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.956622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:21.958218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:21.959782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.090525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:22.101960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:22.104169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:22.105897 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89619130-4926-42bc-b670-36c5ce8c872c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.178772 Nov 06 20:56:22.112869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1542/3143] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:21 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:22.120062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:22.121170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:22.129513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.130248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.131371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.132436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.329540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:22.342576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e262d71b-99be-4090-a0c6-d9d98dd68b26 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1505 microversion: 2.1 time: 0.224673 Nov 06 20:56:22.342576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1543/3144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:22 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:22.356634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:22.357547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:22.366433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.369373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.371723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.372799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.734297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:22.743909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e07eba8-108c-4403-92f8-02a7ace3a807 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.391751 Nov 06 20:56:22.745229 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1544/3145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:22 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:22.754512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:22.755880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:22.765397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.765645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.766289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.766748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.834829 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73d1d4bf-b219-401a-b5ea-033041a8e1e3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.087373 Nov 06 20:56:22.836476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1545/3146] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:22 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:22.845201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:22.846568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:22.857417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.858038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.859436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.860373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.929048 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8702e34b-c832-48e7-935a-165f70a0c1ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090196 Nov 06 20:56:22.932887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1546/3147] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:22 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:22.942030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:22.942772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:22.955747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.956211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:22.957680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:22.958119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.227776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.238728 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c736824f-ad6b-4ba8-9b37-9df56197edac tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.303638 Nov 06 20:56:23.239456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1547/3148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:22 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:23.252435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:23.254193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.266173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.269848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.271090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.271434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.370361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.380548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.382377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.383612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca03bbca-2d71-4b67-902b-a73042040c86 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.142567 Nov 06 20:56:23.395829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1548/3149] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:23 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:23.398374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/action" status: 202 len: 0 microversion: 2.25 time: 2.120177 Nov 06 20:56:23.399299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1602/3150] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:21 2021] POST /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/action => generated 0 bytes in 2122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:23.404795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:23.405667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.408243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:23.410406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.416231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.417056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.418210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.419726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.419992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.420534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.421549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.422238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.758029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.759272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.772177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db3f173c-2d30-49d3-80a1-1cc9f7b34b8b tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1505 microversion: 2.1 time: 0.373059 Nov 06 20:56:23.773642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1549/3151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:23 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:23.774727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.776596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:23.777809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-033dff5e-9d06-4f0b-9dcc-1808c3ecd8b6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.374466 Nov 06 20:56:23.780575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:23.781487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.782559 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1603/3152] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:23 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:23.792106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.792946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.793964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.794593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.847098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:23.848982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.857030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.857876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.858899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.859596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.965009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0b47b0b-c77d-440e-8981-39602aea8755 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.121219 Nov 06 20:56:23.966124 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1604/3153] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:23.971624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:23.975270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:23.983787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.984786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:23.985908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:23.986516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.050310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:24.058747 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-380faf2e-2427-458e-b03d-997697844e3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.283656 Nov 06 20:56:24.059347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1550/3154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:23 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:24.107758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7f5524c-2ef8-4f87-b699-6ddec8f43a01 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.140086 Nov 06 20:56:24.108987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1605/3155] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:23 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:24.256079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:24.256718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:24.267006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.268269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.270759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.271456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.406768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:24.407502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:24.415236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.416237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.417246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.417682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.755814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:24.768609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:24.771213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:24.772728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-050f388b-afee-4004-8fd2-0b17e0317ec5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.372039 Nov 06 20:56:24.773909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1606/3156] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:24 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:24.807108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:24.808319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:24.819528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.820738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.821991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:24.822690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:24.955031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:24.962840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f8131dc-793f-4fbb-9397-d040f13ab333 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.710734 Nov 06 20:56:24.972891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1551/3157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:24 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:24.972891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:24.972891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:24.999830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.000641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.001469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.002103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.199123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.207677 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2488871a-3b2e-4180-9472-e7bd9230a85e tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1487 microversion: 2.1 time: 0.405473 Nov 06 20:56:25.212641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1607/3158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:24 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1487 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:25.217835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:25.224359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.234666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.235339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.239052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.239496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.290647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.299382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.302039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.303430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c9b00f2-9c91-45c3-869d-293a47cceadf tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.338524 Nov 06 20:56:25.314412 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1552/3159] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:24 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:25.325681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.326568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.327880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5e7badf-73bb-4d4e-8b3d-08b33957b1a4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.113367 Nov 06 20:56:25.328776 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1608/3160] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:25 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:25.336958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:25.338339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.342775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.343149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.344031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.344686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.353566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.354431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.364007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.365711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.440350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9011057-8872-41e5-bbe2-131a59a3607b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.109836 Nov 06 20:56:25.441325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1609/3161] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:25 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:25.453934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d82a79a6-1528-4c44-879d-2a42b0ba4eb3 req-4466abe4-a573-41cc-8501-eaf3fdd5b5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0996b95-7820-4da7-ac82-6c25563512ed", "name": "network-vif-plugged", "status": "completed", "tag": "1ff5f294-9386-44eb-971a-6cfc9daf261b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:25.459588 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:25.459588 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:25.476611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d82a79a6-1528-4c44-879d-2a42b0ba4eb3 req-4466abe4-a573-41cc-8501-eaf3fdd5b5ac service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.479105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d82a79a6-1528-4c44-879d-2a42b0ba4eb3 req-4466abe4-a573-41cc-8501-eaf3fdd5b5ac service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.513379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d82a79a6-1528-4c44-879d-2a42b0ba4eb3 req-4466abe4-a573-41cc-8501-eaf3fdd5b5ac service nova] Creating event network-vif-plugged:1ff5f294-9386-44eb-971a-6cfc9daf261b for instance f0996b95-7820-4da7-ac82-6c25563512ed on nch2-master-1 Nov 06 20:56:25.520725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d82a79a6-1528-4c44-879d-2a42b0ba4eb3 req-4466abe4-a573-41cc-8501-eaf3fdd5b5ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077698 Nov 06 20:56:25.525465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1610/3162] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:25.572706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.573675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.590330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.591255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.593352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.596706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.597298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.608382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6dff9bae-0e04-448f-bd4b-e3595af35c2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.292511 Nov 06 20:56:25.609291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1553/3163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:25 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:25.651768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:56:25.775892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad7e821d-7ffb-4b07-b4f3-3a4ac03ee328 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 204 len: 0 microversion: 2.1 time: 0.246618 Nov 06 20:56:25.776680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1611/3164] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:25 2021] DELETE /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:25.792090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.792812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.799054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-854ea113-bcc0-48ad-bdd2-7c20d527cf1d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671adce550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.825922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.826375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.827201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.827665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.866970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-854ea113-bcc0-48ad-bdd2-7c20d527cf1d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Image not found. Nov 06 20:56:25.868005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-854ea113-bcc0-48ad-bdd2-7c20d527cf1d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:25.870289 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-854ea113-bcc0-48ad-bdd2-7c20d527cf1d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d" status: 404 len: 62 microversion: 2.1 time: 0.082971 Nov 06 20:56:25.874054 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1554/3165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:25 2021] DELETE /compute/v2.1/images/10a43bef-299f-4ac1-8d24-404b0b3ea22d => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:56:25.889244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.889893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.900477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.901047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.902161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.902782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.922935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.940706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:56:25.942557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.950077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:25.953267 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80a8a3c0-61c7-41e2-b8d7-582d9b153d5c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.163521 Nov 06 20:56:25.964460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1612/3166] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:25 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:25.985820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:25.986429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:25.993813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.994600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:25.994979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:25.995412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.043122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Instance is already in deleting state, ignoring this request Nov 06 20:56:26.044702 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad12eb42-248f-41f3-9e17-638bfcaf8bd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 204 len: 0 microversion: 2.1 time: 0.165679 Nov 06 20:56:26.045752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1555/3167] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:25 2021] DELETE /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:26.061701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:26.062480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.069383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.069983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.071056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.071668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.289110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:26.302518 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13aa3fbf-29e3-4e20-9a4f-003d69551600 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.320895 Nov 06 20:56:26.305331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1613/3168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:25 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:26.328644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:26.330062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.341830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.342992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.344651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.345629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.495215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:26.510757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e94f9aaa-84ad-4eb4-aa19-afed9491998a tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1493 microversion: 2.1 time: 0.456402 Nov 06 20:56:26.514869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1556/3169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:26 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1493 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:26.525732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:26.528221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.539585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.540346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.542263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.543024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.615957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ac1949b-bb98-4e9f-a297-aac6e077cb15 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.097725 Nov 06 20:56:26.618633 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1557/3170] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:26.629834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:26.631074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.642841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.644185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.646416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.647322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.687235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:26.699685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:26.702082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:26.703541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0e96341-6352-4019-bb5c-360eb6f6da04 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.384852 Nov 06 20:56:26.707487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1614/3171] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:26 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:26.710528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:26.711262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.719780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.720844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.721775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.722827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.732757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8112ff4-3f7a-4a4b-9530-a92a2f12974a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.112043 Nov 06 20:56:26.734109 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1558/3172] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:26 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:26.972678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:26.973785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:26.981200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.981664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:26.982464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:26.982908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.103655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.111635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.113659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.114834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f127f15-71ff-42aa-a437-640c006dbdae tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.146534 Nov 06 20:56:27.115389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1559/3173] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:26 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:27.137537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.145248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7408423b-db29-44e0-8523-9998fa1cd0a8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.440054 Nov 06 20:56:27.145819 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1615/3174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:26 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:27.320440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:27.321061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:27.328021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.328257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.329082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.329577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.535311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:27.536053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:27.543033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.543851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.544898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.545572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.561005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.570613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-908d8a37-52f3-406b-932b-3a8076267b49 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1316 microversion: 2.1 time: 0.254278 Nov 06 20:56:27.580716 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1560/3175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:27 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:27.607825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7270a37c-51ed-4e9c-ba46-ff3cb4d71dc4 req-044eb2ad-3e21-4dc2-9574-75d0b5dd3559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58d9109-b635-447f-add3-72030026b61f", "name": "network-vif-unplugged", "status": "completed", "tag": "6a116836-c0c2-4ec1-a32f-6ce08a64fad9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:27.609394 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:27.609394 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:27.617079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7270a37c-51ed-4e9c-ba46-ff3cb4d71dc4 req-044eb2ad-3e21-4dc2-9574-75d0b5dd3559 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.617526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7270a37c-51ed-4e9c-ba46-ff3cb4d71dc4 req-044eb2ad-3e21-4dc2-9574-75d0b5dd3559 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.651148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7270a37c-51ed-4e9c-ba46-ff3cb4d71dc4 req-044eb2ad-3e21-4dc2-9574-75d0b5dd3559 service nova] Creating event network-vif-unplugged:6a116836-c0c2-4ec1-a32f-6ce08a64fad9 for instance c58d9109-b635-447f-add3-72030026b61f on nch2-master-1 Nov 06 20:56:27.657700 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7270a37c-51ed-4e9c-ba46-ff3cb4d71dc4 req-044eb2ad-3e21-4dc2-9574-75d0b5dd3559 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053508 Nov 06 20:56:27.658626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1561/3176] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:27.663672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:27.665075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:27.671528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.671989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.673000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.673443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.743269 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-957b26db-7fc6-4a55-9120-35cd4dae74d3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.082811 Nov 06 20:56:27.745168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1562/3177] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:27 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:27.750655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:27.756185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:27.772407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.772927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.773343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.774156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.774600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.780794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ab7b0fd-2f82-4772-878b-90735c86e665 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1493 microversion: 2.1 time: 0.249767 Nov 06 20:56:27.791840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1616/3178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:27 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:27.804501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:27.805631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:27.812952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.813760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.814999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:27.815705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:27.868710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7983cad-0628-4291-9988-468d737c6b10 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.069457 Nov 06 20:56:27.876390 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1617/3179] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:27 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:27.947302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.956332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.958625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:27.959902 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52c4b2c0-f258-450d-bb77-a456fd6ae51c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.213147 Nov 06 20:56:27.966143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1563/3180] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:27 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:28.134512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:28.135130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:28.143666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.144728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.145537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.145975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.157247 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 20:56:28.157247 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 20:56:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 20:56:28.172430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:28.176048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:28.186512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.187029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.188006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.188475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.218471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:28.228332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:28.229854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:28.231049 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14a76a13-2f6d-405d-a613-a9aa06b24c16 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.100830 Nov 06 20:56:28.231612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1618/3181] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:28 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:28.329005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:28.336596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50846198-9c3f-4a11-ab92-96755980af7e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.169045 Nov 06 20:56:28.337173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1564/3182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:28 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:28.588137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:28.588783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:28.596135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.596638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.597709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.598158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.757365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:28.758518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:28.766304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.766900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.767814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.768449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.817269 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9405f13-f20e-473d-9041-56f9d3ecbb83 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.064713 Nov 06 20:56:28.819067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1565/3183] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:28.824195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:28.825086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:28.831973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.832448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:28.833230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:28.833669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.003196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.011553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce461f74-8695-4230-b61f-5fa382bbde48 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1466 microversion: 2.1 time: 0.427517 Nov 06 20:56:29.023731 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1619/3184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:28 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1466 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:29.028590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:29.029576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.036755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.037216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.038102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.038718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.089782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40988ca7-925c-496e-8da2-6e7c1c57c2bc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.064639 Nov 06 20:56:29.093984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1620/3185] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:29 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:29.095631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:29.096370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.104149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.104644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.105443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.105892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.258504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1ffd89193f4eb1b796c374eb2d26bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de129bacdaf410c9d891738fc1181f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.267667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-409809b8-ddf5-4ffb-abc1-c6940efdb8c1 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 200 len: 1493 microversion: 2.1 time: 0.447108 Nov 06 20:56:29.268245 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1566/3186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:28 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 1493 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:29.277714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:29.278719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.287362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.288044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.288991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.289524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.318310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:56:29.427945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa603dbf-f09b-4e7b-832c-319ded96e123 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 204 len: 0 microversion: 2.1 time: 0.158023 Nov 06 20:56:29.432605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1567/3187] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:29 2021] DELETE /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:29.438398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:29.439375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.445281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.445741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.446530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.447139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.489872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.506298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.508902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.510313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a830ec5-0a0c-46b3-89bb-4cc5748183d4 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.418699 Nov 06 20:56:29.511418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1621/3188] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:29 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:29.516063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:29.517133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.529053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.529584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.530458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.530974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.547230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.555523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.559337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:29.560644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9ffcd48-7e1b-44e6-8ab3-1036075da54c tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.126582 Nov 06 20:56:29.573132 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1568/3189] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:29 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:29.578056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:29.579209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:29.585973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.586673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:29.587678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:29.588251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.396995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.407914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4eeab79b-b5e5-4e8e-80f9-353fc1fbb352 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.895195 Nov 06 20:56:30.409204 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1622/3190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:29 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:30.423639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:30.424726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.436536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.443698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.444229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.445071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.445523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.451629 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-070b8800-0621-4eb4-ab20-a43cae2f669c tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1472 microversion: 2.1 time: 0.875651 Nov 06 20:56:30.453113 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1569/3191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:29 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1472 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:30.460705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-05d4e8ae-0216-4db5-b1ae-61e95e73ed08 req-396aaff1-309b-4335-ba15-ab4111e2824f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58d9109-b635-447f-add3-72030026b61f", "name": "network-vif-deleted", "tag": "6a116836-c0c2-4ec1-a32f-6ce08a64fad9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:30.463460 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:30.463460 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:30.475893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-05d4e8ae-0216-4db5-b1ae-61e95e73ed08 req-396aaff1-309b-4335-ba15-ab4111e2824f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.477433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-05d4e8ae-0216-4db5-b1ae-61e95e73ed08 req-396aaff1-309b-4335-ba15-ab4111e2824f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.496239 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-05d4e8ae-0216-4db5-b1ae-61e95e73ed08 req-396aaff1-309b-4335-ba15-ab4111e2824f service nova] Creating event network-vif-deleted:6a116836-c0c2-4ec1-a32f-6ce08a64fad9 for instance c58d9109-b635-447f-add3-72030026b61f on nch2-master-1 Nov 06 20:56:30.502406 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-05d4e8ae-0216-4db5-b1ae-61e95e73ed08 req-396aaff1-309b-4335-ba15-ab4111e2824f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047566 Nov 06 20:56:30.504786 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1570/3192] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:30.510968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:30.512697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.517002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c859d25c-2c4f-4c65-8dbb-c8d75dc474f3 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.105860 Nov 06 20:56:30.520122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1623/3193] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:30 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:30.520832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.521603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.522662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.523402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.526158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.528128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: c58d9109-b635-447f-add3-72030026b61f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.539902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.542163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.543674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.544472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.576048 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance c58d9109-b635-447f-add3-72030026b61f could not be found. Nov 06 20:56:30.577874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance c58d9109-b635-447f-add3-72030026b61f could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.581771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23ac600e-025a-4891-8cc2-ee392f92efe3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f" status: 404 len: 111 microversion: 2.1 time: 0.059244 Nov 06 20:56:30.591991 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b85d6b5f-6154-48e2-a4cd-e17f55e84c81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.085114 Nov 06 20:56:30.592775 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1624/3194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:30 2021] GET /compute/v2.1/servers/c58d9109-b635-447f-add3-72030026b61f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:30.600606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1571/3195] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:30 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:30.602554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.603966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.607861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.608689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.618273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.620042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.620454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.621817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.622382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.622833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.623562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.624078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.756633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.769828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.771362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.772601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67e6fac7-176e-4189-aff9-af637a2c0361 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.174260 Nov 06 20:56:30.778268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1572/3196] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:30 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:30.784369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bcd373b9-7516-4c4d-873a-bf37f7d1fdd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f671adce670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.811550 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bcd373b9-7516-4c4d-873a-bf37f7d1fdd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Image not found. Nov 06 20:56:30.812347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bcd373b9-7516-4c4d-873a-bf37f7d1fdd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.813246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bcd373b9-7516-4c4d-873a-bf37f7d1fdd3 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b" status: 404 len: 62 microversion: 2.1 time: 0.035748 Nov 06 20:56:30.814208 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1573/3197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:30 2021] DELETE /compute/v2.1/images/3955f968-031e-48c1-a419-7f7c7e78e54b => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:56:30.823381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.824055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.831041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.831666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.832552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.832995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.846797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f could not be found. Nov 06 20:56:30.847649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.848671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2332eaf-a159-4d4e-b5d7-0f86c0569ac9 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 404 len: 111 microversion: 2.1 time: 0.029160 Nov 06 20:56:30.852099 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1574/3198] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:30 2021] DELETE /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:56:30.858049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.858792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: 042a28ad-9bf3-438e-b5a1-9f84e65b443f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.871144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.871931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.872913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.874857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.892996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f could not be found. Nov 06 20:56:30.893618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance 042a28ad-9bf3-438e-b5a1-9f84e65b443f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.894506 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1dc74e8-f382-4ee9-9a62-ddf6b8cb6208 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f" status: 404 len: 111 microversion: 2.1 time: 0.041326 Nov 06 20:56:30.895252 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1575/3199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:30 2021] GET /compute/v2.1/servers/042a28ad-9bf3-438e-b5a1-9f84e65b443f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:30.903035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-018df473-d010-4825-9692-b27d5aeb92ae tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f6715ad6310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.926280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-018df473-d010-4825-9692-b27d5aeb92ae tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Image not found. Nov 06 20:56:30.926907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-018df473-d010-4825-9692-b27d5aeb92ae tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.927762 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-018df473-d010-4825-9692-b27d5aeb92ae tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa" status: 404 len: 62 microversion: 2.1 time: 0.028521 Nov 06 20:56:30.931550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1576/3200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:30 2021] DELETE /compute/v2.1/images/0abd9720-3fe7-4105-a237-3caa991a8efa => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:56:30.936185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.936724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.943623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.944085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.944930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.945717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.959310 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance a7007c97-5fa8-462d-8192-9bf343e58548 could not be found. Nov 06 20:56:30.960107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance a7007c97-5fa8-462d-8192-9bf343e58548 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.960967 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d90aed7f-4b5a-4ff7-97f9-cb07a7f56e2f tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 404 len: 111 microversion: 2.1 time: 0.028572 Nov 06 20:56:30.964596 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1577/3201] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:30 2021] DELETE /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:30.969502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:30.970334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a7007c97-5fa8-462d-8192-9bf343e58548] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:30.976466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:30.976923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.977382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.978185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:30.978638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:30.997149 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance a7007c97-5fa8-462d-8192-9bf343e58548 could not be found. Nov 06 20:56:30.997770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance a7007c97-5fa8-462d-8192-9bf343e58548 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:30.998665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8075e45-b58c-4ccc-b071-2909da7ab6d7 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548" status: 404 len: 111 microversion: 2.1 time: 0.033046 Nov 06 20:56:31.002666 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1578/3202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:30 2021] GET /compute/v2.1/servers/a7007c97-5fa8-462d-8192-9bf343e58548 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:31.014029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-790e647b-32ea-4afa-87a9-88a4bcb33734 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '.version_select at 0x7f67159b91f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:31.017091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:31.019161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:31.023024 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e49dde03-5ca6-4116-96aa-262b51a06338 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.424910 Nov 06 20:56:31.029034 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1625/3203] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:30 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:31.036145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-790e647b-32ea-4afa-87a9-88a4bcb33734 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Image not found. Nov 06 20:56:31.036789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-790e647b-32ea-4afa-87a9-88a4bcb33734 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:31.037635 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-790e647b-32ea-4afa-87a9-88a4bcb33734 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1" status: 404 len: 62 microversion: 2.1 time: 0.033976 Nov 06 20:56:31.040337 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1579/3204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:31 2021] DELETE /compute/v2.1/images/8a2404f1-a4fe-4ed3-a5e3-48d4a5c98ae1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:56:31.046946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:31.047441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:31.054178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.054631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.055412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.055847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.072062 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance a2fbee84-0888-474a-a089-36a96efd162d could not be found. Nov 06 20:56:31.072713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance a2fbee84-0888-474a-a089-36a96efd162d could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:31.073550 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1711fc26-fd7f-40f3-93ea-2f4954baf723 tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 404 len: 111 microversion: 2.1 time: 0.030350 Nov 06 20:56:31.074407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1626/3205] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:31 2021] DELETE /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:31.083311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:31.083928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] [instance: a2fbee84-0888-474a-a089-36a96efd162d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:31.090781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.091234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.093093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.093697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.112528 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] HTTP exception thrown: Instance a2fbee84-0888-474a-a089-36a96efd162d could not be found. Nov 06 20:56:31.113690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] Returning 404 to user: Instance a2fbee84-0888-474a-a089-36a96efd162d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:31.114971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4677b12c-1b81-4614-bb79-a36cccf8497d tempest-ImagesTestJSON-1532675822 tempest-ImagesTestJSON-1532675822-project] 10.222.0.13 "GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d" status: 404 len: 111 microversion: 2.1 time: 0.036654 Nov 06 20:56:31.116359 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1580/3206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:31 2021] GET /compute/v2.1/servers/a2fbee84-0888-474a-a089-36a96efd162d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:56:31.426302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:31.427089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:31.433540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.433930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.434735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.435170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.483414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:31.492375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:31.505234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.506723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.508790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.509550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.943063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:31.950441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90a63702-255a-4ed5-9968-b3223cd4189b tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1472 microversion: 2.1 time: 0.484081 Nov 06 20:56:31.960554 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1581/3207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:31 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:31.965347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:31.966451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:31.972417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.972876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:31.973670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:31.974108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.051843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58a94459-b723-482b-ade7-a378649c5a80 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.089826 Nov 06 20:56:32.054089 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1582/3208] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:31 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:32.063909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:32.067197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:32.079093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.079914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.081261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.081972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.099174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.113310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a9aeb86-a51d-4205-b429-f3b155b57ccd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.690268 Nov 06 20:56:32.117908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1627/3209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:31 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:32.125423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:32.126540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:32.134664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.135548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.136729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.137410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.162515 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7198cf84-f2b3-4357-8354-523f6b3af163 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.104927 Nov 06 20:56:32.163367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1583/3210] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:32 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:32.171003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:32.171902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:32.182005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.182493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.183291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.183729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.264099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.272655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.274444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.275635 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60343eb0-299e-4583-ac67-0702454ba473 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.156468 Nov 06 20:56:32.287219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1628/3211] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:32 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:32.475189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.483885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.485426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:32.486609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6dd5375a-2c78-48f7-bc8f-6e14575f7ca5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.322263 Nov 06 20:56:32.487169 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1584/3212] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:32 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:32.527343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d99db160-1d76-4daa-9023-c6c21f430e39 req-be617d2f-2be7-4185-ad9f-fcefd2534a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0996b95-7820-4da7-ac82-6c25563512ed", "name": "network-vif-deleted", "tag": "1ff5f294-9386-44eb-971a-6cfc9daf261b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:32.529171 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:32.529171 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:32.537649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d99db160-1d76-4daa-9023-c6c21f430e39 req-be617d2f-2be7-4185-ad9f-fcefd2534a66 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.538066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d99db160-1d76-4daa-9023-c6c21f430e39 req-be617d2f-2be7-4185-ad9f-fcefd2534a66 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.551135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d99db160-1d76-4daa-9023-c6c21f430e39 req-be617d2f-2be7-4185-ad9f-fcefd2534a66 service nova] Creating event network-vif-deleted:1ff5f294-9386-44eb-971a-6cfc9daf261b for instance f0996b95-7820-4da7-ac82-6c25563512ed on nch2-master-1 Nov 06 20:56:32.556498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d99db160-1d76-4daa-9023-c6c21f430e39 req-be617d2f-2be7-4185-ad9f-fcefd2534a66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Nov 06 20:56:32.558928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacbb840-9952-44fa-a73b-0c020a3c93ba", "name": "network-vif-unplugged", "status": "completed", "tag": "e871ba32-0d46-454a-a9b6-d59321c47280"}, {"name": "network-changed", "server_uuid": "bacbb840-9952-44fa-a73b-0c020a3c93ba", "tag": "e871ba32-0d46-454a-a9b6-d59321c47280"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:32.561238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1629/3213] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:32.562603 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:32.562603 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:32.583872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.584385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.595997 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] Creating event network-vif-unplugged:e871ba32-0d46-454a-a9b6-d59321c47280 for instance bacbb840-9952-44fa-a73b-0c020a3c93ba on nch2-master-1 Nov 06 20:56:32.596564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] Creating event network-changed:e871ba32-0d46-454a-a9b6-d59321c47280 for instance bacbb840-9952-44fa-a73b-0c020a3c93ba on nch2-master-1 Nov 06 20:56:32.602321 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cedba296-b194-4741-a16b-c44fb0a88382 req-efcb3894-539b-44a9-ac28-73ea05d638bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.048201 Nov 06 20:56:32.603491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1585/3214] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:32 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:56:32.969160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:32.970337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:32.977364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.977896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:32.978754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:32.979280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.036901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.037562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.037890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lazy-loading 'fault' on Instance uuid f0996b95-7820-4da7-ac82-6c25563512ed {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:33.066033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:33.067493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:33.075241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.076074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.077981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.078509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.156596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c39830b3-17bb-46c1-9054-6f7ed63acb92 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.093101 Nov 06 20:56:33.157524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1586/3215] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:33.168693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:33.169908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:33.176920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f844077aaaf4d1cab10136ac329c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc42ff18c5cc4af1bad1e1d62c7c5f18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.179925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.180637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.182128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.182812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.191566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fda3705-70e8-4ed0-82f1-1d58b570fe47 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 200 len: 1306 microversion: 2.1 time: 0.222920 Nov 06 20:56:33.195090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1630/3216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:32 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:33.207608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:33.213682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:33.231353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.231816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.233030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.233526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.299161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0be36262-ae19-436a-821e-188ce5006eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.102210 Nov 06 20:56:33.304412 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1631/3217] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:33 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:33.310253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:33.310950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:33.319922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.320653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.321477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.322198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.420897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.430597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.432570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.434544 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea95b6c5-7e3c-4d98-889e-eb09e5ee5988 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.128811 Nov 06 20:56:33.445499 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1632/3218] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:33 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:33.466773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.475386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a45904c-e05f-4234-91a6-6fa902f91609 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.311758 Nov 06 20:56:33.475957 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1587/3219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:33 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:33.508347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:33.509241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:33.518227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.518574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.520603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:33.521180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:33.754373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.763757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.765333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:33.767008 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f6cc55c-63ef-4d9c-8c4d-70a8a9ad91b9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.264675 Nov 06 20:56:33.767383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1633/3220] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:33 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:34.169285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.170219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.178312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.178769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.179568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.180012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.210675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.213829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.225973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.226433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.227242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.227685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.242647 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9aa44b52-c0c3-4efb-8566-e4b720da90f6 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.076780 Nov 06 20:56:34.247774 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. Nov 06 20:56:34.249018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.249318 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ed7896dc-1621-4fd0-be81-ffbc89e32974 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 404 len: 111 microversion: 2.1 time: 0.042306 Nov 06 20:56:34.249838 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1588/3221] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:34.249976 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1634/3222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:34 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.268010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1139312555", "metadata": {"image_type": "test"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.277837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.287573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.288349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.290140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.290765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.309204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. Nov 06 20:56:34.309827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.310693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3ef9cca-f3c5-4c6d-837e-01878eb5e443 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "POST /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed/action" status: 404 len: 111 microversion: 2.1 time: 0.054523 Nov 06 20:56:34.311590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1589/3223] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.321139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.322492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.324686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2427a962-b134-45d0-8d10-a7bd57c8e9b9 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-377748579", "metadata": {"image_type": "test"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.326958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2427a962-b134-45d0-8d10-a7bd57c8e9b9 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Failed to fetch instance by id tempest-invalid-140786021 {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 20:56:34.327644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-2427a962-b134-45d0-8d10-a7bd57c8e9b9 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance tempest-invalid-140786021 could not be found. Nov 06 20:56:34.328718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2427a962-b134-45d0-8d10-a7bd57c8e9b9 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance tempest-invalid-140786021 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.329840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2427a962-b134-45d0-8d10-a7bd57c8e9b9 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "POST /compute/v2.1/servers/tempest-invalid-140786021/action" status: 404 len: 100 microversion: 2.1 time: 0.010144 Nov 06 20:56:34.330959 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1590/3224] 10.222.0.13 () {60 vars in 1245 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/tempest-invalid-140786021/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.339826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.340707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.342890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f758bb54-0167-4187-a914-5b7a6ffe6331 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-955167922"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.343996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.344452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f758bb54-0167-4187-a914-5b7a6ffe6331 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 20:56:34.345186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.346067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f758bb54-0167-4187-a914-5b7a6ffe6331 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 06 20:56:34.346838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f758bb54-0167-4187-a914-5b7a6ffe6331 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.349285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f758bb54-0167-4187-a914-5b7a6ffe6331 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011896 Nov 06 20:56:34.359089 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1591/3225] 10.222.0.13 () {60 vars in 1274 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:56:34.390995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d935e60-b83e-4adb-9f0a-c7c945797052 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1682172128"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:34.392937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d935e60-b83e-4adb-9f0a-c7c945797052 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 20:56:34.393524 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7d935e60-b83e-4adb-9f0a-c7c945797052 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 06 20:56:34.394796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d935e60-b83e-4adb-9f0a-c7c945797052 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.395793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d935e60-b83e-4adb-9f0a-c7c945797052 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032610 Nov 06 20:56:34.400239 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1592/3226] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.408908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.409533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.423778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.424435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.425225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.425666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.435348 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ef8d107-46bf-4b3a-88ed-3fdd6d5c404a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.126402 Nov 06 20:56:34.439247 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1635/3227] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:34 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:34.462513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.464496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.474157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.475133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. Nov 06 20:56:34.475313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.476065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.476586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.477407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8bd81b3c-c392-4296-ad28-b8fc0b1120e1 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 404 len: 111 microversion: 2.1 time: 0.075504 Nov 06 20:56:34.477778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.481476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1593/3228] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:56:34 2021] DELETE /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.485886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.488087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] [instance: f0996b95-7820-4da7-ac82-6c25563512ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.505790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.506266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.507305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.507935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.523801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] HTTP exception thrown: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. Nov 06 20:56:34.524797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] Returning 404 to user: Instance f0996b95-7820-4da7-ac82-6c25563512ed could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:34.525848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4a4dd1b-04ba-4d7b-9103-054ca7120064 tempest-ImagesNegativeTestJSON-142857113 tempest-ImagesNegativeTestJSON-142857113-project] 10.222.0.13 "GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed" status: 404 len: 111 microversion: 2.1 time: 0.043935 Nov 06 20:56:34.526582 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1594/3229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:34 2021] GET /compute/v2.1/servers/f0996b95-7820-4da7-ac82-6c25563512ed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:56:34.533373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.534000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.548545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.549016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.549838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.550315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.614434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:34.649066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:34.652208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:34.656653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-270e9f21-f8ea-4445-acb6-23ef7affd5a0 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.203069 Nov 06 20:56:34.657367 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1636/3230] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:34 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:34.784250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:34.785307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:34.793148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.793936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:34.797588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:34.798752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.205328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.213724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6efdd6c6-61b9-4fa4-b8e6-87146a1447f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.685931 Nov 06 20:56:35.216934 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1595/3231] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:34 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:35.252586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.270705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.275658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.277319 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d7b64b1-6546-4663-ba75-e264f66b6eee tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.496772 Nov 06 20:56:35.277904 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1637/3232] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:34 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:35.290062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:35.295304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:35.306058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.306531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.309280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.309786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.378094 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e4e545a-3d8f-44da-a47c-016abf6c3ccc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.098917 Nov 06 20:56:35.380418 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1638/3233] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:35 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:35.400697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1475757627", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "514e4a26-40f9-4959-b8bc-7e6cfc5f6286"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:35.455744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:35.456950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:35.467935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] validate_networks() for [('514e4a26-40f9-4959-b8bc-7e6cfc5f6286', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:35.470760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.473032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.474093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.474791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.524313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e1008bb-f049-4a60-bfc5-91c8df4b25be tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.077608 Nov 06 20:56:35.528286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1639/3234] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:35 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:35.676652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:35.677366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:35.696377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.696851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.697646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:35.698087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:35.850991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.859275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.879168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:35.881157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c61190f1-f806-4251-bd5b-9c41d7f5af28 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.208467 Nov 06 20:56:35.884369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1640/3235] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:35 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:36.088955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:36.089233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:36.089715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:36.090133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:36.090546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:36.110497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.111301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.113159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.113612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.136611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:36.141129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for user e0d0cebeefdc482caf46119297ddb0ad and project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:36.155651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:36.159460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:36.215059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16bb7d8e-d6e4-46ce-8cc0-e513f1d90c92 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996777 Nov 06 20:56:36.216105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1596/3236] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:56:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:56:36.225981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a651c67e-016a-4067-996c-6197632643fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:36.227363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a651c67e-016a-4067-996c-6197632643fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.233835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:36.234528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.241684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.242874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.244691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.245399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.333443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a651c67e-016a-4067-996c-6197632643fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:36.341013 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a651c67e-016a-4067-996c-6197632643fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1225 microversion: 2.1 time: 0.119140 Nov 06 20:56:36.341606 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1641/3237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:36 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:36.355599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:36.356221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.382374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.382838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.383650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.384109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.650184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:36.658170 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee713565-d56f-4e1c-bd80-93ae035a6cd3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.428084 Nov 06 20:56:36.658754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1597/3238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:36 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:36.664788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:36.667427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.678630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:36.687853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:36.689998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.691234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.692470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.693809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.695458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:36.700899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5b21d9f-ad81-4fbc-9acd-6f169e784c6e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.352893 Nov 06 20:56:36.701800 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1642/3239] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:36 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:36.717345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:36.727970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.736775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.740759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.741789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.742410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.783557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b4a3690-7abc-40f2-a7fd-451b5ae6c051 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.122594 Nov 06 20:56:36.785858 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1598/3240] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:36 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:36.798732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce58fcff-2455-4327-b7a0-093b784dd1d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.085024 Nov 06 20:56:36.805238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1643/3241] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:36 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:36.907547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:36.909015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:36.945921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.946372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:36.952109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:36.952855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.082417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:37.097845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:37.099764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:37.101360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6e24efd-3250-4c56-b428-9fda16def60f tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.204901 Nov 06 20:56:37.114334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1599/3242] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:36 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:37.358634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:37.359354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:37.366858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.367536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.368366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.368809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.442466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:37.453279 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27150d78-9d8b-4c73-b027-b9494c0dc33d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1277 microversion: 2.1 time: 0.099334 Nov 06 20:56:37.454975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1644/3243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:37 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:37.675869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:37.676589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:37.689676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.691845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.692929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.693464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.720272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:37.721762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:37.735216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.736407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.740526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:37.741693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:37.987056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:37.994733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-021bff14-a0e8-4504-9138-fe39e8cc6957 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.322946 Nov 06 20:56:37.995328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1600/3244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:37 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:38.008740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:38.010304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:38.022209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.022684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.023505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.023951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.054766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.068030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.071045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.073249 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29696b32-8308-4294-a23f-a8a73cac71a9 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.358041 Nov 06 20:56:38.084429 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1645/3245] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:37 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:38.090897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:38.092376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:38.099541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.099958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e322ad6e-3e91-466c-a431-e937d82d542e tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.100882 Nov 06 20:56:38.100501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.101537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.102168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.102363 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1601/3246] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:37 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:38.124519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:38.125204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:38.143601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.144390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.145217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.145693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.155832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-705a0fa5-283e-4b18-8586-f54708031eb9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.068784 Nov 06 20:56:38.155832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1646/3247] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:38 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:38.220128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.230725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.232955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.234267 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f6c8d1e-722b-4770-ab99-7a57c3150dc5 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.115601 Nov 06 20:56:38.248434 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1602/3248] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:38 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:38.398672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-636f62c2-13cb-4761-9b27-5d99cd467679 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67151dd790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:38.450606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-636f62c2-13cb-4761-9b27-5d99cd467679 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752" status: 200 len: 661 microversion: 2.1 time: 0.055845 Nov 06 20:56:38.451580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1647/3249] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:38 2021] GET /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:38.462474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64a8863c-5e52-4ce7-9c7f-bf9874e48232 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671adc9670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:38.477470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:38.478427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:38.486011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.487184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.488653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:38.489209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:38.525216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64a8863c-5e52-4ce7-9c7f-bf9874e48232 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752" status: 200 len: 661 microversion: 2.1 time: 0.066368 Nov 06 20:56:38.525791 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1603/3250] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:38 2021] GET /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:38.588833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:38.599056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-919face6-7cc5-4d1f-bc09-6347db3a18a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1283 microversion: 2.1 time: 0.126650 Nov 06 20:56:38.599672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1648/3251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:38 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1283 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:39.012359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:39.013798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:39.035581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.037528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.040697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.041757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.096881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:39.104007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:39.121005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.122586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.123424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.123863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.840571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:39.847927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b52b6e4-5d75-4d48-a9a5-23dd91409fa8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.839471 Nov 06 20:56:39.848521 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1604/3252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:39 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:39.856622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:39.861722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:39.870168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:39.875396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:39.877435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:39.880532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.881690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.882190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.882744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.884207 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9978304a-c79f-44d6-bf7c-fcf2da0eae88 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.795111 Nov 06 20:56:39.885840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1649/3253] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:39 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:39.896169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:39.901234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:39.912936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.913587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.914524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.915001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.936622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e558160-c690-42dc-8a34-e642f900b0bd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.083338 Nov 06 20:56:39.937536 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1605/3254] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:39 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:39.943435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:39.944153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:39.951330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.951791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.952741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:39.953196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:39.971482 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e534059b-ab80-450e-9ca2-76441ba007d1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.080956 Nov 06 20:56:39.973062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1650/3255] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:39 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:39.978398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:39.990100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:40.009411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.009411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.011151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.011596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.049581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:40.058958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:40.060660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:40.062094 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99cff37c-b142-4a61-97bf-0fad24ab88f3 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.123138 Nov 06 20:56:40.063364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1606/3256] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:39 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:40.077771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48ca0cd8-fc13-4d56-8d07-29c50b58863c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671adce670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:40.127432 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48ca0cd8-fc13-4d56-8d07-29c50b58863c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170" status: 200 len: 662 microversion: 2.1 time: 0.062376 Nov 06 20:56:40.128572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1607/3257] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:40 2021] GET /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:40.140781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3af06f2-e503-47a8-8f65-73049cbb1ebe tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671ad40ca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:40.207260 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3af06f2-e503-47a8-8f65-73049cbb1ebe tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170" status: 200 len: 662 microversion: 2.1 time: 0.055474 Nov 06 20:56:40.214309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1608/3258] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:40 2021] GET /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170 => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:40.342086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:40.355554 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb10506e-e253-49e9-97b3-ef4788353ef8 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.381092 Nov 06 20:56:40.356570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1651/3259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:39 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:40.756859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-64c0b305-8b40-496b-adde-7a17bf31b7a0 req-09583d57-c9ec-4b1f-ada3-12cd44fec9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de50665b-f9fe-480d-b6a4-1591f2cc2757", "tag": "7da66a9d-f034-4223-9041-8301ccc26527"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:40.758428 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:40.758428 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:40.771753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-64c0b305-8b40-496b-adde-7a17bf31b7a0 req-09583d57-c9ec-4b1f-ada3-12cd44fec9a0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.772125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-64c0b305-8b40-496b-adde-7a17bf31b7a0 req-09583d57-c9ec-4b1f-ada3-12cd44fec9a0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.800667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-64c0b305-8b40-496b-adde-7a17bf31b7a0 req-09583d57-c9ec-4b1f-ada3-12cd44fec9a0 service nova] Creating event network-changed:7da66a9d-f034-4223-9041-8301ccc26527 for instance de50665b-f9fe-480d-b6a4-1591f2cc2757 on nch2-master-1 Nov 06 20:56:40.806912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-64c0b305-8b40-496b-adde-7a17bf31b7a0 req-09583d57-c9ec-4b1f-ada3-12cd44fec9a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055055 Nov 06 20:56:40.807524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1609/3260] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:40.865541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:40.866175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:40.877068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.878467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.879659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.880273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.904027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:40.905203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:40.914287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.915084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:40.916478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:40.917187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.180435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.185942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.196476 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a414800-6fc8-4123-bcec-4bdb1fc9c430 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.335668 Nov 06 20:56:41.197096 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1652/3261] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:40 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:41.197924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.202290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.204002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-026e94e1-7055-414d-a4a3-cbdc426bca94 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1644 microversion: 2.25 time: 0.304659 Nov 06 20:56:41.215711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:41.217039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:41.217358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1610/3262] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:40 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1644 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:41.224621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:41.228075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:41.230388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.231086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.232877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.240602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.244422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.245100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.246334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.247681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.310312 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-50f9f32c-467c-4c8f-bd7c-667babd0f4c4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.111822 Nov 06 20:56:41.321030 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1653/3263] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:41.333577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:41.337473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:41.350807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.351665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.352903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.353643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.366199 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a781abbd-7996-4eb2-8db8-aa2e1a9cac3e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.141830 Nov 06 20:56:41.368762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1611/3264] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:41 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:41.390373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:41.394959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:41.420088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.420829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.421859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:41.434584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:41.509022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.517892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.519457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.522115 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-835ea598-5eb8-483f-9583-df8f6f35eb1a tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.199305 Nov 06 20:56:41.536651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1654/3265] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:41 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:41.654698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:41.665888 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7b7d3b8-ca09-41f4-a8e5-18d93ee7d5d2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.292539 Nov 06 20:56:41.667019 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1612/3266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:41 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:41.745487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a69c1c4-9f1a-4347-a1eb-1e362a763817 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67151c5700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:41.799521 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a69c1c4-9f1a-4347-a1eb-1e362a763817 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30" status: 200 len: 661 microversion: 2.1 time: 0.057681 Nov 06 20:56:41.800139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1655/3267] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:41 2021] GET /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30 => generated 661 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:41.812871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4bc5f946-2a23-40da-9db2-446f97cf3300 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671ad850d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:41.866002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4bc5f946-2a23-40da-9db2-446f97cf3300 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30" status: 200 len: 661 microversion: 2.1 time: 0.058066 Nov 06 20:56:41.867045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1613/3268] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:56:41 2021] GET /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:56:41.921629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1208905411", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:41.970524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:42.214790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:42.216264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.223570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.224143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.225252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.225986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.258974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:42.259884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:42.260555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:42.261164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:42.261582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:42.271242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.271686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.272530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.272966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.292405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Getting quotas for project 753c99ec4c5644e4bdc41ee986f427ac. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:42.296440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Getting quotas for user 632ac3c3360b4e71b654d87ccb9fe26d and project 753c99ec4c5644e4bdc41ee986f427ac. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:42.307971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:42.310356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:42.391453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5157ce1c-4f8c-439e-b6c3-d7cbebf75da7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469950 Nov 06 20:56:42.402044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1656/3269] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:56:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:56:42.410743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:42.410743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.421222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.421993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.422874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.423392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.501980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.510583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ef25a629-d535-40b0-b2de-d8543c86f3aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.300545 Nov 06 20:56:42.521000 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1614/3270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:42 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:42.528761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:42.531075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.542653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.543182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.544809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.545506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.600967 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21dbf7ea-0bf6-4a3a-a241-742b41f6ed52 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.077080 Nov 06 20:56:42.605320 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1615/3271] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:42 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:42.607734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:42.608829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.616159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.616807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.617956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.618266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.669082 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43598fcc-c3ab-47ac-beac-72b39cf1599d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.065740 Nov 06 20:56:42.669924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1616/3272] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:42 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:42.680254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-333435613", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:42.720409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.730146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.732750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.733718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02679fe3-7d19-4d07-ba3e-fccf51e2f86d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1634 microversion: 2.25 time: 0.335602 Nov 06 20:56:42.734493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1657/3273] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:42 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1634 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:42.740476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:42.741388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.748353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.749114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.750101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.750718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.779443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:42.880800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.889761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.891280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:42.892785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f680980-dff5-4b8b-ad75-b3eca1892d59 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.156927 Nov 06 20:56:42.894641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1658/3274] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:42 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:42.908980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:42.910139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:42.924920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.925518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:42.926737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:42.927388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.095590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:43.096018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:43.096529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:43.097194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:43.097807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:43.107171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.107832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.108881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.109511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.127480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Getting quotas for project 753c99ec4c5644e4bdc41ee986f427ac. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:43.132895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Getting quotas for user 632ac3c3360b4e71b654d87ccb9fe26d and project 753c99ec4c5644e4bdc41ee986f427ac. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:43.147846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:43.150682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:43.182423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:43.191331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8410e10e-cf78-4b22-afb6-455803d82c8d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.295303 Nov 06 20:56:43.191983 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1659/3275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:42 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:43.204987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8a3fff3-40a2-4e0f-9503-fa2411c7ad81 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533413 Nov 06 20:56:43.206041 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1617/3276] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:56:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:56:43.207717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-141ceb56-26ec-49d9-a675-fdf9a8e8aecd tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '.version_select at 0x7f6715205550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.209086 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:43.209086 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:43.211224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-141ceb56-26ec-49d9-a675-fdf9a8e8aecd tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.212018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-141ceb56-26ec-49d9-a675-fdf9a8e8aecd tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.221257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-141ceb56-26ec-49d9-a675-fdf9a8e8aecd tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.018951 Nov 06 20:56:43.221688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7cf73de7-7d3a-4c31-93ad-5f9608ddfaf6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.222319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7cf73de7-7d3a-4c31-93ad-5f9608ddfaf6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.223529 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1660/3277] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/os-migrations => generated 1276 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:43.236500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.237460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.245601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.247139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.248628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.249472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.340768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7cf73de7-7d3a-4c31-93ad-5f9608ddfaf6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:43.350222 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7cf73de7-7d3a-4c31-93ad-5f9608ddfaf6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1217 microversion: 2.1 time: 0.137901 Nov 06 20:56:43.364413 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1618/3278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:43.445903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:43.472141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5bde4e94-7a10-4e3c-ba1c-cb6a385b888e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 2126 microversion: 2.25 time: 0.240675 Nov 06 20:56:43.477242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1661/3279] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 2126 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:43.490447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.491150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.498321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.499020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.500214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.500772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.529328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.529940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.543869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.544487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.545432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.546227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.665202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:43.684368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21b8ee3f-2ac6-482d-a077-45d2d984bcb3 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 2126 microversion: 2.25 time: 0.197256 Nov 06 20:56:43.698187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1619/3280] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 2126 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:43.706335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:43.707279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.713811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.714595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.715677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.716370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.771618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68e22cc4-ae30-4beb-8a19-b65511631aec tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.071558 Nov 06 20:56:43.802435 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1620/3281] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:43 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:43.802435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:43.802435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.806870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.807821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.808321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.808798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.848102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:43.857794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbe08726-16bb-4613-960c-2650196f2394 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.332360 Nov 06 20:56:43.858732 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1662/3282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:43.864723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66bc0fed-e270-4cf4-b53a-86e07ce8712f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.086207 Nov 06 20:56:43.871367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1621/3283] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:43 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:43.877065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.886005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.893291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.893900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.894773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.896231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.914052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:43.915313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:43.922501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.922950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:43.923751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:43.924177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.004992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:44.023767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:44.025250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:44.026696 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af21866d-ba75-4d1c-81fc-b8baf5a8ad88 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.117208 Nov 06 20:56:44.028331 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1622/3284] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:43 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:44.028540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lazy-loading 'services' on Instance uuid bacbb840-9952-44fa-a73b-0c020a3c93ba {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:56:44.103417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64bfd242-0000-4b5e-8862-570cfce6ddd7 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments/fa98b723-a4ea-4a19-a28c-a7cff197c3af" status: 202 len: 0 microversion: 2.25 time: 0.232744 Nov 06 20:56:44.104032 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1663/3285] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Nov 6 20:56:43 2021] DELETE /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments/fa98b723-a4ea-4a19-a28c-a7cff197c3af => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:56:44.112572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:44.113725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.122541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.123287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.124240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.125235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.158809 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04cbbd77-6d2c-4291-b6b0-732b75b083c6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050128 Nov 06 20:56:44.160220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1623/3286] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 20:56:44 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:56:44.211045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:44.212347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.220807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.221363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.223197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.223855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.371589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:44.372197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.372816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:44.382261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4505ccb5-ab9d-4ab5-b63c-c480e99e0bc6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.177062 Nov 06 20:56:44.383182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1664/3287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:44 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:44.388642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.389667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.390749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.391670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.491731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:44.500946 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f284c10a-5289-4d0a-832e-6f19c4c68a64 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1269 microversion: 2.1 time: 0.132467 Nov 06 20:56:44.501538 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1624/3288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:44 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:44.788553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:44.789721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.804790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.805434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.806381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.807699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.877254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:44.878761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.885919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3223013-8ea2-4aa0-b311-e10cb7c0c347 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.104434 Nov 06 20:56:44.890472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1665/3289] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:44 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:44.894278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:44.895305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:44.903480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.903979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.904565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.904811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.905251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.906713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:44.910930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:44.912750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.001199 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f768a423-9139-42bf-bccb-a6332fdeeb9e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.108914 Nov 06 20:56:45.009323 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1666/3290] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:44 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:45.051258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:45.053461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:45.061991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.062653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.064759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.065979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.231095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.244660 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4263e6c8-b902-4d62-a750-04ba97ee5956 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.372167 Nov 06 20:56:45.247697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1625/3291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:44 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:45.258220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.263956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:45.267800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:45.277351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.278145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.279742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.280410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.280570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.284591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.290659 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f2dfee6-750c-4522-89a9-2c0fbb555646 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.246493 Nov 06 20:56:45.292122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1667/3292] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:45 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:45.326554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19233814-502b-4270-bd92-c2d7c56c92ea tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.077448 Nov 06 20:56:45.327483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1626/3293] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 20:56:45 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:45.402306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:45.403754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:45.419663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.420538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.421581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.422041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.518343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:45.526849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:45.545064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.545609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.546966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.547663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.595358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.604958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b121848-71d7-413b-8c78-eb37e9c38fd0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.207284 Nov 06 20:56:45.606105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1668/3294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:45 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:45.650672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:45.677021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86af11ae-67ec-4423-bab8-52f63468b574 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1275 microversion: 2.1 time: 0.160779 Nov 06 20:56:45.677653 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1627/3295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:45 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:45.899586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:45.900825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:45.924498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.929456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:45.933119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:45.934197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.009639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a57034dc-0dee-461f-b127-5814baa82502 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.113240 Nov 06 20:56:46.010354 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1669/3296] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:45 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:46.018287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:46.020087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:46.034775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.035234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.036047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.036524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.110758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75231463-48ef-4651-a7d7-779aceabfb8d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.093324 Nov 06 20:56:46.125105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1628/3297] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:46 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:46.262447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:46.263193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:46.291857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.292926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.293796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.294236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.312426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:46.314720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:46.334971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.341482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.342398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.342849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.583875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:46.594940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:46.596537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:46.609043 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3e22e97-8ba4-4987-ac08-29294d8e4821 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.301750 Nov 06 20:56:46.610367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1629/3298] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:46 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:46.626450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:46.627316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:46.637198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.640928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.642976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.647204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.918487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:46.935963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4edbd17-cf7c-4e31-9356-eb9380897255 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.677532 Nov 06 20:56:46.940230 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1670/3299] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:46 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:46.956006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:46.956910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:46.969029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.969495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:46.970406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:46.973199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.233343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:47.251500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49c7a5f4-0be7-46e1-8e41-dab062a4087a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.629381 Nov 06 20:56:47.252182 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1630/3300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:46 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:47.267677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:47.269260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:47.289268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.289734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.290550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.291002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.384762 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1a26677-dec8-44cf-8887-efc86e9d0c09 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.121913 Nov 06 20:56:47.388858 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1631/3301] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:47 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:47.396317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:47.400125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:47.414403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.415123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.416366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.417004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.484934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1d3e454-e284-4589-9fdf-7a884ad5a465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.094269 Nov 06 20:56:47.485978 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1632/3302] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:47 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:47.491747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6f338476-9b75-4e99-8206-ecd07edd51cd req-8adcf0a8-6a82-40d1-9d46-76bd98f2855d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:47.499085 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:47.499085 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:47.509415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f338476-9b75-4e99-8206-ecd07edd51cd req-8adcf0a8-6a82-40d1-9d46-76bd98f2855d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.509867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f338476-9b75-4e99-8206-ecd07edd51cd req-8adcf0a8-6a82-40d1-9d46-76bd98f2855d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.533589 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6f338476-9b75-4e99-8206-ecd07edd51cd req-8adcf0a8-6a82-40d1-9d46-76bd98f2855d service nova] Creating event network-changed:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:56:47.553423 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6f338476-9b75-4e99-8206-ecd07edd51cd req-8adcf0a8-6a82-40d1-9d46-76bd98f2855d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065811 Nov 06 20:56:47.554309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1633/3303] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:47.582213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:47.593417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70d901ea-7268-46ef-b2f8-75b2f2a52a93 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.651655 Nov 06 20:56:47.594264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1671/3304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:46 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:47.639751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:47.640610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:47.648611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.649158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.651556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.664785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.967108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:47.968174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:47.975626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.976619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:47.977625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:47.978238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.245921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:48.259762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:48.261345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:48.266774 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-69371660-0f48-4122-b6d9-08bfbc0a213b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.639879 Nov 06 20:56:48.267477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1634/3305] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:47 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:48.272624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:48.273498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:48.285077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.285814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.286706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.287341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.658151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:48.667017 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be44084b-5593-4e74-8f4b-68469e9fb516 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.704881 Nov 06 20:56:48.667215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:48.668387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1672/3306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:47 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:48.673051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:48.674000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:48.683670 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88bb8ae7-b8ec-4ed6-b72c-b218a292cd9f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.414616 Nov 06 20:56:48.693559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1635/3307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:48 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:48.698656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-861415297", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d7f41d40-db54-4294-8f8b-5894f0c36960"}], "block_device_mapping_v2": [{"uuid": "66f9752d-e592-4a5a-b333-de1426b182d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:48.700653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.701273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.702090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.702530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.761454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03bc1d11-f32a-49db-bf41-02f71abd5ca8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.090530 Nov 06 20:56:48.763366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1673/3308] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:48 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:48.767454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] validate_networks() for [('d7f41d40-db54-4294-8f8b-5894f0c36960', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:48.772575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:48.774202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:48.781615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.782095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.782889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.783332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.827583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81b4c09c-fd1e-4a7c-8fb2-581ee1b14187 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.062451 Nov 06 20:56:48.829619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1674/3309] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:48 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:48.836026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:48.837243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:48.844415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.845016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:48.845961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:48.846408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.232057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:49.241443 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2af0c643-8611-4b57-aef1-e762475bfaf9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.410389 Nov 06 20:56:49.242031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1675/3310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:48 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:49.257202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-08766179-1350-4848-a442-abd9a1379f58 req-8307bb13-13ca-4e0a-ab37-8738d5b6ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcef5068-4637-46e6-b3e8-124382b109f1", "tag": "21508f07-0718-477d-a58c-ec0512e5bdad"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:49.258930 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:49.258930 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:49.267797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-08766179-1350-4848-a442-abd9a1379f58 req-8307bb13-13ca-4e0a-ab37-8738d5b6ab61 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.269104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-08766179-1350-4848-a442-abd9a1379f58 req-8307bb13-13ca-4e0a-ab37-8738d5b6ab61 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.289881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-08766179-1350-4848-a442-abd9a1379f58 req-8307bb13-13ca-4e0a-ab37-8738d5b6ab61 service nova] Creating event network-changed:21508f07-0718-477d-a58c-ec0512e5bdad for instance fcef5068-4637-46e6-b3e8-124382b109f1 on nch2-master-1 Nov 06 20:56:49.297452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-08766179-1350-4848-a442-abd9a1379f58 req-8307bb13-13ca-4e0a-ab37-8738d5b6ab61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044497 Nov 06 20:56:49.298745 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1676/3311] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:49.305516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:49.306378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:49.314016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.314812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.316535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.317179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.404729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:49.417366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:49.418867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:49.420522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8cad23bb-549c-4968-af2e-fc1469355045 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.119968 Nov 06 20:56:49.421812 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1677/3312] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:49 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:49.442990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-757c0703-e50b-44ce-b5aa-5591f2978935 req-ff49ae74-1c83-4cef-bf5a-a631e8112e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de50665b-f9fe-480d-b6a4-1591f2cc2757", "name": "network-vif-plugged", "status": "completed", "tag": "7da66a9d-f034-4223-9041-8301ccc26527"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:49.445608 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:49.445608 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:49.457760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-757c0703-e50b-44ce-b5aa-5591f2978935 req-ff49ae74-1c83-4cef-bf5a-a631e8112e33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.458978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-757c0703-e50b-44ce-b5aa-5591f2978935 req-ff49ae74-1c83-4cef-bf5a-a631e8112e33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.476442 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-757c0703-e50b-44ce-b5aa-5591f2978935 req-ff49ae74-1c83-4cef-bf5a-a631e8112e33 service nova] Creating event network-vif-plugged:7da66a9d-f034-4223-9041-8301ccc26527 for instance de50665b-f9fe-480d-b6a4-1591f2cc2757 on nch2-master-1 Nov 06 20:56:49.484534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-757c0703-e50b-44ce-b5aa-5591f2978935 req-ff49ae74-1c83-4cef-bf5a-a631e8112e33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047316 Nov 06 20:56:49.486007 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1678/3313] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:49.686031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:49.686528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:49.686528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:49.687023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:49.687704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:49.688127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:49.688460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:49.701878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.702524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.704650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.705266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.705975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.707231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.707479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.707975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.740196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:49.748829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Getting quotas for user 2b4178344ec541bb964ed60d977eff68 and project 4c383d3827904548a85fe5db914aee4b. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:49.847805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:49.849982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66f9752d-e592-4a5a-b333-de1426b182d0',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:49.945602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:49.953742 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-945fa803-d3cb-4038-bc16-4e8f78d8fba7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.272388 Nov 06 20:56:49.954629 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1679/3314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:49 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:49.959389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:49.960007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:49.967021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.967459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:49.968288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:49.968790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.042916 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c28cdb2-f4e5-4249-870c-539a99f256ac tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.347654 Nov 06 20:56:50.043795 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1636/3315] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 20:56:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 20:56:50.049057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:50.050952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.067586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.069333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.070294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.070911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.164801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba32faa1-0f19-4b4a-b933-f4ef46bbcd74 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.119435 Nov 06 20:56:50.165910 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1637/3316] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:50 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:50.188245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:50.189977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.220390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.221064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.222757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.223339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.239200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.247437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9144f7c1-193c-44fc-8cd2-bedb9f0b21ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.291576 Nov 06 20:56:50.250599 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1680/3317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:49 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:50.259583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:50.265980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.279692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94a0415f-64df-43c2-a4f8-f24449f50ebf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.111777 Nov 06 20:56:50.281874 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1638/3318] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:50 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:50.299014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:50.301112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.309802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.310419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.311334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.312079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.362648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.371009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.372843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.374103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5adffa1e-7ec7-48b7-b2e3-084cb44096ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1103 microversion: 2.25 time: 0.122382 Nov 06 20:56:50.375060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1681/3319] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:50 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1103 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:50.441483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:50.442181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.448551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.449198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.450024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.450696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.552423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.560897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.562903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.564134 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-183f5322-a181-436c-911b-12bd6df8c329 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.127887 Nov 06 20:56:50.564727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1682/3320] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:50 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:50.665954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:50.675130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5df99e8-9146-4190-bfb0-f4bc9362d582 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.386562 Nov 06 20:56:50.676540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1639/3321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:50 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:50.973745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:50.974557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:50.981028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.982131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:50.982936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:50.983373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.134205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.142048 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-068ce7a0-f80f-4108-ab89-1b9dad796127 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.172020 Nov 06 20:56:51.142954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1683/3322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:50 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:51.177947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:51.179369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.186913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.187617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.188448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.189877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.240995 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03d89e64-9a8d-4bd7-ae87-6e598258b07a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066988 Nov 06 20:56:51.242391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1640/3323] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:51 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:51.266781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:51.267671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.285867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.286609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.287637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.288080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.294854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:51.296145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.324817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.326336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.328043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.329334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.414624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f3aba2c-f539-4da5-bb83-a242c93c1884 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.123751 Nov 06 20:56:51.419174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1641/3324] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:51 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:56:51.420623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:51.421354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.435566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.436019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.437244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.437354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.539153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.549602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.551025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.552205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4944a7b9-2795-4fcc-a4b7-68f7913aa3a0 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1250 microversion: 2.25 time: 0.135693 Nov 06 20:56:51.552863 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1642/3325] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:51 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1250 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:51.585911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:51.586720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.593864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.594919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.596126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.597356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.627718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.639324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e6df656-1c4a-4fa1-972e-8925c4c51a4d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1325 microversion: 2.1 time: 0.376143 Nov 06 20:56:51.639919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1684/3326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:51 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:51.692050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:51.692773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:51.704155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.704743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.705629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:51.706670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:51.722100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.736857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.741086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:51.742546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10791927-fc56-4178-8468-65e6a26f35c7 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.162208 Nov 06 20:56:51.746189 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1643/3327] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:51 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:52.000011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:52.010818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef5ec36d-fe20-44a2-a8dc-fbc0e6495b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.322793 Nov 06 20:56:52.011415 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1685/3328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:51 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:52.159281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:52.159894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:52.167763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.168213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.170040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.170517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.256097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:52.257749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:52.265970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.266682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.268265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.269625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.386827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:52.387368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62d9edc2-805e-4b99-83bc-1bd315cdefe2 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.136485 Nov 06 20:56:52.388233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1686/3329] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:52 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:52.394349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ca8eae4-04f3-47e6-bcf2-62a07e165aa6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1511 microversion: 2.1 time: 0.238777 Nov 06 20:56:52.398584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1644/3330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:52 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:52.427918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:52.429486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:52.443430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.445303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.446282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.448598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.508993 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4230c049-ba58-402b-bb1a-8c1688c5e79f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.085189 Nov 06 20:56:52.510264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1687/3331] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:52 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:52.577003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:52.577416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:52.592208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.600055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.603932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.604611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.657984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:52.658698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:52.677009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.678501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:52.679322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:52.683404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.093297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.103020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.105782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.106955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58756ad6-3436-49da-9473-bb6165d0a305 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1292 microversion: 2.25 time: 0.538299 Nov 06 20:56:53.117283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1645/3332] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:52 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1292 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:53.117283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:53.117283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:53.135537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.136008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.136561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.138811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.139267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.152038 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77e3e829-c94f-47a0-9e37-09618c5715ff tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.498984 Nov 06 20:56:53.153431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1688/3333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:52 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:53.166899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:53.169615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:53.177847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.179278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.180522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.181174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.275870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.283706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.291421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.292924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3abaecd5-3216-4271-b09e-7cdea8f22ebf tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1365 microversion: 2.57 time: 0.184033 Nov 06 20:56:53.304460 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1646/3334] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:53 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:53.317157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:53.318003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:53.326217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.327015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.328092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:53.328818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:53.947801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:53.961134 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9b06c6e-e26a-4d78-99cd-1dc0124cfb1e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.803990 Nov 06 20:56:53.971774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1689/3335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:53 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:53.980169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:53.985136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:53.997747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.000585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.003941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.004579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.026224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.034246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7c95873-3265-4768-ba25-53c2b3d6a3c5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.727221 Nov 06 20:56:54.049249 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1647/3336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:53 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:54.058268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.059928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.075526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.076066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.076994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.077541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.093562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee60755c-a59b-48b6-92d8-cd0337bebbe5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.120033 Nov 06 20:56:54.099925 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1690/3337] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:53 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:54.106775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:54.109521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.120052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.120797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.121810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.122415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.177055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24be4088-0630-45f3-9757-b215343e4610 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.074246 Nov 06 20:56:54.180540 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1691/3338] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:54 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:54.187594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b82a964-04f8-4d7e-90c0-b9d0e5a6e639 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-891264091", "metadata": {"": ""}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:54.191401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b82a964-04f8-4d7e-90c0-b9d0e5a6e639 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:54.193678 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b82a964-04f8-4d7e-90c0-b9d0e5a6e639 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action" status: 400 len: 170 microversion: 2.1 time: 0.011561 Nov 06 20:56:54.195030 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1692/3339] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Nov 6 20:56:54 2021] POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action => generated 170 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:56:54.203889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.205093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.219003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.219536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.220583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.222038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.366296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.376814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e7909ed-b589-491b-b8c1-ba1ee7e01596 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1488 microversion: 2.1 time: 0.324921 Nov 06 20:56:54.378412 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1648/3340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1488 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:54.385048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.385846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.402485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.404906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.414010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.414833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.535658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.546975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.548578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.550317 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b10e1075-5bdd-42f3-8450-c12105f9ca91 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.352653 Nov 06 20:56:54.552085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1693/3341] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:54.565493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.566191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.577995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.578665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.579645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.580240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.667793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.679019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.680584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.681984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f4b5a3f-47ce-40b3-9e56-49656dc206cd tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1371 microversion: 2.57 time: 0.128565 Nov 06 20:56:54.694589 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1694/3342] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:54.699652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:54.700891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.708033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:54.708731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.709340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.710300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.710884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.715480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f8ebfbb-b85d-4c10-9f7f-25a9a7e93741 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.335858 Nov 06 20:56:54.716055 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1649/3343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:54.724694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-de9a65f8-576f-41d6-8616-2a7326e17e60 req-ddd25d61-37e7-40f3-8362-170e03cba06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1791c480-1c88-478b-91cb-e512a6b911cc", "tag": "1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:54.729744 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:54.729744 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:56:54.745618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-de9a65f8-576f-41d6-8616-2a7326e17e60 req-ddd25d61-37e7-40f3-8362-170e03cba06a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.746091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-de9a65f8-576f-41d6-8616-2a7326e17e60 req-ddd25d61-37e7-40f3-8362-170e03cba06a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.759429 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-de9a65f8-576f-41d6-8616-2a7326e17e60 req-ddd25d61-37e7-40f3-8362-170e03cba06a service nova] Creating event network-changed:1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e for instance 1791c480-1c88-478b-91cb-e512a6b911cc on nch2-master-1 Nov 06 20:56:54.764744 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-de9a65f8-576f-41d6-8616-2a7326e17e60 req-ddd25d61-37e7-40f3-8362-170e03cba06a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044770 Nov 06 20:56:54.765701 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1650/3344] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:54.771123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.771833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.778716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.779173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.780737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.781128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.788091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d2c2811-719d-4664-ab86-268c2db16ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 200 len: 131 microversion: 2.1 time: 0.091510 Nov 06 20:56:54.789596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1695/3345] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:56:54 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 131 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:54.802084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:54.802814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:54.817424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.824427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:54.826664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:54.828693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.083642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:55.095103 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4384535f-c940-4f7e-8e38-76dc39b0f49d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.328197 Nov 06 20:56:55.113758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1651/3346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:55.119384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:55.119973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.141503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.142001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.148513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.148513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.278584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:55.287399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-401dae0c-f5f4-4a9f-9524-46570bdee02d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.491708 Nov 06 20:56:55.291012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1696/3347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:54 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:55.304389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:55.305614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.316277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.321901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.322939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.323550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.404395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bbde4eb3-e8fb-4c3c-bd5c-87012b890d90 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.111166 Nov 06 20:56:55.410381 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1697/3348] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:55 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:55.415999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc567f09-48bb-4809-b7e0-59171bee3e5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1941773661", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:55.417878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc567f09-48bb-4809-b7e0-59171bee3e5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:55.418739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc567f09-48bb-4809-b7e0-59171bee3e5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action" status: 400 len: 938 microversion: 2.1 time: 0.007124 Nov 06 20:56:55.419982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1698/3349] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Nov 6 20:56:55 2021] POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action => generated 938 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:56:55.425855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:55.426877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.451773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.455051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.459374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.460089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.477376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:55.486312 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18e77662-205d-45e5-956d-a11f65d2d6e7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.376780 Nov 06 20:56:55.497675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1652/3350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:55 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:55.504629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:55.505704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.515126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcdd6e35-956c-4dba-af83-91a1558587ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.093613 Nov 06 20:56:55.516515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1699/3351] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:55 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:55.521302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:55.522008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.526011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.527791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.528669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.529112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.544267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.545330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.546167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.550820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.955702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:55.966366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9c03479-966b-4331-ace7-700b7462cdfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.466508 Nov 06 20:56:55.969493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1653/3352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:55 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:55.976821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:55.977757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:55.990764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.991688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:55.993413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:55.994776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.015309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.027752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d06b916f-5d6b-470b-b17f-000c99e591ed tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.510526 Nov 06 20:56:56.029021 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1700/3353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:55 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:56.036254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:56.037043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:56.048722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.049574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.050508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.051221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.164028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.174180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.185105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.185105 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b1ffc74-bbea-4d43-89ea-871282fc8c51 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1371 microversion: 2.57 time: 0.147511 Nov 06 20:56:56.185105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1701/3354] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:56 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:56.185105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:56.185105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:56.192073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.192599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.193408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.193849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.439493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.450056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.451793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.453465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19167a5c-2638-41a2-9988-ae30a05474ad tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.482359 Nov 06 20:56:56.454106 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1654/3355] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:55 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:56.468935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1881778209", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "eb18f83c-d18b-4a29-9010-a6e673304a12"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:56.490417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.502045 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5fb0977e-a4f3-4cbe-bf2a-2278296746b2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.322705 Nov 06 20:56:56.503486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1702/3356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:56 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:56.508337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:56.509595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:56.521414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.522321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.523987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.524562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.537216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] validate_networks() for [('eb18f83c-d18b-4a29-9010-a6e673304a12', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:56:56.575457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1b11ec5-e734-43e0-ad14-cda8c0a19dbd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.070530 Nov 06 20:56:56.576120 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1703/3357] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:56 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:56.581927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:56.582626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:56.589644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.590098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.591730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.592397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.938254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:56.946390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-549b4f24-54e8-4d00-812b-2ffe538d1ad5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.368869 Nov 06 20:56:56.956333 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1704/3358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:56 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:56.956333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-402197b1-110d-478b-b2a9-f5d3d72dd28c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:56.956333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-402197b1-110d-478b-b2a9-f5d3d72dd28c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:56.956333 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-402197b1-110d-478b-b2a9-f5d3d72dd28c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action" status: 400 len: 619 microversion: 2.1 time: 0.005855 Nov 06 20:56:56.958195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1705/3359] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Nov 6 20:56:56 2021] POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:56:56.963949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:56.964943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:56.970983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.971429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:56.972209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:56.972699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.011824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f86997e6-f5aa-4969-a589-509b85f4ef94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.052417 Nov 06 20:56:57.015887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1706/3360] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:56 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:57.017148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:57.017834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:57.024557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.025003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.025771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.026236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.407834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:57.418881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9195c10-3275-4c68-aa41-ada21fd7f511 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.405217 Nov 06 20:56:57.419999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1707/3361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:57 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:57.425151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:57.425834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:57.427882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:56:57.428360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:56:57.429207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:56:57.429678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:56:57.430366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:56:57.433759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.434290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.435168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.435688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.449927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.450433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.451320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.451784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.475151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:56:57.480489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:56:57.493469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:56:57.496470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:56:57.516626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:57.531770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:57.533512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:57.535431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-185ab8e2-0679-43c8-8d48-5bf7e15ae522 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1371 microversion: 2.57 time: 0.114369 Nov 06 20:56:57.536352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1708/3362] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:57 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:57.540710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3556f80c-83c8-4577-bf86-ff2d3d6ab687 req-72197979-f255-491c-8d13-262604bfbafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-plugged", "status": "completed", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:57.542467 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:56:57.542467 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:56:57.550473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3556f80c-83c8-4577-bf86-ff2d3d6ab687 req-72197979-f255-491c-8d13-262604bfbafd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.551250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3556f80c-83c8-4577-bf86-ff2d3d6ab687 req-72197979-f255-491c-8d13-262604bfbafd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.557083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0dfea568-8a26-40fd-aa0f-ce7aea328e5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101737 Nov 06 20:56:57.557745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1655/3363] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:56:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:56:57.562236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:57.562940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:57.570581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.571257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.572212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.572831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.577387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3556f80c-83c8-4577-bf86-ff2d3d6ab687 req-72197979-f255-491c-8d13-262604bfbafd service nova] Creating event network-vif-plugged:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:56:57.584891 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3556f80c-83c8-4577-bf86-ff2d3d6ab687 req-72197979-f255-491c-8d13-262604bfbafd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047656 Nov 06 20:56:57.585926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1709/3364] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:56:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:56:57.590895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:57.591916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:57.601799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.602485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.603571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:57.604585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:57.974015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:57.981526 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7c07c7b-cc7a-4f17-b9b7-936946c0cafb tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.422746 Nov 06 20:56:57.985739 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1656/3365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:57 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:57.994614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8be24aec-95ad-4e17-904f-c4825930f261 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:57.995428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8be24aec-95ad-4e17-904f-c4825930f261 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.041042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.050042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.052004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.053827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccbd40c0-a863-4ad6-88a9-465ddf77f485 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.466673 Nov 06 20:56:58.054791 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1710/3366] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:57 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:58.059390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:58.060368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.067825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.068433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.069543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.070063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.072629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8be24aec-95ad-4e17-904f-c4825930f261 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.083313 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8be24aec-95ad-4e17-904f-c4825930f261 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1215 microversion: 2.1 time: 0.096312 Nov 06 20:56:58.084415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1657/3367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:57 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:58.090523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:58.091135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.098772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.099237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.100036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.100671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.248248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.258098 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2037927a-d094-4585-add0-8e84765066e5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.172441 Nov 06 20:56:58.258661 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1658/3368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:58 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:58.270578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19b35f33-c548-4a47-b75f-09f58f320f95 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.214372 Nov 06 20:56:58.271990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1711/3369] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:58 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:58.273927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-890729119"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:58.278294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.282277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:58.284679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.293671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.294430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.295723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.297455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.307330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.309004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.309871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.310297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.361531 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b8a1aab-52a1-4c2c-9720-829f9d8ef47f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.086976 Nov 06 20:56:58.376472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1712/3370] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:58 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:56:58.559001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:58.565652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.583375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.585031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.586006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.586698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.665244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79f52acc-fa08-412b-b8ac-648f05c13402 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action" status: 202 len: 0 microversion: 2.1 time: 0.404851 Nov 06 20:56:58.671920 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1659/3371] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:56:58 2021] POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:56:58.678586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-77344169"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:58.679995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.687214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.687665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.688513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.689176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.723186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.734227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Cannot 'createImage' instance de50665b-f9fe-480d-b6a4-1591f2cc2757 while it is in task_state image_snapshot_pending Nov 06 20:56:58.736464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 409 to user: Cannot 'createImage' instance de50665b-f9fe-480d-b6a4-1591f2cc2757 while it is in task_state image_snapshot_pending {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:56:58.738126 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-efc5d297-f5bd-44a4-82d8-697ab6739049 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action" status: 409 len: 167 microversion: 2.1 time: 0.064737 Nov 06 20:56:58.739217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1660/3372] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:56:58 2021] POST /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757/action => generated 167 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:56:58.746537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-772549dd-1388-483d-9244-087dacb54c6d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f67154f0f70>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:58.749928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.757704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:58.761831 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bea68159-c080-4340-8e3e-db0401061ce8 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1371 microversion: 2.57 time: 0.210093 Nov 06 20:56:58.762397 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1713/3373] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:58 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:56:58.909807 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-772549dd-1388-483d-9244-087dacb54c6d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/images/b5b64b4d-91d6-4356-995e-721352b26060" status: 204 len: 0 microversion: 2.1 time: 0.166661 Nov 06 20:56:58.910761 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1661/3374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:58 2021] DELETE /compute/v2.1/images/b5b64b4d-91d6-4356-995e-721352b26060 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:56:58.918609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:58.919217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:58.927587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.928074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:58.928915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:58.929350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.074339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:59.074964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:59.083158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.083645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.084825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.084934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.584146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:59.593198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0916b4e3-e7d6-42e3-8f13-afe2c0ab9035 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1533 microversion: 2.1 time: 0.678390 Nov 06 20:56:59.593864 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1714/3375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:58 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1533 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:56:59.601149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:59.602001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:59.608689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.609291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.610221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.610864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.745019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:59.760744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d4b22ee-e570-42a4-b7f7-c435263e65d6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1273 microversion: 2.1 time: 0.165333 Nov 06 20:56:59.761762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1715/3376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:59 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:56:59.769749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:56:59.770484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:59.778745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.779227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.790293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.790998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.950918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:59.964087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:59.968744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:56:59.970139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d82ec68-9544-499e-adc4-40a3f729edb6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.899898 Nov 06 20:56:59.970702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1662/3377] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:56:59 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:56:59.975562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:56:59.976525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:56:59.982443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.983253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:56:59.984699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:56:59.985158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.051864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ee3f199-c324-4b0f-aba2-175d603f7298 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.079477 Nov 06 20:57:00.053526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1663/3378] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:56:59 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:00.061358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:00.062397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.072392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.072691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.073683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.074213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.133265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32db465e-0e83-4303-a22e-4494261abc2e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.077874 Nov 06 20:57:00.133915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1664/3379] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:00 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:00.139984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f50daa0e-3442-4aa8-823b-c0654c813ce1 req-23d41d94-f93c-4b8a-bdc1-7c56977e0b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef5068-4637-46e6-b3e8-124382b109f1", "name": "network-vif-plugged", "status": "completed", "tag": "21508f07-0718-477d-a58c-ec0512e5bdad"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:00.141537 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:00.141537 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:00.152654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f50daa0e-3442-4aa8-823b-c0654c813ce1 req-23d41d94-f93c-4b8a-bdc1-7c56977e0b8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.152654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f50daa0e-3442-4aa8-823b-c0654c813ce1 req-23d41d94-f93c-4b8a-bdc1-7c56977e0b8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.166728 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f50daa0e-3442-4aa8-823b-c0654c813ce1 req-23d41d94-f93c-4b8a-bdc1-7c56977e0b8e service nova] Creating event network-vif-plugged:21508f07-0718-477d-a58c-ec0512e5bdad for instance fcef5068-4637-46e6-b3e8-124382b109f1 on nch2-master-1 Nov 06 20:57:00.171748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f50daa0e-3442-4aa8-823b-c0654c813ce1 req-23d41d94-f93c-4b8a-bdc1-7c56977e0b8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035531 Nov 06 20:57:00.172862 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1665/3380] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:00.178705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.179430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.187114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.187972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.188423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.189895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.239759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.250448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b0ac7333-859a-4272-93e2-7c7de0b3a419 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.487550 Nov 06 20:57:00.260685 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1716/3381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:56:59 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:00.311927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.323298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.324819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.326858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f840c780-8f5b-46b9-aef9-3d95653ae0c1 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1356 microversion: 2.57 time: 0.152875 Nov 06 20:57:00.327626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1666/3382] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:00 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:00.360371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.360997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.369216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.370042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.370923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.371433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.406304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:00.513443 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0879f0d1-6f27-4957-a009-f9ce8a5f8c15 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 204 len: 0 microversion: 2.1 time: 0.163254 Nov 06 20:57:00.515291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1717/3383] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:00 2021] DELETE /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:00.523285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.524000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.531161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.531385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.532327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.533146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.612440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.613166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.619289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.619767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.621172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.621651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.626030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.635345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdfdcd51-8655-447a-8048-347612564909 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1296 microversion: 2.1 time: 0.115458 Nov 06 20:57:00.636030 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1667/3384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:00 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:00.780996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.781698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.789770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.791897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.792788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.793397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.952036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:00.960859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70050dcc-760b-4d63-9a7a-5fa8f7931581 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1273 microversion: 2.1 time: 0.185664 Nov 06 20:57:00.970494 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1668/3385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:00 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:00.987853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:00.988436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:00.994473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.994932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:00.995721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:00.996157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.061631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.069576 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acb5b22b-a209-4793-80fe-abda5ac35ed0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1533 microversion: 2.1 time: 0.462363 Nov 06 20:57:01.070145 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1718/3386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:00 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1533 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:01.074475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:01.075429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:01.082474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.082928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.083704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.084136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.137289 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01b52c3a-adbf-4621-ab06-897b6147975d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.065907 Nov 06 20:57:01.138720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1719/3387] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:01 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:01.145244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:01.146232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:01.153036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.153582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.154365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.154798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.200179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-167d4967-79ef-4476-a82b-9295af6a2262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.059080 Nov 06 20:57:01.201245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1720/3388] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:01 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:01.267725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:01.269138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:01.276886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.277558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.278458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.278971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.373991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.382908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.386998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.389361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be6e3ce8-0046-436f-a21e-2a8da1bb130e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.405222 Nov 06 20:57:01.390210 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1669/3389] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:00 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:57:01.654303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:01.655601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:01.662786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.663514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.664439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.665293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.681361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.689154 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-561d5294-e965-4159-812c-f8e2a8f2e34f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1317 microversion: 2.1 time: 0.425668 Nov 06 20:57:01.702394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1721/3390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:01 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:01.736261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:01.745414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e190e495-91d1-483d-96b5-d703675f6390 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1296 microversion: 2.1 time: 0.096495 Nov 06 20:57:01.746291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1670/3391] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:01 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:01.978119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:01.978723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:01.995220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.995689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:01.996536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:01.996964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.087287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:02.088568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:02.095094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.095529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.097146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.097595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.658916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:02.672387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c8d2783-5b08-45cd-b1c0-009e7c38f0aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.697119 Nov 06 20:57:02.675389 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1722/3392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:01 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:02.680474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:02.681838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:02.692116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.693045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.694046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.694961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.726179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:02.736704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b3db3b2-f81f-4667-8ae4-3d5d37f21525 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1539 microversion: 2.1 time: 0.653072 Nov 06 20:57:02.737484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1671/3393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:02 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1539 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:02.748039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f8f50e7-f8ff-43c8-b024-cc845f3876c5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.070995 Nov 06 20:57:02.753602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:02.754291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1723/3394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:02 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:02.755051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:02.760277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:02.760926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:02.763922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.764567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.765515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.766307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.781651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.782111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.783108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.783730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.834089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b9f54c3-a7ac-42af-844f-861ab4c618aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.083756 Nov 06 20:57:02.839840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1672/3395] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:02 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:02.845784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:02.847411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:02.856722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.857395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:02.858360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:02.858941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.110211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.119606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.121957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.123158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9974b240-ea3e-4d6d-8336-d2d4da896d44 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.367612 Nov 06 20:57:03.135400 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1724/3396] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:02 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:03.135400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:03.135400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:03.138503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.138806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.140690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.141686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.167891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.178061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c588d1f-fe47-4259-85da-958d33166282 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1467 microversion: 2.1 time: 0.335925 Nov 06 20:57:03.178679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1673/3397] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:02 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1467 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:03.195768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:03.196425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:03.203232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.203685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.204544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.205016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.247185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a7b03418f54292ab9e70a1a36622ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661d53a03444645b01499f756e32627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.260183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22ff1445-348c-4b0c-9f22-08d5206bdd2b tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 200 len: 1296 microversion: 2.1 time: 0.134814 Nov 06 20:57:03.261049 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1725/3398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:03 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:03.265438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3db2112b-5b13-4aee-bf6c-6d6b0e458b03 req-4096de1b-7e5e-4a7b-b9a6-a1fbd2461e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b981f8-9d0d-4885-92fd-36b67332203a", "tag": "ac110983-e7fe-43d9-8d9e-d8bac8f7734c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:03.266956 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:03.266956 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:03.277201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3db2112b-5b13-4aee-bf6c-6d6b0e458b03 req-4096de1b-7e5e-4a7b-b9a6-a1fbd2461e00 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.278132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3db2112b-5b13-4aee-bf6c-6d6b0e458b03 req-4096de1b-7e5e-4a7b-b9a6-a1fbd2461e00 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.295235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3db2112b-5b13-4aee-bf6c-6d6b0e458b03 req-4096de1b-7e5e-4a7b-b9a6-a1fbd2461e00 service nova] Creating event network-changed:ac110983-e7fe-43d9-8d9e-d8bac8f7734c for instance e9b981f8-9d0d-4885-92fd-36b67332203a on nch2-master-1 Nov 06 20:57:03.310496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3db2112b-5b13-4aee-bf6c-6d6b0e458b03 req-4096de1b-7e5e-4a7b-b9a6-a1fbd2461e00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047102 Nov 06 20:57:03.311424 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1726/3399] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:03.467331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:03.478646 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7787577b-8291-4a9d-b73d-ab391cd37670 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1468 microversion: 2.1 time: 0.284546 Nov 06 20:57:03.479463 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1674/3400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:03 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1468 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:03.498656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1185470730"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:03.500448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:03.514232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.514684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.523982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.524504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.700256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:03.703890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:03.721966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.723519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.725627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.726383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.909233 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-593e852c-b1d6-4d14-906f-942282182ebc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "POST /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc/action" status: 202 len: 0 microversion: 2.1 time: 0.412709 Nov 06 20:57:03.923820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1727/3401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:03 2021] POST /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:57:03.940805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:03.942625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:03.954325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.956939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:03.961463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:03.962112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.072323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:04.083653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b9a299e-6794-4efe-83b8-820ec83d27b3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.392467 Nov 06 20:57:04.094202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1675/3402] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:03 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:04.099602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:04.100601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:04.106961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.107145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.107862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.108334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.155339 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10e82151-875e-48a5-8b21-d12cd15214be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.059533 Nov 06 20:57:04.155965 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1676/3403] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:04 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:04.162916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:04.163974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:04.171613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.172147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.172874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.173313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.226634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:04.229041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea1e600c-2230-4f10-80b7-029a501ab262 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.071462 Nov 06 20:57:04.229819 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1677/3404] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:04 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:04.235028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87b0ebed-5ad5-4c3e-91d1-194ae60ec567 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671adc9550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:04.235839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95e804fd-6c58-49ab-8a9f-ace17db91ec7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1539 microversion: 2.1 time: 0.307311 Nov 06 20:57:04.245921 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1728/3405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:03 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:04.245921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:04.245921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:04.251408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.251872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.252774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.253364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.297610 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87b0ebed-5ad5-4c3e-91d1-194ae60ec567 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.066299 Nov 06 20:57:04.298458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1678/3406] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:04 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:04.310381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:04.311280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] [instance: 79ac3d0d-96c0-41e8-ac54-22ad21abf405] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:04.318591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.319351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.320478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:04.321126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:04.340036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] HTTP exception thrown: Instance 79ac3d0d-96c0-41e8-ac54-22ad21abf405 could not be found. Nov 06 20:57:04.340789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] Returning 404 to user: Instance 79ac3d0d-96c0-41e8-ac54-22ad21abf405 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:04.341723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67f3d858-bdc1-4d76-9c8d-9295f655a051 tempest-ServerShowV257Test-1069317352 tempest-ServerShowV257Test-1069317352-project] 10.222.0.13 "GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405" status: 404 len: 111 microversion: 2.1 time: 0.036861 Nov 06 20:57:04.342914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1679/3407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:04 2021] GET /compute/v2.1/servers/79ac3d0d-96c0-41e8-ac54-22ad21abf405 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:04.498355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:04.509706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:04.511095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:04.520071 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e32acd7e-4003-49a4-9741-b1212bd2ba45 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.281610 Nov 06 20:57:04.521035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1729/3408] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:04 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:05.100573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:05.101193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:05.107599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.108058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.108877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.109322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.167972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:05.169119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:05.176654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.177206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.178329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.178971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.250727 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc630b96-1851-4edd-b676-bbf93fed19af tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.085366 Nov 06 20:57:05.256845 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1730/3409] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:05 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:05.265100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:05.272709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:05.288128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.290024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.290953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.291723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.321221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:05.329031 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32717eda-d627-4373-a611-517b6c05428b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.232094 Nov 06 20:57:05.330363 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1680/3410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:05 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:05.373952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:05.374771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:05.374957 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7e58740-c618-4170-959d-3a3d085dfa82 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.116370 Nov 06 20:57:05.376458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1731/3411] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:05 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:05.385662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3cab963-7fbc-446d-b45d-071ea8199102 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aa9b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:05.391137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.391600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.394901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.395382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.447404 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3cab963-7fbc-446d-b45d-071ea8199102 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.065284 Nov 06 20:57:05.449203 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1732/3412] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:05 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:05.532761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3b2653fd-bb8d-48fe-8dbe-92c4fdfe7da8 req-8f8c248b-b626-40f9-93a2-b777132bdb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1791c480-1c88-478b-91cb-e512a6b911cc", "name": "network-vif-plugged", "status": "completed", "tag": "1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:05.535823 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:05.535823 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:05.548237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3b2653fd-bb8d-48fe-8dbe-92c4fdfe7da8 req-8f8c248b-b626-40f9-93a2-b777132bdb62 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.548951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3b2653fd-bb8d-48fe-8dbe-92c4fdfe7da8 req-8f8c248b-b626-40f9-93a2-b777132bdb62 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.561853 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3b2653fd-bb8d-48fe-8dbe-92c4fdfe7da8 req-8f8c248b-b626-40f9-93a2-b777132bdb62 service nova] Creating event network-vif-plugged:1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e for instance 1791c480-1c88-478b-91cb-e512a6b911cc on nch2-master-1 Nov 06 20:57:05.567724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3b2653fd-bb8d-48fe-8dbe-92c4fdfe7da8 req-8f8c248b-b626-40f9-93a2-b777132bdb62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039165 Nov 06 20:57:05.569011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1733/3413] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:57:05.575464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:05.576653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:05.583868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.584675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.585699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:05.586349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:05.624256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:05.636091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ea588e0-ec93-4aea-a404-989df1b5c63b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1534 microversion: 2.1 time: 0.303798 Nov 06 20:57:05.646703 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1681/3414] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:05 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1534 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:05.959829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:05.968174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:05.974097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:05.975232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69d3e573-4081-4d4f-8dda-8a1910028a10 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.404863 Nov 06 20:57:05.975809 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1734/3415] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:05 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:06.267670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:06.269449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:06.281411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.282097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.283094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.283807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.340050 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20833661-d4ec-4e02-857f-c9701868f63c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.075822 Nov 06 20:57:06.345352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1682/3416] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:06 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:06.346455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:06.347939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:06.356212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.356887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.358352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.359079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.389008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:06.390034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:06.407121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.407626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.408515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.409262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.456773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e4cf79a-99b1-4d25-abb5-a47731bad1f9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.071345 Nov 06 20:57:06.460487 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1683/3417] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:06 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:06.466200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b8d0a22-b95d-4742-84c9-ffaec300ee6a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715453160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:06.511744 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b8d0a22-b95d-4742-84c9-ffaec300ee6a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.052607 Nov 06 20:57:06.518479 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1684/3418] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:06 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:06.600034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:06.609661 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77feba90-86de-4f92-955c-854cb2ed4733 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.267379 Nov 06 20:57:06.610841 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1735/3419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:06 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:06.655173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:06.656063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:06.663632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.664095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.665204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.665665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.903415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:06.911782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bd7d96f-1df4-49ca-9117-ca28d9352f14 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1521 microversion: 2.1 time: 0.261779 Nov 06 20:57:06.912497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1685/3420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:06 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:06.930393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:06.931115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:06.939817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.940967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.941801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:06.942222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:06.970465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:06.995726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:06.996889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:07.004181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.004916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.005547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.007144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.061024 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b58739d6-668f-46f5-ae2c-9e8045954c5f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 204 len: 0 microversion: 2.1 time: 0.134442 Nov 06 20:57:07.062436 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1736/3421] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:06 2021] DELETE /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:07.071333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:07.071710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:07.077559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.078020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.078853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.079304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.423626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:07.435176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:07.436765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:07.438124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2177efab-2472-43bf-8ed3-7d85dab314ff tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1280 microversion: 2.25 time: 0.447062 Nov 06 20:57:07.438813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1686/3422] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:06 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1280 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:07.454813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:07.457533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:07.463065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:07.466957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.467650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.468703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.469567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.482713 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60d54bb6-9c72-4cab-b6c7-29843b895bc7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1527 microversion: 2.1 time: 0.415689 Nov 06 20:57:07.483772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1737/3423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:07 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1527 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:07.496078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:07.497310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:07.507787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.508599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.509919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.510031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.546124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59c8286c-3d7c-498c-8cf4-e2fb01d57625 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.105776 Nov 06 20:57:07.547164 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1687/3424] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:07 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:07.558437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f91a4c75-7f3f-4040-b11a-0f2076835784 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715a068b0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:07.578749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb6b192e-a166-43d2-a31a-486dcebff2a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.092540 Nov 06 20:57:07.579462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1738/3425] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:07 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:07.629731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-664284cd-b379-42a9-b52d-c15561a417f6 req-4831678e-deee-41c8-8891-2a18a63fe037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de50665b-f9fe-480d-b6a4-1591f2cc2757", "name": "network-vif-plugged", "status": "completed", "tag": "7da66a9d-f034-4223-9041-8301ccc26527"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:07.632988 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:07.632988 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:07.639968 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f91a4c75-7f3f-4040-b11a-0f2076835784 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.091434 Nov 06 20:57:07.645195 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1688/3426] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:07 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:07.666406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-664284cd-b379-42a9-b52d-c15561a417f6 req-4831678e-deee-41c8-8891-2a18a63fe037 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.667002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-664284cd-b379-42a9-b52d-c15561a417f6 req-4831678e-deee-41c8-8891-2a18a63fe037 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.669227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:07.671098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:07.711450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.711954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.712938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:07.713389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:07.730195 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-664284cd-b379-42a9-b52d-c15561a417f6 req-4831678e-deee-41c8-8891-2a18a63fe037 service nova] Creating event network-vif-plugged:7da66a9d-f034-4223-9041-8301ccc26527 for instance de50665b-f9fe-480d-b6a4-1591f2cc2757 on nch2-master-1 Nov 06 20:57:07.748991 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-664284cd-b379-42a9-b52d-c15561a417f6 req-4831678e-deee-41c8-8891-2a18a63fe037 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124580 Nov 06 20:57:07.750775 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1739/3427] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:08.061514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:08.072356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbbe9480-0d7b-483b-bf89-a86dc1a92afc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.425780 Nov 06 20:57:08.073100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1689/3428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:07 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:08.457659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:08.458331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:08.474928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.476589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.479062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.480996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.502939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:08.503675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:08.513262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.516742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.517737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.529045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.839534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:08.846645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:08.855469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:08.859259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:08.861157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34579c1c-d940-4584-bfc1-a35d68e13f1e tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1476 microversion: 2.25 time: 0.408227 Nov 06 20:57:08.863476 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eff9db54-af86-47bb-a77a-42878d84b390 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1527 microversion: 2.1 time: 0.365593 Nov 06 20:57:08.878400 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1690/3429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:08 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1527 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:08.884646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1740/3430] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:08 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:08.905330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:08.906688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:08.907521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:08.911345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:08.938866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.941000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.941928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.947248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.954087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.955649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:08.956582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:08.958271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.032871 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db5b596e-a404-4ff4-9e14-147f26407d0a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.140757 Nov 06 20:57:09.042349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1741/3431] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:08 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:09.050394 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdb5590f-3cb3-45ad-9d1f-e0cf06990b33 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.170415 Nov 06 20:57:09.056727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cef372db-00f3-4b58-b320-398ae3221e17 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671acf3b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:09.071656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1691/3432] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:08 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:09.100040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:09.101082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:09.116281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.117216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.120791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.124914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.153221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cef372db-00f3-4b58-b320-398ae3221e17 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.104995 Nov 06 20:57:09.163067 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1742/3433] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:09 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:09.172120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:09.172905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:09.186658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.188100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.189473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.190735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.398195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:09.407830 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e703313-2226-4c40-83ae-81c6eb07ff6f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.243606 Nov 06 20:57:09.409245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1743/3434] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:09 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:09.413179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 1791c480-1c88-478b-91cb-e512a6b911cc {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:09.437427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3b1b27e-88a6-431e-b931-06ee14bad3d9 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1968 microversion: 2.25 time: 0.362008 Nov 06 20:57:09.438200 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1692/3435] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:09 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1968 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:09.455480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:09.456887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:09.463504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.463957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.465411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.465857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.575112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1429849467", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "a5eb6519-b7b2-40a6-95e2-b8fbed3952b8"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:09.641872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 1791c480-1c88-478b-91cb-e512a6b911cc {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:09.668161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] validate_networks() for [('a5eb6519-b7b2-40a6-95e2-b8fbed3952b8', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:57:09.688662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7cc355b0-8427-4e6f-8934-ff64a3bee906 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1968 microversion: 2.25 time: 0.237928 Nov 06 20:57:09.689255 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1693/3436] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:09 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1968 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:57:09.709205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:09.710609 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:09.710609 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:09.717365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.717843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.719901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.720388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.782926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e5a86d6-1d4d-4f43-9f4b-e2da873e7e61 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077809 Nov 06 20:57:09.784428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1694/3437] 10.222.0.13 () {60 vars in 1216 bytes} [Sat Nov 6 20:57:09 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:57:09.797931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:09.810509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:09.818081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.818809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.820064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:09.820829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:09.856328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'flavor' on Instance uuid 1791c480-1c88-478b-91cb-e512a6b911cc {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:09.877982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:57:10.635284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:57:10.635814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:57:10.636650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:57:10.637159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:57:10.637861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:57:10.649665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:10.652066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:10.655124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:10.656930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:10.699604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Getting quotas for project 21423998077b4a0e9f30b00f62b5691f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:57:10.713027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Getting quotas for user 0e9ae6578a154795b5cd02da4737a91a and project 21423998077b4a0e9f30b00f62b5691f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:57:10.739906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:57:10.742980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:57:10.854100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1ed02cb-4b12-4aa2-aae4-579c061c2df9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443424 Nov 06 20:57:10.855139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1744/3438] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:57:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:57:10.860516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-44630029-4dd7-4824-8970-4f81ddc82844 req-34a034db-060c-48f2-8314-5a6c3762d9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de50665b-f9fe-480d-b6a4-1591f2cc2757", "name": "network-vif-unplugged", "status": "completed", "tag": "7da66a9d-f034-4223-9041-8301ccc26527"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:10.863606 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:10.863606 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:10.892208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-44630029-4dd7-4824-8970-4f81ddc82844 req-34a034db-060c-48f2-8314-5a6c3762d9dd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:10.893078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-44630029-4dd7-4824-8970-4f81ddc82844 req-34a034db-060c-48f2-8314-5a6c3762d9dd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:10.912367 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-44630029-4dd7-4824-8970-4f81ddc82844 req-34a034db-060c-48f2-8314-5a6c3762d9dd service nova] Creating event network-vif-unplugged:7da66a9d-f034-4223-9041-8301ccc26527 for instance de50665b-f9fe-480d-b6a4-1591f2cc2757 on nch2-master-1 Nov 06 20:57:10.950142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-44630029-4dd7-4824-8970-4f81ddc82844 req-34a034db-060c-48f2-8314-5a6c3762d9dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088933 Nov 06 20:57:10.956825 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1745/3439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:10.967739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:10.969754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:10.978345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:10.979688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:10.981099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:10.982119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.112672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:11.132130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a713b8a-ca1b-495a-a9ce-dcb0193e8075 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 200 len: 1485 microversion: 2.1 time: 0.173167 Nov 06 20:57:11.132773 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1746/3440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:10 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 1485 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:11.147113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:11.149215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:11.168146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.168666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.169490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.169928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.216215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d6a20f6-28fa-4af5-acd0-29d1271e242a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.081927 Nov 06 20:57:11.218729 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1747/3441] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:11 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:11.231636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:11.233267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:11.246663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.247514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.248535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.250075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.374573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5f30392-1aeb-428b-ae2e-d59451c56ceb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.149618 Nov 06 20:57:11.375227 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1748/3442] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:11 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:11.388127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-999c9db2-c44a-4efc-805c-1daac93ff51e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671577ea60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:11.531618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-999c9db2-c44a-4efc-805c-1daac93ff51e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.154928 Nov 06 20:57:11.532463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1749/3443] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:11 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:11.551001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:11.553665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:11.589371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.592963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.596208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.598221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.932468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:11.941525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3db68588-57b1-484a-9a33-074836cf1d84 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.407928 Nov 06 20:57:11.942521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1750/3444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:11 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:11.949690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:11.950511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:11.969234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.970303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:11.973688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:11.975982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.117639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:12.130626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8adcac8-fb1f-4bb1-8837-1c2697a62b84 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1224 microversion: 2.1 time: 0.186791 Nov 06 20:57:12.131832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1751/3445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:11 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:12.268151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-64a8b279-c08d-41a7-aee3-c529535728a0 req-33069a32-6b59-4b69-b816-d1ce05ff4fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de50665b-f9fe-480d-b6a4-1591f2cc2757", "name": "network-vif-deleted", "tag": "7da66a9d-f034-4223-9041-8301ccc26527"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:12.269879 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:12.269879 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:12.288770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-64a8b279-c08d-41a7-aee3-c529535728a0 req-33069a32-6b59-4b69-b816-d1ce05ff4fcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.289445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-64a8b279-c08d-41a7-aee3-c529535728a0 req-33069a32-6b59-4b69-b816-d1ce05ff4fcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.307882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-64a8b279-c08d-41a7-aee3-c529535728a0 req-33069a32-6b59-4b69-b816-d1ce05ff4fcb service nova] Creating event network-vif-deleted:7da66a9d-f034-4223-9041-8301ccc26527 for instance de50665b-f9fe-480d-b6a4-1591f2cc2757 on nch2-master-1 Nov 06 20:57:12.313806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-64a8b279-c08d-41a7-aee3-c529535728a0 req-33069a32-6b59-4b69-b816-d1ce05ff4fcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180404 Nov 06 20:57:12.343658 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1752/3446] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:12.350831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:12.351785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:12.367576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.368852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.371169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.374222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.400428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. Nov 06 20:57:12.401265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:12.402321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd692861-0af1-43f7-bfe5-3e8aedcddcf4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 404 len: 111 microversion: 2.1 time: 0.056404 Nov 06 20:57:12.407059 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1753/3447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:12 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:12.413705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:12.415198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:12.428601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.429455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.430438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.431159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.507138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5429ad9a-67f4-4f34-b58e-5f9cdf2eeca8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.100147 Nov 06 20:57:12.508148 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1754/3448] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:12 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:12.519619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:12.521894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:12.532865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.534164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.536014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:12.536710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:12.612354 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b0b3ba0d-ada0-4f24-91c6-3f5dde97afbc tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.099151 Nov 06 20:57:12.616607 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1755/3449] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:12 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:12.618770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'create', calling method: .version_select at 0x7f6714a9fc10>, body: {"keypair": {"name": "tempest-keypair-1609360858"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:12.713454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for project ec8f9116653e40f0a02c98904ff90b65. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:57:12.733912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for user e0d0cebeefdc482caf46119297ddb0ad and project ec8f9116653e40f0a02c98904ff90b65. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:57:12.990855 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-290a94b1-38cb-4660-96a9-161b136da79e tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc/action" status: 202 len: 0 microversion: 2.25 time: 3.196483 Nov 06 20:57:12.993033 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1695/3450] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:09 2021] POST /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc/action => generated 0 bytes in 3199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:13.002251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7b8b36b-3ec1-48d6-bcd7-405618c35441 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153b5b80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:13.103455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7b8b36b-3ec1-48d6-bcd7-405618c35441 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.108304 Nov 06 20:57:13.105950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1696/3451] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:12 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:13.113229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:13.114189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:13.121844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:13.122647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:13.123716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:13.124404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:13.466174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for project ec8f9116653e40f0a02c98904ff90b65. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:57:13.476520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for user e0d0cebeefdc482caf46119297ddb0ad and project ec8f9116653e40f0a02c98904ff90b65. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:57:13.508576 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2efd3309-e4a7-4c1b-a2ae-1b91a5e58785 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.894157 Nov 06 20:57:13.515269 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1756/3452] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:57:12 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:13.524777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:13.532095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:13.546837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:13.552690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:13.553861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:13.556271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:14.597423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:14.615332 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74f34468-2a88-47aa-85fb-c81e56ce6d61 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 1.504240 Nov 06 20:57:14.631925 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1697/3453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:13 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:14.643831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:14.644953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:14.663762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:14.664610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:14.665877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:14.666952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:14.868628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:14.876583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f6979e0-1486-4b0e-b59a-23ff0a584021 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1286 microversion: 2.1 time: 0.243197 Nov 06 20:57:14.882125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1698/3454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:14 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1286 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:14.887400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:14.893608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:14.907958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:14.912450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:14.913697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:14.925025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:14.953689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:14.972329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:14.974141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:14.975373 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0d8d3d1-96c4-4e63-b36e-51acd0bc1f92 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 1.458990 Nov 06 20:57:14.975933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1757/3455] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:13 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:14.993380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c43bd4f4-3ad5-4bd2-95d1-3fc879753bec req-ac7101fb-fdb7-48d7-af27-caa175b9e8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-plugged", "status": "completed", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:14.995216 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:14.995216 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:15.012369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c43bd4f4-3ad5-4bd2-95d1-3fc879753bec req-ac7101fb-fdb7-48d7-af27-caa175b9e8e4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.015782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c43bd4f4-3ad5-4bd2-95d1-3fc879753bec req-ac7101fb-fdb7-48d7-af27-caa175b9e8e4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.025383 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a9cdfbb-2b8b-4596-b357-12c7f3660d25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.141413 Nov 06 20:57:15.026808 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1699/3456] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:14 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:15.039943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:15.042057 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c43bd4f4-3ad5-4bd2-95d1-3fc879753bec req-ac7101fb-fdb7-48d7-af27-caa175b9e8e4 service nova] Creating event network-vif-plugged:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:57:15.042397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:15.063354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.063826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.065927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.069715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c43bd4f4-3ad5-4bd2-95d1-3fc879753bec req-ac7101fb-fdb7-48d7-af27-caa175b9e8e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088781 Nov 06 20:57:15.071776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.078606 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1758/3457] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:15.097331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9d90498-783c-459d-af1a-b20aa7383e9c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aa99d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:15.150545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1dc057c-cc60-440c-b98a-9868989664ac tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.121917 Nov 06 20:57:15.151607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1700/3458] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:15 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:15.172034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9d90498-783c-459d-af1a-b20aa7383e9c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.090224 Nov 06 20:57:15.172736 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1759/3459] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:15 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:15.649756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:15.650471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:15.667394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.672440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.673449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.679228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.898036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:15.899978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:15.910299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.910898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.911961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:15.913176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:15.968164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:15.979461 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8d35bb5-2db9-47ad-8034-b926158c9ca1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.331224 Nov 06 20:57:15.982052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1701/3460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:15 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:15.993557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:15.994401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:16.006010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.009191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.012206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.012893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.464687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:16.477407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:16.481504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:16.485111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e2fd018-6f55-4f2b-a7c5-da219113b007 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.495267 Nov 06 20:57:16.491437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1702/3461] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:15 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:57:16.501368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:16.502784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:16.515180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.520627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.523628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.524353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.593933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:16.603285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9121e03-7988-465c-81a2-9d1c4aca122d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.708810 Nov 06 20:57:16.614332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1760/3462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:15 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:16.615051 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14f1eb43-5f8a-4fe9-ba08-1783f1eb13e7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.120932 Nov 06 20:57:16.621974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1703/3463] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:16 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:16.629203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:16.635700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ea1917b-ee59-4809-a8c7-40c4199ec8e3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153a30d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:16.638118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:16.661145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.665656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.670295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:16.671255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:16.785549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c170e0d-a7f0-406e-be9d-b257f1131916 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.159911 Nov 06 20:57:16.787980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1761/3464] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:16 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:16.788517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ea1917b-ee59-4809-a8c7-40c4199ec8e3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.164583 Nov 06 20:57:16.797619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1704/3465] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:16 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:17.000024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:17.001238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:17.021579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.028047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.031202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.033242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.234412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2686dd67-f9b4-41e8-83c8-90dda93c6ee9 req-6ec10fc7-8add-404c-a4b6-d507f008e420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b981f8-9d0d-4885-92fd-36b67332203a", "name": "network-vif-plugged", "status": "completed", "tag": "ac110983-e7fe-43d9-8d9e-d8bac8f7734c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:17.236815 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:17.236815 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:17.249383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2686dd67-f9b4-41e8-83c8-90dda93c6ee9 req-6ec10fc7-8add-404c-a4b6-d507f008e420 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.254419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2686dd67-f9b4-41e8-83c8-90dda93c6ee9 req-6ec10fc7-8add-404c-a4b6-d507f008e420 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.277576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2686dd67-f9b4-41e8-83c8-90dda93c6ee9 req-6ec10fc7-8add-404c-a4b6-d507f008e420 service nova] Creating event network-vif-plugged:ac110983-e7fe-43d9-8d9e-d8bac8f7734c for instance e9b981f8-9d0d-4885-92fd-36b67332203a on nch2-master-1 Nov 06 20:57:17.287158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2686dd67-f9b4-41e8-83c8-90dda93c6ee9 req-6ec10fc7-8add-404c-a4b6-d507f008e420 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202623 Nov 06 20:57:17.288230 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1705/3466] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:17.515278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:17.517118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:17.530404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.531271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.534461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.535352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.550145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:17.560149 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e31256db-2cdd-4880-a7e5-7937293413f5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.566468 Nov 06 20:57:17.568950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1762/3467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:16 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:17.633420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:17.634715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:17.644838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.648953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.649987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.650589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.884153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:17.893308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:17.894868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:17.896070 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0a46689-5eaa-45f1-8fb2-c9f8fdfb88d2 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.390368 Nov 06 20:57:17.907610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1706/3468] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:17 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:17.914741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:17.917795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:17.942501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.946097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:17.947141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:17.947746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:18.026987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-220e3352-9bc5-4fc4-89b0-4f8fdd343f57 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.116925 Nov 06 20:57:18.032072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1707/3469] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:17 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:18.039214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1936758314", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514e4a26-40f9-4959-b8bc-7e6cfc5f6286"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:18.115255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] validate_networks() for [('514e4a26-40f9-4959-b8bc-7e6cfc5f6286', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:57:18.218399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:18.227459 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53d8bc27-51bf-40b5-906f-a5b23c0cf0f9 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.598380 Nov 06 20:57:18.238362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1763/3470] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:17 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:18.251191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:18.254396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:18.272898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:18.274084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:18.275407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:18.276818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:18.381497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6d80402-b3dd-48fb-b189-aa7930497e55 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.140142 Nov 06 20:57:18.383284 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1764/3471] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:18 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:18.389644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d948d282-5f0d-4693-afe8-15605c773b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a61d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:18.539087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d948d282-5f0d-4693-afe8-15605c773b45 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.154068 Nov 06 20:57:18.540368 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1765/3472] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:18 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:18.548404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c9a57aac-0b30-4932-a326-8d7695c44c5f req-ffacddc2-6740-4434-b741-ed26a735a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f4f0a1-23c6-46bd-b4c0-705a61ffdc99", "tag": "93c7d686-82c3-47f5-b551-bbb8fa1160ac"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:18.551995 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:18.551995 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:18.566584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c9a57aac-0b30-4932-a326-8d7695c44c5f req-ffacddc2-6740-4434-b741-ed26a735a3a9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:18.567751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c9a57aac-0b30-4932-a326-8d7695c44c5f req-ffacddc2-6740-4434-b741-ed26a735a3a9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:18.591995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c9a57aac-0b30-4932-a326-8d7695c44c5f req-ffacddc2-6740-4434-b741-ed26a735a3a9 service nova] Creating event network-changed:93c7d686-82c3-47f5-b551-bbb8fa1160ac for instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 on nch2-master-1 Nov 06 20:57:18.597592 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c9a57aac-0b30-4932-a326-8d7695c44c5f req-ffacddc2-6740-4434-b741-ed26a735a3a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053737 Nov 06 20:57:18.598518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1766/3473] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:18.604042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:18.604779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:18.620162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:18.620661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:18.624419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:18.625752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.233494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:19.243565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c77591a-28b3-4494-b862-b1b2f060b49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1315 microversion: 2.1 time: 0.643849 Nov 06 20:57:19.249407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1767/3474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:18 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:19.259776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:19.262764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:19.279168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.279989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.282483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.284397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.489890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:57:19.491744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:57:19.492572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:57:19.493155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:57:19.493770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:57:19.510796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.513240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.518110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.519282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.566781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:57:19.584042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for user e0d0cebeefdc482caf46119297ddb0ad and project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:57:19.613444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:57:19.618654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:57:19.713134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15d38074-f69b-4229-8c6e-bd28afd76f0e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.678783 Nov 06 20:57:19.714724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1708/3475] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:57:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:57:19.720730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:19.722002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:19.729847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.730588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.732409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.733276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.796145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:19.817392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:19.819317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:19.828399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d72ea12-f30f-4391-9447-2af0be93e62d tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.577566 Nov 06 20:57:19.832556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1768/3476] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:19 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:19.847673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:19.849304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:19.862544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.864419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:19.869533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:19.870290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:20.002579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b72d9c5-077f-485c-bf89-2760fd503a91 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.285094 Nov 06 20:57:20.003483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1709/3477] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:19 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:20.013931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:20.015095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:20.044956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:20.045418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:20.046253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:20.047514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:20.170076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c32bfa0-339c-45fc-a50f-64fce69ad0ea tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.165331 Nov 06 20:57:20.171547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1710/3478] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:20 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:20.182727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-888c2fa0-3318-4fcf-a91a-1fbce0979bf2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715319940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:20.285193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-888c2fa0-3318-4fcf-a91a-1fbce0979bf2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.112157 Nov 06 20:57:20.286216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1711/3479] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:20 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:20.297097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01737b95-a584-4531-9e8e-2df63fb614fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:20.300323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01737b95-a584-4531-9e8e-2df63fb614fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:20.726292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01737b95-a584-4531-9e8e-2df63fb614fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:20.739941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01737b95-a584-4531-9e8e-2df63fb614fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1225 microversion: 2.1 time: 0.450450 Nov 06 20:57:20.744729 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1712/3480] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:20 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1225 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:20.763655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:20.764714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:20.781311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:20.792416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:20.796392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:20.797102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.198313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:21.218809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82236cef-c1fb-4e64-86e2-ed128d69ac68 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 1.376083 Nov 06 20:57:21.219897 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1769/3481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:19 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:21.237525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:21.238466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:21.247978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.248170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:21.248903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.249910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.250583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.256014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df8f7342-044e-4f63-a57e-509333607b64 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1501 microversion: 2.1 time: 0.509609 Nov 06 20:57:21.280800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1713/3482] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:20 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1501 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:21.286577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:21.287579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:21.297330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.297791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.299163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.299614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.382908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecf8cdef-602c-48d3-b6fa-64691ce50d4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.100692 Nov 06 20:57:21.383848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1714/3483] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:21 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:21.391939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:21.393445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:21.408857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.409678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.410725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.411384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.499449 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bd889df-0acf-4a38-a95f-c61ea7541262 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.113781 Nov 06 20:57:21.503893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1715/3484] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:21 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:21.509680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:21.518251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:21.532006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.532901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.534262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.534927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.586209 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e7ae4c4-4bd3-4e7f-8415-6947a38c46cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.080322 Nov 06 20:57:21.590428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1716/3485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:21 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:21.596853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4047e421-2f51-42f1-ad57-9b18000e0c33 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715319670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:21.659425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4047e421-2f51-42f1-ad57-9b18000e0c33 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.067351 Nov 06 20:57:21.660674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1717/3486] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:21 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:21.760397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:21.762518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:21.775371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.776562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.780826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:21.782116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:21.920760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:21.930065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f22a1802-fccb-4f9d-993d-59a9670e366b tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1283 microversion: 2.1 time: 0.174757 Nov 06 20:57:21.933340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1718/3487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:21 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:22.009023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6bba15b4-eed8-440d-b97d-b1851c695be0 req-68fceee8-c1b0-480c-b28b-426eb77a91ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1791c480-1c88-478b-91cb-e512a6b911cc", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:22.011193 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:22.011193 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:22.028725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6bba15b4-eed8-440d-b97d-b1851c695be0 req-68fceee8-c1b0-480c-b28b-426eb77a91ed service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.030250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6bba15b4-eed8-440d-b97d-b1851c695be0 req-68fceee8-c1b0-480c-b28b-426eb77a91ed service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.062846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6bba15b4-eed8-440d-b97d-b1851c695be0 req-68fceee8-c1b0-480c-b28b-426eb77a91ed service nova] Creating event network-vif-unplugged:1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e for instance 1791c480-1c88-478b-91cb-e512a6b911cc on nch2-master-1 Nov 06 20:57:22.075603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6bba15b4-eed8-440d-b97d-b1851c695be0 req-68fceee8-c1b0-480c-b28b-426eb77a91ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068697 Nov 06 20:57:22.076733 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1719/3488] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:22.169926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:22.189347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:22.197666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:22.199229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34254a0e-8626-42d3-b9bd-5fe8560c992c tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.969169 Nov 06 20:57:22.201760 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1770/3489] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:21 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:22.239115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:22.240330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:22.249833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.250610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.254915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.255853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.396935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:22.398759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:22.412468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.413195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.414404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.415582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.509705 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60ed4025-fdb8-497f-beb3-108b319681fb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.116627 Nov 06 20:57:22.511207 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1771/3490] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:22 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:22.522037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:22.523633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:22.535001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.535861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.537165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.538291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.574852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:22.589443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6db12f81-f2ad-40d1-b0d1-416e17dd117d tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.356121 Nov 06 20:57:22.590125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1720/3491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:22 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:22.604656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:22.609628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ee71e2d-c142-48f3-b4eb-7aaf9f2e63f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.094877 Nov 06 20:57:22.610052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:22.612842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1772/3492] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:22 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:22.626259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.627275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.628076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.628825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.683247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a3f6a72-bbc9-4377-91b7-bf9652613e3a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b14ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:22.724862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-666b9415-5595-44fe-a468-d80a9086fd52 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.125937 Nov 06 20:57:22.728534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1721/3493] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:22 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:22.784823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a3f6a72-bbc9-4377-91b7-bf9652613e3a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.113819 Nov 06 20:57:22.785726 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1773/3494] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:22 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:22.953120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:22.954331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:22.975546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.977716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:22.981306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:22.981841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.162845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:23.175851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-459cc684-8528-4c8a-92be-6da961585a8c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1283 microversion: 2.1 time: 0.228712 Nov 06 20:57:23.177077 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1722/3495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:22 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1283 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:23.219002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:23.220425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:23.234008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.234846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.236438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.237785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.523197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:23.524137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:23.527378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:23.543283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.543751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.544596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.545045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.549031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:23.554926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:23.556963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e697504-f742-4e5a-83db-b6f6c2fe05dc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.341752 Nov 06 20:57:23.559083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1774/3496] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:23 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:23.606598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:23.607596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:23.616523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-759886c7-0eeb-403b-9f6c-7e57da41c06a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.098167 Nov 06 20:57:23.617595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1723/3497] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:23 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:23.621045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.621713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.630927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:23.634889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.635537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.638959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:23.664458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.665254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.679041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.680066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.779641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ffbb58f-1474-4535-97c6-9383236378e9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.155690 Nov 06 20:57:23.780216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1724/3498] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:23 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:23.791949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:23.793327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:23.802195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.808325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.811489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:23.812147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:23.875656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:23.885155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-52551823-fc69-4290-bec3-4ba644e817d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.282041 Nov 06 20:57:23.888028 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1775/3499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:23 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:23.899552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a8ffdd8-f269-47c4-9ba8-aec9b6f193cb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.113370 Nov 06 20:57:23.900527 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1725/3500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:23 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:23.902584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-248213d5-2a1c-4a44-828b-af8c443c818d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67150f28b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:23.975967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-248213d5-2a1c-4a44-828b-af8c443c818d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.082604 Nov 06 20:57:23.978801 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1776/3501] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:23 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:24.119840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8c929ad2-b0fb-4abc-8868-4ea6e82bf045 req-dd3a68aa-c5eb-47c8-8537-abe3fd91ec7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1791c480-1c88-478b-91cb-e512a6b911cc", "tag": "1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:24.121955 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:24.121955 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:24.136110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8c929ad2-b0fb-4abc-8868-4ea6e82bf045 req-dd3a68aa-c5eb-47c8-8537-abe3fd91ec7c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.139826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8c929ad2-b0fb-4abc-8868-4ea6e82bf045 req-dd3a68aa-c5eb-47c8-8537-abe3fd91ec7c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.171887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8c929ad2-b0fb-4abc-8868-4ea6e82bf045 req-dd3a68aa-c5eb-47c8-8537-abe3fd91ec7c service nova] Creating event network-changed:1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e for instance 1791c480-1c88-478b-91cb-e512a6b911cc on nch2-master-1 Nov 06 20:57:24.178797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8c929ad2-b0fb-4abc-8868-4ea6e82bf045 req-dd3a68aa-c5eb-47c8-8537-abe3fd91ec7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063164 Nov 06 20:57:24.183149 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1726/3502] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:24.201615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:24.202415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:24.214644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.215098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.217275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.222649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.580407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:24.581389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:24.591344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.602274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.605392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.606251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.792804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:24.802499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74e497bf-f1b8-4671-8b92-1f68ac97f6d5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.611874 Nov 06 20:57:24.806232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1777/3503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:24 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:24.822138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:24.823371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:24.839006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.839724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.840902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.842101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:24.938758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef200b2f-0ed4-4cda-9102-328600f26b7f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.129862 Nov 06 20:57:24.942238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1778/3504] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:24 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:24.950208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-65b38174-67d3-43b4-b69d-5d81b07b9db9 req-3f93586d-c596-442a-a32b-316d798e14e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32061ca8-bcb4-4e81-88ab-f5e4bd028872", "tag": "8e1bfa1e-3334-4ad8-8f73-fc61a05f1710"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:24.958850 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:24.958850 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:24.976317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-65b38174-67d3-43b4-b69d-5d81b07b9db9 req-3f93586d-c596-442a-a32b-316d798e14e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:24.977071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-65b38174-67d3-43b4-b69d-5d81b07b9db9 req-3f93586d-c596-442a-a32b-316d798e14e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.013343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-65b38174-67d3-43b4-b69d-5d81b07b9db9 req-3f93586d-c596-442a-a32b-316d798e14e3 service nova] Creating event network-changed:8e1bfa1e-3334-4ad8-8f73-fc61a05f1710 for instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 on nch2-master-1 Nov 06 20:57:25.031787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-65b38174-67d3-43b4-b69d-5d81b07b9db9 req-3f93586d-c596-442a-a32b-316d798e14e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086301 Nov 06 20:57:25.038450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1779/3505] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:25.053278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:25.058817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:25.089670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.090485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.104404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.104404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.181387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2adb58f5-ec14-4771-a6c7-60b467afe134 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.139894 Nov 06 20:57:25.182208 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1780/3506] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:25 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:25.231506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:25.231506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:25.265127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.265722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.267985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.268838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.293190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:25.304576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:25.306111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:25.307280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ede8ad37-04d0-46ba-93da-1fcae7446303 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.733315 Nov 06 20:57:25.307844 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1727/3507] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:24 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:57:25.328655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:25.337653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:25.344212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.349310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.350493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.351148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.461737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86c9682b-5a10-4fab-b6ab-51325ba06056 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.132007 Nov 06 20:57:25.471806 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1728/3508] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:25 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:25.481572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f0a059b-70f6-48ef-94b3-446b5a1846cb tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715a09550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:25.592860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f0a059b-70f6-48ef-94b3-446b5a1846cb tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.118617 Nov 06 20:57:25.594291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1729/3509] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:25 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:25.724195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:25.732828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-272278a5-859b-49fb-a21b-6bc42a4d2291 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.549354 Nov 06 20:57:25.743385 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1781/3510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:25 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:25.823016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:25.824058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:25.836332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.840932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.841783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.842236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.951309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:25.954345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:25.963069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.964078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:25.965091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:25.970657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.098850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33e7e43b-5832-4682-8c29-ebcb1277a67a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.143261 Nov 06 20:57:26.102141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1782/3511] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:25 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:26.113545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:26.122257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0892b183-3115-4fc7-8ea2-5eea9e45b22a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.304513 Nov 06 20:57:26.125476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1730/3512] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:25 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:26.203777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:26.205239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:26.215319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.216044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.218027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.235117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.308145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bdbe4681-14f4-4fc2-bc24-bfc94b3ec530 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.116408 Nov 06 20:57:26.310035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1783/3513] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:26 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:26.330781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:26.331397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:26.351241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.351616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.355183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.355684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.476394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:26.477414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:26.484411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.485211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.486291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.486942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.530418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fa463e9-7f1b-4c08-80d2-ab9c562fdbd2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.057950 Nov 06 20:57:26.534856 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1784/3514] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:26 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:57:26.607869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7559ebe8-d3cc-4f04-8e69-b69dea4c5b75 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a739d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:26.691705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:26.706088 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7559ebe8-d3cc-4f04-8e69-b69dea4c5b75 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.102176 Nov 06 20:57:26.715068 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1785/3515] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:26 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:26.719059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:26.721155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:26.724273 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90674b57-d254-4691-b68e-7a5d6f5fe9bc tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.397746 Nov 06 20:57:26.725424 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1731/3516] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:26 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:26.760694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:26.772267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:26.784951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.786206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:26.788631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:26.789365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.115789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:27.117480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:27.128504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.129141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.130403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.131052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.185939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:27.204775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4fa20cc-3d5a-480a-8780-8d06fc053f1e tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.450221 Nov 06 20:57:27.214246 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1786/3517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:26 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:27.214246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:27.214246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:27.221765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e75c09f-7c25-42de-91f9-4cc3f039e2ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.111224 Nov 06 20:57:27.223874 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1732/3518] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:27 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:27.230282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.230684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.231509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.231952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.328834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:27.334669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:27.362516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.363005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.363855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.364321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.489057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1bd1902-7fc9-4251-a5d1-51c62710aa4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.171300 Nov 06 20:57:27.490823 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1733/3519] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:27 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:27.545689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:27.549768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:27.565144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.565979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.569481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.570296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.711626 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b482c88-6db8-4bba-bc70-893c4add8ab5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.170523 Nov 06 20:57:27.713163 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1734/3520] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:27 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:27.722428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b384871-0f35-48ca-82d2-b9219ee35f2e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671549b1f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:27.794291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:27.795425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b384871-0f35-48ca-82d2-b9219ee35f2e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.077657 Nov 06 20:57:27.796128 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1735/3521] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:27 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:27.813380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:27.816481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:27.820211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c17b6573-eb77-47f3-b281-ea0cefc1f329 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.613209 Nov 06 20:57:27.826868 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1787/3522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:27 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:27.829104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.832810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:27.833727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:27.835794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.007983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d06b7e87-8825-4dfc-bd91-776dc835fc42 req-ef404b3a-84ad-47dc-a6a0-118bffa70ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f4f0a1-23c6-46bd-b4c0-705a61ffdc99", "name": "network-vif-plugged", "status": "completed", "tag": "93c7d686-82c3-47f5-b551-bbb8fa1160ac"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:28.013014 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:28.013014 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:28.040606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d06b7e87-8825-4dfc-bd91-776dc835fc42 req-ef404b3a-84ad-47dc-a6a0-118bffa70ea2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.047120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d06b7e87-8825-4dfc-bd91-776dc835fc42 req-ef404b3a-84ad-47dc-a6a0-118bffa70ea2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.080691 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d06b7e87-8825-4dfc-bd91-776dc835fc42 req-ef404b3a-84ad-47dc-a6a0-118bffa70ea2 service nova] Creating event network-vif-plugged:93c7d686-82c3-47f5-b551-bbb8fa1160ac for instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 on nch2-master-1 Nov 06 20:57:28.093966 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d06b7e87-8825-4dfc-bd91-776dc835fc42 req-ef404b3a-84ad-47dc-a6a0-118bffa70ea2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088611 Nov 06 20:57:28.096377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1788/3523] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:57:28.225000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:28.225949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:28.266632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.271399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.272270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.275326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.421062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:28.438260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:28.443572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:28.445160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de23ef54-e909-428a-8502-cffb9ee8242f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.642586 Nov 06 20:57:28.448993 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1736/3524] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:27 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:28.462177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:28.467768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:28.507312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.507712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.516257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.516741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.578341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:28.637207 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d365585a-5b76-48e6-8811-6f801262bade tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.419281 Nov 06 20:57:28.637956 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1789/3525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:28 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:28.648530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:28.649482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:28.675292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.675730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.676458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.677063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.848496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eba3bcca-53d8-4ee1-9864-15e7d55fbefd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.397696 Nov 06 20:57:28.849383 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1737/3526] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:28 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:28.856168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6273bc03-63fa-4236-91cd-fd8271284bfd tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.215611 Nov 06 20:57:28.856911 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1790/3527] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:28 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:28.868337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1a49097-6dd5-4cdc-8d4e-502caace83ce tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714af79d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:28.872738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:28.875625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:28.889978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.892227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.893206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.893815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.945186 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b52d35cf-6829-46e7-9154-3e4614e22db1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.085005 Nov 06 20:57:28.946473 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1738/3528] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:28 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:28.966184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:28.968135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:28.976669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.977368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.978346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:28.978938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:28.982092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1a49097-6dd5-4cdc-8d4e-502caace83ce tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.123102 Nov 06 20:57:28.992069 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1791/3529] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:28 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:29.404508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:29.419607 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3684d534-16f5-4bf3-a5ff-e67ab23c243d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.471688 Nov 06 20:57:29.429171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1739/3530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:28 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:29.477778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:29.487876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:29.509809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:29.510270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:29.511083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:29.511520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:29.655675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:29.656550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:29.667714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:29.668480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:29.669956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:29.670557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.354121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:30.378199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:30.384525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:30.385778 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-712a81d8-504f-4d9c-96d1-8c62bfda3328 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1486 microversion: 2.25 time: 0.922454 Nov 06 20:57:30.386351 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1792/3531] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:29 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1486 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:30.401304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:30.402302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:30.409875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.410363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.422558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.423107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.435158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:30.468746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4724a159-a420-4c45-92c4-de44ae268f26 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1328 microversion: 2.1 time: 0.816700 Nov 06 20:57:30.483205 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1740/3532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:29 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1328 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:30.484644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:30.489016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:30.489688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11df3eff-2729-4ee7-aa96-e6143656631f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.096289 Nov 06 20:57:30.494210 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1793/3533] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:30 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:30.502785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:30.504031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:30.504384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.504938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.505761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.506413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.531281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.532083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.533146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.533766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.592217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3dde5e14-437a-4c51-a159-825a4a8b9c53 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.116854 Nov 06 20:57:30.592923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1741/3534] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:30 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:30.598205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32c30266-a190-425a-8d24-ff9da438b64a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.102336 Nov 06 20:57:30.599405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1794/3535] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:30 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:30.605058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:30.607765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:30.608059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79a9050c-0c4d-4c2e-ba11-cf737c4dba36 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153a35e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:30.620926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.624986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.629936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:30.632558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:30.686113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79a9050c-0c4d-4c2e-ba11-cf737c4dba36 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1455 microversion: 2.1 time: 0.090979 Nov 06 20:57:30.687518 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1742/3536] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:30 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:30.944117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:30.951999 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80319a97-092c-4a02-943d-d879f2dacbce tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.351026 Nov 06 20:57:30.953536 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1795/3537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:30 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:31.403789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.404649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.411059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.412332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.413228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.413783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.492268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.493007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.499940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.500813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.502426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.503119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.610232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:31.631334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:31.632951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:31.634164 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f5fa95f-2f44-419b-934e-9a1efd2d31b1 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1476 microversion: 2.25 time: 0.235009 Nov 06 20:57:31.635420 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1743/3538] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:31.642077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:31.643317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.651371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.651833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.652701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.653145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.717257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:31.718358 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d950676a-fa96-4e93-931c-60a05b343644 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.081270 Nov 06 20:57:31.720615 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1744/3539] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:31 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:31.727937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:31.728118 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4b7be09-8685-4ded-9fbc-320f313c2463 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1527 microversion: 2.1 time: 0.240073 Nov 06 20:57:31.729269 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1796/3540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1527 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:31.729712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.734024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:31.734999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.739084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.739843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.741058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.741738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.744356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.745019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.746669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.747308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.797272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80ed0a1e-abce-4056-a740-f9682ac1ad30 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.074894 Nov 06 20:57:31.797993 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1745/3541] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:31 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:31.803656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7678a067-303e-4eae-b22e-e735463f5d71 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '.version_select at 0x7f671574c310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.805249 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:31.805249 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:31.806825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7678a067-303e-4eae-b22e-e735463f5d71 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.807293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7678a067-303e-4eae-b22e-e735463f5d71 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.820603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7678a067-303e-4eae-b22e-e735463f5d71 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.021089 Nov 06 20:57:31.821462 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1746/3542] 10.222.0.13 () {60 vars in 1183 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/os-migrations => generated 1940 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:31.822830 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bdb2c9c8-53ab-4773-bcc7-f61389d7cea1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.090996 Nov 06 20:57:31.823774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1797/3543] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:31 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:31.827231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab162a8f-1b0b-4256-8956-de6e565d0323 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715414430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.834817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.837011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.846717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.847610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.849457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.849924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.888444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab162a8f-1b0b-4256-8956-de6e565d0323 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1464 microversion: 2.1 time: 0.065445 Nov 06 20:57:31.895848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1747/3544] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:31.901018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:31.901956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:31.910224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.910931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:31.911897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:31.912586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.122417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:32.136516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] Lazy-loading 'services' on Instance uuid 1791c480-1c88-478b-91cb-e512a6b911cc {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:32.137815 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c44bf5c6-02e1-4b9f-9a08-8e4d1228d3d5 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1527 microversion: 2.1 time: 0.311207 Nov 06 20:57:32.139263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1798/3545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1527 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:32.145299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f634f54b-eb93-4855-a120-562de7f38b20 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714abd670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.153892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-330e7350-6059-4ab9-b443-fb5badc1e042 tempest-LiveAutoBlockMigrationV225Test-2030327405 tempest-LiveAutoBlockMigrationV225Test-2030327405-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1968 microversion: 2.25 time: 0.256577 Nov 06 20:57:32.167845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1748/3546] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:31 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1968 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:32.167845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.167845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.167845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.168486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.170735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.170735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.206908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f634f54b-eb93-4855-a120-562de7f38b20 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 200 len: 1464 microversion: 2.1 time: 0.065507 Nov 06 20:57:32.207458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1799/3547] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:32 2021] GET /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:32.366359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:32.379793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-815a2845-faa9-4de6-9909-83bdf38f15d7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.223159 Nov 06 20:57:32.381157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1749/3548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:32 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:32.388493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.389149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.397685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.398987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.399974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.400460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.437396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:32.505306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.505796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.515586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.516796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.518521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.519013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.536467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] HTTP exception thrown: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. Nov 06 20:57:32.537715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Returning 404 to user: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:32.538855 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee465327-6c33-49e4-b083-8ef4532504ce tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] 10.222.0.13 "DELETE /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 404 len: 111 microversion: 2.1 time: 0.330034 Nov 06 20:57:32.540069 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1800/3549] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:32 2021] DELETE /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 111 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:32.546548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.547454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.556515 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-018bcbea-db44-459a-bcbd-3aa8f8106349 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 204 len: 0 microversion: 2.1 time: 0.171979 Nov 06 20:57:32.557430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.558382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.559823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.560670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.561143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1750/3550] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:32 2021] DELETE /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:32.568124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.570796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.579069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.579069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.580443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.580893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.765766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:32.770751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:32.775292 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a739ffd5-5154-41e7-a44e-d5e0862c7738 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1468 microversion: 2.1 time: 0.233747 Nov 06 20:57:32.775984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1801/3551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:32 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:32.778961 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc5de10d-71a3-4dda-b8e7-a790d3a64a07 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1527 microversion: 2.1 time: 0.216333 Nov 06 20:57:32.779606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1751/3552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:32 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:32.785532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:32.786812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.791533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:32.793665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.793921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.794483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.795442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.796495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.801088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.801774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.802636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.803878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.848393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca27b46c-1391-4df1-acd5-47dd67d0e4f5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.066451 Nov 06 20:57:32.849070 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1752/3553] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:32 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:32.854534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-630514324"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:32.856105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:32.864386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.864866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:32.865882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:32.867189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.003716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:33.012527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a55ff2e0-c187-4b07-8cc4-63810469e0ce tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1413 microversion: 2.1 time: 0.235098 Nov 06 20:57:33.013641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1802/3554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:32 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1413 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:33.018168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Action: 'update', calling method: >, body: {"server": {"name": "63f4f0a1-23c6-46bd-b4c0-705a61ffdc99_new"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:33.019632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.026598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.027052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.028005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.028473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.044573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] HTTP exception thrown: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. Nov 06 20:57:33.045169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] Returning 404 to user: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:33.046005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e97f1c7c-dbdf-46e9-9c06-72771502ffe5 tempest-ServersNegativeTestMultiTenantJSON-523113271 tempest-ServersNegativeTestMultiTenantJSON-523113271-project] 10.222.0.13 "PUT /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 404 len: 111 microversion: 2.1 time: 0.031242 Nov 06 20:57:33.050869 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1803/3555] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 20:57:33 2021] PUT /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:33.055967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:33.056926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.063134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.064559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.065375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.065868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.110527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-768559f8-003d-4afe-9219-f29591b5b636 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.058175 Nov 06 20:57:33.111712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1804/3556] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:33 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:33.119000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:33.120687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.131121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.131586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.132463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.132914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.167953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91fe8d54-83f6-4e75-b9c0-013c99b24bc3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "POST /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1/action" status: 202 len: 0 microversion: 2.1 time: 0.317430 Nov 06 20:57:33.168612 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1753/3557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:32 2021] POST /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:57:33.182237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:33.184322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.192795 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e232d8b5-17bf-4738-ac7a-413871752daf tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.079156 Nov 06 20:57:33.193755 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1805/3558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:33 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:33.194187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.194901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.195879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.196406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.200215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d71d7a0-3a58-4d7e-947e-59c119cb392c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aafb80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:33.239920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:33.277499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d71d7a0-3a58-4d7e-947e-59c119cb392c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.082020 Nov 06 20:57:33.278662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1806/3559] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:33 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:33.339454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a9bf5f1-eaca-492c-9f40-5a69716d875a tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 204 len: 0 microversion: 2.1 time: 0.169157 Nov 06 20:57:33.343129 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1754/3560] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:33 2021] DELETE /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:33.349416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:33.350339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.358098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.360615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.362146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.362838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.399184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:33.400039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.408983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.409441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.410865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.411311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.840628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:33.843697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:33.852583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-181ee6d2-2cba-4328-8004-e6efd77a7bdf tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1533 microversion: 2.1 time: 0.507957 Nov 06 20:57:33.856494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1807/3561] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:33 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1533 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:33.866368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bacefe9-be09-4557-9b9e-a048c840efcc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.469596 Nov 06 20:57:33.867257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b698040b-bd6d-441c-a774-9427df25d5d1 req-05e5ea18-9d53-48df-ac88-f2516feee7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-unplugged", "status": "completed", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:33.871963 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:33.871963 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:33.878882 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1755/3562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:33 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:33.883986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:33.886615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:33.887858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b698040b-bd6d-441c-a774-9427df25d5d1 req-05e5ea18-9d53-48df-ac88-f2516feee7b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.888330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b698040b-bd6d-441c-a774-9427df25d5d1 req-05e5ea18-9d53-48df-ac88-f2516feee7b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.897050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.898585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.899402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:33.900490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:33.909756 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b698040b-bd6d-441c-a774-9427df25d5d1 req-05e5ea18-9d53-48df-ac88-f2516feee7b0 service nova] Creating event network-vif-unplugged:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:57:33.924820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b698040b-bd6d-441c-a774-9427df25d5d1 req-05e5ea18-9d53-48df-ac88-f2516feee7b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060782 Nov 06 20:57:33.926120 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1808/3563] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:33.953661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36ef257e-6fa2-45c9-a368-c4ee72595379 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.073256 Nov 06 20:57:33.956479 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1756/3564] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:33 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:34.031780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:34.032568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:34.039139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.039764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.040858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.041646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.122900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:34.124658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:34.132265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.133175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.133560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.134319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.185955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f564d40a-f9ac-4325-9e75-503d6f743e0b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066719 Nov 06 20:57:34.192684 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1757/3565] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:34 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:34.208896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:34.210199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:34.220113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.220619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.221426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.221864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.261673 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce6489f7-671b-4d18-9597-5136cad2efb6 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.061955 Nov 06 20:57:34.265649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1758/3566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:34 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:57:34.291710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db952ce0-a76d-400a-9d80-29b3f487ec60 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715356790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:34.342070 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db952ce0-a76d-400a-9d80-29b3f487ec60 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.054637 Nov 06 20:57:34.342954 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1759/3567] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:34 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:34.361420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:34.370453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d1a119e-5a35-441f-b585-82eaa117cdab tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 200 len: 1413 microversion: 2.1 time: 0.344025 Nov 06 20:57:34.380392 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1809/3568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:34 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 1413 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:34.646492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-44a2e39f-8937-4ede-812f-199b4ef860c6 req-3ef018e7-7e68-4d10-b8d4-e0827e11462f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1791c480-1c88-478b-91cb-e512a6b911cc", "name": "network-vif-deleted", "tag": "1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:34.648123 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:34.648123 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:34.671327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44a2e39f-8937-4ede-812f-199b4ef860c6 req-3ef018e7-7e68-4d10-b8d4-e0827e11462f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.671769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44a2e39f-8937-4ede-812f-199b4ef860c6 req-3ef018e7-7e68-4d10-b8d4-e0827e11462f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.693985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-44a2e39f-8937-4ede-812f-199b4ef860c6 req-3ef018e7-7e68-4d10-b8d4-e0827e11462f service nova] Creating event network-vif-deleted:1c0d21ce-7b68-4ae6-9a77-2a2a01a0e72e for instance 1791c480-1c88-478b-91cb-e512a6b911cc on nch1-master-1 Nov 06 20:57:34.705755 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-44a2e39f-8937-4ede-812f-199b4ef860c6 req-3ef018e7-7e68-4d10-b8d4-e0827e11462f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063473 Nov 06 20:57:34.708882 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1760/3569] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:34.875234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:34.913773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:34.915955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:34.919318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:34.934439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.935310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.936273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.936936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.939879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.940666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:34.941681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:34.943843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.365815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:35.377818 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6abf39e7-937c-4b93-85df-8f28e29a34f1 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.487294 Nov 06 20:57:35.379318 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1761/3570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:34 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:35.395213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:35.396287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:35.409311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.409869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.410752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.411312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.418655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:35.427232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0c11f45-1a4c-441c-9a16-45f763aff0af tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1533 microversion: 2.1 time: 0.555598 Nov 06 20:57:35.432342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1810/3571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:34 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1533 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:35.439660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:35.447035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:35.464812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.465640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.466722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.467334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.494301 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2c7aacf-0174-4901-a9a4-d5b09102d534 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.109948 Nov 06 20:57:35.495574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1762/3572] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:35 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:35.505767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:35.507405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:35.516025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.520983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.523778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.524643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.585685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-820468da-41d5-4cff-be9e-d48a60c745eb tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.151619 Nov 06 20:57:35.586311 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1811/3573] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:35 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:35.594150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1cd47b87-ae59-4de5-a43c-d32b9c269573 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 14 microversion: 2.1 time: 0.097028 Nov 06 20:57:35.595223 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1763/3574] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:35 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:57:35.604560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:35.605282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 1791c480-1c88-478b-91cb-e512a6b911cc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:35.606314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7ed9da5-4edf-4178-a494-d94528d3cf20 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a62c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:35.625348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.625710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.630547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:35.630882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:35.654725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] HTTP exception thrown: Instance 1791c480-1c88-478b-91cb-e512a6b911cc could not be found. Nov 06 20:57:35.655337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Returning 404 to user: Instance 1791c480-1c88-478b-91cb-e512a6b911cc could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:35.656182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fe5ca04-2fff-4649-8d38-0ca8f85d8378 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc" status: 404 len: 111 microversion: 2.1 time: 0.059880 Nov 06 20:57:35.656971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1764/3575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:35 2021] GET /compute/v2.1/servers/1791c480-1c88-478b-91cb-e512a6b911cc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:35.705001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7ed9da5-4edf-4178-a494-d94528d3cf20 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.116682 Nov 06 20:57:35.705601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1812/3576] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:35 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:36.144220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f011be70-4dca-455d-82d8-6a04e16fcb12 req-04441e6a-399a-4a6c-8491-a8cb9f2d78eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f4f0a1-23c6-46bd-b4c0-705a61ffdc99", "name": "network-vif-deleted", "tag": "93c7d686-82c3-47f5-b551-bbb8fa1160ac"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:36.147226 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:36.147226 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:36.160843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f011be70-4dca-455d-82d8-6a04e16fcb12 req-04441e6a-399a-4a6c-8491-a8cb9f2d78eb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.161603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f011be70-4dca-455d-82d8-6a04e16fcb12 req-04441e6a-399a-4a6c-8491-a8cb9f2d78eb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.175170 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f011be70-4dca-455d-82d8-6a04e16fcb12 req-04441e6a-399a-4a6c-8491-a8cb9f2d78eb service nova] Creating event network-vif-deleted:93c7d686-82c3-47f5-b551-bbb8fa1160ac for instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 on nch2-master-1 Nov 06 20:57:36.180192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f011be70-4dca-455d-82d8-6a04e16fcb12 req-04441e6a-399a-4a6c-8491-a8cb9f2d78eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112451 Nov 06 20:57:36.181401 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1765/3577] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:36.399443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:36.401312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:36.412157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.413495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.414470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.415220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.453341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:36.454983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:36.462509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.467755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.472718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.472718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.529739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:36.530359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:36.530975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lazy-loading 'fault' on Instance uuid 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:37.068915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ae6578a154795b5cd02da4737a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21423998077b4a0e9f30b00f62b5691f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:37.079142 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8bc9ed7-fe4a-4e7f-a26a-7c188b84e462 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 200 len: 1318 microversion: 2.1 time: 0.633220 Nov 06 20:57:37.089391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1766/3578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:36 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:37.090755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:37.091389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:37.102613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.113214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.114363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.114971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.201681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed70ef14-76b0-4317-920e-f546c2c45ccd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.119433 Nov 06 20:57:37.207212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1767/3579] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:37 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:37.215239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:37.216395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:37.224199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.224749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.225562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.226007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.272588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:37.283256 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24274234-2c31-4221-afdf-20dfb2687819 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.889093 Nov 06 20:57:37.283850 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1813/3580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:36 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:37.294471 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4a7dc98-0353-493f-a597-23187a3fcc6b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.084823 Nov 06 20:57:37.300915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1768/3581] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:37 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:37.306300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b962549-bd62-4754-bf36-2ad28ab4f399 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671539c430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:37.308215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:37.309538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:37.322838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.323602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.324709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.325317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.396128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b962549-bd62-4754-bf36-2ad28ab4f399 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.091899 Nov 06 20:57:37.397950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1769/3582] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:37 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:37.410286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0a6219e5-0229-48ba-b2d6-039d63c2055e req-d348546a-fb65-4a40-850c-de41d802c801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32061ca8-bcb4-4e81-88ab-f5e4bd028872", "name": "network-vif-plugged", "status": "completed", "tag": "8e1bfa1e-3334-4ad8-8f73-fc61a05f1710"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:37.412267 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:37.412267 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:37.426059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0a6219e5-0229-48ba-b2d6-039d63c2055e req-d348546a-fb65-4a40-850c-de41d802c801 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.427163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0a6219e5-0229-48ba-b2d6-039d63c2055e req-d348546a-fb65-4a40-850c-de41d802c801 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.442882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-678f6349-f39c-4add-9dc0-2bef32e1206f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action" status: 200 len: 8203 microversion: 2.1 time: 0.153038 Nov 06 20:57:37.443698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1814/3583] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:37 2021] POST /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a/action => generated 8203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:37.446598 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0a6219e5-0229-48ba-b2d6-039d63c2055e req-d348546a-fb65-4a40-850c-de41d802c801 service nova] Creating event network-vif-plugged:8e1bfa1e-3334-4ad8-8f73-fc61a05f1710 for instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 on nch2-master-1 Nov 06 20:57:37.453858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0a6219e5-0229-48ba-b2d6-039d63c2055e req-d348546a-fb65-4a40-850c-de41d802c801 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054596 Nov 06 20:57:37.454832 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1770/3584] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:37.455594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:37.456637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:37.466188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.466943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.467970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.468610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.716535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:37.726700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc030e7b-9f0c-456b-9120-dcc32d260d8f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.277264 Nov 06 20:57:37.740371 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1815/3585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:37 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:37.759328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:37.760122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:37.766528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.770614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:37.774091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:37.774558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.025094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:38.026127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.067019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.069725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.073818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.075146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.099053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:38.116580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c8905ea-fafb-437a-9c0e-15192341fcea tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.355923 Nov 06 20:57:38.117256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1771/3586] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:37 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:38.125331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:38.126901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] [instance: 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.149281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.151557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.154248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.154946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.156644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:38.196581 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] HTTP exception thrown: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. Nov 06 20:57:38.197662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] Returning 404 to user: Instance 63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:38.201519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38d14e7a-d5bb-4ea3-b9df-6507d291dfa0 tempest-ServersNegativeTestMultiTenantJSON-1518829870 tempest-ServersNegativeTestMultiTenantJSON-1518829870-project] 10.222.0.13 "GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99" status: 404 len: 111 microversion: 2.1 time: 0.081006 Nov 06 20:57:38.202640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1772/3587] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:38 2021] GET /compute/v2.1/servers/63f4f0a1-23c6-46bd-b4c0-705a61ffdc99 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:38.217749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:38.218353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.230548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.237286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.238243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.238705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.340562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bf31f8c-07ac-45da-9e21-3c57257b9c1b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 204 len: 0 microversion: 2.1 time: 0.321896 Nov 06 20:57:38.341752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1816/3588] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:38 2021] DELETE /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:57:38.351054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:38.353558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.354336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Locking {{(pid=134828) lock /opt/stack/nova/nova/compute/api.py:4624}} Nov 06 20:57:38.362649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.363649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.364693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.365699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.436409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc87af5f-b4fa-4bdc-86e0-7ab9c19b6e70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.090586 Nov 06 20:57:38.444653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1817/3589] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:38 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:38.463073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:38.463924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.484205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.486297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.487456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.488190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.496702 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-544096c7-7f6a-4675-9220-98cef105bb5a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.292810 Nov 06 20:57:38.498503 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1773/3590] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:38 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:38.521516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:38.522545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.543721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.543721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.543721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.543721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.645192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-134a076c-aa7b-469b-b071-bcafe9f73d0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.144791 Nov 06 20:57:38.646050 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1774/3591] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:38 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:38.662115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:38.663075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:38.672441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.680536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:38.687380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:38.687844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.034501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:39.039214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:39.052692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b69d3ce4-c480-4cc3-9bc0-c4fcfb2aa38f tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1524 microversion: 2.1 time: 0.405151 Nov 06 20:57:39.053251 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1775/3592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:38 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1524 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:39.055981 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82e48116-18be-453a-9642-8a0ac3a4ab36 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1325 microversion: 2.1 time: 0.610071 Nov 06 20:57:39.059453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32fe6f5c-9025-4f7f-b3f3-deffddd880bd tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67152b43a0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:39.070634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1818/3593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:38 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:39.080172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:39.085753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:39.095096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.096071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.099119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.100117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.133127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32fe6f5c-9025-4f7f-b3f3-deffddd880bd tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.078623 Nov 06 20:57:39.139968 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1776/3594] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:39 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:39.451440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:39.452510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:39.472136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.473114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.475491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.477330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.589858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49b5c664-e16b-4022-a722-05b1e684384b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.142235 Nov 06 20:57:39.590569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1777/3595] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:39 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:39.656491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:39.658987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:39.660441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:39.667666 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc27e69c-b4c5-4394-b0d0-6944d01da9e1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.592126 Nov 06 20:57:39.668263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1819/3596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:39 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:39.677915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.678375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.679259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.679640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.685886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:39.698124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.702011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.756813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f is locked Nov 06 20:57:39.764636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 409 to user: Instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f is locked {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:39.768372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b82e685e-12f3-4931-a3f1-5171221a1ca9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 409 len: 107 microversion: 2.1 time: 0.087670 Nov 06 20:57:39.772730 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1820/3597] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:39 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 107 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:57:39.793884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:39.795404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:39.809186 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e8e9c7c-9224-4701-a694-a13773f953e8 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.154152 Nov 06 20:57:39.813708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.813909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1778/3598] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:39 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:39.813995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.813995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:39.813995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:39.912104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Unlocking {{(pid=134827) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 06 20:57:40.006145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b451370-8a8b-4c24-92eb-2564b1ed828c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.227173 Nov 06 20:57:40.011009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1821/3599] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:39 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 20:57:40.023871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93009761-34b6-4976-8702-fb52cf10f532 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:40.033013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93009761-34b6-4976-8702-fb52cf10f532 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.034134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93009761-34b6-4976-8702-fb52cf10f532 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.047562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5d1cf4c7-dd6f-46f2-919a-7343e9f52230 req-26881893-0293-450e-afd4-71fb2cae196e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef5068-4637-46e6-b3e8-124382b109f1", "name": "network-vif-plugged", "status": "completed", "tag": "21508f07-0718-477d-a58c-ec0512e5bdad"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:40.050601 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:40.050601 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:40.073868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5d1cf4c7-dd6f-46f2-919a-7343e9f52230 req-26881893-0293-450e-afd4-71fb2cae196e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.074581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5d1cf4c7-dd6f-46f2-919a-7343e9f52230 req-26881893-0293-450e-afd4-71fb2cae196e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.111028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5d1cf4c7-dd6f-46f2-919a-7343e9f52230 req-26881893-0293-450e-afd4-71fb2cae196e service nova] Creating event network-vif-plugged:21508f07-0718-477d-a58c-ec0512e5bdad for instance fcef5068-4637-46e6-b3e8-124382b109f1 on nch2-master-1 Nov 06 20:57:40.113428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93009761-34b6-4976-8702-fb52cf10f532 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Going to try to stop instance {{(pid=134828) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 20:57:40.122138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5d1cf4c7-dd6f-46f2-919a-7343e9f52230 req-26881893-0293-450e-afd4-71fb2cae196e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079140 Nov 06 20:57:40.124952 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1822/3600] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:40.143448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:40.145244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:40.154666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.155946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.157022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.158245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.216359 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93009761-34b6-4976-8702-fb52cf10f532 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.201225 Nov 06 20:57:40.219868 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1779/3601] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:40 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:40.228378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:40.229204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:40.244727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.245191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.246002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.246449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.727474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:40.738387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c6512e2-6d5d-4912-a08d-c697548c90b0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1522 microversion: 2.1 time: 0.517792 Nov 06 20:57:40.739005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1780/3602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:40 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:40.756399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:40.762327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-025d7c94-7c5f-4ba1-b7d3-581b045cf885 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671525a1f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:40.764515 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7065b8c-905f-43f7-abb6-bec2d5cfa741 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 200 len: 1524 microversion: 2.1 time: 0.638090 Nov 06 20:57:40.765093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1823/3603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:40 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 1524 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:40.777862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:40.778495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:40.791980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.792376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.798805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.799266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.835772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-025d7c94-7c5f-4ba1-b7d3-581b045cf885 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.078784 Nov 06 20:57:40.837712 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1781/3604] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:40 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:40.856603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:40.857719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:40.870141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.870608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.871430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.871879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.953134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61006aa2-4eed-4051-b2b9-e3c07760f488 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.113031 Nov 06 20:57:40.953801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1782/3605] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:40 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:40.959570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:40.969604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:40.977342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.977878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:40.978637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:40.979080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.179054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:41.186929 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cfc1cf71-2262-4144-b21b-d0aefe83f97e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.420833 Nov 06 20:57:41.187648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1824/3606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:40 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:41.192891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:41.194076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.200475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.201211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.202000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.202432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.255346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22c70953-80af-4c72-8f16-45039127d31d tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action" status: 200 len: 40734 microversion: 2.42 time: 0.066236 Nov 06 20:57:41.256276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1825/3607] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:41 2021] POST /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/action => generated 40734 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:41.263027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:41.263969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-068d2f1a-8750-47e3-97a0-1c02c3ab57a9 req-90c80c9f-db53-4ec2-b3a7-dd2965e9e76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacbb840-9952-44fa-a73b-0c020a3c93ba", "name": "network-vif-deleted", "tag": "e871ba32-0d46-454a-a9b6-d59321c47280"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:41.265653 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:41.265653 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:41.271799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-477be868-eb80-43eb-bc41-8476d6e798d4 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1522 microversion: 2.1 time: 0.315965 Nov 06 20:57:41.272544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1783/3608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:40 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:41.276952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-068d2f1a-8750-47e3-97a0-1c02c3ab57a9 req-90c80c9f-db53-4ec2-b3a7-dd2965e9e76c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.277576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-068d2f1a-8750-47e3-97a0-1c02c3ab57a9 req-90c80c9f-db53-4ec2-b3a7-dd2965e9e76c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.287117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.287760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.300444 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-068d2f1a-8750-47e3-97a0-1c02c3ab57a9 req-90c80c9f-db53-4ec2-b3a7-dd2965e9e76c service nova] Creating event network-vif-deleted:e871ba32-0d46-454a-a9b6-d59321c47280 for instance bacbb840-9952-44fa-a73b-0c020a3c93ba on nch1-master-1 Nov 06 20:57:41.301656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.302294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.304003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.306011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.306477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-068d2f1a-8750-47e3-97a0-1c02c3ab57a9 req-90c80c9f-db53-4ec2-b3a7-dd2965e9e76c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048667 Nov 06 20:57:41.307383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1826/3609] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:41.312781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-730853941"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:41.315044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.323988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.324753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.325745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.326371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.568436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:41.588638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:41.590525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:41.591815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e166e7ba-12d9-4a77-8409-fcac8ad093e4 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2952 microversion: 2.42 time: 0.308369 Nov 06 20:57:41.592987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1784/3610] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:41 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2952 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:41.625634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.626560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.634001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.636530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.637223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.637674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.707280 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe7723e4-befa-477b-bf10-22290db158ef tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872/action" status: 202 len: 0 microversion: 2.1 time: 0.398047 Nov 06 20:57:41.712351 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1827/3611] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:41 2021] POST /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:57:41.723968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fb9397c-c153-465c-a185-3491d829987a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f6714aafe50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.857135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12f11f4b-f5c0-4cc3-bc12-741c2e13d52c tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.235870 Nov 06 20:57:41.867319 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1785/3612] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 20:57:41 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845/os-interface => generated 1829 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:57:41.872983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.873988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bacbb840-9952-44fa-a73b-0c020a3c93ba] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.882024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.882024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.882923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.883405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.909174 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] HTTP exception thrown: Instance bacbb840-9952-44fa-a73b-0c020a3c93ba could not be found. Nov 06 20:57:41.910012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Returning 404 to user: Instance bacbb840-9952-44fa-a73b-0c020a3c93ba could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:41.911052 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8af327f2-d3ba-436b-b74c-2800c9c904d6 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba" status: 404 len: 111 microversion: 2.1 time: 0.042460 Nov 06 20:57:41.911822 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1786/3613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:41 2021] GET /compute/v2.1/servers/bacbb840-9952-44fa-a73b-0c020a3c93ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:41.917663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57f43647-d4c9-4ee6-96e4-5c7fabef2a0a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671525aee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.923286 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fb9397c-c153-465c-a185-3491d829987a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814" status: 204 len: 0 microversion: 2.1 time: 0.208512 Nov 06 20:57:41.923890 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1828/3614] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:41 2021] DELETE /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:41.931902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:41.932559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:41.947195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.947660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:41.952515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:41.956044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.020066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:42.029149 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57f43647-d4c9-4ee6-96e4-5c7fabef2a0a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.115902 Nov 06 20:57:42.030020 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1787/3615] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:41 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:42.039638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-154cd8da-1891-4505-9802-0c4e7d09c1e6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f67152a04c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:42.075678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-154cd8da-1891-4505-9802-0c4e7d09c1e6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Image not found. Nov 06 20:57:42.076550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-154cd8da-1891-4505-9802-0c4e7d09c1e6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Image not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:42.077457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-154cd8da-1891-4505-9802-0c4e7d09c1e6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814" status: 404 len: 62 microversion: 2.1 time: 0.045807 Nov 06 20:57:42.087629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1788/3616] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:42 2021] GET /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:57:42.098391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:42.099693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:42.108447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.108953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.111102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.111762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.178613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9202a67a-d9d1-4d87-bfd5-c7bad62dffb1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 32609 microversion: 2.20 time: 0.089408 Nov 06 20:57:42.180019 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1789/3617] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:42 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 32609 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:42.180747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-265014d5-9569-47b6-8866-d61dcc59188b tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "DELETE /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 204 len: 0 microversion: 2.1 time: 0.254631 Nov 06 20:57:42.181438 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1829/3618] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:41 2021] DELETE /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:42.188967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:42.189945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:42.190446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:42.191230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:42.198174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.198957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.200346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.201068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.210071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.210647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.214361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.215040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.506565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:42.516341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:42.520601 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5effcbd4-9219-4b6a-8284-30b474624271 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1511 microversion: 2.1 time: 0.334597 Nov 06 20:57:42.531714 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1830/3619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:42 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:42.539226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:42.539783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:42.561996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50aeff65-0d69-439d-91f5-17534fe4c7b9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1534 microversion: 2.1 time: 0.380335 Nov 06 20:57:42.564064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1790/3620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:42 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1534 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:42.585970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.586339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.587548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:42.588541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:42.814960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:42.822712 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab1e7f68-dfc4-4a18-ba3f-32b3d31b9b68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.288243 Nov 06 20:57:42.823404 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1831/3621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:42 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:43.044692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c56a1dc-fe98-4a8a-a74c-a01a6bb70e50 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153fea60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:43.102295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c56a1dc-fe98-4a8a-a74c-a01a6bb70e50 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.062468 Nov 06 20:57:43.103673 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1791/3622] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:43 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:43.195475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:43.196682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:43.203064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.203530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.204433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.204945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.367975 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-901ebac5-276b-4c02-8429-39c74ea559bd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 200 len: 40758 microversion: 2.20 time: 0.180741 Nov 06 20:57:43.368900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1832/3623] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:43 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 40758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:43.379901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:43.380813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:43.393602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.394375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.395567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.396818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.441021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1b99bcb-ed83-49a9-87a1-e229ed0a3114 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/ips" status: 200 len: 151 microversion: 2.20 time: 0.065002 Nov 06 20:57:43.448359 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1792/3624] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Nov 6 20:57:43 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 20:57:43.540170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:43.540929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:43.551730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.557139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.558049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.558789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.584366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:43.585290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:43.614243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.615146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:43.617205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:43.618331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:44.217312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:44.249577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b745db42-659c-4bec-9643-04c4d2ffdf3a tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1511 microversion: 2.1 time: 0.712197 Nov 06 20:57:44.250503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1833/3625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:43 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:44.265055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:44.268925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:44.281213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:44.282795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:44.283987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:44.284986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:44.359499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:44.371770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e2532440-59e6-43d6-9790-a877b5502631 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1534 microversion: 2.1 time: 0.789656 Nov 06 20:57:44.372988 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1793/3626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:43 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1534 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:44.397414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f1f3b30-48bb-443c-b8e0-8b340ffd6a67 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671525d430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:44.487575 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f1f3b30-48bb-443c-b8e0-8b340ffd6a67 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.113173 Nov 06 20:57:44.491796 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1794/3627] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:44 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:44.698082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0e603997-d7a4-47f8-b381-499f20ff4d59 req-641eca06-ea90-4e3f-892d-3fb5bab65708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81864163-41d3-46b9-b9bb-3bb2b1ef142d", "name": "network-vif-deleted", "tag": "42df9c2c-9b18-42f4-91c3-d59e5082f301"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:44.702662 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:44.702662 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:57:44.715216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0e603997-d7a4-47f8-b381-499f20ff4d59 req-641eca06-ea90-4e3f-892d-3fb5bab65708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:44.716124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0e603997-d7a4-47f8-b381-499f20ff4d59 req-641eca06-ea90-4e3f-892d-3fb5bab65708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:44.745567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:44.760736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.507864 Nov 06 20:57:44.764979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1834/3628] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:44 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:44.772446 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0e603997-d7a4-47f8-b381-499f20ff4d59 req-641eca06-ea90-4e3f-892d-3fb5bab65708 service nova] Creating event network-vif-deleted:42df9c2c-9b18-42f4-91c3-d59e5082f301 for instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d on nch1-master-1 Nov 06 20:57:44.783482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0e603997-d7a4-47f8-b381-499f20ff4d59 req-641eca06-ea90-4e3f-892d-3fb5bab65708 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092110 Nov 06 20:57:44.790115 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1795/3629] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:45.049727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:45.051813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa699cb9-677e-41a1-9923-ef376ad7a278 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002474 Nov 06 20:57:45.058660 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1835/3630] 10.222.0.13 () {56 vars in 885 bytes} [Sat Nov 6 20:57:45 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 06 20:57:45.276940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:45.277652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:45.288389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.288855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.292998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.293505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.384919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.385639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.385829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lazy-loading 'fault' on Instance uuid 81864163-41d3-46b9-b9bb-3bb2b1ef142d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:45.393021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:45.395199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:45.420018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.420819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.421881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.422519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.506380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:45.521451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7a5dcc94-e378-410e-93f1-1590696e0bae tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 200 len: 1314 microversion: 2.1 time: 0.249994 Nov 06 20:57:45.522552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1796/3631] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:45 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:45.527449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b43043c2-04e3-4439-a550-161b5b41a2c5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671525ad30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:45.615636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b43043c2-04e3-4439-a550-161b5b41a2c5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.091818 Nov 06 20:57:45.616623 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1797/3632] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:45 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:45.784275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:45.785221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:45.790586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:45.796744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.798867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.801281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:45.803101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:45.803342 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d1f2f34-5efd-4512-8e0e-189a83dec41a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1540 microversion: 2.1 time: 0.415677 Nov 06 20:57:45.806315 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1836/3633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:45 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1540 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:46.152321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:46.162827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59a28de9-7979-4530-9cee-67012baad679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.383826 Nov 06 20:57:46.167543 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1798/3634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:45 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:46.538620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:46.540055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: 81864163-41d3-46b9-b9bb-3bb2b1ef142d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:46.550339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.553495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.554570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.562688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.586915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] HTTP exception thrown: Instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d could not be found. Nov 06 20:57:46.592588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Returning 404 to user: Instance 81864163-41d3-46b9-b9bb-3bb2b1ef142d could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:46.596596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-385f5c1c-4170-45c1-a9e9-d7b5cf4fc1df tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d" status: 404 len: 111 microversion: 2.1 time: 0.059067 Nov 06 20:57:46.598450 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1837/3635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:46 2021] GET /compute/v2.1/servers/81864163-41d3-46b9-b9bb-3bb2b1ef142d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:46.606605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:46.607817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:46.623121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.623643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.629609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-28977749-312a-4545-97c6-adbef0c95a25 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714af7820>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:46.639229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.640729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.705992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:46.716089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-28977749-312a-4545-97c6-adbef0c95a25 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.090827 Nov 06 20:57:46.716838 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1838/3636] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:46 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:46.820752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:46.823577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:46.843688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.844176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.846682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.847140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.858951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd3d99a3-87cb-4f65-ace8-e76f8384f3ca tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 204 len: 0 microversion: 2.1 time: 0.255116 Nov 06 20:57:46.861837 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1799/3637] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:46 2021] DELETE /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:57:46.872330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:46.873162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:46.881775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.882500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:46.884010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:46.884855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.154979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:47.163287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1187de36-400c-40e7-bdf7-6497f84e8504 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1525 microversion: 2.1 time: 0.298637 Nov 06 20:57:47.163874 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1800/3638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:46 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:47.185423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:47.186273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:47.193803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:47.194488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.198862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:47.199502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.226070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:47.235884 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6393d9f8-2bd7-4c3a-a46e-356b17d28da2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1540 microversion: 2.1 time: 0.419173 Nov 06 20:57:47.238735 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1839/3639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:46 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1540 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:47.414910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:47.426887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3be0388a-0659-4840-86b8-a7eaae7e80fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.244906 Nov 06 20:57:47.428376 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1801/3640] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:47 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:47.686433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-77a8401a-6e57-4f06-bed3-ae46d247cfc2 req-dc3d6ef1-4ba2-4f3f-8f84-84f4a305a929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32061ca8-bcb4-4e81-88ab-f5e4bd028872", "name": "network-vif-plugged", "status": "completed", "tag": "8e1bfa1e-3334-4ad8-8f73-fc61a05f1710"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:47.688024 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:47.688024 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:47.706733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77a8401a-6e57-4f06-bed3-ae46d247cfc2 req-dc3d6ef1-4ba2-4f3f-8f84-84f4a305a929 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:47.707193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77a8401a-6e57-4f06-bed3-ae46d247cfc2 req-dc3d6ef1-4ba2-4f3f-8f84-84f4a305a929 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.732028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d10bd0bb-0bf1-4c44-99d6-78877a5594c5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715228ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:47.734371 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-77a8401a-6e57-4f06-bed3-ae46d247cfc2 req-dc3d6ef1-4ba2-4f3f-8f84-84f4a305a929 service nova] Creating event network-vif-plugged:8e1bfa1e-3334-4ad8-8f73-fc61a05f1710 for instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 on nch2-master-1 Nov 06 20:57:47.744469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-77a8401a-6e57-4f06-bed3-ae46d247cfc2 req-dc3d6ef1-4ba2-4f3f-8f84-84f4a305a929 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061561 Nov 06 20:57:47.749502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1840/3641] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:47.764436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:47.765294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:47.779142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:47.779750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.780756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:47.788953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:47.819625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d10bd0bb-0bf1-4c44-99d6-78877a5594c5 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.092221 Nov 06 20:57:47.828695 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1802/3642] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:47 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:47.850101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lazy-loading 'flavor' on Instance uuid e9e2a717-8f31-430c-b427-215e5fa49de6 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:57:48.183015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:48.183931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:48.203109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.205777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.209158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.211014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.265485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2bb8eb45-300a-41c0-a9ab-2b27fd1eb8d8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 202 len: 0 microversion: 2.20 time: 0.505085 Nov 06 20:57:48.267005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1841/3643] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:57:47 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:57:48.276358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:48.279430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:48.305505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.306135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.307421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.311158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.399766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4178344ec541bb964ed60d977eff68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c383d3827904548a85fe5db914aee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:48.411184 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df7e8c57-2b5f-4647-91a6-974a602542e5 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 200 len: 1483 microversion: 2.1 time: 0.232573 Nov 06 20:57:48.424767 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1803/3644] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:48 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 1483 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:48.433559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:48.434170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:48.449489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.449939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.450734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.458583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.750547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:48.763684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:48.768833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:48.773334 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7e7a728-a012-4e59-84ab-e6bd8c441417 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.347182 Nov 06 20:57:48.775012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1804/3645] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:48 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:48.793425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:48.794096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:48.806454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:48.818193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a50e7826-3d9d-4b41-b33f-6b6b3715087d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1540 microversion: 2.1 time: 0.549572 Nov 06 20:57:48.818922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.832590 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1842/3646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:48 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1540 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:48.833678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.834632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.837893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.847309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-92daa536-c67c-4665-9320-538fbf3c8ff6 req-6bb64db1-2eed-4eda-9066-5a4b071ec6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b", "name": "network-vif-deleted", "tag": "924c058a-77c0-4dc6-a5e1-a65e4c088faa"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:48.850766 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:48.850766 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:48.857925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-92daa536-c67c-4665-9320-538fbf3c8ff6 req-6bb64db1-2eed-4eda-9066-5a4b071ec6e8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:48.858673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-92daa536-c67c-4665-9320-538fbf3c8ff6 req-6bb64db1-2eed-4eda-9066-5a4b071ec6e8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:48.871990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-92daa536-c67c-4665-9320-538fbf3c8ff6 req-6bb64db1-2eed-4eda-9066-5a4b071ec6e8 service nova] Creating event network-vif-deleted:924c058a-77c0-4dc6-a5e1-a65e4c088faa for instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b on nch1-master-1 Nov 06 20:57:48.877897 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-92daa536-c67c-4665-9320-538fbf3c8ff6 req-6bb64db1-2eed-4eda-9066-5a4b071ec6e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042568 Nov 06 20:57:48.878966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1843/3647] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:48.890139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46e5db8f-c346-4f3a-976b-40cc6559454f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a87e50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:48.971817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46e5db8f-c346-4f3a-976b-40cc6559454f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.086704 Nov 06 20:57:48.972531 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1844/3648] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:48 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:49.090639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:49.133601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-742bc6ee-a3fc-4a46-8ece-0ccc9ef876a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.351476 Nov 06 20:57:49.134233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1805/3649] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:48 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:49.431306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:49.432153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] [instance: bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:49.441184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:49.441738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:49.442614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:49.443848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:49.461262 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] HTTP exception thrown: Instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b could not be found. Nov 06 20:57:49.462107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] Returning 404 to user: Instance bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:49.463102 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-568a39f4-5cbe-49b7-b252-3df7c1cd2074 tempest-LiveAutoBlockMigrationV225Test-92513929 tempest-LiveAutoBlockMigrationV225Test-92513929-project] 10.222.0.13 "GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b" status: 404 len: 111 microversion: 2.1 time: 0.035728 Nov 06 20:57:49.463652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1845/3650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:49 2021] GET /compute/v2.1/servers/bc827ee7-cdd8-4861-8f0a-cd5da4e4a23b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:57:49.824956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:49.833238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:49.892700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:49.895513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:49.898323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:49.900351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:50.093784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-601de09c-2cdf-42db-a308-57a7a0d9100d tempest-ComputeTenantNetworksTest-1567603779 tempest-ComputeTenantNetworksTest-1567603779-project] Calling method '.version_select at 0x7f67153cd310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:50.424906 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-601de09c-2cdf-42db-a308-57a7a0d9100d tempest-ComputeTenantNetworksTest-1567603779 tempest-ComputeTenantNetworksTest-1567603779-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.635704 Nov 06 20:57:50.425740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1806/3651] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:57:49 2021] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:50.431071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:50.432027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:50.446618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:50.449290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:50.452081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:50.454455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:50.484241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:50.493987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:50.497932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:50.501353 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c701cf9-b406-4faf-8484-5814cbf300ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.682988 Nov 06 20:57:50.504339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1846/3652] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:49 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:50.518328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b32baea2-b2ab-44f0-b06a-b8d2cebbde00 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a6d040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:50.637222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b32baea2-b2ab-44f0-b06a-b8d2cebbde00 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.131595 Nov 06 20:57:50.643464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1847/3653] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:50 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:50.658907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:50.659542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:50.665694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:50.666152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:50.667216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:50.667667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:51.461692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:51.475997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7972b2f6-2f62-4f52-b93f-e5c845c2fe68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1656 microversion: 2.1 time: 0.826701 Nov 06 20:57:51.482511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1848/3654] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:50 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1656 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:51.489328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7e7a16e-44e1-47f9-9357-836f73fc84c9 tempest-ComputeTenantNetworksTest-1567603779 tempest-ComputeTenantNetworksTest-1567603779-project] Calling method '.version_select at 0x7f6714a73820>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:51.507886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:51.523171 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-423fc4bf-e535-4355-9f4b-ec2ed6a8e269 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1540 microversion: 2.1 time: 1.095080 Nov 06 20:57:51.525335 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1807/3655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:50 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1540 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:51.548543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cadd1ce3-9f0c-435e-aec1-8777e40395ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:51.570720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cadd1ce3-9f0c-435e-aec1-8777e40395ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:51.572556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cadd1ce3-9f0c-435e-aec1-8777e40395ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:51.633920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cadd1ce3-9f0c-435e-aec1-8777e40395ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Going to try to start instance {{(pid=134828) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 20:57:51.708014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cadd1ce3-9f0c-435e-aec1-8777e40395ef tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.178207 Nov 06 20:57:51.714235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1808/3656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:51 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:51.727127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:51.728645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:51.728894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7e7a16e-44e1-47f9-9357-836f73fc84c9 tempest-ComputeTenantNetworksTest-1567603779 tempest-ComputeTenantNetworksTest-1567603779-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks/996350c9-5f86-4e57-a57e-b7aecb565c76" status: 200 len: 140 microversion: 2.1 time: 0.244964 Nov 06 20:57:51.730069 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1849/3657] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 20:57:51 2021] GET /compute/v2.1/os-tenant-networks/996350c9-5f86-4e57-a57e-b7aecb565c76 => generated 140 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:51.736901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81378f64-6642-4815-b465-d440dc949e0d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aaf4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:51.743851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:51.758707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:51.762799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:51.763337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:51.866083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81378f64-6642-4815-b465-d440dc949e0d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.134757 Nov 06 20:57:51.866886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1850/3658] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:51 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:51.889168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:51.889805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:51.918141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:51.919697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:51.921051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:51.923609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:52.348588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:52.361034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:52.362882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:52.364262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d819197-4716-4518-b283-ace17bf804a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.648382 Nov 06 20:57:52.376280 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1809/3659] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:51 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:52.464227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:52.473390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fecc6ab7-5da6-458d-8254-743206eba7dd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1665 microversion: 2.1 time: 0.602415 Nov 06 20:57:52.473982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1851/3660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:51 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1665 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:52.549315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:52.549930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:52.563809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:52.564027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:52.582541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:52.583080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:52.882158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21aacd07-49f4-43fa-90fb-cb0eaaeccc2f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671ad43d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:52.951907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21aacd07-49f4-43fa-90fb-cb0eaaeccc2f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.073457 Nov 06 20:57:52.952498 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1852/3661] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:52 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:53.048828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:53.058097 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9ec322c-a6c1-4719-b680-370c525229e9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1522 microversion: 2.1 time: 0.519878 Nov 06 20:57:53.060912 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1810/3662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:52 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:53.077180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:53.077688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:53.092100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.092609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.096554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.097210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.158420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:57:53.350890 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1ba190a-c285-4a8b-bb16-08fd9b99e81d tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 204 len: 0 microversion: 2.1 time: 0.275916 Nov 06 20:57:53.352266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1853/3663] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:57:53 2021] DELETE /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:57:53.362181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:53.363894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:53.383591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:53.384589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:53.388079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.388562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.391399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.393549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.399449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.400118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.401095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:53.402396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:53.977881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:53.985615 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78b043b6-65cd-4e51-9267-5df57053bc1c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1528 microversion: 2.1 time: 0.629194 Nov 06 20:57:53.986200 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1811/3664] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:53 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1528 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:54.001105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:54.001718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:54.009480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.015636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.017048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:54.017948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.018662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.043103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:54.050465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:54.052711 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7fea362-8785-49e4-8852-c4be348a3e81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.673344 Nov 06 20:57:54.080798 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1854/3665] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:53 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:54.098868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c78b9361-01a7-483c-a36d-36f8f37ed59c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a87e50>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:54.187090 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c78b9361-01a7-483c-a36d-36f8f37ed59c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.102265 Nov 06 20:57:54.189817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1855/3666] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:54 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:54.452115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:54.464439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c6d32c0-3d75-4420-9c50-ba4c582a321d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.466880 Nov 06 20:57:54.470168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1812/3667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:53 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:54.486005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:54.486521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:54.513352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.514393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.515316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.518803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.776458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:54.791151 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e242f83c-475e-4a14-83dd-160d27b81e90 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.309830 Nov 06 20:57:54.792017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1856/3668] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:54 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:54.809741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:54.810539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:54.818380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.819294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.820487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:54.821085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:54.926330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Unlocking {{(pid=134828) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 06 20:57:54.983870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e787b0f9-c025-4738-92ce-7db30dbd7aae tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.178105 Nov 06 20:57:54.988147 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1813/3669] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:54 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:54.995022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:54.995702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:55.003856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:55.003856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:55.010194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.010648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.011977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.013501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.022060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.023281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.027506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.033190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.460481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:55.472722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:55.502435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83bf0cc8-366e-438d-921f-6001653237ac tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1528 microversion: 2.1 time: 0.499932 Nov 06 20:57:55.503103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-622f64e1-a0c3-4f63-8bd7-eea7dc33e35a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.511739 Nov 06 20:57:55.503706 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1857/3670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:54 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:55.504678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1814/3671] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:54 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1528 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:55.511584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:55.512664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:55.516569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02b876a2-4425-49ab-a5ad-c4b86c311339 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a793a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:55.565710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.566927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.574357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.574940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.617184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02b876a2-4425-49ab-a5ad-c4b86c311339 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.108586 Nov 06 20:57:55.618014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1858/3672] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:55 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:55.640712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:55.644340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:55.660272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.665836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.667306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.668025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.901974 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc126409-0e49-48c6-a330-37946034889c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.282382 Nov 06 20:57:55.905468 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1859/3673] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:55 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:55.912795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4fcc940d-95ce-4517-a20e-dcbc0447a89f req-aefaa429-2788-423d-9514-f3dc7ebd3979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32061ca8-bcb4-4e81-88ab-f5e4bd028872", "name": "network-vif-unplugged", "status": "completed", "tag": "8e1bfa1e-3334-4ad8-8f73-fc61a05f1710"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:55.917080 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:55.917080 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:55.929564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4fcc940d-95ce-4517-a20e-dcbc0447a89f req-aefaa429-2788-423d-9514-f3dc7ebd3979 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.930934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4fcc940d-95ce-4517-a20e-dcbc0447a89f req-aefaa429-2788-423d-9514-f3dc7ebd3979 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.949237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4fcc940d-95ce-4517-a20e-dcbc0447a89f req-aefaa429-2788-423d-9514-f3dc7ebd3979 service nova] Creating event network-vif-unplugged:8e1bfa1e-3334-4ad8-8f73-fc61a05f1710 for instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 on nch2-master-1 Nov 06 20:57:55.957056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4fcc940d-95ce-4517-a20e-dcbc0447a89f req-aefaa429-2788-423d-9514-f3dc7ebd3979 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052519 Nov 06 20:57:55.958460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1860/3674] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:55.962133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:55.965154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:55.966059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:55.971068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:55.975199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.975916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:55.976034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:55.977259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:55.977377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75dc8eb6-882b-4a13-9277-74f58a6e917c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.471225 Nov 06 20:57:55.977845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1815/3675] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:55 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:55.989725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:56.256359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:56.267304 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cbd01e81-65be-4bd9-ae7e-b757fd3b07d7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1674 microversion: 2.1 time: 0.307473 Nov 06 20:57:56.269465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1861/3676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:55 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1674 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:56.621339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:56.623616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:56.628494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:56.629173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:56.630144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:56.630766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:56.636651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00729b97-616f-48dd-80bf-02cca5febc7c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a593a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:56.707316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00729b97-616f-48dd-80bf-02cca5febc7c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.074208 Nov 06 20:57:56.708092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1862/3677] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:56 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:56.783624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:56.794491 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-613a781d-835e-48d0-b141-12756eaa27a7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 200 len: 1486 microversion: 2.1 time: 0.271823 Nov 06 20:57:56.795281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1816/3678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:56 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:56.808326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-90345005-4be8-4756-8c9e-bba6a5e11c2a req-4a2b8416-4ccd-4b35-8e0f-d4056a9e3795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32061ca8-bcb4-4e81-88ab-f5e4bd028872", "name": "network-vif-deleted", "tag": "8e1bfa1e-3334-4ad8-8f73-fc61a05f1710"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:56.810204 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:57:56.810204 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:57:56.820576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-90345005-4be8-4756-8c9e-bba6a5e11c2a req-4a2b8416-4ccd-4b35-8e0f-d4056a9e3795 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:56.821463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-90345005-4be8-4756-8c9e-bba6a5e11c2a req-4a2b8416-4ccd-4b35-8e0f-d4056a9e3795 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:56.843055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-90345005-4be8-4756-8c9e-bba6a5e11c2a req-4a2b8416-4ccd-4b35-8e0f-d4056a9e3795 service nova] Creating event network-vif-deleted:8e1bfa1e-3334-4ad8-8f73-fc61a05f1710 for instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 on nch2-master-1 Nov 06 20:57:56.850720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-90345005-4be8-4756-8c9e-bba6a5e11c2a req-4a2b8416-4ccd-4b35-8e0f-d4056a9e3795 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045950 Nov 06 20:57:56.855762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1863/3679] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:57:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:57:57.003518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:57.004532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:57.013739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.014567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.016098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.016801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.248497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:57.257988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:57.260504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:57.262115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df86f9d5-d50f-4107-b785-337522fa03b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.266017 Nov 06 20:57:57.274526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1817/3680] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:56 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:57.286835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:57.287557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:57.300312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.303632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.307092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.308407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.595356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:57.605454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db6ead05-9c28-45f7-b906-ef35a27e55ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1654 microversion: 2.1 time: 0.323714 Nov 06 20:57:57.607613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1864/3681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:57 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1654 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:57.627428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:57.628045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:57.635311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.635311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.636130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.636652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.722841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02bdbbb0-ebb6-4582-8c21-c64ea6645997 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a6d940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:57.733024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fefef52a-d9d8-4740-a2fb-e2e780a73a68 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.112523 Nov 06 20:57:57.737194 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1818/3682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:57:57 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:57:57.749715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:57.751697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:57.771450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.771942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.775581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.776277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.819030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02bdbbb0-ebb6-4582-8c21-c64ea6645997 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.101454 Nov 06 20:57:57.819832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1865/3683] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:57 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:57.836642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:57.838500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:57.861305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.864335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.865337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:57.868706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:57.915701 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. Nov 06 20:57:57.920484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:57:57.921605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37a9117a-d037-4698-9715-fed6b9d09020 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 404 len: 111 microversion: 2.1 time: 0.100408 Nov 06 20:57:57.922837 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1866/3684] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:57 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:57:58.098970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:58.111741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e60552b-f5d7-4835-9118-221427910769 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1661 microversion: 2.1 time: 0.373106 Nov 06 20:57:58.113527 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1819/3685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:57 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1661 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:58.243117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-791235223", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514e4a26-40f9-4959-b8bc-7e6cfc5f6286"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:57:58.283457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:58.284330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:58.299417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:58.299914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:58.304691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:58.304691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:58.355717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] validate_networks() for [('514e4a26-40f9-4959-b8bc-7e6cfc5f6286', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:57:58.672148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:58.685258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:58.688781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:58.690000 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a39af60b-862b-47c8-b3b5-5f102be5d462 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.412338 Nov 06 20:57:58.691969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1820/3686] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:58 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:57:58.834205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0d04271-fc11-4861-9538-fa41ec1bfdec tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153fe940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:58.907026 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0d04271-fc11-4861-9538-fa41ec1bfdec tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.076471 Nov 06 20:57:58.912562 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1821/3687] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:58 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:59.132582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:59.133410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:59.142326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.147637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.151709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.152424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.359130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:57:59.360225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:57:59.360871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:57:59.361389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:57:59.361964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:57:59.385384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.385971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.389812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.390571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.442224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:57:59.455675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Getting quotas for user e0d0cebeefdc482caf46119297ddb0ad and project ec8f9116653e40f0a02c98904ff90b65. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:57:59.488250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:57:59.494612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:59.508807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:57:59.510295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1cbf7ef-21c4-4eb5-a209-6701e60a77f9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.380046 Nov 06 20:57:59.523181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1822/3688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:59 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:59.533833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:59.534689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:59.548091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.549874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.552380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.554327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.621068 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20b6f311-efbe-4ffd-b6e8-4118e44f308a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.384272 Nov 06 20:57:59.636220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1867/3689] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:57:58 2021] POST /compute/v2.1/servers => generated 383 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:57:59.641592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5f17c23-3756-47a9-8886-4d2e21488c24 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:59.653977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5f17c23-3756-47a9-8886-4d2e21488c24 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:59.751144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5f17c23-3756-47a9-8886-4d2e21488c24 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:59.762555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5f17c23-3756-47a9-8886-4d2e21488c24 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1224 microversion: 2.1 time: 0.124722 Nov 06 20:57:59.767793 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1868/3690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:59 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:57:59.779137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:57:59.779852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:57:59.805728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.806548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.807609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:57:59.808810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:57:59.907613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:57:59.920455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96188f5b-7dca-4577-89b9-897cca4a2d1e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.396245 Nov 06 20:57:59.934389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1823/3691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:57:59 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:57:59.939330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72b0d48d-28b1-47a8-a31e-05461b41b6f9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671524b700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:00.022791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72b0d48d-28b1-47a8-a31e-05461b41b6f9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.087237 Nov 06 20:58:00.023738 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1824/3692] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:57:59 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:00.038108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:00.039390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:00.052214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.054624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.055484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.062508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.091027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.101953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.105202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.113897 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df00fd9a-0298-41dc-9433-e467f3980a4d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.344647 Nov 06 20:58:00.117100 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1869/3693] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:57:59 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:00.454774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.465779 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-725f9d97-f745-41ce-80bd-4cb0f5ef891c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.439546 Nov 06 20:58:00.466759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1825/3694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:00 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:00.488088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:00.489765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:00.502467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.503788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.508907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.510519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.783358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:00.786380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:00.801615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.803113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.805873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:00.809022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:00.871518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.885646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0382a55d-0699-4ab5-ac92-2517389f148d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.405667 Nov 06 20:58:00.888713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1870/3695] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:00 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:00.983584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:00.992723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1ac49be-842d-4d64-8691-ddf1db911f74 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1220 microversion: 2.1 time: 0.213859 Nov 06 20:58:00.994259 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1826/3696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:00 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1220 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:01.037112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-438e997f-508c-4a1d-b2dd-14b7a2d430ee tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aa9430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:01.093081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-438e997f-508c-4a1d-b2dd-14b7a2d430ee tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.059597 Nov 06 20:58:01.093646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1871/3697] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:01 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:01.137738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:01.139079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:01.153495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:01.154234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:01.155436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:01.156224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:01.445299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:01.459742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:01.464841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:01.467937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0279984e-9a77-4b5b-8d91-e9770dfb2316 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.336097 Nov 06 20:58:01.481876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1827/3698] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:01 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:02.014116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:02.015486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:02.038482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:02.041948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:02.046918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:02.049482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:02.106869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81d4fe94-eb1c-459f-b352-60a1d5ded89b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67153fe790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:02.201017 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81d4fe94-eb1c-459f-b352-60a1d5ded89b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.098858 Nov 06 20:58:02.206586 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1828/3699] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:02 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:02.284926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:02.300785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a471b826-ae4a-47af-9ae0-e0b48ff565fa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1282 microversion: 2.1 time: 0.291419 Nov 06 20:58:02.314267 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1872/3700] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:02 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:02.489410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:02.492509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:02.511840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:02.514165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:02.515309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:02.516559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:03.076986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:03.090208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:03.099309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:03.101985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f15c1918-1d1f-416f-bc8e-46a80bbb9e45 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.617054 Nov 06 20:58:03.116372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1829/3701] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:02 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:03.214896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12c623d1-b3ba-4391-b430-9b5eb1795b6f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714aaf4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:03.319760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:03.320678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:03.327956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12c623d1-b3ba-4391-b430-9b5eb1795b6f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1454 microversion: 2.1 time: 0.117663 Nov 06 20:58:03.331208 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1873/3702] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:03 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:03.340336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:03.341441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:03.345092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:03.345549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:03.620631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:03.635909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89c953cf-f5fc-4592-b0f3-95453481e51f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.319698 Nov 06 20:58:03.637131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1830/3703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:03 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:04.040761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c49152b1-cfe6-4daa-b8f4-eab7344c9f68 req-aa29b0c4-f18e-4a36-b1eb-0da73e978bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "name": "network-vif-plugged", "status": "completed", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:04.044267 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:04.044267 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:04.069413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c49152b1-cfe6-4daa-b8f4-eab7344c9f68 req-aa29b0c4-f18e-4a36-b1eb-0da73e978bf0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.070042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c49152b1-cfe6-4daa-b8f4-eab7344c9f68 req-aa29b0c4-f18e-4a36-b1eb-0da73e978bf0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.108711 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c49152b1-cfe6-4daa-b8f4-eab7344c9f68 req-aa29b0c4-f18e-4a36-b1eb-0da73e978bf0 service nova] Creating event network-vif-plugged:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:58:04.121016 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c49152b1-cfe6-4daa-b8f4-eab7344c9f68 req-aa29b0c4-f18e-4a36-b1eb-0da73e978bf0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085294 Nov 06 20:58:04.128244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1831/3704] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:04.140584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:04.145761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:04.159430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.163339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.164375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.164933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.278323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1227225877", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "a0d87934-0232-4205-a7f7-5ad3a2322d26"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:04.351200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] validate_networks() for [('a0d87934-0232-4205-a7f7-5ad3a2322d26', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:58:04.496580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:04.508480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:04.510075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:04.511320 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ecf85e3-9574-41a2-b2df-554870de8fb3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.381197 Nov 06 20:58:04.511829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1832/3705] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:04 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:04.529569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e07279ff-f06d-47be-9381-018d3816d13d req-94c4b7b3-34cf-4cf7-98bc-16a981e8e523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0646dc-086d-493b-9821-1a815390c091", "tag": "c9e1077c-96e4-47ab-9e42-04ae85e221d6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:04.531418 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:04.531418 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:04.546835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e07279ff-f06d-47be-9381-018d3816d13d req-94c4b7b3-34cf-4cf7-98bc-16a981e8e523 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.548725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e07279ff-f06d-47be-9381-018d3816d13d req-94c4b7b3-34cf-4cf7-98bc-16a981e8e523 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.571393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e07279ff-f06d-47be-9381-018d3816d13d req-94c4b7b3-34cf-4cf7-98bc-16a981e8e523 service nova] Creating event network-changed:c9e1077c-96e4-47ab-9e42-04ae85e221d6 for instance ee0646dc-086d-493b-9821-1a815390c091 on nch2-master-1 Nov 06 20:58:04.577977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e07279ff-f06d-47be-9381-018d3816d13d req-94c4b7b3-34cf-4cf7-98bc-16a981e8e523 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052137 Nov 06 20:58:04.579421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1833/3706] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:04.590612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-612226ea-1670-4a51-9a2a-96e8b551667c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671524b430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:04.646984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-612226ea-1670-4a51-9a2a-96e8b551667c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1463 microversion: 2.1 time: 0.066212 Nov 06 20:58:04.647563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1834/3707] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:04 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1463 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:04.659706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:04.669831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:04.676776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.677234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.678032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.678482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.934079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:04.941578 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5adf595-525d-4dfb-b252-30a2275e9449 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.288045 Nov 06 20:58:04.951654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1835/3708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:04 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:04.952466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:58:04.952892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:58:04.953729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:58:04.954146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:58:04.955179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:58:04.957260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3badb198-6476-49db-912f-cab8960b94b3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671524b700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:04.964661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.965112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:04.965921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:04.966397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.012925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3badb198-6476-49db-912f-cab8960b94b3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 200 len: 1463 microversion: 2.1 time: 0.059678 Nov 06 20:58:05.013945 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1836/3709] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:04 2021] GET /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 1463 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:05.015332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:58:05.025060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:05.025833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:05.027789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for user 0cbe3496db994852a09c97ee075fbd4a and project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:58:05.038186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.043418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.045396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.047869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.056160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:58:05.069937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:58:05.158266 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ebaf4e6-5a90-4761-827c-6ef98932a367 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194795 Nov 06 20:58:05.164118 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1874/3710] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:58:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:58:05.170380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ff083f6-0c2f-45d5-8d18-39f7765bee91 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:05.171009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ff083f6-0c2f-45d5-8d18-39f7765bee91 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:05.278740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ff083f6-0c2f-45d5-8d18-39f7765bee91 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:05.290031 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ff083f6-0c2f-45d5-8d18-39f7765bee91 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1211 microversion: 2.1 time: 0.124273 Nov 06 20:58:05.292408 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1875/3711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:05 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:05.397486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:05.408163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ca9f2b6-ec37-4577-b17f-790e59281579 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1480 microversion: 2.1 time: 0.385057 Nov 06 20:58:05.409068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1837/3712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:05 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1480 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:05.528989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:05.529949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:05.536942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.537399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.538275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.538710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.770321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:05.782900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:05.784575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:05.786494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1289f4b-c728-4ef8-bd55-9af07907781d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.261290 Nov 06 20:58:05.787062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1876/3713] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:05 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:05.960099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:05.960674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:05.967987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.968498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:05.969329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:05.969774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.121573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:06.131385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68b325f8-ee0c-42ee-9518-ca913c6a68a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.175562 Nov 06 20:58:06.132094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1838/3714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:05 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:06.306687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:06.308138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:06.314819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.315265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.316367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.316817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.380462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:06.402707 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df83962a-6f31-4f65-bf12-cc093d0fb66d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1263 microversion: 2.1 time: 0.099484 Nov 06 20:58:06.403377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1877/3715] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:06 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:06.428414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:06.429033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:06.435692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.436146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.436973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.437411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.642064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:06.657332 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac8ce9e0-2ce7-4537-8e0d-f1c53a720573 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1467 microversion: 2.1 time: 0.226021 Nov 06 20:58:06.657332 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1839/3716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:06 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:06.667850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-27532232"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:06.669361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:06.684365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.685301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.686871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.687461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.807735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:06.808629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:06.816177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.817516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:06.820144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:06.820952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:07.013189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:07.035628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:07.037633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:07.038898 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8374df0f-07fe-4960-b5db-8ae5b816e55e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1742 microversion: 2.20 time: 0.235719 Nov 06 20:58:07.039603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1840/3717] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:06 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1742 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:07.060277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-697c32bb-bbac-42a4-8311-32988fea69f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "POST /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc/action" status: 202 len: 0 microversion: 2.1 time: 0.396363 Nov 06 20:58:07.062219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1878/3718] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:58:06 2021] POST /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 20:58:07.072170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0a03e81-c0c1-40cc-86fd-abd860434d47 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714c4c040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:07.130377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0a03e81-c0c1-40cc-86fd-abd860434d47 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.062155 Nov 06 20:58:07.134042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1841/3719] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:07 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:07.149088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:07.149813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:07.156717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:07.160623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:07.161868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:07.162333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:07.420681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:07.421632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:07.432494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:07.436382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:07.439349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:07.441264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:07.835556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:07.849300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00a9bedd-d580-4b23-8178-8635903187f9 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.704299 Nov 06 20:58:07.850255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1879/3720] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:07 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:07.892925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:07.902517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ab3709a-c3ae-4bd1-a25b-b91b1f544edd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.485998 Nov 06 20:58:07.904681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1842/3721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:07 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:08.056973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:08.057585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:08.066534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.067259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.071651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.072053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.146451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba2773bb-b147-482d-a7ba-00cce485a355 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671ad85700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:08.211370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba2773bb-b147-482d-a7ba-00cce485a355 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.069227 Nov 06 20:58:08.217052 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1843/3722] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:08 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:08.392407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:08.407697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:08.409610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:08.410824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f88e4873-980a-4ed5-a6b2-6bdea7b21cf1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.357510 Nov 06 20:58:08.412746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1880/3723] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:08 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:08.605891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-95276d91-27d9-4af7-9633-f9db89e5b11c req-20abc28c-ef2d-4c20-93ec-8649a61fad61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2434de4-2c14-4111-8b89-1a7a517e3a35", "tag": "d9f96638-2b86-47db-ab65-f6ee62e849cd"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:08.609684 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:08.609684 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:08.631929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-95276d91-27d9-4af7-9633-f9db89e5b11c req-20abc28c-ef2d-4c20-93ec-8649a61fad61 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.632172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-95276d91-27d9-4af7-9633-f9db89e5b11c req-20abc28c-ef2d-4c20-93ec-8649a61fad61 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.652653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-95276d91-27d9-4af7-9633-f9db89e5b11c req-20abc28c-ef2d-4c20-93ec-8649a61fad61 service nova] Creating event network-changed:d9f96638-2b86-47db-ab65-f6ee62e849cd for instance f2434de4-2c14-4111-8b89-1a7a517e3a35 on nch2-master-1 Nov 06 20:58:08.658614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-95276d91-27d9-4af7-9633-f9db89e5b11c req-20abc28c-ef2d-4c20-93ec-8649a61fad61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062305 Nov 06 20:58:08.659800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1844/3724] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:08.867806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:08.868503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:08.877474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.882847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.883891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.885169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.922817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:08.923707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:08.939375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.939847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:08.943119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:08.943601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:09.281344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:09.289352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7bf5ae3-ed9c-4109-a906-e6014bf4eed7 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.426172 Nov 06 20:58:09.301902 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1881/3725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:08 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:09.307953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e26c190-0ef2-4d7d-ab48-f1755d787fe9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a629d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:09.314939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:09.323470 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf5c9724-40bb-43bf-b380-fff79fe9170e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.405561 Nov 06 20:58:09.336940 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1845/3726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:08 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:09.398030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e26c190-0ef2-4d7d-ab48-f1755d787fe9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.094495 Nov 06 20:58:09.398766 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1882/3727] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:09 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:09.435284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:09.435895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:09.442949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:09.443408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:09.444319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:09.444796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:09.743103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:09.756129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:09.766208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:09.767544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5bd2b97-d6c0-4ea3-9ebf-9f4610364ac9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.339736 Nov 06 20:58:09.768135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1846/3728] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:09 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:09.935039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1e0e0357-7e7c-4000-aeaa-83b5c241c333 req-a82181d6-b03a-4e4b-9f78-3ab3cf98b105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef5068-4637-46e6-b3e8-124382b109f1", "name": "network-vif-unplugged", "status": "completed", "tag": "21508f07-0718-477d-a58c-ec0512e5bdad"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:09.938934 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:09.938934 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:58:09.959740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1e0e0357-7e7c-4000-aeaa-83b5c241c333 req-a82181d6-b03a-4e4b-9f78-3ab3cf98b105 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:09.960190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1e0e0357-7e7c-4000-aeaa-83b5c241c333 req-a82181d6-b03a-4e4b-9f78-3ab3cf98b105 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:09.985850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1e0e0357-7e7c-4000-aeaa-83b5c241c333 req-a82181d6-b03a-4e4b-9f78-3ab3cf98b105 service nova] Creating event network-vif-unplugged:21508f07-0718-477d-a58c-ec0512e5bdad for instance fcef5068-4637-46e6-b3e8-124382b109f1 on nch2-master-1 Nov 06 20:58:09.996998 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1e0e0357-7e7c-4000-aeaa-83b5c241c333 req-a82181d6-b03a-4e4b-9f78-3ab3cf98b105 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067475 Nov 06 20:58:09.999797 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1883/3729] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:10.308814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:10.309542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:10.316492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.319070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.320001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.320712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.343587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:10.345743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:10.358213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.358679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.370320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.370812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.727514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:10.733636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:10.737837 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e6f0b04-7e60-4d25-9d3b-ecb4c236affd tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.432554 Nov 06 20:58:10.741897 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1847/3730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:10 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:10.742845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29a1c640-1db1-4d20-817c-6eb2175798ed tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.404523 Nov 06 20:58:10.744343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1884/3731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:10 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:10.754616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd1781cf-91e3-438d-a5f2-189537ac0dae tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714c440d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:10.786702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:10.787321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:10.801424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.801878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.802676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:10.803121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:10.844796 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd1781cf-91e3-438d-a5f2-189537ac0dae tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.100636 Nov 06 20:58:10.846045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1848/3732] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:10 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:11.145132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:11.160376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:11.166827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:11.168095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c06530b-f4ae-4f33-9bf0-7e91d23c4aba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.385189 Nov 06 20:58:11.169042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1885/3733] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:10 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:11.770311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:11.771097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:11.771410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:11.772039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:11.791158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:11.792407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:11.794024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:11.794663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:11.799988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:11.800489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:11.805120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:11.809641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:12.145340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:12.153978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fe0e75f-ce54-4a1b-adc2-d41153abb20c tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.388993 Nov 06 20:58:12.157340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1849/3734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:11 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:12.163946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:12.165091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55ffdab2-95af-4029-99ec-64e7f779ae13 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671ac2baf0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:12.177974 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4987a1ec-5489-47de-9ae1-078b5762c639 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.410393 Nov 06 20:58:12.189077 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1886/3735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:11 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:12.201228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:12.202089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:12.217440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:12.217911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:12.221519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:12.221996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:12.229196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55ffdab2-95af-4029-99ec-64e7f779ae13 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.070616 Nov 06 20:58:12.230274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1850/3736] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:12 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:12.430387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:12.445405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:12.449063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:12.450867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ca9f862-8f22-4f4a-b303-b97ddfab8c16 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.260820 Nov 06 20:58:12.451873 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1887/3737] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:12 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:13.177558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:13.178900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:13.185385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.186009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.187297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.188398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.206293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:13.206904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:13.218218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.218624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.219666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.220375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.432437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:13.448588 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4edad77e-aeef-434e-9107-5ddf2ec30e18 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.276444 Nov 06 20:58:13.453543 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1851/3738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:13 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:13.462804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc69f85f-e47b-413f-b39b-45036b676912 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715414430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:13.470054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:13.480591 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a5c72c8-55ed-4bd3-8be0-1c5d6cc3e17b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.278809 Nov 06 20:58:13.485604 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1888/3739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:13 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:13.492167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:13.493310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:13.500099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.500789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.502044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:13.502796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:13.523271 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc69f85f-e47b-413f-b39b-45036b676912 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.068458 Nov 06 20:58:13.524622 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1852/3740] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:13 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:13.687832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:13.697645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:13.700035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:13.701488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b05ac5c8-e530-4adf-95ee-a0a798f6d2a5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.214708 Nov 06 20:58:13.714074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1889/3741] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:13 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:14.324399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4a9cdfa3-5c99-4283-8154-397890c4abda req-5cea88f9-1a7c-42e1-acde-24a1db1cd23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-plugged", "status": "completed", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:14.330780 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:14.330780 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:14.347912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a9cdfa3-5c99-4283-8154-397890c4abda req-5cea88f9-1a7c-42e1-acde-24a1db1cd23a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.348669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a9cdfa3-5c99-4283-8154-397890c4abda req-5cea88f9-1a7c-42e1-acde-24a1db1cd23a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.364835 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4a9cdfa3-5c99-4283-8154-397890c4abda req-5cea88f9-1a7c-42e1-acde-24a1db1cd23a service nova] Creating event network-vif-plugged:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:58:14.379285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4a9cdfa3-5c99-4283-8154-397890c4abda req-5cea88f9-1a7c-42e1-acde-24a1db1cd23a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062773 Nov 06 20:58:14.379923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1853/3742] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:58:14.469234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:14.469868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:14.478479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.485115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.486179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.486773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.508685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:14.509422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:14.528410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.528904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.533937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.534414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.832837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:14.846214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29180fcd-ef41-4848-b864-e28dbcf9372a tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.381194 Nov 06 20:58:14.847094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:14.859186 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1890/3743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:14 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:14.865391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d84819b-0efb-4376-a04c-2a7169bdb6e8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.365835 Nov 06 20:58:14.866276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1854/3744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:14 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:14.870101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af37c585-34c0-437b-9f42-f40bd056615a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a598b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:14.875419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:14.876666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:14.883660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.884566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.885948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:14.886808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:14.979646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af37c585-34c0-437b-9f42-f40bd056615a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.127573 Nov 06 20:58:14.981472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1891/3745] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:14 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:15.092127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:15.102915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:15.104553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:15.106320 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da5c1ec9-ac94-41c2-a347-61a2f2c0c2c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.236294 Nov 06 20:58:15.106959 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1855/3746] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:14 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:15.868343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:15.869708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:15.879156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:15.880033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:15.881232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:15.881989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:15.889982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:15.891515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:15.920847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:15.922367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:15.925068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:15.934098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:16.159683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:16.168078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0ca8951-b331-4386-9c9b-e4ae13dfb6f0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.304581 Nov 06 20:58:16.189129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1892/3747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:15 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:16.202318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b6e03ea-06be-42b8-a98a-db4bc16a7daa tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714af7a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:16.278030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:16.283023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b6e03ea-06be-42b8-a98a-db4bc16a7daa tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.092467 Nov 06 20:58:16.284402 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1893/3748] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:16 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:16.289017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:16.290107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:16.293801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4a175e9-135d-47f4-8e4c-61e82e2b08b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.410945 Nov 06 20:58:16.294656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1856/3749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:15 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:16.298253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:16.298940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:16.299926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:16.300583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:16.427177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-833a7902-9bcc-4bfd-b92b-8229b1699559 req-30afc120-f860-4296-9edf-5abafb181831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0646dc-086d-493b-9821-1a815390c091", "name": "network-vif-plugged", "status": "completed", "tag": "c9e1077c-96e4-47ab-9e42-04ae85e221d6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:16.428772 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:16.428772 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:16.435935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-833a7902-9bcc-4bfd-b92b-8229b1699559 req-30afc120-f860-4296-9edf-5abafb181831 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:16.441272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-833a7902-9bcc-4bfd-b92b-8229b1699559 req-30afc120-f860-4296-9edf-5abafb181831 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:16.457193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-833a7902-9bcc-4bfd-b92b-8229b1699559 req-30afc120-f860-4296-9edf-5abafb181831 service nova] Creating event network-vif-plugged:c9e1077c-96e4-47ab-9e42-04ae85e221d6 for instance ee0646dc-086d-493b-9821-1a815390c091 on nch2-master-1 Nov 06 20:58:16.463257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-833a7902-9bcc-4bfd-b92b-8229b1699559 req-30afc120-f860-4296-9edf-5abafb181831 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039530 Nov 06 20:58:16.464845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1857/3750] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:16.469620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:16.496030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:16.498025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:16.501461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df092aee-073b-4372-803b-259a27e235e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.215713 Nov 06 20:58:16.502328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1894/3751] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:16 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:17.197191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:17.198221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:17.223393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.224168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.228033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.229372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.316495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0dac0ca9-200e-4610-9263-45a6d79dc74d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a1f4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:17.408492 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0dac0ca9-200e-4610-9263-45a6d79dc74d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.115114 Nov 06 20:58:17.409305 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1895/3752] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:17 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:17.415194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:17.416041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:17.424144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.424728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.425454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.425957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.492252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:17.524776 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76efaf5f-e901-4b98-b75f-2544fb9722a2 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1324 microversion: 2.1 time: 0.329580 Nov 06 20:58:17.526532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1858/3753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:17 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:17.554340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:17.557004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:17.578839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.580021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.581719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:17.587418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:17.626690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:17.639611 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bbf8e6d4-fe75-4f8c-a8bd-0c6b46821986 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.227570 Nov 06 20:58:17.642104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1896/3754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:17 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:17.877200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:17.891158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:17.894875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:17.902906 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64d607aa-56e0-4c9b-bc65-24a25e50e34e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.373486 Nov 06 20:58:17.903837 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1859/3755] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:17 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:18.421972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a335fde-c30b-4e82-9645-d0f249eb7805 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67157bf700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:18.479726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7010308d-1f7e-4e92-b4a7-32d274ceca91 req-0b97b3a4-3e35-4f73-83a0-d028ab8a1b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2434de4-2c14-4111-8b89-1a7a517e3a35", "name": "network-vif-plugged", "status": "completed", "tag": "d9f96638-2b86-47db-ab65-f6ee62e849cd"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:18.482659 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:18.482659 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:18.499028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7010308d-1f7e-4e92-b4a7-32d274ceca91 req-0b97b3a4-3e35-4f73-83a0-d028ab8a1b3d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:18.502135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7010308d-1f7e-4e92-b4a7-32d274ceca91 req-0b97b3a4-3e35-4f73-83a0-d028ab8a1b3d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:18.530377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7010308d-1f7e-4e92-b4a7-32d274ceca91 req-0b97b3a4-3e35-4f73-83a0-d028ab8a1b3d service nova] Creating event network-vif-plugged:d9f96638-2b86-47db-ab65-f6ee62e849cd for instance f2434de4-2c14-4111-8b89-1a7a517e3a35 on nch2-master-1 Nov 06 20:58:18.543018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7010308d-1f7e-4e92-b4a7-32d274ceca91 req-0b97b3a4-3e35-4f73-83a0-d028ab8a1b3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067523 Nov 06 20:58:18.548127 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1860/3756] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:18.560727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:18.562956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:18.573540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:18.574932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:18.576153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:18.577301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:18.993893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:19.006339 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a08afbad-52e1-4358-b1a3-ad98eadfecf5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1521 microversion: 2.1 time: 0.456707 Nov 06 20:58:19.010090 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1861/3757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:18 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:19.021696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:19.025075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:19.049398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.052012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.056244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.059261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.375847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:19.390046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f47aaad3-018c-49b6-b691-0f492392eeae tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.378703 Nov 06 20:58:19.393542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1862/3758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:19 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:19.408061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:19.410986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:19.434448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.435377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.439274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.440114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.778924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:19.803998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:19.812381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:19.816024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9219ec7b-71f1-4a82-8850-113210c1a242 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.417267 Nov 06 20:58:19.818884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1863/3759] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:19 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:19.840541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:19.841285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:19.850821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.853118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.856601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:19.857247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:19.915517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:58:20.054238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f106ab59-03dc-46d1-8de9-243a95a02ff0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 204 len: 0 microversion: 2.1 time: 0.232427 Nov 06 20:58:20.055205 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1864/3760] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:58:19 2021] DELETE /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:20.066899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:20.068893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:20.081939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.082739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:20.084020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.084790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:20.466754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:20.517999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8da8905-d9dd-42bb-8078-53238674755e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1527 microversion: 2.1 time: 0.422592 Nov 06 20:58:20.529771 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1865/3761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:20 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:20.562322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:20.564893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:20.612913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.619409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:20.625931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.628265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:20.888572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:20.896664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68457d9c-877c-4f9b-8e97-a59836a2dd06 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1311 microversion: 2.1 time: 0.365370 Nov 06 20:58:20.897783 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1866/3762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:20 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1311 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:20.912012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:20.913049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:20.922321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.924010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:20.932575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:20.933261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:21.154068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:21.177282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:21.179999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:21.181544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c821ab3-3d2e-48b7-bdca-cf9e35e49dbf tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.275231 Nov 06 20:58:21.183145 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1867/3763] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:20 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:21.549348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:21.559521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:21.582477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:21.585590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:21.593260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:21.595927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:21.941546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:21.957262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea8feba7-af3d-498f-80a2-e4655ead5a01 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1527 microversion: 2.1 time: 0.422091 Nov 06 20:58:21.958547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1868/3764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:21 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1527 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:21.966117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:21.967605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:21.976273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:21.977351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:21.978369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:21.979403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:22.339344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:22.348457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83fecfa5-fd67-495e-83ce-6c6f92e1df86 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1494 microversion: 2.1 time: 0.387769 Nov 06 20:58:22.350038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1869/3765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:21 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1494 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:22.382603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:22.386373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:22.410310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:22.410777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:22.411591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:22.412044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:22.758223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:22.767476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:22.770061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:22.774198 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c036f5fe-d054-4e86-aaca-afe5cbb04db0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.421571 Nov 06 20:58:22.775288 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1870/3766] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:22 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:23.562664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:23.563285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:23.569096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:23.569768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:23.572221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:23.572845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:23.859336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f8cc286-3a0a-43ca-a16f-3c3d23529fa8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1645 microversion: 2.1 time: 1.082846 Nov 06 20:58:23.871387 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1871/3767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:22 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1645 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:23.886226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:23.887577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:23.905221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:23.907053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:23.913086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:23.915022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.001694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.003402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.004955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lazy-loading 'fault' on Instance uuid ee0646dc-086d-493b-9821-1a815390c091 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:58:24.114766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d0cebeefdc482caf46119297ddb0ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8f9116653e40f0a02c98904ff90b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:24.127356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33fcba33-2493-4f14-8dfb-5c649bfaf7e0 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 200 len: 1314 microversion: 2.1 time: 0.249871 Nov 06 20:58:24.128524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1872/3768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:23 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:24.143453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-694a3b79-342f-413c-93a4-ef16cbbf30bf req-253da69a-ce45-4a4f-a6df-58761d02fe4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0646dc-086d-493b-9821-1a815390c091", "name": "network-vif-deleted", "tag": "c9e1077c-96e4-47ab-9e42-04ae85e221d6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:24.146154 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:24.146154 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:24.168176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-694a3b79-342f-413c-93a4-ef16cbbf30bf req-253da69a-ce45-4a4f-a6df-58761d02fe4f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.173961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-694a3b79-342f-413c-93a4-ef16cbbf30bf req-253da69a-ce45-4a4f-a6df-58761d02fe4f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.227148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-694a3b79-342f-413c-93a4-ef16cbbf30bf req-253da69a-ce45-4a4f-a6df-58761d02fe4f service nova] Creating event network-vif-deleted:c9e1077c-96e4-47ab-9e42-04ae85e221d6 for instance ee0646dc-086d-493b-9821-1a815390c091 on nch2-master-1 Nov 06 20:58:24.250508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-694a3b79-342f-413c-93a4-ef16cbbf30bf req-253da69a-ce45-4a4f-a6df-58761d02fe4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110270 Nov 06 20:58:24.252473 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1873/3769] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:24.261993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:24.263282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:24.273652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.274374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.275329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.276471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.572889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:24.622706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:24.628892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:24.630759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3dcbe9f-0fc5-4914-98f5-3f56f695ee5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.376424 Nov 06 20:58:24.638860 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1874/3770] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:24 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:24.650419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:24.651412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:24.699388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.706007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:24.709686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:24.710382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.043029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d5e98fd-e70c-4f99-9d60-0eefe88f8461 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1645 microversion: 2.1 time: 0.400149 Nov 06 20:58:25.043677 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1875/3771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:24 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1645 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:25.061432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.063326 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:25.063326 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:25.066667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.067339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.068654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.069227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.117643 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60568d21-1960-4696-a48c-99755c8b4f1f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061379 Nov 06 20:58:25.119075 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1876/3772] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:58:25 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:58:25.136062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:25.137806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:25.150701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.151647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.153099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.154006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.194132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lazy-loading 'flavor' on Instance uuid f2434de4-2c14-4111-8b89-1a7a517e3a35 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:58:25.217645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:58:25.218434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a335fde-c30b-4e82-9645-d0f249eb7805 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 6.800056 Nov 06 20:58:25.219189 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1897/3773] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:18 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 6802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:25.236966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.238760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: ee0646dc-086d-493b-9821-1a815390c091] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:25.247503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.247972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.250229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.250801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.269700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance ee0646dc-086d-493b-9821-1a815390c091 could not be found. Nov 06 20:58:25.270942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance ee0646dc-086d-493b-9821-1a815390c091 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:25.272199 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b0cd3f01-b537-4d21-a0b8-3354ddb60936 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091" status: 404 len: 111 microversion: 2.1 time: 0.046447 Nov 06 20:58:25.272942 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1898/3774] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:25 2021] GET /compute/v2.1/servers/ee0646dc-086d-493b-9821-1a815390c091 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:58:25.283937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2aa232e-d1a7-4376-b9fa-55cd0da39115 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f6714a590d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.317669 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b2aa232e-d1a7-4376-b9fa-55cd0da39115 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Image not found. Nov 06 20:58:25.318637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2aa232e-d1a7-4376-b9fa-55cd0da39115 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:25.319754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2aa232e-d1a7-4376-b9fa-55cd0da39115 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814" status: 404 len: 62 microversion: 2.1 time: 0.040618 Nov 06 20:58:25.321253 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1899/3775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:25 2021] DELETE /compute/v2.1/images/0e226d69-97c1-4fad-a815-393fb917f814 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:58:25.329595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.330349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:25.343259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.343967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.345185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.345784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.374233 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. Nov 06 20:58:25.375825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:25.378519 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4bcb6fa2-0baf-4135-a11c-64d8ea9c08d6 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 404 len: 111 microversion: 2.1 time: 0.053851 Nov 06 20:58:25.379369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1900/3776] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:58:25 2021] DELETE /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:58:25.394865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.395685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: 32061ca8-bcb4-4e81-88ab-f5e4bd028872] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:25.407256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.407723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.408557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.409731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.440369 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. Nov 06 20:58:25.440884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance 32061ca8-bcb4-4e81-88ab-f5e4bd028872 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:25.442491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83b6420d-3ad7-4f3b-8221-9fea2dd7943e tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872" status: 404 len: 111 microversion: 2.1 time: 0.058929 Nov 06 20:58:25.443632 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1901/3777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:25 2021] GET /compute/v2.1/servers/32061ca8-bcb4-4e81-88ab-f5e4bd028872 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:58:25.486676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad021a56-40f8-4f4c-920b-41d5398748fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f6714a873a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.537770 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad021a56-40f8-4f4c-920b-41d5398748fc tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609360858" status: 202 len: 0 microversion: 2.1 time: 0.089605 Nov 06 20:58:25.538810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1902/3778] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 20:58:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609360858 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:58:25.661751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:25.662514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:25.671411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.671874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.680585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:25.681053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:25.986115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:25.997537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:25.999080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:26.003816 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e3543ae-96bb-4b69-bff2-69e523677764 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1737 microversion: 2.20 time: 0.343999 Nov 06 20:58:26.005118 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1903/3779] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:25 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1737 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:26.235612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7bd767c-796b-4fb2-8e35-1989b527f539 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67149e4c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:26.319644 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7bd767c-796b-4fb2-8e35-1989b527f539 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.089164 Nov 06 20:58:26.322076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1904/3780] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:26 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:27.038594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:27.041443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:27.052957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.054511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.056082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.057141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.367204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:27.383406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:27.385251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:27.387297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40a2f3d1-7532-4c9f-935f-099648f83994 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1719 microversion: 2.20 time: 0.355419 Nov 06 20:58:27.388050 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1905/3781] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:27 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1719 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:27.415824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-732fbc09-a4a1-41ae-83a5-888cf085695f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '.version_select at 0x7f6714a59670>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:27.494261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-732fbc09-a4a1-41ae-83a5-888cf085695f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Image not found. Nov 06 20:58:27.497600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-732fbc09-a4a1-41ae-83a5-888cf085695f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:27.503924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-732fbc09-a4a1-41ae-83a5-888cf085695f tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/images/b5b64b4d-91d6-4356-995e-721352b26060" status: 404 len: 62 microversion: 2.1 time: 0.109360 Nov 06 20:58:27.505121 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1906/3782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:27 2021] DELETE /compute/v2.1/images/b5b64b4d-91d6-4356-995e-721352b26060 => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:58:27.520731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4eca158c-45f5-4083-985e-3719047b173b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a61af0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:27.588819 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4eca158c-45f5-4083-985e-3719047b173b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.081888 Nov 06 20:58:27.589389 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1907/3783] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:27 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:27.594730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:27.595403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:27.602880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.603612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.604707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.605337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.642053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. Nov 06 20:58:27.643759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:27.644848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f717583-74df-4bfb-a0fc-1d168cb20daa tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "DELETE /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 404 len: 111 microversion: 2.1 time: 0.054360 Nov 06 20:58:27.648213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1908/3784] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:58:27 2021] DELETE /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:58:27.656384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:27.657097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] [instance: de50665b-f9fe-480d-b6a4-1591f2cc2757] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:27.664852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.665012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.665781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:27.668264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:27.685332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] HTTP exception thrown: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. Nov 06 20:58:27.686590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] Returning 404 to user: Instance de50665b-f9fe-480d-b6a4-1591f2cc2757 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:58:27.688580 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e94d129-0b8a-47c1-a732-cb4f3b50b7b5 tempest-ImagesOneServerNegativeTestJSON-1988448079 tempest-ImagesOneServerNegativeTestJSON-1988448079-project] 10.222.0.13 "GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757" status: 404 len: 111 microversion: 2.1 time: 0.035886 Nov 06 20:58:27.689383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1909/3785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:27 2021] GET /compute/v2.1/servers/de50665b-f9fe-480d-b6a4-1591f2cc2757 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 20:58:28.419489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:28.420128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:28.433759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:28.435794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:28.437596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:28.438431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:28.708541 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50191c0f-6be4-43a6-9778-76d6a2b2d821 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35/action" status: 202 len: 0 microversion: 2.1 time: 3.582022 Nov 06 20:58:28.709647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1877/3786] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:58:25 2021] POST /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35/action => generated 0 bytes in 3584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:58:28.714500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3757601-a74b-44fb-8da6-7078068c815c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715228280>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:28.784187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:28.798885 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3757601-a74b-44fb-8da6-7078068c815c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.088042 Nov 06 20:58:28.799242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:28.799654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1878/3787] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:28 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:28.800966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:28.802173 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a7bbc32-c93c-4008-829e-fb6611289cd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1719 microversion: 2.20 time: 0.387176 Nov 06 20:58:28.817806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:28.818671 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1910/3788] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:28 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1719 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:28.821820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:28.839251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:28.842700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:28.844181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:28.844997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:29.303895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:29.329417 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae6ca931-24d7-4701-b95f-5e8d7aecaed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.528143 Nov 06 20:58:29.334333 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1879/3789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:28 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:29.826230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:29.826851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:29.833157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ce19e006-5c15-46b8-a4a3-82c70b725dd2 req-a2ae8010-e43b-47ee-a5d4-f7723adffbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "name": "network-vif-unplugged", "status": "completed", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:29.835458 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:29.835458 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:58:29.853114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:29.854901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:29.859229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ce19e006-5c15-46b8-a4a3-82c70b725dd2 req-a2ae8010-e43b-47ee-a5d4-f7723adffbbd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:29.860787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:29.861443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:29.869295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ce19e006-5c15-46b8-a4a3-82c70b725dd2 req-a2ae8010-e43b-47ee-a5d4-f7723adffbbd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:29.903105 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ce19e006-5c15-46b8-a4a3-82c70b725dd2 req-a2ae8010-e43b-47ee-a5d4-f7723adffbbd service nova] Creating event network-vif-unplugged:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:58:29.920649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ce19e006-5c15-46b8-a4a3-82c70b725dd2 req-a2ae8010-e43b-47ee-a5d4-f7723adffbbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102031 Nov 06 20:58:29.921571 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1911/3790] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:29.942830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bcabcb3-6fd4-4d54-b185-1d9fc60d2201 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a46c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:30.021125 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bcabcb3-6fd4-4d54-b185-1d9fc60d2201 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.095662 Nov 06 20:58:30.023610 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1912/3791] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:29 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:30.350729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:30.351590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:30.361102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:30.368645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:30.370409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:30.371073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:30.524742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:30.544387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:30.552498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:30.555234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4cb860b-bd41-4958-a8c2-ce64a9a8d7f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1719 microversion: 2.20 time: 0.731746 Nov 06 20:58:30.556432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1880/3792] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:29 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1719 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:31.037558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22df05cc-a6b9-4d62-a6ea-c3b7656f953d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714c480d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:31.073525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:31.088450 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c44777a7-2e11-41f7-91cc-075643c70981 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.741865 Nov 06 20:58:31.090328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1913/3793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:30 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:31.109548 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22df05cc-a6b9-4d62-a6ea-c3b7656f953d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.075442 Nov 06 20:58:31.110123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1881/3794] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:31 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:31.130471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-41fd257b-a9e5-4309-b8e4-a30611ad1e18 req-f4959ac4-2e38-49ce-98ba-d12c793bc134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2434de4-2c14-4111-8b89-1a7a517e3a35", "name": "network-vif-unplugged", "status": "completed", "tag": "d9f96638-2b86-47db-ab65-f6ee62e849cd"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:31.132391 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:31.132391 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:58:31.152967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-41fd257b-a9e5-4309-b8e4-a30611ad1e18 req-f4959ac4-2e38-49ce-98ba-d12c793bc134 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:31.154935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-41fd257b-a9e5-4309-b8e4-a30611ad1e18 req-f4959ac4-2e38-49ce-98ba-d12c793bc134 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:31.180778 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-41fd257b-a9e5-4309-b8e4-a30611ad1e18 req-f4959ac4-2e38-49ce-98ba-d12c793bc134 service nova] Creating event network-vif-unplugged:d9f96638-2b86-47db-ab65-f6ee62e849cd for instance f2434de4-2c14-4111-8b89-1a7a517e3a35 on nch2-master-1 Nov 06 20:58:31.197813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-41fd257b-a9e5-4309-b8e4-a30611ad1e18 req-f4959ac4-2e38-49ce-98ba-d12c793bc134 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073039 Nov 06 20:58:31.198638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1914/3795] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:31.574362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:31.575390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:31.587603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:31.588818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:31.590882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:31.592862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.071876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:32.087248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:32.088999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:32.090265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-810816d7-2e32-4495-80ef-38e175f6f812 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1662 microversion: 2.20 time: 0.520128 Nov 06 20:58:32.090833 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1882/3796] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:31 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1662 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:32.115697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:32.120959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:32.146846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "009aa4f5-f40b-4281-b200-5544181221dc"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:32.161196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.161196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.161403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:32.163734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.169367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.185567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.193028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.195098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.201038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.578489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:32.593670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95b7f206-044a-4844-856e-ca460edd7329 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.485449 Nov 06 20:58:32.603631 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1915/3797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:32 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:32.603631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a395c9a-dff5-44b6-9a6e-7b9dbfe06040 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67158a3dc0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:32.676662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a395c9a-dff5-44b6-9a6e-7b9dbfe06040 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.078901 Nov 06 20:58:32.677236 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1916/3798] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:32 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:32.782326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6fbc573-b4a8-437f-a418-cff2fc28a56d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.661895 Nov 06 20:58:32.783133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1883/3799] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Nov 6 20:58:32 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments => generated 188 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 20:58:32.946390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:32.947251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:32.953718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.954425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:32.955437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:32.956067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.175454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:33.177263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.177816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.178735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.179274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.269506 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-470f2075-e0e2-4c6d-a64e-4a40ba6d665b tempest-AZV2TestJSON-322529459 tempest-AZV2TestJSON-322529459-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.590235 Nov 06 20:58:33.270270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1917/3800] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Nov 6 20:58:32 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:58:33.285922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5dcd47ae-f665-46dd-9d65-4cfebc49ebf6 req-a5831bff-d973-4d4f-b83e-3d82269ac519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2434de4-2c14-4111-8b89-1a7a517e3a35", "tag": "d9f96638-2b86-47db-ab65-f6ee62e849cd"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:33.287639 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:33.287639 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:58:33.299922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5dcd47ae-f665-46dd-9d65-4cfebc49ebf6 req-a5831bff-d973-4d4f-b83e-3d82269ac519 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.300654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5dcd47ae-f665-46dd-9d65-4cfebc49ebf6 req-a5831bff-d973-4d4f-b83e-3d82269ac519 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.316335 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5dcd47ae-f665-46dd-9d65-4cfebc49ebf6 req-a5831bff-d973-4d4f-b83e-3d82269ac519 service nova] Creating event network-changed:d9f96638-2b86-47db-ab65-f6ee62e849cd for instance f2434de4-2c14-4111-8b89-1a7a517e3a35 on nch2-master-1 Nov 06 20:58:33.321858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5dcd47ae-f665-46dd-9d65-4cfebc49ebf6 req-a5831bff-d973-4d4f-b83e-3d82269ac519 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050420 Nov 06 20:58:33.323099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1918/3801] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:33.438754 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11666e98-3579-4bb6-9327-c1994db1f67b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action" status: 202 len: 0 microversion: 2.20 time: 0.497213 Nov 06 20:58:33.448459 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1884/3802] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 20:58:32 2021] POST /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:33.457512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:33.470655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:33.506464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.512638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.513557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.517533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.613443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:33.613980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:33.633467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.634306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.635309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:33.635858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:33.958152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:33.973249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:33.981845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:33.991793 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bdd85881-af80-4fbf-af49-ed1de80e74ba tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1748 microversion: 2.20 time: 0.541659 Nov 06 20:58:33.992698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1919/3803] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:33 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1748 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:34.000163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:34.009782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6e8dbe3-14e3-4fdf-bbcd-a0532ad2d8f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.401918 Nov 06 20:58:34.009986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25ea1e21-41fd-4161-93a1-4c12959de8ef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a31a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:34.011606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1885/3804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:33 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:34.505371 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25ea1e21-41fd-4161-93a1-4c12959de8ef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.509500 Nov 06 20:58:34.513184 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1920/3805] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:33 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:35.010842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:35.012384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:35.032139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:35.032996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:35.046020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:35.051467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:35.052647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:35.057380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:35.059686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:35.060598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:35.067155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:35.067821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:35.541007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:35.572472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:35.576550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:35.579122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07bbbe6a-d48c-428a-a7bd-42a80ecd90b5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1750 microversion: 2.20 time: 0.572031 Nov 06 20:58:35.579703 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1886/3806] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:35 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1750 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:35.590476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50d17844-09e1-47c3-98d3-f4e8b5c7a5d0 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714c5a5e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:35.591296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:35.600242 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8c5f6e5-ffd7-4e64-940a-aa4010024864 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.572649 Nov 06 20:58:35.604426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1921/3807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:35 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:36.010633 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50d17844-09e1-47c3-98d3-f4e8b5c7a5d0 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.425571 Nov 06 20:58:36.013009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1887/3808] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:35 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:36.599585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:36.600965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:36.610981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:36.611664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:36.612670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:36.613402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:36.622682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:36.623893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:36.650253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:36.661615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:36.662657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:36.663256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:36.949664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:36.964340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:36.969548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:36.971686 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b11fd32-08b9-4537-8f9b-676e59a51927 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1750 microversion: 2.20 time: 0.376772 Nov 06 20:58:36.980652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1922/3809] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:36 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1750 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:36.987355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:36.997919 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d6015b4-6440-4a6e-99b3-f0ce79d42d6d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.380686 Nov 06 20:58:37.000640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1888/3810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:36 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:37.024319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e923c0d-f754-4a82-b036-3651edb420bf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b189d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:37.174291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e923c0d-f754-4a82-b036-3651edb420bf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1453 microversion: 2.1 time: 0.153446 Nov 06 20:58:37.175613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1923/3811] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:37 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:37.824620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1936111277", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "af3a0b98-5e85-4204-bfc9-9a8757f4ab65"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:37.881459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] validate_networks() for [('af3a0b98-5e85-4204-bfc9-9a8757f4ab65', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:58:37.999973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:38.000615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:38.009144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:38.009955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:38.011737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:38.012875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:38.722816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:38.742802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:38.744494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:38.745926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dbfd2855-20b4-496c-ab96-c22e6a4335db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.751477 Nov 06 20:58:38.746866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1924/3812] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:37 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:38.760700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:38.761754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:38.780350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:38.780816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:38.782088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:38.782641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.523216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:58:39.524972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:58:39.525646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:58:39.526271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:58:39.529135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:58:39.532863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:39.563543 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46b6bf2d-078f-4062-9936-2201d100acb7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.815121 Nov 06 20:58:39.564886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1925/3813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:38 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:39.574485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.574485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.574485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.574485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.586323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76819e61-8ff4-4c5e-b487-425f18f0c472 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b18040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:39.617293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Getting quotas for project 7c12e0618d884fc29318833f9f5a544e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:58:39.623535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Getting quotas for user 5738428039b14b6580b7e2c9d3e29490 and project 7c12e0618d884fc29318833f9f5a544e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:58:39.640861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Going to run 2 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:58:39.654952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 7a17d778-9236-458e-aa12-f22d07373a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:58:39.687045 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76819e61-8ff4-4c5e-b487-425f18f0c472 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1462 microversion: 2.1 time: 0.108413 Nov 06 20:58:39.689010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1926/3814] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:39 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1462 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:39.704360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=7a17d778-9236-458e-aa12-f22d07373a44,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:58:39.710264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5da5996-0671-4f10-a5ac-fd813db973b6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a6d820>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:39.801485 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bb6ba98c-1aba-40f1-a750-9f329124e669 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.135732 Nov 06 20:58:39.818887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1889/3815] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:58:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:58:39.821865 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5da5996-0671-4f10-a5ac-fd813db973b6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 200 len: 1462 microversion: 2.1 time: 0.125324 Nov 06 20:58:39.822579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1927/3816] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:39 2021] GET /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 1462 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:39.826787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:39.829681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:39.837010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.838544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.839921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.840759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.843441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:39.870878 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:39.870878 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:58:39.875231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:39.885834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Searching by: {'deleted': False, 'project_id': '7c12e0618d884fc29318833f9f5a544e'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:58:39.917027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.917748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:39.918768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:39.919356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:40.023605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b6520db6-e78b-4ca6-8bd6-296577930fb2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.198809 Nov 06 20:58:40.024563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1928/3817] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 20:58:39 2021] GET /compute/v2.1/servers => generated 677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:40.034979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.035617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:40.045444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:40.046774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:40.047731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:40.048373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:40.095496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.110676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.112661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.114489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-baf4455f-fdfa-473e-8e6a-b1d9f712bd48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.294392 Nov 06 20:58:40.116999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1890/3818] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:39 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:40.125293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e2d126f0-d058-41e6-96d8-3aba3dd05b6d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.126442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e2d126f0-d058-41e6-96d8-3aba3dd05b6d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:40.282796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e2d126f0-d058-41e6-96d8-3aba3dd05b6d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.292615 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e2d126f0-d058-41e6-96d8-3aba3dd05b6d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1220 microversion: 2.1 time: 0.174398 Nov 06 20:58:40.293199 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1891/3819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:40.316484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.329811 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a2f7952-0094-4c0a-abad-7c3eec61e0c2 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1468 microversion: 2.1 time: 0.302938 Nov 06 20:58:40.337280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1929/3820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:40.348889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9fdd532-dde5-4ab2-95ff-668f1248103c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67159c0310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.499768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9fdd532-dde5-4ab2-95ff-668f1248103c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?changes-since=2021-11-06T20%3A56%3A40Z" status: 200 len: 2373 microversion: 2.1 time: 0.154554 Nov 06 20:58:40.501818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1892/3821] 10.222.0.13 () {58 vars in 1198 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/images?changes-since=2021-11-06T20%3A56%3A40Z => generated 2373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:40.522824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-859b4beb-ec86-4f14-bda9-d578bb10c6a9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a31700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.583086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.583924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:40.596215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:40.596498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:40.597319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:40.597757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:40.603302 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-859b4beb-ec86-4f14-bda9-d578bb10c6a9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-985242358" status: 200 len: 484 microversion: 2.1 time: 0.094664 Nov 06 20:58:40.603996 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1930/3822] 10.222.0.13 () {58 vars in 1228 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-985242358 => generated 484 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:40.618651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcb9b0f1-a7dd-47d3-9283-484e0ef1024f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a463a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.779619 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcb9b0f1-a7dd-47d3-9283-484e0ef1024f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?server=6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 956 microversion: 2.1 time: 0.167913 Nov 06 20:58:40.781501 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1931/3823] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/images?server=6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 956 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:40.803737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc428607-a1d4-4076-bbeb-f4b9285a59f3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a46430>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:40.891093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:40.902116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6dbee89-f36b-47bc-93d8-c0a69566716f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.324502 Nov 06 20:58:40.902605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1893/3824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:40.929764 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc428607-a1d4-4076-bbeb-f4b9285a59f3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 484 microversion: 2.1 time: 0.138404 Nov 06 20:58:40.930455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1932/3825] 10.222.0.13 () {58 vars in 1316 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:40.944489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db4491b9-0db2-4b68-8934-da6bd8e9d898 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714bed700>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.038025 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db4491b9-0db2-4b68-8934-da6bd8e9d898 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 484 microversion: 2.1 time: 0.099648 Nov 06 20:58:41.050203 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1894/3826] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Nov 6 20:58:40 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1 => generated 484 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:41.053299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b972ec3-9937-4c2e-aba2-37a35ae59790 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b18280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.133141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.134502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:41.148045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.148853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.149925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.150601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.260821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b972ec3-9937-4c2e-aba2-37a35ae59790 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.213893 Nov 06 20:58:41.272276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1933/3827] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:41.276910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65fc0f99-dd1c-4066-9c2f-aee2784eb3ba tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a46ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.336956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:41.349810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:41.351744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:41.353479 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a607f336-24a0-43bb-8720-12cb213e898d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.224123 Nov 06 20:58:41.365326 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65fc0f99-dd1c-4066-9c2f-aee2784eb3ba tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.090590 Nov 06 20:58:41.365326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1934/3828] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:41.367059 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1895/3829] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:41.379984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53b9eb91-7dc1-4dfb-a280-6a67595b1f3b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714c4c790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.382228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.382837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:41.389342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.390371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.391159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.392024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.441156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53b9eb91-7dc1-4dfb-a280-6a67595b1f3b tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.067635 Nov 06 20:58:41.442548 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1896/3830] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:41.454029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d16377e1-b003-4919-a49c-ffcd75ef4f74 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714bef430>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.458310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:41.466346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10aab40c-506c-4259-a88b-19875e47327c tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.087805 Nov 06 20:58:41.467679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1935/3831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:41.559033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d16377e1-b003-4919-a49c-ffcd75ef4f74 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?changes-since=2021-11-06T20%3A56%3A37Z" status: 200 len: 6331 microversion: 2.1 time: 0.108925 Nov 06 20:58:41.559956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1897/3832] 10.222.0.13 () {58 vars in 1219 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images/detail?changes-since=2021-11-06T20%3A56%3A37Z => generated 6331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:41.576023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-43923bca-fb94-4792-9dd9-a4278e0775ab tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a31280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.667912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-43923bca-fb94-4792-9dd9-a4278e0775ab tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-985242358" status: 200 len: 664 microversion: 2.1 time: 0.094877 Nov 06 20:58:41.669467 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1936/3833] 10.222.0.13 () {58 vars in 1249 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-985242358 => generated 664 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:41.681992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-049eaa32-0a09-453e-a7d2-96678af0725c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714befca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.759268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-049eaa32-0a09-453e-a7d2-96678af0725c tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1466 microversion: 2.1 time: 0.081200 Nov 06 20:58:41.761206 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1898/3834] 10.222.0.13 () {58 vars in 1337 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1 => generated 1466 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:41.775192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e762abc-80bb-4227-aaf4-2a157317a4b7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b1a790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.861834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-71ddbe91-d34b-4cc0-a0ff-0c53c671f257 req-60194c8e-c0ea-4f22-9bbd-e28ba3820f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-unplugged", "status": "completed", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:41.863950 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:41.863950 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:41.882546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e762abc-80bb-4227-aaf4-2a157317a4b7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1466 microversion: 2.1 time: 0.111270 Nov 06 20:58:41.882831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1937/3835] 10.222.0.13 () {58 vars in 1323 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2Ffcef5068-4637-46e6-b3e8-124382b109f1 => generated 1466 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:41.895974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-71ddbe91-d34b-4cc0-a0ff-0c53c671f257 req-60194c8e-c0ea-4f22-9bbd-e28ba3820f8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.901494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-71ddbe91-d34b-4cc0-a0ff-0c53c671f257 req-60194c8e-c0ea-4f22-9bbd-e28ba3820f8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.903325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a30ca02e-fd6a-475e-a49e-aa85387de036 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a6d280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.933549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-71ddbe91-d34b-4cc0-a0ff-0c53c671f257 req-60194c8e-c0ea-4f22-9bbd-e28ba3820f8e service nova] Creating event network-vif-unplugged:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:58:41.946190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-71ddbe91-d34b-4cc0-a0ff-0c53c671f257 req-60194c8e-c0ea-4f22-9bbd-e28ba3820f8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089513 Nov 06 20:58:41.947323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1899/3836] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:41.954788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:41.955702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:41.963077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.963901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:41.965772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:41.966634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:42.028617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a30ca02e-fd6a-475e-a49e-aa85387de036 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.135398 Nov 06 20:58:42.029421 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1938/3837] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:42.052021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6eab618f-2f80-4e31-ba29-9834cb7ecf6e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b1a790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.158246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6eab618f-2f80-4e31-ba29-9834cb7ecf6e tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.115136 Nov 06 20:58:42.159929 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1939/3838] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 20:58:42 2021] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:42.178820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4a553ce-1dc0-415d-b01c-d7847476e2f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714b18790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.222454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:42.234748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7a9ea2f-60eb-4141-a691-a6882576fc11 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.283144 Nov 06 20:58:42.235627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1900/3839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:41 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:42.270542 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4a553ce-1dc0-415d-b01c-d7847476e2f6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c" status: 200 len: 784 microversion: 2.1 time: 0.100769 Nov 06 20:58:42.271110 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1940/3840] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:58:42 2021] GET /compute/v2.1/images/84b8d88b-fc57-44cc-ba26-535c5373e60c => generated 784 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:42.288484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2de5274-d956-4e2f-b4d0-970773557edc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67152f6040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.358304 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2de5274-d956-4e2f-b4d0-970773557edc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.075586 Nov 06 20:58:42.370563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1901/3841] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Nov 6 20:58:42 2021] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:42.374905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.375537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:42.387716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:42.387936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-197a7e40-2488-4c4e-96f9-474b848cc2c4 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715215a60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.388204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:42.390123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:42.390593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:42.579980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:42.590604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:42.592124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:42.593391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f02bc393-9063-4b08-980e-5dbeb0247101 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.224555 Nov 06 20:58:42.594272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1941/3842] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:42 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:58:42.603963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:42.606007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:42.612795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:42.613080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:42.614074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:42.614663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:42.689443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:42.702112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e3c205a-d504-4037-b993-59c82ba15af3 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.106673 Nov 06 20:58:42.703349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1942/3843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:42 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:43.252648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:43.253521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:43.261071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.261765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.262771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.263485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.369540 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-197a7e40-2488-4c4e-96f9-474b848cc2c4 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed" status: 204 len: 0 microversion: 2.1 time: 0.995415 Nov 06 20:58:43.370765 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1902/3844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:42 2021] DELETE /compute/v2.1/images/2dc56c11-5a37-4575-a38d-49375879b6ed => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:43.379601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdca0726-f195-4567-9cb5-415c479284dd tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6715215310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:43.570281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:43.588724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-429926f9-99ea-461a-9b7f-d8fa13fe0653 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.339934 Nov 06 20:58:43.590216 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1943/3845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:43 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:43.611130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:43.611736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:43.617621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.618077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.618862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.619287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.771575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:43.780456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:43.782002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:43.783457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76bb5601-0503-4f93-91c1-612052535264 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.176075 Nov 06 20:58:43.794324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1944/3846] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:43 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:43.799094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:43.799712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:43.805410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.805867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.806653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:43.807189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:43.911921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:43.922357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-889c56ae-27e0-4554-833c-0339589a10f6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.126708 Nov 06 20:58:43.925810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1945/3847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:43 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:44.275444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdca0726-f195-4567-9cb5-415c479284dd tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53" status: 204 len: 0 microversion: 2.1 time: 0.899361 Nov 06 20:58:44.276204 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1903/3848] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:43 2021] DELETE /compute/v2.1/images/95ca0b2d-8283-47c3-b485-e1e4fd31cd53 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:44.283963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29646478-dd42-44fa-8360-80158d9f58dc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f6714a721f0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:44.610660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:44.612319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:44.625719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:44.626586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:44.627875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:44.628648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:44.853133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:44.871704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-508ae79e-5667-4a90-a550-b9fc0272d9f6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.265862 Nov 06 20:58:44.883018 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1904/3849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:44 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:44.893582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:44.896462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:44.921388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:44.921871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:44.923293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:44.928606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.214992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:45.225582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:45.227090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:45.228553 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92a22f8e-09c9-4a57-a35c-d346af8d1429 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.339671 Nov 06 20:58:45.229339 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1905/3850] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:44 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:45.245832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:45.246930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:45.265434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.268504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.269501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.273218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.391310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:45.399232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3139cf4-8ded-4e88-9174-21316c44fe4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.168686 Nov 06 20:58:45.399939 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1906/3851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:45 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:45.636159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29646478-dd42-44fa-8360-80158d9f58dc tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94" status: 204 len: 0 microversion: 2.1 time: 1.355767 Nov 06 20:58:45.637365 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1946/3852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:44 2021] DELETE /compute/v2.1/images/b5043cab-a9eb-46b9-8287-efde634f4b94 => generated 0 bytes in 1358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:45.647451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:45.648037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:45.667754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.668240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.669137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.669749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.710041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:58:45.829150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a778a957-a00d-4092-a123-75b9db2203a3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 204 len: 0 microversion: 2.1 time: 0.186713 Nov 06 20:58:45.830028 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1907/3853] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:58:45 2021] DELETE /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:58:45.838593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:45.839643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:45.849391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.859178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.860511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.864378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.894535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:45.897704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:45.913249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.915625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:45.917503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:45.919298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:46.113500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.123490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb38660e-b84a-46fb-8f4e-b4bf244fe277 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.288900 Nov 06 20:58:46.125830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1947/3854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:45 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:46.189972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.197706 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-baa9a11a-c9a7-4d29-8c0a-2e96b5cfa917 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.311366 Nov 06 20:58:46.198316 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1908/3855] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:45 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:46.265504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:46.268456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:46.278085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:46.278954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:46.280170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:46.281060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:46.417242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:46.418014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:46.424410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:46.424865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:46.425838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:46.426279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:46.437311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.446224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.447952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.449403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef326de7-d516-4c0c-a21d-cb2154a21456 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.189801 Nov 06 20:58:46.449975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1948/3856] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:46 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:46.491631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:46.499566 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-937dbd0a-fa8f-458a-bb91-e58070fc5622 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.085929 Nov 06 20:58:46.500146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1909/3857] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:46 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:47.143134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:47.143815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:47.150170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.150633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.151433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.151920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.215138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:47.216875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:47.226168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.230820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.233298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.233737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.378222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.385863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0458c1d5-469a-44d0-b095-1b5f92a358d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.247276 Nov 06 20:58:47.386457 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1949/3858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:47 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:47.463808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.489743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:47.490263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:47.491280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b2d3c5c-2837-4228-9068-71af2c434621 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.279989 Nov 06 20:58:47.492476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1910/3859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:47 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:47.507748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.508217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.509080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.509531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.517502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:47.521099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:47.532777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.533883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.535203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:47.535965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:47.660187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.668934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4023e2a8-9fb6-473a-88eb-787eafaee1a9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.156170 Nov 06 20:58:47.672686 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1911/3860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:47 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:47.813497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.822729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.824264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:47.825680 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8179d7f9-d0df-4913-91a7-fc2e3edad1f4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.340255 Nov 06 20:58:47.840532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1950/3861] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:47 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:48.403922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:48.404678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:48.412428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.413086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.413885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.414463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.508619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:48.509241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:48.532701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.533167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.533989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.534433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.575935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:48.586607 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e991e015-5540-402d-b4f6-779d168b9711 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.186099 Nov 06 20:58:48.598656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1912/3862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:48 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:48.686387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:48.687170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:48.693839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.694557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.696067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.696646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.729624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:48.738000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b12947c-f238-4a45-9617-ea21f9480982 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.233006 Nov 06 20:58:48.748543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1951/3863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:48 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:48.770013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:48.779393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7491e8f1-b85e-494d-8600-9cd3c59f5cbb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.097119 Nov 06 20:58:48.781372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1913/3864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:48 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:48.857895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:48.860029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:48.866381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.867325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:48.868373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:48.869048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.031509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:49.040024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:49.041868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:49.043038 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-210ac7b2-e506-4a17-a62a-1b54a78d1fa2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.189366 Nov 06 20:58:49.043790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1952/3865] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:48 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:49.604419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:49.605039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:49.612212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.613121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.613501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.613945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.755805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:49.756725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:49.765346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.766153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.767133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.767738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.871740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:49.880568 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2147ab9-4b76-4786-9f76-01fa91cb940f tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.279697 Nov 06 20:58:49.893140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1914/3866] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:49 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:49.899593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:49.900515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:49.910271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.910892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:49.913946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:49.914854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:50.013210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:50.021640 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03ce1b25-08d9-47c2-9e59-2687c182b90f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.127059 Nov 06 20:58:50.022304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1915/3867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:49 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:50.058480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:50.061770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:50.063289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:50.066332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3de45227-fa77-407e-8065-7400f52396f4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.314803 Nov 06 20:58:50.067110 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1953/3868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:49 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:50.070042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:50.070497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:50.071296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:50.071738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:50.292733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:50.301407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:50.303487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:50.304707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e787ade3-a37f-4ca8-aff1-650e4072342d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.247014 Nov 06 20:58:50.305500 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1916/3869] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:50 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:50.909601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:50.911483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:50.935357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:50.937275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:50.938305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:50.939060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.038720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:51.039394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:51.047262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.047722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.048552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.049003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.128507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.136060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4adad90-fd29-4310-a463-948a65a0d8f2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.101012 Nov 06 20:58:51.136867 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1917/3870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:51 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:51.141224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:51.142216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:51.151301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.151759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.152587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.153042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.586431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.594495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e7e5c01-83ac-417d-9a1f-f9985dce0295 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.696875 Nov 06 20:58:51.595065 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1954/3871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:50 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:51.599798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:51.600794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:51.607027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.607726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.609225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:51.609957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:51.815869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.823844 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4ba8589-22bf-4a6e-9151-710bd207efdb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.686088 Nov 06 20:58:51.824870 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1918/3872] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:51 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:51.896953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.906109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.907690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:51.908973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-939a97f4-41e3-421a-bacf-b1c87ec7ed48 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.312743 Nov 06 20:58:51.909892 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1955/3873] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:51 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:52.153032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:52.154405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:52.165452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.166301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:52.167589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.168209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:52.255790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:52.277682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de34da8f-07e4-4e48-953a-920f0ff26db2 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.128303 Nov 06 20:58:52.279064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1919/3874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:52 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:52.620653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:52.621537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:52.634969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.636002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:52.637256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.644019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:52.843327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:52.844134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:52.851059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.851858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:52.852831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:52.853446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:53.041946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.050850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04a7bfa6-9433-45bb-9078-2a3deb4d1aef tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.443621 Nov 06 20:58:53.053164 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1956/3875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:52 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:53.066421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:53.073740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:53.091615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:53.093286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:53.094523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:53.095207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:53.185319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.193860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80d46233-ca4a-42fd-9d34-4a0bd73d350f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.355458 Nov 06 20:58:53.195103 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1920/3876] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:52 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:53.302036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:53.308800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.309093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:53.316898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:53.317355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:53.317659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.318151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:53.318589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:53.319184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.320406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cb4f54db-054f-47e6-b62a-ea5ad3241887 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.259695 Nov 06 20:58:53.320979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1957/3877] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:53 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:53.388413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:53.396989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08799845-65a4-4417-9fe0-2438d917dab8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.104839 Nov 06 20:58:53.397800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1921/3878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:53 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:54.070076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:54.071984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:54.079783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.080559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.081678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.082361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.211595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:54.215433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:54.230596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.231134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.232007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.232719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.480898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.489871 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0716f6d2-80b0-4687-8d22-ed07b8810677 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.425581 Nov 06 20:58:54.501055 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1958/3879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:54 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:54.506069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:54.506983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:54.515277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.515901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.516897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.517496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.545359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.553838 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bee4aead-e81b-489e-be0e-dd9fb9dc241a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.346511 Nov 06 20:58:54.564207 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1922/3880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:54 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:54.568978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:54.569610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:54.577886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.578409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.579331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:54.580101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:54.686922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.694945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2063b37-e707-42a3-995c-904a3b4b69a7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.129379 Nov 06 20:58:54.695557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1923/3881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:54 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:54.721173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.729768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.731279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:54.732559 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21ba3f85-9cec-418f-8ce1-c67d49e4a20f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.230055 Nov 06 20:58:54.733332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1959/3882] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:54 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:55.507070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:55.507694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:55.515181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.515779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.516786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.517439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.573393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:55.575192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:55.584721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.585353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.586704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.587496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.719761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:55.730216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2cb6f85-aef7-492c-84f0-0909858a5744 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.226957 Nov 06 20:58:55.731532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1924/3883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:55 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:55.737998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:55.738693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:55.746702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.749361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.749361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.749361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.846951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:55.849076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:55.858574 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f49a29f-b25e-478b-a586-70a7edd00645 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.289713 Nov 06 20:58:55.859303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-327eaae2-97fa-4d53-82f5-9d4769d92f38 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1224 microversion: 2.1 time: 0.126620 Nov 06 20:58:55.860092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1925/3884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:55 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:55.864790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1960/3885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:55 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:55.881883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:55.882830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:55.889708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.890338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:55.891169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:55.891686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:56.045143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:56.054528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:56.056151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:56.057483 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f63d483-c191-4972-9ee1-1c099c854dbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.179958 Nov 06 20:58:56.058124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1926/3886] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:55 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:56.754290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:56.755457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:56.765229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:56.765926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:56.768763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:56.769627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:56.876275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:56.879157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:56.898128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:56.898709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:56.899655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:56.900137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:57.355124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.364975 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87a8fdc3-a74a-4bf3-8d8a-3fee752cdcdf tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.617764 Nov 06 20:58:57.365559 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1961/3887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:56 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:57.370086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:57.371019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:57.375598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.385079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e5bc715-28cd-440b-965e-24d91a703b72 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1504 microversion: 2.1 time: 0.513846 Nov 06 20:58:57.388137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1927/3888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:56 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:57.393094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:57.395198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:57.395721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:57.396690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:57.397326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:57.400941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:57.413591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:57.414063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:57.414956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:57.415400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:57.490486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.507455 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17f668b3-2268-4170-9eb0-e1fe131c4367 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1278 microversion: 2.1 time: 0.140466 Nov 06 20:58:57.508444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1962/3889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:57 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:57.805993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.816934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.818647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:57.819945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a54f86e-1021-4a77-a7d4-2f8c45efc61a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.430408 Nov 06 20:58:57.820635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1928/3890] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:57 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:58.382027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:58.383240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:58.392025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:58.392525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:58.393331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:58.393770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:58.405496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:58.406266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:58.425543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:58.426303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:58.427118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:58.427561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.057493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.065397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.066801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-774dc893-e552-4c11-9ffc-0368f5ad8d84 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1494 microversion: 2.1 time: 0.665967 Nov 06 20:58:59.067649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1929/3891] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:58 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1494 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:58:59.072531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:59.073608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:59.075729 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-236a288f-ca2e-4513-8b02-c70fe05a9467 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.696896 Nov 06 20:58:59.080417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.081191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.082444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.083342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.085917 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1963/3892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:58 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:59.098437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:59.099063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:59.113908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.115861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.117043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.117695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.440066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.452523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.479587 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f94ccc5-0483-4fe6-8a22-3275d309f709 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.410541 Nov 06 20:58:59.482568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.483898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1930/3893] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:59 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:59.488682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:58:59.490151 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f85c501a-9b50-48f4-be36-8b1aa645ff29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.403266 Nov 06 20:58:59.492433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1964/3894] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:58:59 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:58:59.499761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6d7df0b-2213-43b0-a9f6-9811114088a8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '.version_select at 0x7f6714c44670>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:59.501528 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:59.501528 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:59.504874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d7df0b-2213-43b0-a9f6-9811114088a8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.505574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d7df0b-2213-43b0-a9f6-9811114088a8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.517076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6d7df0b-2213-43b0-a9f6-9811114088a8 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.031602 Nov 06 20:58:59.517914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1931/3895] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:58:59 2021] GET /compute/v2.1/os-migrations => generated 400 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:59.537464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:58:59.538309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:58:59.547703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.548334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.550753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.553001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.803176 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8cd0ffc2-26a1-480b-b36e-c495788e11ac tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1645 microversion: 2.1 time: 0.275928 Nov 06 20:58:59.804818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1965/3896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:58:59 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1645 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:58:59.891053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1aed2938-770f-4431-992d-c11c06cd2db4 req-98561cea-053d-4d5a-be0c-ef7816bdd32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86319767-1e5a-4a86-923e-5cf44758eb77", "tag": "0e7edde5-674c-43bf-a97c-265ac3279959"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:58:59.896146 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:58:59.896146 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:58:59.905343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1aed2938-770f-4431-992d-c11c06cd2db4 req-98561cea-053d-4d5a-be0c-ef7816bdd32c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:58:59.905983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1aed2938-770f-4431-992d-c11c06cd2db4 req-98561cea-053d-4d5a-be0c-ef7816bdd32c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:58:59.926328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1aed2938-770f-4431-992d-c11c06cd2db4 req-98561cea-053d-4d5a-be0c-ef7816bdd32c service nova] Creating event network-changed:0e7edde5-674c-43bf-a97c-265ac3279959 for instance 86319767-1e5a-4a86-923e-5cf44758eb77 on nch2-master-1 Nov 06 20:58:59.933819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1aed2938-770f-4431-992d-c11c06cd2db4 req-98561cea-053d-4d5a-be0c-ef7816bdd32c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075865 Nov 06 20:58:59.934657 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1932/3897] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:58:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:58:59.987531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-914749763", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "a0d87934-0232-4205-a7f7-5ad3a2322d26"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:00.038340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] validate_networks() for [('a0d87934-0232-4205-a7f7-5ad3a2322d26', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:59:00.094429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:00.095307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:00.106870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.108546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.110510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.111574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.471704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:00.482459 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb02dff5-2b64-43cc-9ddc-9d2d3aa542c9 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 200 len: 1473 microversion: 2.1 time: 0.393323 Nov 06 20:59:00.484453 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1933/3898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:00 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 1473 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:00.500643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:00.501562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:00.511305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.511894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.512952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.513736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.934155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:00.944449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:59:00.946330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:59:00.946986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:59:00.947463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:59:00.947890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:59:00.958992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.959475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.960320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.960769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.963420 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad92dc77-4363-4ef6-aa80-b09bc1f5528d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.457050 Nov 06 20:59:00.964076 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1934/3899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:00 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:00.977719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:00.978421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:00.989654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:00.994476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for user 0cbe3496db994852a09c97ee075fbd4a and project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:00.997569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:00.998047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:00.999469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.000902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.009969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:59:01.013046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:01.081746 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d1b94e6-53d8-4f1d-8925-6433af15b9e0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095372 Nov 06 20:59:01.082672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1966/3900] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:58:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:59:01.091648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6e8f7806-8064-4c40-8389-3504f531259b req-b6ce82df-82c1-4c1a-807d-160479244ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef5068-4637-46e6-b3e8-124382b109f1", "name": "network-vif-deleted", "tag": "21508f07-0718-477d-a58c-ec0512e5bdad"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:01.093745 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:01.093745 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:01.102958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6e8f7806-8064-4c40-8389-3504f531259b req-b6ce82df-82c1-4c1a-807d-160479244ade service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.104532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6e8f7806-8064-4c40-8389-3504f531259b req-b6ce82df-82c1-4c1a-807d-160479244ade service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.134054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6e8f7806-8064-4c40-8389-3504f531259b req-b6ce82df-82c1-4c1a-807d-160479244ade service nova] Creating event network-vif-deleted:21508f07-0718-477d-a58c-ec0512e5bdad for instance fcef5068-4637-46e6-b3e8-124382b109f1 on nch2-master-1 Nov 06 20:59:01.140418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6e8f7806-8064-4c40-8389-3504f531259b req-b6ce82df-82c1-4c1a-807d-160479244ade service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052717 Nov 06 20:59:01.141249 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1967/3901] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:01.147836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-597f2c59-33bb-4dd5-af7d-4d77758ffb35 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:01.148955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-597f2c59-33bb-4dd5-af7d-4d77758ffb35 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:01.296475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-597f2c59-33bb-4dd5-af7d-4d77758ffb35 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:01.306137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-597f2c59-33bb-4dd5-af7d-4d77758ffb35 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1210 microversion: 2.1 time: 0.163437 Nov 06 20:59:01.307342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1968/3902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:01 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1210 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:01.331260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:01.340111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:01.342077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:01.343372 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3cdda7b7-ebb3-4d3f-ba37-9e4b72c18d83 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.373822 Nov 06 20:59:01.343923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1935/3903] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:00 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:01.508887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:01.510392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: fcef5068-4637-46e6-b3e8-124382b109f1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:01.521469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.522890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.524564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.525548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.550724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] HTTP exception thrown: Instance fcef5068-4637-46e6-b3e8-124382b109f1 could not be found. Nov 06 20:59:01.552012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Returning 404 to user: Instance fcef5068-4637-46e6-b3e8-124382b109f1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:01.555715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea6def79-d4f0-4a68-8442-3a6192587c8a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1" status: 404 len: 111 microversion: 2.1 time: 0.059531 Nov 06 20:59:01.568125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:01.569344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:01.575533 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1969/3904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:01 2021] GET /compute/v2.1/servers/fcef5068-4637-46e6-b3e8-124382b109f1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:59:01.577241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.578161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.579270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.579903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.613755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:01.707781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b7d6776-1005-4764-9276-3dd15fa76455 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 204 len: 0 microversion: 2.1 time: 0.144969 Nov 06 20:59:01.708807 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1936/3905] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:59:01 2021] DELETE /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:01.718289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:01.719198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:01.725913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.726445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.727450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.727928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.917691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:01.928187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d57f2340-d1aa-474c-96d1-791326a4ada6 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1474 microversion: 2.1 time: 0.214483 Nov 06 20:59:01.929722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1970/3906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:01 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1474 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:01.981463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:01.982425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:01.991222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.991844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:01.992834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:01.993431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.323987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:02.324714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:02.331157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.331900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.332932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.333581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.345655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:02.355283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-487097b6-681d-431e-8dab-9cd068461597 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.378284 Nov 06 20:59:02.359979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1937/3907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:01 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:02.371294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:02.371928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:02.382027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.382473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.383281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.384277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.445966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:02.454807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9869aee7-99e2-4523-ad79-3f119706e8b8 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1262 microversion: 2.1 time: 0.134370 Nov 06 20:59:02.459291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1971/3908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:02 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:02.583214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:02.598902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:02.600713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:02.602122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8111c8c1-6182-4a8a-9906-e694ce66d295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.241132 Nov 06 20:59:02.603138 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1938/3909] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:02 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:02.946768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:02.947382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:02.955018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.955744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:02.956796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:02.957452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:03.185759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c31e8d2b-104c-4ee3-b6bf-f538ebed1463 req-25d9f845-d3db-4846-8eef-508dac406798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a17d778-9236-458e-aa12-f22d07373a44", "tag": "ad493490-6388-409e-a22c-2b5da48ab36d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:03.197070 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:03.197070 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:03.208630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:03.225880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c31e8d2b-104c-4ee3-b6bf-f538ebed1463 req-25d9f845-d3db-4846-8eef-508dac406798 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:03.226333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c31e8d2b-104c-4ee3-b6bf-f538ebed1463 req-25d9f845-d3db-4846-8eef-508dac406798 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:03.235969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21026c65-39c6-4eda-a2af-8dbdde00b3d7 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1474 microversion: 2.1 time: 0.292985 Nov 06 20:59:03.237651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1972/3910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:02 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:03.264489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c31e8d2b-104c-4ee3-b6bf-f538ebed1463 req-25d9f845-d3db-4846-8eef-508dac406798 service nova] Creating event network-changed:ad493490-6388-409e-a22c-2b5da48ab36d for instance 7a17d778-9236-458e-aa12-f22d07373a44 on nch2-master-1 Nov 06 20:59:03.270650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c31e8d2b-104c-4ee3-b6bf-f538ebed1463 req-25d9f845-d3db-4846-8eef-508dac406798 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094287 Nov 06 20:59:03.271711 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1939/3911] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:03.373940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:03.375339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:03.382321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:03.383025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:03.384436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:03.385033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:03.478170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:03.479669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:03.487368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:03.487955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:03.490159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:03.490771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:04.480658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:04.488164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:04.493446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c158e1b6-16e9-47d9-b2f1-139aa4e2cbc9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 1.122873 Nov 06 20:59:04.501574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-941844b9-659c-4057-9f56-af0e919d98be tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 1.028505 Nov 06 20:59:04.502906 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1940/3913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:03 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:04.503044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1973/3913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:03 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:04.508951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:04.510759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:04.518062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:04.519294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:04.519420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:04.520555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:04.521561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:04.522209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:04.538392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:04.538983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:04.539785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:04.540398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.091314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.095581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.105465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74784aef-084d-409c-afa7-12c6a7a7fa98 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1474 microversion: 2.1 time: 0.600914 Nov 06 20:59:05.106674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1941/3914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:04 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1474 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:05.109656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.114282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.115866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8cedb996-57f8-4b25-80c6-9112fdc87d94 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.611680 Nov 06 20:59:05.116903 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1974/3915] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:04 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:05.288513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7faee562-ece8-45be-a59a-e46886962ff4 req-780fca55-f849-4659-8676-4ed441aad66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb50e55-c156-48b0-9e20-92e1599e1a46", "tag": "4194ac97-448e-472f-b93d-2a03adcfb436"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:05.290448 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:05.290448 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:05.301182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7faee562-ece8-45be-a59a-e46886962ff4 req-780fca55-f849-4659-8676-4ed441aad66f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:05.301937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7faee562-ece8-45be-a59a-e46886962ff4 req-780fca55-f849-4659-8676-4ed441aad66f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.317965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7faee562-ece8-45be-a59a-e46886962ff4 req-780fca55-f849-4659-8676-4ed441aad66f service nova] Creating event network-changed:4194ac97-448e-472f-b93d-2a03adcfb436 for instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 on nch2-master-1 Nov 06 20:59:05.324329 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7faee562-ece8-45be-a59a-e46886962ff4 req-780fca55-f849-4659-8676-4ed441aad66f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040670 Nov 06 20:59:05.324918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1942/3916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:05.510688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:05.511347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:05.519100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:05.519816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:05.530779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:05.531599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.535144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:05.536426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:05.537238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.537918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.542221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:05.543309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:05.840501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.865257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4a1e1ce-e703-42bf-9828-3eed44aa5588 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.356167 Nov 06 20:59:05.868396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1975/3917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:05 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:05.872449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:05.880242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90458f5e-f83f-42fd-866c-2afba7617d03 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.364916 Nov 06 20:59:05.880857 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1943/3918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:05 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:06.122865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:06.124056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:06.133569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.134472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.135574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.136732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.137190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:06.138360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:06.150309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.152255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.153518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.154856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.190423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.191533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.192584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lazy-loading 'fault' on Instance uuid 6262f742-8bb2-4502-ae7f-a74d0bc253fc {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:59:06.273868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632ac3c3360b4e71b654d87ccb9fe26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753c99ec4c5644e4bdc41ee986f427ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:06.282753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fc6fbb8-53fb-4d10-ac34-6a69f41f2ce3 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 200 len: 1308 microversion: 2.1 time: 0.163466 Nov 06 20:59:06.293306 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1976/3919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:06 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:06.480183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:06.499510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:06.501432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:06.502828 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ed2745e-2573-4f0e-800d-a8d2101ea5a1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.371685 Nov 06 20:59:06.504056 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1944/3920] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:06 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:06.889705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:06.890536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:06.898485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:06.899011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.899098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:06.899205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.900085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.900658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.913002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.913466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:06.914329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:06.914776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.144419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:07.148167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:07.156151 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5178c91c-29b9-4bc6-a178-b3b4dd85b36b tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.273396 Nov 06 20:59:07.157479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1977/3921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:06 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:07.163081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae2f821f-bc4c-49f5-8f0f-f3ba4a3df6bd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.268103 Nov 06 20:59:07.168510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1945/3922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:06 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:07.300011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:07.302794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] [instance: 6262f742-8bb2-4502-ae7f-a74d0bc253fc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:07.308787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.309147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.309936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.310420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.325212 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] HTTP exception thrown: Instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc could not be found. Nov 06 20:59:07.325814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Returning 404 to user: Instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:07.327181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4c60d69-9c7d-44ef-8fb8-6a0af5581b7d tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc" status: 404 len: 111 microversion: 2.1 time: 0.030829 Nov 06 20:59:07.327727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1978/3923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:07 2021] GET /compute/v2.1/servers/6262f742-8bb2-4502-ae7f-a74d0bc253fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:59:07.335734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9b9cc20-83fb-435d-826b-3a35b4762595 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671abdfca0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:07.358667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-675843c5-befd-4174-b5c4-c28da366370a req-1d51d352-bd38-467e-9b76-e8b95ffcbe85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262f742-8bb2-4502-ae7f-a74d0bc253fc", "name": "network-vif-deleted", "tag": "727932c3-7c17-41cf-a440-b43625fb7fb0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:07.360519 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:07.360519 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:07.368342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-675843c5-befd-4174-b5c4-c28da366370a req-1d51d352-bd38-467e-9b76-e8b95ffcbe85 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.368859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-675843c5-befd-4174-b5c4-c28da366370a req-1d51d352-bd38-467e-9b76-e8b95ffcbe85 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.383372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-675843c5-befd-4174-b5c4-c28da366370a req-1d51d352-bd38-467e-9b76-e8b95ffcbe85 service nova] Creating event network-vif-deleted:727932c3-7c17-41cf-a440-b43625fb7fb0 for instance 6262f742-8bb2-4502-ae7f-a74d0bc253fc on nch2-master-1 Nov 06 20:59:07.388491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-675843c5-befd-4174-b5c4-c28da366370a req-1d51d352-bd38-467e-9b76-e8b95ffcbe85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Nov 06 20:59:07.390012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1979/3924] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:07.521976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:07.522756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:07.530942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.532055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.533555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.534191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.752557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9b9cc20-83fb-435d-826b-3a35b4762595 tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30" status: 204 len: 0 microversion: 2.1 time: 0.420411 Nov 06 20:59:07.753345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1946/3925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:07 2021] DELETE /compute/v2.1/images/20134c76-cc25-42a9-a65f-e851021ebd30 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:07.759944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:07.761012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:07.768539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.769214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.770231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:07.770855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:07.896451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-025ef10e-31c2-400e-b877-619b48574bb5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.141073 Nov 06 20:59:07.897355 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1947/3926] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:07 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:59:07.915181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a57d86b-8ec0-445b-9396-50db14eeac9a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f67152e9310>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:08.036051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.057787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.073317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.078918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-311ec476-27c3-4bdc-b46e-08da494a085c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.558480 Nov 06 20:59:08.080074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1980/3927] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:07 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:59:08.092953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:08.093715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:08.100235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.101102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.101929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.102421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.304721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a57d86b-8ec0-445b-9396-50db14eeac9a tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170" status: 204 len: 0 microversion: 2.1 time: 0.404954 Nov 06 20:59:08.305658 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1948/3928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:07 2021] DELETE /compute/v2.1/images/2c44d33d-9b1b-4f63-8f65-a8c2a2c08170 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:08.312658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:08.313761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:08.324676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.325343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.327218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.327830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.342316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.355426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee1a662b-1371-4ee8-80b2-988da73de49b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1671 microversion: 2.1 time: 0.273920 Nov 06 20:59:08.356044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1981/3929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:08 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:08.366469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:08.367963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:08.381830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.392990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.393846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.394295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.628589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.633532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:08.637011 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8a960fe-7c21-4c35-a048-c5d07d00d559 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.329478 Nov 06 20:59:08.637891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1949/3930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:08 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:08.642929 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-479f39f1-4063-46e3-9c92-4ac6453f5793 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.283330 Nov 06 20:59:08.643866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f819bb2b-d6c2-411f-9b4f-19e41c9596cb tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] Calling method '.version_select at 0x7f671abdfa60>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:08.644611 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1982/3931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:08 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:08.652113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7d9cfb0e-5a42-4edc-a6d4-1422d2ece5d1 req-c85bb63f-5224-4ce5-9bf0-5be9a639a42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "name": "network-vif-plugged", "status": "completed", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:08.653854 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:08.653854 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:08.671415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7d9cfb0e-5a42-4edc-a6d4-1422d2ece5d1 req-c85bb63f-5224-4ce5-9bf0-5be9a639a42c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:08.672121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7d9cfb0e-5a42-4edc-a6d4-1422d2ece5d1 req-c85bb63f-5224-4ce5-9bf0-5be9a639a42c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:08.686381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7d9cfb0e-5a42-4edc-a6d4-1422d2ece5d1 req-c85bb63f-5224-4ce5-9bf0-5be9a639a42c service nova] Creating event network-vif-plugged:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 20:59:08.692672 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7d9cfb0e-5a42-4edc-a6d4-1422d2ece5d1 req-c85bb63f-5224-4ce5-9bf0-5be9a639a42c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046182 Nov 06 20:59:08.693448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1983/3932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:08.911424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f819bb2b-d6c2-411f-9b4f-19e41c9596cb tempest-ListImageFiltersTestJSON-1372948671 tempest-ListImageFiltersTestJSON-1372948671-project] 10.222.0.13 "DELETE /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752" status: 204 len: 0 microversion: 2.1 time: 0.272144 Nov 06 20:59:08.912233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1950/3933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:08 2021] DELETE /compute/v2.1/images/193f5da3-e0e6-4d9a-97c5-1a851d5be752 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:09.102690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:09.104451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:09.114449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.114449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.114449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.114827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.296401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.307477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.309266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.311059 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0f24201-8e54-4774-afc1-66ba3c33dbee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.216373 Nov 06 20:59:09.322958 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1984/3934] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:09 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:09.374967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:09.376114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:09.382235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.382772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.383635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.384314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.589736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.601387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-749ed784-d881-41a1-a9ef-aa666219d107 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1671 microversion: 2.1 time: 0.231769 Nov 06 20:59:09.602192 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1951/3935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:09 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:09.657847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:09.658581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:09.661074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:09.661715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:09.668383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.668541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.668943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.669133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.670086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.670550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:09.671005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.671587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:09.925461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.941533 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc51a594-81d8-4977-b1a3-171ac96b7222 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.288373 Nov 06 20:59:09.942163 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1985/3936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:09 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:09.972688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:09.983413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be2c2cbc-7462-4f70-869c-e1acf87568f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.325275 Nov 06 20:59:09.995714 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1952/3937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:09 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:10.329677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:10.331076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:10.339581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.341375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.342429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.342927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.552475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:10.565281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:10.567356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:10.568780 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-797b1e38-6add-4f09-a840-3306aa60a10b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.243016 Nov 06 20:59:10.572350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1986/3938] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:10 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:10.620087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:10.620662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:10.634089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.634721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.635851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.637107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.718389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-af995b6a-c62d-41a9-95e0-97e4e1f0d4a0 req-e1fef99f-8f74-4944-9727-591cfcc220dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86319767-1e5a-4a86-923e-5cf44758eb77", "name": "network-vif-plugged", "status": "completed", "tag": "0e7edde5-674c-43bf-a97c-265ac3279959"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:10.720008 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:10.720008 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:10.729516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-af995b6a-c62d-41a9-95e0-97e4e1f0d4a0 req-e1fef99f-8f74-4944-9727-591cfcc220dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.730391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-af995b6a-c62d-41a9-95e0-97e4e1f0d4a0 req-e1fef99f-8f74-4944-9727-591cfcc220dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.743270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-af995b6a-c62d-41a9-95e0-97e4e1f0d4a0 req-e1fef99f-8f74-4944-9727-591cfcc220dc service nova] Creating event network-vif-plugged:0e7edde5-674c-43bf-a97c-265ac3279959 for instance 86319767-1e5a-4a86-923e-5cf44758eb77 on nch2-master-1 Nov 06 20:59:10.749507 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-af995b6a-c62d-41a9-95e0-97e4e1f0d4a0 req-e1fef99f-8f74-4944-9727-591cfcc220dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Nov 06 20:59:10.750441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1987/3939] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:10.859248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:10.867976 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-492b5ac3-1bdf-416a-9723-eeb9867cff32 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.252681 Nov 06 20:59:10.869935 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1953/3940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:10 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:10.959333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:10.960017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:10.970052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.970522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:10.971337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:10.971787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:11.272804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:11.292172 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68eb40f2-1333-4e25-8c3b-a6547eeeaa19 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.337090 Nov 06 20:59:11.295433 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1954/3941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:10 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:11.313825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:11.314340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:11.325211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:11.325686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:11.327150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:11.327597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:11.548115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48837f07-1393-4ba9-b07f-0cea0ed43575 tempest-ListImageFiltersNegativeTestJSON-175588634 tempest-ListImageFiltersNegativeTestJSON-175588634-project] Calling method '.version_select at 0x7f671ad43ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:11.589879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-48837f07-1393-4ba9-b07f-0cea0ed43575 tempest-ListImageFiltersNegativeTestJSON-175588634 tempest-ListImageFiltersNegativeTestJSON-175588634-project] HTTP exception thrown: Image not found. Nov 06 20:59:11.590492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48837f07-1393-4ba9-b07f-0cea0ed43575 tempest-ListImageFiltersNegativeTestJSON-175588634 tempest-ListImageFiltersNegativeTestJSON-175588634-project] Returning 404 to user: Image not found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:11.591329 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48837f07-1393-4ba9-b07f-0cea0ed43575 tempest-ListImageFiltersNegativeTestJSON-175588634 tempest-ListImageFiltersNegativeTestJSON-175588634-project] 10.222.0.13 "GET /compute/v2.1/images/3952c469-4e7c-4bba-87d0-a2904fbb2214" status: 404 len: 62 microversion: 2.1 time: 0.663149 Nov 06 20:59:11.596044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1988/3942] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Nov 6 20:59:10 2021] GET /compute/v2.1/images/3952c469-4e7c-4bba-87d0-a2904fbb2214 => generated 62 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 20:59:11.596893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:11.602020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:11.619657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:11.623613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:11.624643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:11.627258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:11.703438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:11.712324 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ee05ae6-5695-4a11-95d9-cbbf9cc1c20d tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.415349 Nov 06 20:59:11.712919 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1955/3943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:11 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:11.933786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:11.944034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:11.945767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:11.947373 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1eb85aaa-a642-4db5-8f37-a7316576eeb8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1806 microversion: 2.20 time: 0.354045 Nov 06 20:59:11.948174 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1989/3944] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:11 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:12.311928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:12.312965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:12.320134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.321891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.324851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.325906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.522815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:12.531256 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4232cda7-8e10-40e9-99ba-c60c5dfa8120 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1320 microversion: 2.1 time: 0.225111 Nov 06 20:59:12.532087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1956/3945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:12 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:12.729030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:12.729652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:12.736607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.737072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.737992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.738437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.785831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3f2d090f-5ef8-45b7-863c-acadcd8823d6 req-603cf76e-f414-426b-9dac-fddaa26d4219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a17d778-9236-458e-aa12-f22d07373a44", "name": "network-vif-plugged", "status": "completed", "tag": "ad493490-6388-409e-a22c-2b5da48ab36d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:12.787630 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:12.787630 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:12.804469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3f2d090f-5ef8-45b7-863c-acadcd8823d6 req-603cf76e-f414-426b-9dac-fddaa26d4219 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.808495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3f2d090f-5ef8-45b7-863c-acadcd8823d6 req-603cf76e-f414-426b-9dac-fddaa26d4219 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.837384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3f2d090f-5ef8-45b7-863c-acadcd8823d6 req-603cf76e-f414-426b-9dac-fddaa26d4219 service nova] Creating event network-vif-plugged:ad493490-6388-409e-a22c-2b5da48ab36d for instance 7a17d778-9236-458e-aa12-f22d07373a44 on nch2-master-1 Nov 06 20:59:12.850315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3f2d090f-5ef8-45b7-863c-acadcd8823d6 req-603cf76e-f414-426b-9dac-fddaa26d4219 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073656 Nov 06 20:59:12.851845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1957/3946] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:12.966755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:12.967382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:12.975733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.976197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.977303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:12.977753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:12.983449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:12.996958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cee9a293-4785-4ffa-90cc-d1bd634946bf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.272049 Nov 06 20:59:12.999676 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1990/3947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:12 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:13.264752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:13.279178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:13.283081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:13.284640 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2fe567a2-9ad8-405b-9992-6213b5fd5a26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1793 microversion: 2.20 time: 0.322143 Nov 06 20:59:13.285362 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1958/3948] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:12 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1793 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:59:13.549750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:13.550479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:13.557642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:13.558905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:13.560023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:13.560776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:13.751561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:13.760434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62303910-b80a-4baf-b16a-23722a147184 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 200 len: 1508 microversion: 2.1 time: 0.213795 Nov 06 20:59:13.761103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1991/3949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:13 2021] GET /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:13.777141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:13.778247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 7a17d778-9236-458e-aa12-f22d07373a44] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:13.785876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:13.787042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:13.788064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:13.788883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:13.998934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:14.007111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f8510f2-81ad-4e67-83d6-97b8fa37c497 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44" status: 200 len: 1320 microversion: 2.1 time: 0.233492 Nov 06 20:59:14.020220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:14.021587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:14.028219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1959/3950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:13 2021] GET /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:14.040271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:14.047734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:14.048921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:14.049634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:14.382272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:14.391875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9cf63e5b-4319-4468-af0c-3a51da20d84c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.380652 Nov 06 20:59:14.392494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1992/3951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:14 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:14.869298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d411f28d-cc58-4c96-8c05-9a98ad04caee req-eaf6e3df-6e41-4b89-b140-d4e7ab776492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb50e55-c156-48b0-9e20-92e1599e1a46", "name": "network-vif-plugged", "status": "completed", "tag": "4194ac97-448e-472f-b93d-2a03adcfb436"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:14.871777 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:14.871777 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:14.879735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d411f28d-cc58-4c96-8c05-9a98ad04caee req-eaf6e3df-6e41-4b89-b140-d4e7ab776492 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:14.880831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d411f28d-cc58-4c96-8c05-9a98ad04caee req-eaf6e3df-6e41-4b89-b140-d4e7ab776492 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:14.893396 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d411f28d-cc58-4c96-8c05-9a98ad04caee req-eaf6e3df-6e41-4b89-b140-d4e7ab776492 service nova] Creating event network-vif-plugged:4194ac97-448e-472f-b93d-2a03adcfb436 for instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 on nch2-master-1 Nov 06 20:59:14.898545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d411f28d-cc58-4c96-8c05-9a98ad04caee req-eaf6e3df-6e41-4b89-b140-d4e7ab776492 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032752 Nov 06 20:59:14.902039 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1960/3952] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:15.031809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:15.032787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 7a17d778-9236-458e-aa12-f22d07373a44] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:15.039901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.040439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.041247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.041935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.189488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:15.199231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f045af2-4ba0-44f7-b016-974fc32adea8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44" status: 200 len: 1509 microversion: 2.1 time: 0.171666 Nov 06 20:59:15.200141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1993/3953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:15 2021] GET /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:15.217474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:15.218538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 7a17d778-9236-458e-aa12-f22d07373a44] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:15.226385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.227060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.228392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.228997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.267483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 7a17d778-9236-458e-aa12-f22d07373a44] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:15.366777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad28ada2-930e-4709-8e3d-5dd0da651efb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44" status: 204 len: 0 microversion: 2.1 time: 0.153494 Nov 06 20:59:15.370398 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1961/3954] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:59:15 2021] DELETE /compute/v2.1/servers/7a17d778-9236-458e-aa12-f22d07373a44 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:15.377179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:15.378707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:15.385662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.386390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.387407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.388141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.412588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:15.414252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:15.419880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 86319767-1e5a-4a86-923e-5cf44758eb77] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:15.423544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.424009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.431878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:15.432361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:15.581291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-316e3b7e-70d2-4749-926b-0aacf8003bd7 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "DELETE /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77" status: 204 len: 0 microversion: 2.1 time: 0.208313 Nov 06 20:59:15.581892 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1994/3955] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:59:15 2021] DELETE /compute/v2.1/servers/86319767-1e5a-4a86-923e-5cf44758eb77 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:15.757322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:15.766450 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9de09b5-50c7-42d9-8d81-cdda77560ead tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.360899 Nov 06 20:59:15.774608 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1962/3956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:15 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:15.785291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1978822699", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "af3a0b98-5e85-4204-bfc9-9a8757f4ab65"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:15.851264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] validate_networks() for [('af3a0b98-5e85-4204-bfc9-9a8757f4ab65', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:59:16.790957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:16.791562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:16.799359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:16.800048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:16.800864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:16.801300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:17.174320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:59:17.175484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:59:17.176204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:59:17.176641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:59:17.177040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:59:17.183024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:17.191176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:17.191624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:17.195778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2095885-8669-4181-bb67-455ba96f7155 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1310 microversion: 2.1 time: 0.407830 Nov 06 20:59:17.196193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:17.196731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:17.197962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1963/3957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:16 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1310 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:17.220770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Getting quotas for project 7c12e0618d884fc29318833f9f5a544e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:17.245151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Getting quotas for user 5738428039b14b6580b7e2c9d3e29490 and project 7c12e0618d884fc29318833f9f5a544e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:17.273936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Going to run 2 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:59:17.276809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:17.338652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=25923086-946d-426a-9928-7eb58fc69090,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:17.464732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34ea854c-73f7-4d45-9fe5-378edf150149 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.688935 Nov 06 20:59:17.469276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1995/3958] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:15 2021] POST /compute/v2.1/servers => generated 32 bytes in 1695 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Nov 06 20:59:17.477201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:17.484549 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:17.484549 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:17.490208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:17.493155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Searching by: {'deleted': False, 'project_id': '7c12e0618d884fc29318833f9f5a544e'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 20:59:17.524514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:17.525280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:17.526495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:17.527289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:17.559281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 20:59:17.646387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d566741-9afc-4d9e-a253-46ef17f86ef8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.172601 Nov 06 20:59:17.652546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1964/3959] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 20:59:17 2021] GET /compute/v2.1/servers => generated 1337 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:17.659974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-122a71ea-e613-44d2-90a3-457f67e25dce tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:17.660878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-122a71ea-e613-44d2-90a3-457f67e25dce tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:17.850777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-122a71ea-e613-44d2-90a3-457f67e25dce tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:17.866996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-122a71ea-e613-44d2-90a3-457f67e25dce tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1218 microversion: 2.1 time: 0.209443 Nov 06 20:59:17.867811 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1996/3960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:17 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:18.214247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:18.217502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:18.230572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.231053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.231847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.235838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.596613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:18.605953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aaa7a6ca-2173-4cbf-a17d-d665fee3d92c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1494 microversion: 2.1 time: 0.395247 Nov 06 20:59:18.611862 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1965/3961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:18 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1494 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:18.625159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:18.626493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:18.637200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.637933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.639452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.640141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.883970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:18.884370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:18.892932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.893387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.894192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:18.894634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:18.959549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8f80da5-4e20-47ad-875b-c31af8ff0032 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1645 microversion: 2.1 time: 0.336575 Nov 06 20:59:18.962203 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1997/3962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:18 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1645 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:18.978178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:18.978732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:18.991124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.001136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.002324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.002936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.030999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:19.042339 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-962aa299-4f12-49f0-99a4-5e7fb4c7ca80 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1214 microversion: 2.1 time: 0.160734 Nov 06 20:59:19.045406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1966/3963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:18 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:19.352825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f64a9be-eb6f-4655-8be8-d1dbd0114f8a tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1645 microversion: 2.1 time: 0.378989 Nov 06 20:59:19.354178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1998/3964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:18 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1645 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:19.370009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:19.372167 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:19.372167 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:19.374660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.375118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.375995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.376401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.455725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23846507-a11e-4d7a-99ff-52912cef5132 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.089501 Nov 06 20:59:19.459551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1967/3965] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:59:19 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:19.471275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:19.472210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:19.485202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.485989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.487035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.487834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.630883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2d99c84-72c9-4a61-aee8-06b4d35222e1 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46/action" status: 202 len: 0 microversion: 2.1 time: 0.163825 Nov 06 20:59:19.633911 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 1999/3966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:19 2021] POST /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:59:19.642771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:19.648683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:19.660441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.662333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.663638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.664332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.837583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8526a89d-7a98-4b9a-b6fe-bffb8e298e6f req-5afea0fc-8bf6-476d-aaaf-8f36a9d10da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a17d778-9236-458e-aa12-f22d07373a44", "name": "network-vif-deleted", "tag": "ad493490-6388-409e-a22c-2b5da48ab36d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:19.847258 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:19.847258 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:19.867082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8526a89d-7a98-4b9a-b6fe-bffb8e298e6f req-5afea0fc-8bf6-476d-aaaf-8f36a9d10da7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:19.868127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8526a89d-7a98-4b9a-b6fe-bffb8e298e6f req-5afea0fc-8bf6-476d-aaaf-8f36a9d10da7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:19.915744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8526a89d-7a98-4b9a-b6fe-bffb8e298e6f req-5afea0fc-8bf6-476d-aaaf-8f36a9d10da7 service nova] Creating event network-vif-deleted:ad493490-6388-409e-a22c-2b5da48ab36d for instance 7a17d778-9236-458e-aa12-f22d07373a44 on nch2-master-1 Nov 06 20:59:19.950142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8526a89d-7a98-4b9a-b6fe-bffb8e298e6f req-5afea0fc-8bf6-476d-aaaf-8f36a9d10da7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100661 Nov 06 20:59:19.955672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2000/3967] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:20.064502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:20.065653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:20.083892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:20.085914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:20.092509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:20.096730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:20.257009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:20.271297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65c496be-f5e0-459f-822a-549036f8da4e tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1276 microversion: 2.1 time: 0.210325 Nov 06 20:59:20.272385 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2001/3968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:20 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:20.275707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-460074ff-20ab-4bcb-9f12-5eff8119896b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1650 microversion: 2.1 time: 0.637331 Nov 06 20:59:20.279417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1968/3969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:19 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1650 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:21.306858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:21.308316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:21.309570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:21.310883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:21.328282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:21.328747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:21.329080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:21.329233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:21.330289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:21.330852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:21.334218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:21.334824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:22.530530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a656722-e32d-4c0f-a3d8-0dcc1edac32c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1630 microversion: 2.1 time: 1.229728 Nov 06 20:59:22.531158 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1969/3970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:21 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1630 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:22.545385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1eb017b5-3b90-4e5c-b68c-6f32b00bee4c req-797bc206-e05b-44b7-9934-5c2dd85262a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86319767-1e5a-4a86-923e-5cf44758eb77", "name": "network-vif-deleted", "tag": "0e7edde5-674c-43bf-a97c-265ac3279959"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:22.546942 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:22.546942 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:22.554208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1eb017b5-3b90-4e5c-b68c-6f32b00bee4c req-797bc206-e05b-44b7-9934-5c2dd85262a1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:22.555212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1eb017b5-3b90-4e5c-b68c-6f32b00bee4c req-797bc206-e05b-44b7-9934-5c2dd85262a1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:22.567452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1eb017b5-3b90-4e5c-b68c-6f32b00bee4c req-797bc206-e05b-44b7-9934-5c2dd85262a1 service nova] Creating event network-vif-deleted:0e7edde5-674c-43bf-a97c-265ac3279959 for instance 86319767-1e5a-4a86-923e-5cf44758eb77 on nch2-master-1 Nov 06 20:59:22.572667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1eb017b5-3b90-4e5c-b68c-6f32b00bee4c req-797bc206-e05b-44b7-9934-5c2dd85262a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040331 Nov 06 20:59:22.573521 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1970/3971] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:22.579016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:22.580809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:22.592363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:22.593097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:22.594069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:22.594673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:22.595165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:22.607463 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37e3b89d-fcb2-4446-a177-f0cf74dbe09f tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 1.306211 Nov 06 20:59:22.608271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2002/3972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:21 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:22.629347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lazy-loading 'flavor' on Instance uuid 7cb50e55-c156-48b0-9e20-92e1599e1a46 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:59:22.656621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 20:59:23.626066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:23.627327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:23.637686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:23.639954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:23.642063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:23.643388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:24.063330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:24.080604 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf347c98-6f39-4d0c-aac1-18b3309b1bd8 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.458757 Nov 06 20:59:24.094049 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2003/3973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:23 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:24.105101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-44654c32-e506-4be0-a5d7-5bf33ca3ca19 req-42937a25-6e30-4a21-8868-e03f4ea91130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25923086-946d-426a-9928-7eb58fc69090", "tag": "8a518c86-0ed7-4991-b132-8a2a643d85b4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:24.111065 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:24.111065 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:24.128884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-44654c32-e506-4be0-a5d7-5bf33ca3ca19 req-42937a25-6e30-4a21-8868-e03f4ea91130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:24.129328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-44654c32-e506-4be0-a5d7-5bf33ca3ca19 req-42937a25-6e30-4a21-8868-e03f4ea91130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:24.147734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-44654c32-e506-4be0-a5d7-5bf33ca3ca19 req-42937a25-6e30-4a21-8868-e03f4ea91130 service nova] Creating event network-changed:8a518c86-0ed7-4991-b132-8a2a643d85b4 for instance 25923086-946d-426a-9928-7eb58fc69090 on nch2-master-1 Nov 06 20:59:24.162170 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-44654c32-e506-4be0-a5d7-5bf33ca3ca19 req-42937a25-6e30-4a21-8868-e03f4ea91130 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071858 Nov 06 20:59:24.162785 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2004/3974] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:24.375968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'create', calling method: .version_select at 0x7f671ac58d30>, body: {"keypair": {"name": "tempest-keypair-402375225"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:24.401624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for project bde5e9d550d3483d977ecaff1085f735. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:24.407703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for user 856a90ddc12344cabd39fd40bb39a6f5 and project bde5e9d550d3483d977ecaff1085f735. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:25.183862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8fb61a28-5a9f-4e5d-8c9a-a477a857f389 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46/action" status: 202 len: 0 microversion: 2.1 time: 2.608723 Nov 06 20:59:25.186018 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1971/3975] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:22 2021] POST /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46/action => generated 0 bytes in 2612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 20:59:25.194868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f2b061d6-1da8-4e8e-9f0a-dedd1f2f98f4 req-d37e176e-91cc-4a9b-9ae8-a3cb4fafc0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b078aad-b0ea-4219-ad06-31d344d0374d", "tag": "b2d5d03b-8f4a-49cf-96ef-822017228b48"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:25.198320 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:25.198320 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:25.213675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f2b061d6-1da8-4e8e-9f0a-dedd1f2f98f4 req-d37e176e-91cc-4a9b-9ae8-a3cb4fafc0a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:25.216864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f2b061d6-1da8-4e8e-9f0a-dedd1f2f98f4 req-d37e176e-91cc-4a9b-9ae8-a3cb4fafc0a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:25.244600 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f2b061d6-1da8-4e8e-9f0a-dedd1f2f98f4 req-d37e176e-91cc-4a9b-9ae8-a3cb4fafc0a5 service nova] Creating event network-changed:b2d5d03b-8f4a-49cf-96ef-822017228b48 for instance 4b078aad-b0ea-4219-ad06-31d344d0374d on nch2-master-1 Nov 06 20:59:25.251817 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f2b061d6-1da8-4e8e-9f0a-dedd1f2f98f4 req-d37e176e-91cc-4a9b-9ae8-a3cb4fafc0a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063483 Nov 06 20:59:25.257274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1972/3976] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:25.265025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for project bde5e9d550d3483d977ecaff1085f735. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:25.267997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:25.272309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for user 856a90ddc12344cabd39fd40bb39a6f5 and project bde5e9d550d3483d977ecaff1085f735. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:25.272484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:25.295408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:25.295866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:25.296698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:25.297219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:25.342005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef4f554b-1fba-46b2-a326-d9a320da7ad0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.177552 Nov 06 20:59:25.353209 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2005/3977] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 20:59:24 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:25.358114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:25.358873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:25.409178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:25.409810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:25.410689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:25.411939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:26.244829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:26.253656 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b531c7f8-af13-445e-8a3b-8fbea79b44eb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.994864 Nov 06 20:59:26.258994 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1973/3978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:25 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:26.274188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:26.290239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6e9a6d2-e99a-4668-b1f1-bfc0455e4c0c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.936254 Nov 06 20:59:26.290932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2006/3979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:25 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:27.274738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:27.275965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:27.283272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:27.284569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:27.285529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:27.290787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:27.310876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:27.312018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:27.322355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:27.323686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:27.327928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:27.328627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:28.173150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:28.187080 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cdf09a1b-9b82-4061-bef2-6e89b0a6c7fe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.915874 Nov 06 20:59:28.189995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1974/3980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:27 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:28.235971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:28.251642 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a286cb19-770e-48c4-a4e1-c49daf288136 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.946885 Nov 06 20:59:28.265122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2007/3981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:27 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:28.607359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e558fb50-b5dd-4dff-8c8e-0e32e4550851 req-92238504-a32a-44bb-ade7-4a7a9579c401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb50e55-c156-48b0-9e20-92e1599e1a46", "name": "network-vif-unplugged", "status": "completed", "tag": "4194ac97-448e-472f-b93d-2a03adcfb436"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:28.608926 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:28.608926 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:28.621645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e558fb50-b5dd-4dff-8c8e-0e32e4550851 req-92238504-a32a-44bb-ade7-4a7a9579c401 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:28.623925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e558fb50-b5dd-4dff-8c8e-0e32e4550851 req-92238504-a32a-44bb-ade7-4a7a9579c401 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:28.638622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e558fb50-b5dd-4dff-8c8e-0e32e4550851 req-92238504-a32a-44bb-ade7-4a7a9579c401 service nova] Creating event network-vif-unplugged:4194ac97-448e-472f-b93d-2a03adcfb436 for instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 on nch2-master-1 Nov 06 20:59:28.649848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e558fb50-b5dd-4dff-8c8e-0e32e4550851 req-92238504-a32a-44bb-ade7-4a7a9579c401 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046332 Nov 06 20:59:28.650950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1975/3982] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:29.209077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:29.209736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:29.218618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:29.219075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:29.219873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:29.220326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:29.270755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:29.271458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:29.277929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:29.281980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:29.285104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:29.293105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:29.451634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:29.470034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-155a598c-9317-454a-87f1-bd85987141a6 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.265210 Nov 06 20:59:29.481633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2008/3983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:29 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:29.552006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:29.560217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb9d46c9-a920-4232-b568-13b37e033a82 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.294096 Nov 06 20:59:29.560959 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1976/3984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:29 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:29.875021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-13445036", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cff17f89-70c3-4182-b73b-2147af75a12c"}], "security_groups": [{"name": "tempest-securitygroup--1273870162"}], "key_name": "tempest-keypair-402375225", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:29.982321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] validate_networks() for [('cff17f89-70c3-4182-b73b-2147af75a12c', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:59:30.391564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for project bde5e9d550d3483d977ecaff1085f735. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:30.395934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for user 856a90ddc12344cabd39fd40bb39a6f5 and project bde5e9d550d3483d977ecaff1085f735. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:30.407683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:59:30.408101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:59:30.408605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:59:30.409017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:59:30.409423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:59:30.418419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.418867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.419749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.420197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.438266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for project bde5e9d550d3483d977ecaff1085f735. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:30.442550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Getting quotas for user 856a90ddc12344cabd39fd40bb39a6f5 and project bde5e9d550d3483d977ecaff1085f735. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:30.454688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:59:30.457216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:30.487206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:30.487983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:30.496087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.496781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.498193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.498686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.516343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48dbb53d-1a51-4e6d-8249-1706e65e4e9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.645304 Nov 06 20:59:30.517441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2009/3985] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:29 2021] POST /compute/v2.1/servers => generated 407 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:59:30.526728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-917c43de-1d6f-40d7-9289-01c45b190a0e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:30.527346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-917c43de-1d6f-40d7-9289-01c45b190a0e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:30.634259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-917c43de-1d6f-40d7-9289-01c45b190a0e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:30.643287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-917c43de-1d6f-40d7-9289-01c45b190a0e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1267 microversion: 2.1 time: 0.120176 Nov 06 20:59:30.652387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2010/3986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:30 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:30.657641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:30.668280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:30.691337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.691906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.692640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.693077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.744212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:30.756089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4a9f3f3-352a-47cf-a014-4531c69f0e55 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.272718 Nov 06 20:59:30.758608 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1977/3987] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:30 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:30.763309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-bf0ee471-7a09-4026-b3a0-defe6cdc5cbd req-25e81c08-bc9a-454b-8a66-b1199af5f944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb50e55-c156-48b0-9e20-92e1599e1a46", "tag": "4194ac97-448e-472f-b93d-2a03adcfb436"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:30.768956 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:30.768956 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:30.777101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bf0ee471-7a09-4026-b3a0-defe6cdc5cbd req-25e81c08-bc9a-454b-8a66-b1199af5f944 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:30.782900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-bf0ee471-7a09-4026-b3a0-defe6cdc5cbd req-25e81c08-bc9a-454b-8a66-b1199af5f944 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:30.800004 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-bf0ee471-7a09-4026-b3a0-defe6cdc5cbd req-25e81c08-bc9a-454b-8a66-b1199af5f944 service nova] Creating event network-changed:4194ac97-448e-472f-b93d-2a03adcfb436 for instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 on nch2-master-1 Nov 06 20:59:30.805387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-bf0ee471-7a09-4026-b3a0-defe6cdc5cbd req-25e81c08-bc9a-454b-8a66-b1199af5f944 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045557 Nov 06 20:59:30.806305 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1978/3988] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:30.996919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:31.007902 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85f98ffe-d4ef-41a5-b978-b5e87bf304d9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.353721 Nov 06 20:59:31.008843 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2011/3989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:30 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:31.662767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:31.663469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:31.669777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:31.671030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:31.672155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:31.672807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:31.754545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:31.764751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da5e0ab9-34d5-4d72-8644-8dbca1bbc9fa tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1319 microversion: 2.1 time: 0.107733 Nov 06 20:59:31.765346 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1979/3990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:31 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:31.775708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:31.777064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:31.787490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:31.788326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:31.789334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:31.789782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:32.025481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:32.026106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:32.028085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:32.033968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:32.034438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:32.035238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:32.035684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:32.038488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7b3b787-e125-4b22-a467-9f78e11d8085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.267073 Nov 06 20:59:32.039085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2012/3991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:31 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:32.236462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1205a314-5738-4b2c-b3fd-d32c836a2a91 req-7ef45888-c29e-43e0-8add-3e12490b64c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25923086-946d-426a-9928-7eb58fc69090", "name": "network-vif-plugged", "status": "completed", "tag": "8a518c86-0ed7-4991-b132-8a2a643d85b4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:32.238721 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:32.238721 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:32.250027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1205a314-5738-4b2c-b3fd-d32c836a2a91 req-7ef45888-c29e-43e0-8add-3e12490b64c4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:32.250785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1205a314-5738-4b2c-b3fd-d32c836a2a91 req-7ef45888-c29e-43e0-8add-3e12490b64c4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:32.264020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1205a314-5738-4b2c-b3fd-d32c836a2a91 req-7ef45888-c29e-43e0-8add-3e12490b64c4 service nova] Creating event network-vif-plugged:8a518c86-0ed7-4991-b132-8a2a643d85b4 for instance 25923086-946d-426a-9928-7eb58fc69090 on nch2-master-1 Nov 06 20:59:32.270028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1205a314-5738-4b2c-b3fd-d32c836a2a91 req-7ef45888-c29e-43e0-8add-3e12490b64c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039499 Nov 06 20:59:32.276060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2013/3992] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:32.313970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:32.322772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb53ff24-6e05-4fd3-994b-bdb884a22c39 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.300647 Nov 06 20:59:32.335442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1980/3993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:32 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:32.787121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:32.787969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:32.796265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:32.797258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:32.798270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:32.799017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.056127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:33.061480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:33.062685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:33.065888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34f71430-6ba4-40c2-b68b-63c50bad0c04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.286963 Nov 06 20:59:33.068362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2014/3994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:32 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:33.071782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:33.072242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.073167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:33.073599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.341808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:33.342672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:33.351685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:33.352958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.353280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:33.353969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:33.354414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.361736 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc71b6cc-e946-42a7-a3e3-713e89e1a66d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.307321 Nov 06 20:59:33.363348 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1981/3995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:33 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:33.674702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:33.708100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4aa050e-0371-4b4a-8c8a-1346d6465625 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.370170 Nov 06 20:59:33.710878 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2015/3996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:33 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:33.737329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4c80a4f8-c95d-4298-a2d1-b5c30978acf5 req-30ac6a83-9f93-4209-abb6-0d7698ddf33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1", "tag": "9a28fc71-da6e-45a2-a80a-58faa0b40f48"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:33.739457 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:33.739457 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:33.754507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c80a4f8-c95d-4298-a2d1-b5c30978acf5 req-30ac6a83-9f93-4209-abb6-0d7698ddf33a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:33.755052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c80a4f8-c95d-4298-a2d1-b5c30978acf5 req-30ac6a83-9f93-4209-abb6-0d7698ddf33a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:33.771653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4c80a4f8-c95d-4298-a2d1-b5c30978acf5 req-30ac6a83-9f93-4209-abb6-0d7698ddf33a service nova] Creating event network-changed:9a28fc71-da6e-45a2-a80a-58faa0b40f48 for instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 on nch2-master-1 Nov 06 20:59:33.783415 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4c80a4f8-c95d-4298-a2d1-b5c30978acf5 req-30ac6a83-9f93-4209-abb6-0d7698ddf33a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049927 Nov 06 20:59:33.784641 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1982/3997] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:34.087598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:34.088944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:34.096698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.097385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.098505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.099088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.381459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:34.383999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:34.394287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.395047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.395939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.396562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.761604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:34.769310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77d11516-0043-4aa0-a10e-df5446cb946f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.685411 Nov 06 20:59:34.769893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2016/3998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:34 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:34.774548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-75e347ef-9033-40a4-89ff-48c776989f4f req-92a6609c-6ae6-498e-8cce-8bcc9e2d5c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b078aad-b0ea-4219-ad06-31d344d0374d", "name": "network-vif-plugged", "status": "completed", "tag": "b2d5d03b-8f4a-49cf-96ef-822017228b48"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:34.776279 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:34.776279 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:34.783791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-75e347ef-9033-40a4-89ff-48c776989f4f req-92a6609c-6ae6-498e-8cce-8bcc9e2d5c9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.784244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-75e347ef-9033-40a4-89ff-48c776989f4f req-92a6609c-6ae6-498e-8cce-8bcc9e2d5c9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.796017 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-75e347ef-9033-40a4-89ff-48c776989f4f req-92a6609c-6ae6-498e-8cce-8bcc9e2d5c9d service nova] Creating event network-vif-plugged:b2d5d03b-8f4a-49cf-96ef-822017228b48 for instance 4b078aad-b0ea-4219-ad06-31d344d0374d on nch2-master-1 Nov 06 20:59:34.801667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-75e347ef-9033-40a4-89ff-48c776989f4f req-92a6609c-6ae6-498e-8cce-8bcc9e2d5c9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030465 Nov 06 20:59:34.802264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2017/3999] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:34.809836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:34.810591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:34.817050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.817509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:34.818304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:34.818742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:35.081532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:35.093773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aee7c319-f2cb-48f5-9f3e-adbf4345dc62 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.717642 Nov 06 20:59:35.104465 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1983/4000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:34 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:35.180889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:35.188741 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad6cfca6-df7c-4006-9dc1-6a97317e8a6c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.384764 Nov 06 20:59:35.189326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2018/4001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:34 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:35.793786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:35.796435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:35.804847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:35.805843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:35.807040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:35.808006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:36.112980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:36.114095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:36.124781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:36.125531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:36.126531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:36.128010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:36.177243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:36.187670 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2dc0277f-09f3-4bba-803a-a36f77affa10 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.404877 Nov 06 20:59:36.201535 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1984/4002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:35 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:36.205607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:36.206284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:36.214492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:36.215626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:36.216464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:36.216912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:36.494595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:36.501928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:36.506353 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a500ea1-d99d-4d23-8527-bd73e52f2090 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1318 microversion: 2.1 time: 0.399796 Nov 06 20:59:36.510908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-294a693d-17ab-4f84-a566-e64e52125bcd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1504 microversion: 2.1 time: 0.308922 Nov 06 20:59:36.512040 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1985/4003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:36 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:36.514009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2019/4004] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:36 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:37.210474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.211150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:37.218177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.218715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.219514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.219985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.378331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:37.389249 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d65214f-1b28-4859-ad75-436fe0a1ec3d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.183673 Nov 06 20:59:37.389844 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1986/4005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:37.529295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.530090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.530492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:37.531268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:37.538011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.538205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.538310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.538762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.539106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.539553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.539930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.540632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.790043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:37.800320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:37.803690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8088f5ea-43c4-4d69-b135-faa13eca94bb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1506 microversion: 2.1 time: 0.275619 Nov 06 20:59:37.806952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1987/4006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:37.812064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68919466-eaec-41be-8236-81daddb26ad5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1479 microversion: 2.1 time: 0.287490 Nov 06 20:59:37.812745 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2020/4007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:37.820625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.821385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:37.827425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.827874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.828530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c3e1f1b-48a9-46d1-8565-666a7d483ea0 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '.version_select at 0x7f671acb59d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.829011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.829455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.829950 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:37.829950 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:37.831384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3e1f1b-48a9-46d1-8565-666a7d483ea0 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.831842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3e1f1b-48a9-46d1-8565-666a7d483ea0 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.841564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c3e1f1b-48a9-46d1-8565-666a7d483ea0 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.016176 Nov 06 20:59:37.842320 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2021/4008] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/os-migrations => generated 785 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:37.853462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:37.854079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:37.866025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.866025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:37.866025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:37.866025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.054535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:38.064746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-313baa92-1fde-4d52-aa5f-5dd7d4fbaa82 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090" status: 200 len: 1506 microversion: 2.1 time: 0.247897 Nov 06 20:59:38.065880 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1988/4009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:38.082824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:38.083411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa7509e8-5e7f-478f-8ed4-cc0d7482c908 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1630 microversion: 2.1 time: 0.233481 Nov 06 20:59:38.083649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:38.095041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2022/4010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:37 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1630 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:38.095235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.095573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.096662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.097804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.131666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:38.263920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ef3008af-03ce-411b-9aeb-4a9b917a2085 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090" status: 204 len: 0 microversion: 2.1 time: 0.184457 Nov 06 20:59:38.268185 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1989/4011] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:59:38 2021] DELETE /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 20:59:38.273463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:38.274388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:38.300112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.300785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.301750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.304867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.339188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:38.351498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-909313504", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "a0d87934-0232-4205-a7f7-5ad3a2322d26"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:38.424650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] validate_networks() for [('a0d87934-0232-4205-a7f7-5ad3a2322d26', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:59:38.467820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b350e36d-1c5b-48e9-8594-3507c838c3b9 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 204 len: 0 microversion: 2.1 time: 0.198306 Nov 06 20:59:38.469122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2023/4012] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 20:59:38 2021] DELETE /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 20:59:38.476792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:38.478168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:38.489903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.490628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.492152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.493345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.798608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:38.817804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b103623-cbd8-4057-8df8-9e7de24d003d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.346885 Nov 06 20:59:38.824148 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2024/4013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:38 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:38.833075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:38.834089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:38.853689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.854152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:38.854955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:38.855602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:39.435482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:39.443321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e6c868c-078f-4fdd-b395-e9c92d7789fb tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090" status: 200 len: 1512 microversion: 2.1 time: 0.617214 Nov 06 20:59:39.444332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2025/4014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:38 2021] GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090 => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:39.454853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:59:39.455450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:59:39.455751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:59:39.456208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:59:39.456658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:59:39.474415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:39.474882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:39.476052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:39.477284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:39.499293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:39.503223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for user 0cbe3496db994852a09c97ee075fbd4a and project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:39.514552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:59:39.517013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:39.561160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec159ef4-0322-466b-90c2-4afef7508119 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217575 Nov 06 20:59:39.561834 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1990/4015] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 20:59:39.571775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea77bd3d-6d5a-4803-b68f-ccfba4d5d4c6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:39.572416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea77bd3d-6d5a-4803-b68f-ccfba4d5d4c6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:39.631302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea77bd3d-6d5a-4803-b68f-ccfba4d5d4c6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:39.639954 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea77bd3d-6d5a-4803-b68f-ccfba4d5d4c6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1210 microversion: 2.1 time: 0.071492 Nov 06 20:59:39.641030 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2026/4016] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:39 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1210 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:39.839074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:39.839828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:39.847125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:39.847561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:39.849302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:39.849834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.069080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:40.079689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d289dbd2-0e5e-4166-8fe9-b2666960fa4b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.247907 Nov 06 20:59:40.080685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1991/4017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:39 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:40.462577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:40.463330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:40.475938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:40.477512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.478313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:40.478778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.550176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:40.560857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ace3cfea-2abf-4162-9375-32771908236a tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090" status: 200 len: 1470 microversion: 2.1 time: 0.103417 Nov 06 20:59:40.562337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2027/4018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:40 2021] GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090 => generated 1470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:40.638471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e754607e-5d49-4ccd-bf45-b96618537b66 req-7df8f1fd-cc28-495f-b5ac-fdc733821139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25923086-946d-426a-9928-7eb58fc69090", "name": "network-vif-deleted", "tag": "8a518c86-0ed7-4991-b132-8a2a643d85b4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:40.640083 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:40.640083 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:40.648970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e754607e-5d49-4ccd-bf45-b96618537b66 req-7df8f1fd-cc28-495f-b5ac-fdc733821139 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:40.649597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e754607e-5d49-4ccd-bf45-b96618537b66 req-7df8f1fd-cc28-495f-b5ac-fdc733821139 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.659239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:40.660337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:40.666454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e754607e-5d49-4ccd-bf45-b96618537b66 req-7df8f1fd-cc28-495f-b5ac-fdc733821139 service nova] Creating event network-vif-deleted:8a518c86-0ed7-4991-b132-8a2a643d85b4 for instance 25923086-946d-426a-9928-7eb58fc69090 on nch2-master-1 Nov 06 20:59:40.667781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:40.668481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.670415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:40.671038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:40.673077 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e754607e-5d49-4ccd-bf45-b96618537b66 req-7df8f1fd-cc28-495f-b5ac-fdc733821139 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038347 Nov 06 20:59:40.677256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1992/4019] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:40.748178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:40.758383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f13f5e0-010e-48fb-8fdf-6890c1bce10b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1262 microversion: 2.1 time: 0.101959 Nov 06 20:59:40.759448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2028/4020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:40 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:41.103601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:41.104778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:41.112727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.113120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.113930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.114604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.438500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:41.461100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9f463d6-e036-4fbf-a98a-3f786fa23afc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.353964 Nov 06 20:59:41.471976 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1993/4021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:41 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:41.578583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:41.579196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 25923086-946d-426a-9928-7eb58fc69090] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:41.585979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.586671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.587641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.588250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.603709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] HTTP exception thrown: Instance 25923086-946d-426a-9928-7eb58fc69090 could not be found. Nov 06 20:59:41.604340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Returning 404 to user: Instance 25923086-946d-426a-9928-7eb58fc69090 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:41.605189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-902984e1-85ec-44f9-bbd4-40d4fd48dffe tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090" status: 404 len: 111 microversion: 2.1 time: 0.030360 Nov 06 20:59:41.605934 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2029/4022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:41 2021] GET /compute/v2.1/servers/25923086-946d-426a-9928-7eb58fc69090 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:59:41.614844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:41.615598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:41.623235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.623905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.624839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.625416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.777690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:41.780070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:41.787451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.787907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:41.788742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:41.789366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:42.045440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5738428039b14b6580b7e2c9d3e29490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c12e0618d884fc29318833f9f5a544e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:42.085663 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd8f7ddb-767e-4f8c-a70d-1ac67126f02d tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 200 len: 1512 microversion: 2.1 time: 0.474282 Nov 06 20:59:42.089348 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1994/4023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:41 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:42.105074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d831568f-6694-47fc-8372-18d86a9161d2 req-e41ba66e-51ed-483f-a9e9-ae4b6f95c1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b078aad-b0ea-4219-ad06-31d344d0374d", "name": "network-vif-deleted", "tag": "b2d5d03b-8f4a-49cf-96ef-822017228b48"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:42.107296 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:42.107296 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:42.151686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d831568f-6694-47fc-8372-18d86a9161d2 req-e41ba66e-51ed-483f-a9e9-ae4b6f95c1c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:42.158916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d831568f-6694-47fc-8372-18d86a9161d2 req-e41ba66e-51ed-483f-a9e9-ae4b6f95c1c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:42.178960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d831568f-6694-47fc-8372-18d86a9161d2 req-e41ba66e-51ed-483f-a9e9-ae4b6f95c1c3 service nova] Creating event network-vif-deleted:b2d5d03b-8f4a-49cf-96ef-822017228b48 for instance 4b078aad-b0ea-4219-ad06-31d344d0374d on nch2-master-1 Nov 06 20:59:42.185902 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d831568f-6694-47fc-8372-18d86a9161d2 req-e41ba66e-51ed-483f-a9e9-ae4b6f95c1c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094838 Nov 06 20:59:42.187683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1995/4024] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:42.257896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:42.267584 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7dc95f6-08c1-43be-b240-289212e57f65 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.494113 Nov 06 20:59:42.269128 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2030/4025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:41 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:42.479507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:42.480232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:42.490127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:42.493956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:42.495319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:42.497555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:42.513541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7e11fb49-a4fe-402c-89c4-472a1f1a41a3 req-78933fda-3c55-4554-9639-522df226b0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1", "name": "network-vif-plugged", "status": "completed", "tag": "9a28fc71-da6e-45a2-a80a-58faa0b40f48"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:42.515423 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:42.515423 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:42.548990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7e11fb49-a4fe-402c-89c4-472a1f1a41a3 req-78933fda-3c55-4554-9639-522df226b0e7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:42.549450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7e11fb49-a4fe-402c-89c4-472a1f1a41a3 req-78933fda-3c55-4554-9639-522df226b0e7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:42.587925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7e11fb49-a4fe-402c-89c4-472a1f1a41a3 req-78933fda-3c55-4554-9639-522df226b0e7 service nova] Creating event network-vif-plugged:9a28fc71-da6e-45a2-a80a-58faa0b40f48 for instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 on nch2-master-1 Nov 06 20:59:42.604927 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7e11fb49-a4fe-402c-89c4-472a1f1a41a3 req-78933fda-3c55-4554-9639-522df226b0e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095649 Nov 06 20:59:42.608287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2031/4026] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:42.853701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:42.873618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7e959fb-39c7-40c5-ae56-12bc40802ea4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.394919 Nov 06 20:59:42.875100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1996/4027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:42 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:43.112229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:43.112980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] [instance: 4b078aad-b0ea-4219-ad06-31d344d0374d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:43.121353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.122109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.122914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.124140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.138726 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] HTTP exception thrown: Instance 4b078aad-b0ea-4219-ad06-31d344d0374d could not be found. Nov 06 20:59:43.139333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] Returning 404 to user: Instance 4b078aad-b0ea-4219-ad06-31d344d0374d could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:43.140414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d171cfb7-0a6d-4d87-b526-f765ccc71029 tempest-MultipleCreateTestJSON-209482855 tempest-MultipleCreateTestJSON-209482855-project] 10.222.0.13 "GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d" status: 404 len: 111 microversion: 2.1 time: 0.037434 Nov 06 20:59:43.141442 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2032/4028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:43 2021] GET /compute/v2.1/servers/4b078aad-b0ea-4219-ad06-31d344d0374d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 20:59:43.260564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-fa9bfd09-b67e-4487-aa92-837ca53d648e req-3e44fda8-a0be-4fdf-8512-05ef399ccf50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7675136e-8794-496a-a186-3531f5aa4d0f", "tag": "be7b680a-e8bb-4f73-a40c-30b3e1f27383"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:43.271628 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:43.271628 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:43.286745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:43.287588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:43.297953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fa9bfd09-b67e-4487-aa92-837ca53d648e req-3e44fda8-a0be-4fdf-8512-05ef399ccf50 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.298400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fa9bfd09-b67e-4487-aa92-837ca53d648e req-3e44fda8-a0be-4fdf-8512-05ef399ccf50 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.309056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.310202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.311303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.312634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.322523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fa9bfd09-b67e-4487-aa92-837ca53d648e req-3e44fda8-a0be-4fdf-8512-05ef399ccf50 service nova] Creating event network-changed:be7b680a-e8bb-4f73-a40c-30b3e1f27383 for instance 7675136e-8794-496a-a186-3531f5aa4d0f on nch2-master-1 Nov 06 20:59:43.338268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-fa9bfd09-b67e-4487-aa92-837ca53d648e req-3e44fda8-a0be-4fdf-8512-05ef399ccf50 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079541 Nov 06 20:59:43.339485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1997/4029] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:43.701291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:43.735934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01c57f24-f998-4a91-bfe4-aee9e8fa8a83 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.453889 Nov 06 20:59:43.737251 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2033/4030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:43 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:43.896035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:43.897010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:43.908456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.909269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:43.910223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:43.910811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:44.229182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:44.239326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30dcedf8-25a2-4317-b222-136040cc767a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1393 microversion: 2.1 time: 0.347377 Nov 06 20:59:44.250304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1998/4031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:43 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1393 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:44.753893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:44.755215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:44.763080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:44.763973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:44.765051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:44.765706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:45.124006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:45.145061 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-964c1849-2103-4ec2-b4e4-406fc9f83333 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.388834 Nov 06 20:59:45.149307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2034/4032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:44 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:45.256678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:45.257927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:45.273875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:45.274847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:45.275823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:45.276465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:45.461042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:45.476502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fc0e490-77e2-4662-b044-dc01e67bbc37 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1574 microversion: 2.1 time: 0.223359 Nov 06 20:59:45.477525 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 1999/4033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:45 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:45.493840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:45.494346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:45.503757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:45.504205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:45.505726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:45.506662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:46.010311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1de58b2-3dff-49bd-b0af-1bcbdd022a93 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2146101555", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:46.012639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a1de58b2-3dff-49bd-b0af-1bcbdd022a93 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] HTTP exception thrown: min_count must be <= max_count Nov 06 20:59:46.013219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1de58b2-3dff-49bd-b0af-1bcbdd022a93 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Returning 400 to user: min_count must be <= max_count {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:46.014256 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1de58b2-3dff-49bd-b0af-1bcbdd022a93 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.220860 Nov 06 20:59:46.014826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2000/4034] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:45 2021] POST /compute/v2.1/servers => generated 74 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 06 20:59:46.077779 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7b6c1df-653c-490a-9ef9-5dce3d2eb25f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.587896 Nov 06 20:59:46.079684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2035/4035] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 20:59:45 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/os-interface => generated 284 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:46.102150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-094dcacf-c57c-4faa-a9c8-1072930f61fb tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-372798154", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "max_count": 0}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:46.103508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-094dcacf-c57c-4faa-a9c8-1072930f61fb tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:46.104540 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-094dcacf-c57c-4faa-a9c8-1072930f61fb tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006031 Nov 06 20:59:46.105347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2001/4036] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:46 2021] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:59:46.167177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:46.167976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:46.184362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:46.184839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:46.185676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:46.186153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:46.192183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9655be3-6668-4ba5-b895-020bb27d20a6 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-673948560", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "max_count": 2.5}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:46.193621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9655be3-6668-4ba5-b895-020bb27d20a6 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:46.197088 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9655be3-6668-4ba5-b895-020bb27d20a6 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017753 Nov 06 20:59:46.199244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2002/4037] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:46 2021] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 20:59:46.264209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de742be0-909f-4b14-8514-2a0e7fe43a8b tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-857331449", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 0}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:46.266374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de742be0-909f-4b14-8514-2a0e7fe43a8b tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:46.267388 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de742be0-909f-4b14-8514-2a0e7fe43a8b tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009927 Nov 06 20:59:46.278726 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2003/4038] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:46 2021] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 20:59:46.338540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ee8c53e-2f6b-4f4f-8c44-98387b933872 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1091489952", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 2.5}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:46.340215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ee8c53e-2f6b-4f4f-8c44-98387b933872 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:46.342130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ee8c53e-2f6b-4f4f-8c44-98387b933872 tempest-MultipleCreateNegativeTestJSON-1422433318 tempest-MultipleCreateNegativeTestJSON-1422433318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011310 Nov 06 20:59:46.350746 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2004/4039] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:46 2021] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:59:46.486517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:46.494180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92c01599-7820-48be-a8ed-edbba8e24489 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.331109 Nov 06 20:59:46.497451 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2036/4040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:46 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:47.333665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:47.335387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:47.351222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.352470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.353314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.354231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.391469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 20:59:47.479449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:47.479449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:47.488510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.488964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.489752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.490192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.516942 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 204 len: 0 microversion: 2.42 time: 0.195940 Nov 06 20:59:47.519281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2005/4041] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 20:59:47 2021] DELETE /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 20:59:47.527470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-99a3d615-4587-4608-b48b-26a63f3e8069 req-63d99b3a-340f-437c-83fe-90f319b927c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1", "tag": "9a28fc71-da6e-45a2-a80a-58faa0b40f48"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:47.529610 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:47.529610 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:47.538445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-99a3d615-4587-4608-b48b-26a63f3e8069 req-63d99b3a-340f-437c-83fe-90f319b927c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.539385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-99a3d615-4587-4608-b48b-26a63f3e8069 req-63d99b3a-340f-437c-83fe-90f319b927c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.554435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-99a3d615-4587-4608-b48b-26a63f3e8069 req-63d99b3a-340f-437c-83fe-90f319b927c3 service nova] Creating event network-changed:9a28fc71-da6e-45a2-a80a-58faa0b40f48 for instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 on nch2-master-1 Nov 06 20:59:47.560884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-99a3d615-4587-4608-b48b-26a63f3e8069 req-63d99b3a-340f-437c-83fe-90f319b927c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038675 Nov 06 20:59:47.562251 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2006/4042] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:47.566400 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8598dda9-563e-42a9-a433-0bc7e61e363c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.094799 Nov 06 20:59:47.569836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2037/4043] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:47 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:59:47.573642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:47.575636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:47.579679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:47.580730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:47.584181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.584986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.585883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.586554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.589877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.590378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:47.591252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:47.591693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:48.080325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:48.087906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:48.092175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:48.094522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:48.096806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ee09599-24ac-4229-903a-5b6593f38a0f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2958 microversion: 2.42 time: 0.525999 Nov 06 20:59:48.098094 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2038/4044] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:47 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2958 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:48.098591 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3e22fdc-9c32-4b01-89eb-a28438171829 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.534564 Nov 06 20:59:48.102119 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2007/4045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:47 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:48.183490 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 20:59:48.183713 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 20:59:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 20:59:48.578366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:48.580077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:48.592187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:48.592187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:48.592187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:48.592187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:48.633977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb015257-0f2c-42b8-83ff-02dd423581f1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.059990 Nov 06 20:59:48.635578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2039/4046] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:48 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:59:49.120080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:49.125365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:49.126432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:49.129033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:49.143989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.149743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.150214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.151044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.151478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.153475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.154422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.154883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.701490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:49.710680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:49.711297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:49.712186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:49.713738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c117778f-928e-49af-8db1-8d610376765f tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2958 microversion: 2.42 time: 0.599889 Nov 06 20:59:49.714296 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2040/4047] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:49 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2958 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:49.719272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c9c534c-2da1-43a5-978e-4cf5f7b946eb tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.604827 Nov 06 20:59:49.719906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:49.721127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:49.733665 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2008/4048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:49 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:49.739134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.739835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.740941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:49.741696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:49.792886 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d31d834-64fb-4e72-b66a-d2cdc22c4ce0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.074644 Nov 06 20:59:49.794141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2041/4049] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:49 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:59:49.912786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1508341847", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:49.988238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] validate_networks() for [('9864333c-2854-4b94-bfa9-88d2ed7bffd6', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 20:59:50.165884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b8cd2e7d-97a6-4f97-bc49-3635d3893ce4 req-bf783341-49eb-4d99-b8a3-5282ee701e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-unplugged", "status": "completed", "tag": "17be14bc-9403-4e98-b5d4-244642a0bc18"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:50.168059 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:50.168059 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:50.177421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b8cd2e7d-97a6-4f97-bc49-3635d3893ce4 req-bf783341-49eb-4d99-b8a3-5282ee701e65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:50.177944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b8cd2e7d-97a6-4f97-bc49-3635d3893ce4 req-bf783341-49eb-4d99-b8a3-5282ee701e65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:50.193920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b8cd2e7d-97a6-4f97-bc49-3635d3893ce4 req-bf783341-49eb-4d99-b8a3-5282ee701e65 service nova] Creating event network-vif-unplugged:17be14bc-9403-4e98-b5d4-244642a0bc18 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:50.199518 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b8cd2e7d-97a6-4f97-bc49-3635d3893ce4 req-bf783341-49eb-4d99-b8a3-5282ee701e65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038123 Nov 06 20:59:50.200407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2042/4050] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:50.736166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:50.736899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:50.744790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:50.745487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:50.746469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:50.747055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:50.898514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 20:59:50.899031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 20:59:50.899412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 20:59:50.899830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 20:59:50.900246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 20:59:50.919297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:50.920134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:50.922638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:50.923594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:50.959551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Getting quotas for project 6c71a91e0f3c434c899dc6d8aac735e8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 20:59:50.967078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Getting quotas for user 8cb55cd5e080421ab9d992777399549b and project 6c71a91e0f3c434c899dc6d8aac735e8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 20:59:50.980605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 20:59:50.984347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 20:59:51.095695 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9125472b-ba78-4382-b526-72e46b5937d9 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369830 Nov 06 20:59:51.096639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2009/4051] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 20:59:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 20:59:51.109358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:51.110067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:51.120180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:51.128215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:51.128854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:51.129672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:51.130109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:51.130348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:51.138129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:51.139436 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3580c94-bfa5-4041-94e5-315b819b3e4b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2937 microversion: 2.42 time: 0.409073 Nov 06 20:59:51.140002 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2043/4052] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:50 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2937 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:59:51.152873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:51.154244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:51.163504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:51.168844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:51.170162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:51.173329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:51.244471 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d12c3413-f278-40e7-8762-2b4c1c7f9c6d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.099306 Nov 06 20:59:51.245845 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2044/4053] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:51 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:59:51.252750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-340e2b35-6006-4e2c-970d-4b6c270775a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:51.253906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-340e2b35-6006-4e2c-970d-4b6c270775a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:51.389129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-340e2b35-6006-4e2c-970d-4b6c270775a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:51.402316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-340e2b35-6006-4e2c-970d-4b6c270775a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1224 microversion: 2.1 time: 0.154465 Nov 06 20:59:51.414581 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2045/4054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:51 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:51.625041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:51.636159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6609806b-04fd-443a-ac72-d8a81379e242 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.538449 Nov 06 20:59:51.637135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2010/4055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:51 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:52.164209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:52.167906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:52.185183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.185978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.187626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.188744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.257296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:52.258291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:52.281375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.283593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.284649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.285818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.364176 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d21fea1-74a4-4e55-ad41-aec68f82399b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.107878 Nov 06 20:59:52.367427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2011/4056] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:52 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:59:52.382406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-unplugged", "status": "completed", "tag": "fcdcc226-5447-40fc-ae90-f14b9d979ea3"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-unplugged", "status": "completed", "tag": "9210c3a1-39eb-4a93-b546-62b199efbddb"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-unplugged", "status": "completed", "tag": "6129e605-3b1f-4e2f-bd52-7ed954bb7a76"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-unplugged", "status": "completed", "tag": "da512244-df04-4f1e-9589-476f01bcf03c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:52.387878 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:52.387878 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:52.411594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.413468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.435316 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Creating event network-vif-unplugged:fcdcc226-5447-40fc-ae90-f14b9d979ea3 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:52.436144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Creating event network-vif-unplugged:9210c3a1-39eb-4a93-b546-62b199efbddb for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:52.436885 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Creating event network-vif-unplugged:6129e605-3b1f-4e2f-bd52-7ed954bb7a76 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:52.437594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] Creating event network-vif-unplugged:da512244-df04-4f1e-9589-476f01bcf03c for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:52.452200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c56713b0-af46-4e1f-98ce-3ac727708820 req-2da02b0a-1f85-4e44-93a1-6457edae8f3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.079190 Nov 06 20:59:52.454086 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2012/4057] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:52.461787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:52.463613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:52.475048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.475905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.477042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.477684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.524874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:52.544779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:52.546598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:52.551347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-454ae6fe-8beb-430d-864d-4af6a197cc1a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2916 microversion: 2.42 time: 0.394735 Nov 06 20:59:52.552436 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2046/4058] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:52 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2916 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:52.571717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:52.584951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f4d7d8e-12df-445c-a661-a1bad3a6c865 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1294 microversion: 2.1 time: 0.128350 Nov 06 20:59:52.586607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2013/4059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:52 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:52.655173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:52.656075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:52.664114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.664797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.666103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.667001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.670482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-04cd340d-10ef-48a2-b57e-3af7bed1f192 req-37b58607-3e30-42b0-8507-a49c6f6a0a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-deleted", "tag": "17be14bc-9403-4e98-b5d4-244642a0bc18"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:52.671909 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:52.671909 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:52.680893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04cd340d-10ef-48a2-b57e-3af7bed1f192 req-37b58607-3e30-42b0-8507-a49c6f6a0a52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:52.681346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04cd340d-10ef-48a2-b57e-3af7bed1f192 req-37b58607-3e30-42b0-8507-a49c6f6a0a52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:52.712814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-04cd340d-10ef-48a2-b57e-3af7bed1f192 req-37b58607-3e30-42b0-8507-a49c6f6a0a52 service nova] Creating event network-vif-deleted:17be14bc-9403-4e98-b5d4-244642a0bc18 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:52.718021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-04cd340d-10ef-48a2-b57e-3af7bed1f192 req-37b58607-3e30-42b0-8507-a49c6f6a0a52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051529 Nov 06 20:59:52.718802 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2014/4060] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:52.911758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:52.921490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c11c345-bbb2-44d8-9576-41ad7d36c78f tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.271108 Nov 06 20:59:52.922508 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2047/4061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:52 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:53.377234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:53.378238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:53.384722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.385178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:53.386200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.386644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:53.427213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9386c89b-e442-48e3-88d0-8af4399ebf46 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.055382 Nov 06 20:59:53.430413 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2015/4062] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:53 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:59:53.573414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:53.574846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:53.586112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.586530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:53.587851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.588310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:53.606814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:53.607923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:53.619069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.620098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:53.621249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:53.622428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.037731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:54.048082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:54.050582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:54.052179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe706764-4ead-4079-b4db-d8d2c824a2a5 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2708 microversion: 2.42 time: 0.482923 Nov 06 20:59:54.054131 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2048/4063] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:53 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2708 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 20:59:54.058538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:54.059558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:54.066213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.066976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.067203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:54.068222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.068893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.081186 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c29374e-41f1-4b8c-9ef9-7a83c65cd25f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.480589 Nov 06 20:59:54.094042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2016/4064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:53 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:54.322320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:54.337791 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca89aefe-98c2-4037-98fe-dfe92f342b7b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.281823 Nov 06 20:59:54.339074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2049/4065] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:54 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:54.438416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:54.440518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:54.462154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.462922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.464006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.464654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.488005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-76e6ab82-5def-429f-a5da-7c09df2b0ef0 req-429b321e-9921-40c2-84f3-c8b98235afe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7675136e-8794-496a-a186-3531f5aa4d0f", "name": "network-vif-plugged", "status": "completed", "tag": "be7b680a-e8bb-4f73-a40c-30b3e1f27383"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:54.489629 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:54.489629 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:54.501940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-76e6ab82-5def-429f-a5da-7c09df2b0ef0 req-429b321e-9921-40c2-84f3-c8b98235afe8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.502393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-76e6ab82-5def-429f-a5da-7c09df2b0ef0 req-429b321e-9921-40c2-84f3-c8b98235afe8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.529039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d260ca4d-d16c-423a-8503-6f7f951aa814 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.093839 Nov 06 20:59:54.529586 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2017/4066] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:54 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:59:54.544040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-76e6ab82-5def-429f-a5da-7c09df2b0ef0 req-429b321e-9921-40c2-84f3-c8b98235afe8 service nova] Creating event network-vif-plugged:be7b680a-e8bb-4f73-a40c-30b3e1f27383 for instance 7675136e-8794-496a-a186-3531f5aa4d0f on nch2-master-1 Nov 06 20:59:54.549804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-76e6ab82-5def-429f-a5da-7c09df2b0ef0 req-429b321e-9921-40c2-84f3-c8b98235afe8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065231 Nov 06 20:59:54.550742 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2050/4067] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 20:59:54.742435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-deleted", "tag": "9210c3a1-39eb-4a93-b546-62b199efbddb"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-deleted", "tag": "da512244-df04-4f1e-9589-476f01bcf03c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:54.744040 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:54.744040 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:54.760066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:54.760066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:54.783723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] Creating event network-vif-deleted:9210c3a1-39eb-4a93-b546-62b199efbddb for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:54.784673 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] Creating event network-vif-deleted:da512244-df04-4f1e-9589-476f01bcf03c for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:54.792248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a64a6daf-468b-4d85-bc1a-782e05a56666 req-c3dfbf69-df83-4295-b965-d48098a2059e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053531 Nov 06 20:59:54.794293 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2018/4068] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:54 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:55.077107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:55.077881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:55.085190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.085890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.086684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.087118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.100625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:55.101339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:55.114080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.114845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.115810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.116253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.447880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:55.451722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:55.461702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:55.463147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:55.464266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3515163-6456-4ad7-acbc-1c5cd0edac07 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.368162 Nov 06 20:59:55.464451 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9310c1b3-0f88-4ddb-a981-d9e2b4ae1565 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 2211 microversion: 2.42 time: 0.392668 Nov 06 20:59:55.464976 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2051/4069] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:55 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 2211 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:59:55.468573 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2019/4070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:55 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:55.478566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:55.479619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:55.493311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-945284b7-2d0e-43a8-ab87-a59daaee861d req-414bd989-fe0c-418f-8882-ac8c37136be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7eb544-4d31-45ec-ba05-8d471c4e6133", "tag": "b5dfb038-ed68-40fa-ba80-c498ad9ecae0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:55.495222 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:55.495222 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:55.496597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.497068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.497876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.498324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.510740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-945284b7-2d0e-43a8-ab87-a59daaee861d req-414bd989-fe0c-418f-8882-ac8c37136be3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.512675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-945284b7-2d0e-43a8-ab87-a59daaee861d req-414bd989-fe0c-418f-8882-ac8c37136be3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.540751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-945284b7-2d0e-43a8-ab87-a59daaee861d req-414bd989-fe0c-418f-8882-ac8c37136be3 service nova] Creating event network-changed:b5dfb038-ed68-40fa-ba80-c498ad9ecae0 for instance 0e7eb544-4d31-45ec-ba05-8d471c4e6133 on nch2-master-1 Nov 06 20:59:55.546214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-945284b7-2d0e-43a8-ab87-a59daaee861d req-414bd989-fe0c-418f-8882-ac8c37136be3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063786 Nov 06 20:59:55.547052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2052/4071] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:55.552890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:55.553919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:55.562297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.562945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.564070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:55.564711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:55.613538 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8af6a679-e705-4233-9045-3aa49493ba20 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.064663 Nov 06 20:59:55.617277 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2053/4072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:55 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 20:59:55.780500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:55.792130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75eeb1a9-84de-4a57-bc4c-031c18af8e12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1310 microversion: 2.1 time: 0.321852 Nov 06 20:59:55.792737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2020/4073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:55 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:56.485662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:56.487155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:56.488098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:56.488734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:56.495099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.495932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.497045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.497543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.497709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.498188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.499051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.499662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.530649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.531367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.532034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lazy-loading 'fault' on Instance uuid 71bd8a14-1498-4584-a269-945f8ff7a845 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 20:59:56.589001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:56.600060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:56.602505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '407605b252be40ad88a3fce348750e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f37b0e9c3a4480a04ebeec1085ec97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:56.603928 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72af761a-8381-4c20-8ac2-2a97accc885a tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 200 len: 1609 microversion: 2.42 time: 0.120155 Nov 06 20:59:56.604552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2021/4074] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:56 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 1609 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 20:59:56.624154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:56.625192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:56.631262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.631937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.632759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.633365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.672894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae2f1d43-b49a-4534-9985-fdec353245eb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.052104 Nov 06 20:59:56.675154 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2022/4075] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:56 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:59:56.676526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:56.684756 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4964f48-5f02-4135-aa76-4720fa2108eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.205047 Nov 06 20:59:56.685326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2054/4076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:56 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:56.815461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:56.816513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:56.822865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-deleted", "tag": "fcdcc226-5447-40fc-ae90-f14b9d979ea3"}, {"server_uuid": "71bd8a14-1498-4584-a269-945f8ff7a845", "name": "network-vif-deleted", "tag": "6129e605-3b1f-4e2f-bd52-7ed954bb7a76"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:56.825121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.825617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.826570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.827036 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:56.827036 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 20:59:56.827243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.837731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:56.838379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:56.852847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] Creating event network-vif-deleted:fcdcc226-5447-40fc-ae90-f14b9d979ea3 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:56.853838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] Creating event network-vif-deleted:6129e605-3b1f-4e2f-bd52-7ed954bb7a76 for instance 71bd8a14-1498-4584-a269-945f8ff7a845 on nch2-master-1 Nov 06 20:59:56.860069 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6768a9f4-9d92-40fe-bbdd-7e07edcc13d4 req-62c64183-4be0-43fa-861f-994b7d2127d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045110 Nov 06 20:59:56.861479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2055/4077] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 20:59:56 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:56.975685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:56.983353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bff65dd8-96f2-432e-b035-97617a29eb54 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1494 microversion: 2.1 time: 0.178636 Nov 06 20:59:56.983924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2023/4078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:56 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:56.999872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:57.000642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:57.006755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.007227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.008026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.008565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.136275 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65710d00-c9d7-4e7b-ba14-79af0151b27c tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1645 microversion: 2.1 time: 0.140435 Nov 06 20:59:57.137457 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2056/4079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:56 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1645 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:57.152572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:57.154051 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 20:59:57.154051 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 20:59:57.155656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.156114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.156951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.157388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.181894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e430fc0-a028-4861-a79e-857063689c4f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032860 Nov 06 20:59:57.182490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2024/4080] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 20:59:57 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:57.623730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:57.625100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:57.632533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.633231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.634037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.634474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.649217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] HTTP exception thrown: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. Nov 06 20:59:57.650503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Returning 404 to user: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 20:59:57.651439 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13afa2d5-1970-4991-aa10-4451b3ec57be tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 404 len: 111 microversion: 2.42 time: 0.032084 Nov 06 20:59:57.652192 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2057/4081] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 20:59:57 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 20:59:57.660618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bc8e244-8a2b-4966-a759-c7325b746940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '.version_select at 0x7f6714c02940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:57.685698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:57.686860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:57.687542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bc8e244-8a2b-4966-a759-c7325b746940 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886713322" status: 204 len: 0 microversion: 2.42 time: 0.030407 Nov 06 20:59:57.688794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2025/4082] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Nov 6 20:59:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886713322 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 20:59:57.693807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.694190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.695242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.695517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.715601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:57.716145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:57.727189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.727926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.728748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:57.729190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:57.737873 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90c0cfe9-654d-4b27-ab84-af26c08b7ac8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 14 microversion: 2.1 time: 0.056380 Nov 06 20:59:57.738812 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2058/4083] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:57 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 20:59:57.971848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:57.981304 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91fee0a4-4726-45d7-95f9-2238bfac1574 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.273113 Nov 06 20:59:57.991193 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2026/4084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:57 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:58.548688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52646cb2-a717-4fe2-97f2-d75adef114f7", "device": "/dev/xvdb"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:58.550248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:58.557449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:58.557911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:58.558756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:58.559383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:58.749519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:58.751193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:58.758185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:58.758669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:58.759469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:58.759929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:58.825678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de51b211-6860-47fa-ad3a-3d544f571bf9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 8208 microversion: 2.1 time: 0.078900 Nov 06 20:59:58.826479 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2027/4085] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:58 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 8208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 20:59:58.843867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7cf0095a-e369-4115-9e2b-bf249c0675f1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "POST /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298026 Nov 06 20:59:58.844843 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2059/4086] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 20:59:58 2021] POST /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 20:59:59.000116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 20:59:59.000938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:59.009727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:59.010499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:59.011539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:59.012632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:59.165196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 20:59:59.181921 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2fe1b55-c3c5-4f0d-ad34-37c801666fc2 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.184840 Nov 06 20:59:59.183191 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2028/4087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 20:59:58 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 20:59:59.838225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 20:59:59.839445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 20:59:59.846932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:59.847601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:59.848338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 20:59:59.854661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 20:59:59.920843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5dc39205-9d14-4861-936c-e5db31c1eef6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 16402 microversion: 2.1 time: 0.085532 Nov 06 20:59:59.921484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2060/4088] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 20:59:59 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 16402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:00.200125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:00.201788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:00.218195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:00.221570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:00.222720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:00.224138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:00.533454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:00.541662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1ef6059-68c6-4fbb-a3cc-fb809cd482eb tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.346308 Nov 06 21:00:00.543819 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2029/4089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:00 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:00.932400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:00.933650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:00.947328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:00.947847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:00.948609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:00.953440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.023452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab896de7-75da-430b-b45e-ce1c13ab8e40 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 16402 microversion: 2.1 time: 0.095207 Nov 06 21:00:01.028525 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2061/4090] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:00 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 16402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:01.559064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:01.560031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:01.567256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.567809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.568892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.569471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.867287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:01.868193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:01.877650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.878373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.883722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.885651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.916277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] HTTP exception thrown: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. Nov 06 21:00:01.917226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Returning 404 to user: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:01.918722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f58c3685-7fa1-4f33-908b-a7916c5a11f9 tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 404 len: 111 microversion: 2.1 time: 0.057323 Nov 06 21:00:01.919411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2062/4091] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:01 2021] DELETE /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:00:01.928566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:01.929586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] [instance: 71bd8a14-1498-4584-a269-945f8ff7a845] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:01.936940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.938321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.940059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:01.940857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:01.957908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] HTTP exception thrown: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. Nov 06 21:00:01.958506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] Returning 404 to user: Instance 71bd8a14-1498-4584-a269-945f8ff7a845 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:01.959345 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e155779-aee7-4bc6-978a-1718fdd5934b tempest-TaggedBootDevicesTest_v242-541674125 tempest-TaggedBootDevicesTest_v242-541674125-project] 10.222.0.13 "GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845" status: 404 len: 111 microversion: 2.1 time: 0.035189 Nov 06 21:00:01.959900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2063/4092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:01 2021] GET /compute/v2.1/servers/71bd8a14-1498-4584-a269-945f8ff7a845 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:00:02.043967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:02.045644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:02.056485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.057527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.059590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.060564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.175620 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a767eec0-aaa1-4fd7-8f11-c19e5cb45e4c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 16402 microversion: 2.1 time: 0.141337 Nov 06 21:00:02.176196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:02.176465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2064/4093] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:02 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 16402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:02.186495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f50be9b7-2352-430f-a35f-b0b28c9bf912 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.631145 Nov 06 21:00:02.189043 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2030/4094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:01 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:02.259270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:02.260377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:02.267728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.268180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.269002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.269606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.507779 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-50d30310-9564-4a92-9263-1c4e0799d24b tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1691 microversion: 2.1 time: 0.253615 Nov 06 21:00:02.518975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2065/4095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:02 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:02.524243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:02.525777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:02.532220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.532926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.533922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:02.534681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:02.566981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lazy-loading 'flavor' on Instance uuid 7675136e-8794-496a-a186-3531f5aa4d0f {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:00:02.586470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 21:00:03.188235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:03.189329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:03.200207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.201108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:03.202461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.202904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:03.245522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4147b8df-ded2-44d5-ab45-584b227b2510 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 16402 microversion: 2.1 time: 0.061804 Nov 06 21:00:03.246957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2066/4096] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:03 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 16402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:03.255736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:03.257185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:03.264820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.265428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:03.272860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.273325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:03.528224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:03.537935 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04e3376d-3a10-4fd2-a85e-d91b5495767c tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.286665 Nov 06 21:00:03.538825 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2067/4097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:03 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:03.807937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/action" status: 202 len: 0 microversion: 2.1 time: 1.287559 Nov 06 21:00:03.817430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:03.818042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:03.820574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2031/4098] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:02 2021] POST /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/action => generated 0 bytes in 1301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:00:03.825060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.825420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:03.826198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:03.826626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.099710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:04.109183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e4bc93c-5bbf-499e-8f3d-252e8061c49b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.295429 Nov 06 21:00:04.119012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2068/4099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:03 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:04.245542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9c059f00-8758-479b-9773-a9fda0c2ac20 req-814da762-5cda-4def-bb62-186f6c7d0a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7eb544-4d31-45ec-ba05-8d471c4e6133", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfb038-ed68-40fa-ba80-c498ad9ecae0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:04.247324 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:04.247324 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:04.265748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:04.268280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9c059f00-8758-479b-9773-a9fda0c2ac20 req-814da762-5cda-4def-bb62-186f6c7d0a3b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:04.269532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:04.272617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9c059f00-8758-479b-9773-a9fda0c2ac20 req-814da762-5cda-4def-bb62-186f6c7d0a3b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.285536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9c059f00-8758-479b-9773-a9fda0c2ac20 req-814da762-5cda-4def-bb62-186f6c7d0a3b service nova] Creating event network-vif-plugged:b5dfb038-ed68-40fa-ba80-c498ad9ecae0 for instance 0e7eb544-4d31-45ec-ba05-8d471c4e6133 on nch2-master-1 Nov 06 21:00:04.288801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:04.289246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.290044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:04.290473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.297634 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9c059f00-8758-479b-9773-a9fda0c2ac20 req-814da762-5cda-4def-bb62-186f6c7d0a3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056229 Nov 06 21:00:04.298235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2032/4100] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:04.354771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-44eab37c-5c91-4ce0-8693-33a53b27c79c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.097260 Nov 06 21:00:04.360190 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2069/4101] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:04 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:04.557996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:04.558767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:04.566166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:04.566864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.568020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:04.568578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:04.942891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:04.950926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6b92a9c-6675-41e4-a51f-3fa318eec246 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.398015 Nov 06 21:00:04.951651 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2033/4102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:04 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:05.127440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:05.128482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:05.135775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.136458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:05.137508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.138100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:05.366395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:05.367455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:05.374468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.374913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:05.383942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:05.390894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.391350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:05.396889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-95bfff8b-d019-4e9b-b85f-c28db8dff565 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.273492 Nov 06 21:00:05.407254 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2070/4103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:05 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:05.443212 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5deac718-b853-4fdb-8fca-f4ac3886c67a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.079192 Nov 06 21:00:05.447639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2034/4104] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:05 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:05.968921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:05.969426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:05.975756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.976536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:05.977348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:05.977789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:06.381561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:06.390079 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c433195-9bee-4e06-89a7-4f5263005ea6 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1324 microversion: 2.1 time: 0.425502 Nov 06 21:00:06.390984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2071/4105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:05 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:06.415436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:06.417407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:06.425392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:06.426082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:06.427201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:06.427716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:06.457669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:06.459191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:06.469806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:06.470357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:06.471268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:06.471840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:06.515704 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8512509-fc7a-4763-832b-017c1a548ffb tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.063097 Nov 06 21:00:06.517433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2072/4106] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:06 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:06.734817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:06.751757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2bfdd4af-5ca6-401a-ad97-edf10d774ef4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.340760 Nov 06 21:00:06.752970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2035/4107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:06 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:07.409259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:07.410788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:07.421098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.422323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.423630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.424739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.531978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:07.534274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:07.548177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.550325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.551451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.552107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.619063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e20d83f2-4b48-4c01-8bdd-767cd521b709 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.092943 Nov 06 21:00:07.620448 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2036/4108] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:07.678014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:07.687945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8df79100-9f53-4141-9f10-02237940bd78 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1519 microversion: 2.1 time: 0.283707 Nov 06 21:00:07.689051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2073/4109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:07 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:07.750183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ece3cc6-e150-42f0-8886-19265ec573a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-98016963", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:07.751612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ece3cc6-e150-42f0-8886-19265ec573a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:07.752457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ece3cc6-e150-42f0-8886-19265ec573a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.006877 Nov 06 21:00:07.753468 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2037/4110] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers => generated 175 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:00:07.766351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edc6ad2a-64f0-453f-a335-20cd2eb1585f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:07.767062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edc6ad2a-64f0-453f-a335-20cd2eb1585f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: e18f38e6-873e-430f-bb39-da12e66afad6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:07.771258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:07.772043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:07.773377 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-edc6ad2a-64f0-453f-a335-20cd2eb1585f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] HTTP exception thrown: Instance e18f38e6-873e-430f-bb39-da12e66afad6 could not be found. Nov 06 21:00:07.774124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edc6ad2a-64f0-453f-a335-20cd2eb1585f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 404 to user: Instance e18f38e6-873e-430f-bb39-da12e66afad6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:07.775409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edc6ad2a-64f0-453f-a335-20cd2eb1585f tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/e18f38e6-873e-430f-bb39-da12e66afad6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.013601 Nov 06 21:00:07.785609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.785863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2074/4111] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:00:07 2021] GET /compute/v2.1/servers/e18f38e6-873e-430f-bb39-da12e66afad6/metadata => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:07.786549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.787482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:07.787935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:07.832276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15d66994-00c4-4cbd-87f4-c0e2f7591bec tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1654825006", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:07.834248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15d66994-00c4-4cbd-87f4-c0e2f7591bec tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:07.835299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15d66994-00c4-4cbd-87f4-c0e2f7591bec tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006840 Nov 06 21:00:07.837454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2075/4112] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers => generated 687 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 21:00:07.892414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b2ef97f-c71d-461a-ae15-09059e05c70e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1878825443", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:07.894065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b2ef97f-c71d-461a-ae15-09059e05c70e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:07.894931 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b2ef97f-c71d-461a-ae15-09059e05c70e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006461 Nov 06 21:00:07.895499 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2076/4113] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers => generated 689 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 21:00:07.945975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eeeef954-3181-49b6-b235-6bf8bb7ab7c1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-261081213", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:07.947559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eeeef954-3181-49b6-b235-6bf8bb7ab7c1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:07.948421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eeeef954-3181-49b6-b235-6bf8bb7ab7c1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006371 Nov 06 21:00:07.957690 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2077/4114] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Nov 06 21:00:07.966883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:07.975599 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-109a90b6-913a-4b00-b725-e8e25c945271 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.209464 Nov 06 21:00:07.976186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2038/4115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:07 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:07.999588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1509894d-a03a-49e5-b39c-8272f77c8552 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1353778330", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9864333c-2854-4b94-bfa9-88d2ed7bffd6"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:08.001893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1509894d-a03a-49e5-b39c-8272f77c8552 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:08.003065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1509894d-a03a-49e5-b39c-8272f77c8552 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.007905 Nov 06 21:00:08.003598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2078/4116] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Nov 6 21:00:07 2021] POST /compute/v2.1/servers => generated 2221 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 06 21:00:08.015346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-381bf94c-d37c-48a7-bad6-986011d9f40e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:08.015916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-381bf94c-d37c-48a7-bad6-986011d9f40e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 3d4766ce-d907-477d-9857-61b82df8d136] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:08.021698 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-381bf94c-d37c-48a7-bad6-986011d9f40e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] HTTP exception thrown: Instance 3d4766ce-d907-477d-9857-61b82df8d136 could not be found. Nov 06 21:00:08.022290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-381bf94c-d37c-48a7-bad6-986011d9f40e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 404 to user: Instance 3d4766ce-d907-477d-9857-61b82df8d136 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:08.023131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-381bf94c-d37c-48a7-bad6-986011d9f40e tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/3d4766ce-d907-477d-9857-61b82df8d136/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.012318 Nov 06 21:00:08.023690 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2039/4117] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Nov 6 21:00:08 2021] GET /compute/v2.1/servers/3d4766ce-d907-477d-9857-61b82df8d136/metadata/test2 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:08.038101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:08.038600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:08.045596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.046041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.046836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.047268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.075469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:00:08.188541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6659bca6-4d55-4c38-b9e5-315d67142b30 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 204 len: 0 microversion: 2.1 time: 0.154043 Nov 06 21:00:08.192352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2079/4118] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:08 2021] DELETE /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:00:08.197899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:08.198413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:08.214584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.215218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.216800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.217505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.440808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:08.449892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-122b3199-dd90-413e-a822-6d1c9a2c3390 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1525 microversion: 2.1 time: 0.256107 Nov 06 21:00:08.451067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2040/4119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:08 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:08.634674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:08.636396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:08.645214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.648692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.652997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.653452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.675376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0335f1ae-d45d-46d8-a82d-afc28c8c4b72 req-a956d37d-7aab-41a8-ac55-5427339b4b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7675136e-8794-496a-a186-3531f5aa4d0f", "name": "network-vif-unplugged", "status": "completed", "tag": "be7b680a-e8bb-4f73-a40c-30b3e1f27383"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:08.678497 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:08.678497 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:08.693529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0335f1ae-d45d-46d8-a82d-afc28c8c4b72 req-a956d37d-7aab-41a8-ac55-5427339b4b24 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:08.694263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0335f1ae-d45d-46d8-a82d-afc28c8c4b72 req-a956d37d-7aab-41a8-ac55-5427339b4b24 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:08.712638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0335f1ae-d45d-46d8-a82d-afc28c8c4b72 req-a956d37d-7aab-41a8-ac55-5427339b4b24 service nova] Creating event network-vif-unplugged:be7b680a-e8bb-4f73-a40c-30b3e1f27383 for instance 7675136e-8794-496a-a186-3531f5aa4d0f on nch2-master-1 Nov 06 21:00:08.719379 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0335f1ae-d45d-46d8-a82d-afc28c8c4b72 req-a956d37d-7aab-41a8-ac55-5427339b4b24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048608 Nov 06 21:00:08.720427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2041/4120] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:08.731808 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d41fc9f9-5ee1-4a32-aab6-19f8c167c6ab tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.104087 Nov 06 21:00:08.732493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2080/4121] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:08 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:08.993160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:08.994062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:09.000616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.001300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.002259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.002978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.307044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:09.319889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d606a171-90e7-4ebe-a943-6604d312d000 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.330614 Nov 06 21:00:09.332424 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2042/4122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:08 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:09.469044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:09.470078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:09.477691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.478538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.479634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.480348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.743412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:09.744683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:09.752403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.752877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.753942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:09.754375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:09.799980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:09.812744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ace2d574-2d90-4482-baaf-77e572204933 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1525 microversion: 2.1 time: 0.348731 Nov 06 21:00:09.813363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2081/4123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:09 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1525 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:09.827157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2c0750de-be71-443c-95c0-b06680310945 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.087688 Nov 06 21:00:09.830132 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2043/4124] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:09 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:10.338843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:10.339615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:10.351284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.351746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.352610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.353052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.507304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:10.516896 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72aab15f-da11-48d2-9bbb-39f7e5d4d03b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.182642 Nov 06 21:00:10.517491 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2082/4125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:10 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:10.757098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4bedda45-f5c7-49c0-ab25-2c57be2e36d7 req-a3fc05a3-3286-4b3d-a75c-e2d1e57250e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7675136e-8794-496a-a186-3531f5aa4d0f", "tag": "be7b680a-e8bb-4f73-a40c-30b3e1f27383"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:10.759214 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:10.759214 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:10.768878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4bedda45-f5c7-49c0-ab25-2c57be2e36d7 req-a3fc05a3-3286-4b3d-a75c-e2d1e57250e1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.769857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4bedda45-f5c7-49c0-ab25-2c57be2e36d7 req-a3fc05a3-3286-4b3d-a75c-e2d1e57250e1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.782601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4bedda45-f5c7-49c0-ab25-2c57be2e36d7 req-a3fc05a3-3286-4b3d-a75c-e2d1e57250e1 service nova] Creating event network-changed:be7b680a-e8bb-4f73-a40c-30b3e1f27383 for instance 7675136e-8794-496a-a186-3531f5aa4d0f on nch2-master-1 Nov 06 21:00:10.788743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4bedda45-f5c7-49c0-ab25-2c57be2e36d7 req-a3fc05a3-3286-4b3d-a75c-e2d1e57250e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035305 Nov 06 21:00:10.789936 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2044/4126] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:10.830937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:10.832197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:10.839501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.840510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.840651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:10.841633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:10.841870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.842488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.860565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.866881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.867801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:10.868504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:10.921829 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5386032b-8951-4deb-97f0-412cf670dfd7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.085519 Nov 06 21:00:10.922971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2045/4127] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:10 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:10.936602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb55cd5e080421ab9d992777399549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c71a91e0f3c434c899dc6d8aac735e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:10.947536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b1fa745-bc82-4498-b95b-7eec41f0ce63 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 200 len: 1483 microversion: 2.1 time: 0.121091 Nov 06 21:00:10.957524 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2083/4128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:10 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 1483 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:11.033755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d824c444-9a26-4f80-85dc-194474b7ee3e req-bb65ed9e-54f2-43d9-b4b9-324ade5affae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7eb544-4d31-45ec-ba05-8d471c4e6133", "name": "network-vif-deleted", "tag": "b5dfb038-ed68-40fa-ba80-c498ad9ecae0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:11.035795 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:11.035795 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:11.047876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d824c444-9a26-4f80-85dc-194474b7ee3e req-bb65ed9e-54f2-43d9-b4b9-324ade5affae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.048349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d824c444-9a26-4f80-85dc-194474b7ee3e req-bb65ed9e-54f2-43d9-b4b9-324ade5affae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.063417 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d824c444-9a26-4f80-85dc-194474b7ee3e req-bb65ed9e-54f2-43d9-b4b9-324ade5affae service nova] Creating event network-vif-deleted:b5dfb038-ed68-40fa-ba80-c498ad9ecae0 for instance 0e7eb544-4d31-45ec-ba05-8d471c4e6133 on nch2-master-1 Nov 06 21:00:11.071047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d824c444-9a26-4f80-85dc-194474b7ee3e req-bb65ed9e-54f2-43d9-b4b9-324ade5affae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043262 Nov 06 21:00:11.072021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2046/4129] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:11.539395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:11.540760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:11.550863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.551882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.553038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.554489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.852673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:11.862184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75055039-390c-420d-afa0-cfc9c0d05210 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.331000 Nov 06 21:00:11.872422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2084/4130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:11 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:11.934786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:11.936603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:11.943928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.944866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.945814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.946262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.966224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:11.967301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] [instance: 0e7eb544-4d31-45ec-ba05-8d471c4e6133] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:11.974053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.974832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.976087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:11.976912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:11.992705 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] HTTP exception thrown: Instance 0e7eb544-4d31-45ec-ba05-8d471c4e6133 could not be found. Nov 06 21:00:11.993652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] Returning 404 to user: Instance 0e7eb544-4d31-45ec-ba05-8d471c4e6133 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:11.994578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6dd23c45-1f6f-42b8-8a7a-d5771cc3e2a1 tempest-ServerMetadataNegativeTestJSON-1061861311 tempest-ServerMetadataNegativeTestJSON-1061861311-project] 10.222.0.13 "GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133" status: 404 len: 111 microversion: 2.1 time: 0.032911 Nov 06 21:00:11.995581 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2085/4131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:11 2021] GET /compute/v2.1/servers/0e7eb544-4d31-45ec-ba05-8d471c4e6133 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:12.014386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1976640-5a59-4bb2-b109-42b1e7868666 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.084168 Nov 06 21:00:12.019094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2047/4132] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:11 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:12.451953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1342330395", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "54622a1c-b032-44c2-86b4-69aae5ce053f"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:12.504673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] validate_networks() for [('54622a1c-b032-44c2-86b4-69aae5ce053f', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:12.856270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:12.856857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:12.857224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:12.857635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:12.858047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:12.874104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:12.874908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:12.875646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:12.876096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:12.886238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:12.887549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:12.894571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:12.895043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:12.895816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:12.896254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:12.897514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Getting quotas for project 1eda26ab6485409184fe8eba4e51cad6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:12.901685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Getting quotas for user c20811a983464fdba21701044f28d720 and project 1eda26ab6485409184fe8eba4e51cad6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:12.913574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Going to run 3 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:12.916088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:12.952892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=ae066647-0a6c-43ec-a209-5dcae549fabf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:12.991798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=31e2c1ee-028d-486e-b826-f8b25247e8e7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:13.053902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:13.066900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ac933c4-7495-484c-9087-b23861aaccab tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737938 Nov 06 21:00:13.068345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2086/4133] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:00:13.076018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1495412f-11da-4272-9487-97472534c450 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.194797 Nov 06 21:00:13.077445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:13.078833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:13.086324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2048/4134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:12 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:13.096696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:13.097001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:13.097886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:13.098865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:13.100535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:13.102582 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:13.102582 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:13.114907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:13.116703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:13.153736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f90ab977-396d-419a-b16d-287d024884de tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.083654 Nov 06 21:00:13.157432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2087/4135] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:13 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:13.159353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:13.159819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:13.160679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:13.161129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:13.182385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-362535e0-37ea-4d4f-8da0-52161c0594c3 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.094108 Nov 06 21:00:13.183643 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2049/4136] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:00:13 2021] GET /compute/v2.1/servers => generated 1018 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:13.196055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6ef3249-0a4f-4b74-b633-9d7f1613e7f7 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:13.196976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6ef3249-0a4f-4b74-b633-9d7f1613e7f7 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:13.285510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f6ef3249-0a4f-4b74-b633-9d7f1613e7f7 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:13.296444 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6ef3249-0a4f-4b74-b633-9d7f1613e7f7 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1223 microversion: 2.1 time: 0.105343 Nov 06 21:00:13.297192 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2088/4137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:13 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:14.095229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:14.096211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:14.110493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.111253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.112270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.112941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.165658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:14.167605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:14.179673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.180409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.185938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.186585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.246850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d86c0e1b-32fe-4fbf-924b-7c310f76225e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.080038 Nov 06 21:00:14.248330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2089/4138] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:14 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:14.314427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:14.315572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:14.325311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.326073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.327024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.327606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.675492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:14.686430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33cd328f-4c61-4ec7-a2ad-7d4295e1130e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1219 microversion: 2.1 time: 0.376436 Nov 06 21:00:14.697510 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2090/4139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:14 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1219 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:14.703628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:14.705038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:14.711950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.712518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.713572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:14.714956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:14.890405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:14.898151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be2c8bf9-2379-459d-b92f-a9b85cca1439 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.807344 Nov 06 21:00:14.898743 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2050/4140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:14 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:15.017839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Action: 'create', calling method: .version_select at 0x7f671abdfa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1026038616", "metadata": {"Type": "work"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:15.114083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:15.130740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0623bd9-6725-446b-80b0-ddb9921ee70e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.432184 Nov 06 21:00:15.131433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2091/4141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:14 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:15.151791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:15.153117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:15.161130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.161859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.163033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.163833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.500660 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.600838 Nov 06 21:00:15.507971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2051/4142] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Nov 6 21:00:14 2021] POST /compute/v2.1/os-volumes => generated 346 bytes in 608 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 06 21:00:15.513512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:15.514581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:15.537364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.538144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.539368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.540134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.552258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:15.566162 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd96bdf5-9e4e-473c-a19c-93bf35c7e965 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.418251 Nov 06 21:00:15.568195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2092/4143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:15 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:15.572978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea58df70-faa4-439f-9f3a-f56625fef300 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f671ad55ca0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:15.639908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea58df70-faa4-439f-9f3a-f56625fef300 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 200 len: 346 microversion: 2.1 time: 0.069247 Nov 06 21:00:15.640949 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2093/4144] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:00:15 2021] GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:15.671545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-381f8b0c-ee25-4a4f-9e74-ed2d7317c054 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.161902 Nov 06 21:00:15.672890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2052/4145] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:15 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:15.704016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:15.704986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:15.712709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.713166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.713955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.716213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.783357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-947966985", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "eb18f83c-d18b-4a29-9010-a6e673304a12"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:15.860386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] validate_networks() for [('eb18f83c-d18b-4a29-9010-a6e673304a12', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:15.869860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:15.885559 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a20e5ce-b5bd-4648-bc90-9031b77c5603 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1283 microversion: 2.1 time: 0.185345 Nov 06 21:00:15.887229 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2094/4146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:15 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:15.915512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:15.916338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:15.923599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.924058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:15.935437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:15.935973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.382396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:16.393672 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18d113e3-b36b-4242-994d-1db04eeb52f2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.482154 Nov 06 21:00:16.395080 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2095/4147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:15 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:16.654345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4e2915f-b305-4c60-903e-45c30854cc5f tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f6715066c10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:16.709714 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4e2915f-b305-4c60-903e-45c30854cc5f tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 200 len: 347 microversion: 2.1 time: 0.060878 Nov 06 21:00:16.710515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2096/4148] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:00:16 2021] GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 347 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:00:16.722928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:16.724102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:16.731913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.732500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.733547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.734438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.770880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:16.771898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:16.772605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:16.773220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:16.773793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:16.786530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.788766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cb81bd87-fe3d-4f4b-88bf-0f81533c4501 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.069397 Nov 06 21:00:16.789460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.793263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2097/4149] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:16 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:16.795773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.796529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.802387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2bb41b17-c62b-49a4-bbb9-16e56d072569 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f671ac58ee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:16.821275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:16.825658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:16.838365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:16.841480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:16.893139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-339d8b81-22c7-4c60-9bda-93363f5b3df7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116342 Nov 06 21:00:16.894468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2bb41b17-c62b-49a4-bbb9-16e56d072569 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 200 len: 347 microversion: 2.1 time: 0.099609 Nov 06 21:00:16.895612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2098/4150] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:00:16 2021] GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:16.896499 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2053/4151] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:00:16.908579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:16.909605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:16.912875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e86cc5e-214d-4e96-9c10-cce6893fd914 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:16.913831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e86cc5e-214d-4e96-9c10-cce6893fd914 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:16.917160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.918520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:16.919611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:16.920248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:17.030607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9e86cc5e-214d-4e96-9c10-cce6893fd914 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:17.031133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:17.038049 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e86cc5e-214d-4e96-9c10-cce6893fd914 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1214 microversion: 2.1 time: 0.129284 Nov 06 21:00:17.038898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2054/4152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:16 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:17.043838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba3c727c-03df-49ef-9824-940b57867bf8 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f67152f6040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:17.049276 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-28b87cd8-a9de-4edd-9657-80237478a751 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1281 microversion: 2.1 time: 0.147183 Nov 06 21:00:17.050617 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2099/4153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:16 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:17.112620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba3c727c-03df-49ef-9824-940b57867bf8 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 202 len: 0 microversion: 2.1 time: 0.072451 Nov 06 21:00:17.113590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2055/4154] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:00:17 2021] DELETE /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:00:17.122874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-affa47fd-6b2a-49b4-9079-576ae0ec845e tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f67151e8b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:17.184872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-affa47fd-6b2a-49b4-9079-576ae0ec845e tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 200 len: 346 microversion: 2.1 time: 0.066514 Nov 06 21:00:17.185451 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2100/4155] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:00:17 2021] GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:17.413041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:17.413841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:17.426843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:17.427630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:17.429498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:17.429951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:17.595324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:17.604116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2d6e1690-58da-4e85-87b0-c6f15ad6d4c9 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.196723 Nov 06 21:00:17.605080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2056/4156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:17 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:17.803794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:17.804735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:17.812888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:17.813760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:17.814910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:17.815437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:17.856794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b7a89ae-4245-4e33-bcf9-3d1e0eb4d64e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.057361 Nov 06 21:00:17.857433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2101/4157] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:17 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:18.055390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:18.056021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:18.069440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.069908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.070716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.071166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.075764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:18.076871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:18.102570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.103436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.113134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.113839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.171632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:18.179706 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70da9088-b4bc-4f3d-89ea-355a6e484578 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1274 microversion: 2.1 time: 0.128392 Nov 06 21:00:18.180323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2057/4158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:18 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:18.196781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30374b19-2638-4b45-a9e5-1a1db38f16b3 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Calling method '.version_select at 0x7f6714c14550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:18.229550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:18.248730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c69869a9-5372-4d8b-9870-03a7dee89e54 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1281 microversion: 2.1 time: 0.181063 Nov 06 21:00:18.250079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-30374b19-2638-4b45-a9e5-1a1db38f16b3 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] HTTP exception thrown: Volume 92099a35-b4f5-4cb9-9285-2333c72f94df could not be found. Nov 06 21:00:18.250259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30374b19-2638-4b45-a9e5-1a1db38f16b3 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] Returning 404 to user: Volume 92099a35-b4f5-4cb9-9285-2333c72f94df could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:18.251393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30374b19-2638-4b45-a9e5-1a1db38f16b3 tempest-VolumesGetTestJSON-235430414 tempest-VolumesGetTestJSON-235430414-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df" status: 404 len: 109 microversion: 2.1 time: 0.058332 Nov 06 21:00:18.252619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2058/4159] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:00:18 2021] GET /compute/v2.1/os-volumes/92099a35-b4f5-4cb9-9285-2333c72f94df => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:00:18.254076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2102/4160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:18 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1281 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:18.623034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:18.624227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:18.634040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.635215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.636895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.637620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.877412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:18.879069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:18.889621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.890382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.891575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:18.892224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:18.958638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc145411-3f21-42a4-b121-ba5819d0758f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.093836 Nov 06 21:00:18.962439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2103/4161] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:18 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:19.113903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:19.125355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60cb4076-042b-49e5-bb2c-91816e1e83b6 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1550 microversion: 2.1 time: 0.506887 Nov 06 21:00:19.126020 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2059/4162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:18 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1550 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:19.198370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:19.199664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:19.231166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.231745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.232899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.233389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.272947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:19.274686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:19.289889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.290842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.292183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.293048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.667631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:19.677900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92f8aa94-4609-4523-9aeb-1d82bab716de tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1272 microversion: 2.1 time: 0.484996 Nov 06 21:00:19.678678 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2104/4163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:19 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:19.860591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-31405b23-2df6-415b-acdf-cbd8e25e32fc req-7564f43b-8968-4b87-8f70-26514b87d758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae066647-0a6c-43ec-a209-5dcae549fabf", "tag": "2e0c8684-c658-4d36-99ae-c0dff5a0b3ae"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:19.862972 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:19.862972 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:19.873945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31405b23-2df6-415b-acdf-cbd8e25e32fc req-7564f43b-8968-4b87-8f70-26514b87d758 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.874631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31405b23-2df6-415b-acdf-cbd8e25e32fc req-7564f43b-8968-4b87-8f70-26514b87d758 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.894102 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-31405b23-2df6-415b-acdf-cbd8e25e32fc req-7564f43b-8968-4b87-8f70-26514b87d758 service nova] Creating event network-changed:2e0c8684-c658-4d36-99ae-c0dff5a0b3ae for instance ae066647-0a6c-43ec-a209-5dcae549fabf on nch2-master-1 Nov 06 21:00:19.900424 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-31405b23-2df6-415b-acdf-cbd8e25e32fc req-7564f43b-8968-4b87-8f70-26514b87d758 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044119 Nov 06 21:00:19.901158 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2105/4164] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:19.972972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:19.974346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:19.983980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.987816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:19.988740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:19.989196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.013889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:20.034963 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49c0c9e3-7bb0-4d80-b28f-db6c374451d5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.765961 Nov 06 21:00:20.037800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2060/4165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:19 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:20.084645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f03c93dd-3459-4ae3-88dd-ec1465b2f093 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.115941 Nov 06 21:00:20.090526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2106/4166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:19 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:20.143239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:20.143859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:20.160470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.163519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.164533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.168782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.461143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-df3e5256-3cb9-485e-9211-e616ec13cf10 req-104b5fa3-8d97-4162-bf88-c1ce89e6a795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e2c1ee-028d-486e-b826-f8b25247e8e7", "tag": "22e9e98b-1283-4123-bc56-db5286235acf"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:20.474501 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:20.474501 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:20.487519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df3e5256-3cb9-485e-9211-e616ec13cf10 req-104b5fa3-8d97-4162-bf88-c1ce89e6a795 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.488346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df3e5256-3cb9-485e-9211-e616ec13cf10 req-104b5fa3-8d97-4162-bf88-c1ce89e6a795 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.510633 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-df3e5256-3cb9-485e-9211-e616ec13cf10 req-104b5fa3-8d97-4162-bf88-c1ce89e6a795 service nova] Creating event network-changed:22e9e98b-1283-4123-bc56-db5286235acf for instance 31e2c1ee-028d-486e-b826-f8b25247e8e7 on nch2-master-1 Nov 06 21:00:20.539227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-df3e5256-3cb9-485e-9211-e616ec13cf10 req-104b5fa3-8d97-4162-bf88-c1ce89e6a795 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087057 Nov 06 21:00:20.545106 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2107/4167] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:00:20.571487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:20.581059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59dd549e-35e8-429c-8276-a2f66bb7f234 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1540 microversion: 2.1 time: 0.442442 Nov 06 21:00:20.586321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2061/4168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:20 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1540 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:20.605955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-98d4e31a-9e7f-4cd2-b619-f73cdf4ef492 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '.version_select at 0x7f671ac88b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:20.608666 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:20.608666 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:20.610761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98d4e31a-9e7f-4cd2-b619-f73cdf4ef492 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.611431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98d4e31a-9e7f-4cd2-b619-f73cdf4ef492 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.625968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-98d4e31a-9e7f-4cd2-b619-f73cdf4ef492 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.026228 Nov 06 21:00:20.632253 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2108/4169] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 21:00:20 2021] GET /compute/v2.1/os-migrations => generated 1168 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:20.640536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:20.642029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:20.650732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.651551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.653493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.654158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.695384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:20.696544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:20.707284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.708737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:20.709972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:20.710635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.058488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:21.068856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f2ac718-273f-4ab9-ba73-c71166d7c445 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.377644 Nov 06 21:00:21.070846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-854879c0-00c7-4dad-90cc-457277d785e9 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1691 microversion: 2.1 time: 0.434783 Nov 06 21:00:21.071655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2062/4170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:20 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1691 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:21.080186 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2109/4171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:20 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:21.094495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:21.096745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:21.097465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:21.098043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:21.105494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.106245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.107187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.107804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.125825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.126295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.127087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.127524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.486601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:21.500137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c40c6ab-cf31-4174-9ba7-f40f917de4b2 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.427074 Nov 06 21:00:21.500757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2063/4172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:21 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:21.501617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7cd2afe-4c4f-4213-b4a6-124b7f48346f tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1691 microversion: 2.1 time: 0.409439 Nov 06 21:00:21.505746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2110/4173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:21 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:21.507900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:21.509156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:21.516039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.517181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.518001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.518438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.570758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8c70096-b157-4e66-a668-92a5dd6f029c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.067567 Nov 06 21:00:21.573056 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2064/4174] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:21 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:21.606636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:21.607530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:21.613461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.614133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.614933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.615372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.719438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lazy-loading 'services' on Instance uuid 7675136e-8794-496a-a186-3531f5aa4d0f {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:00:21.819561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5175a029-bfdb-4bac-9232-e2a0de08d7bc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments/52646cb2-a717-4fe2-97f2-d75adef114f7" status: 202 len: 0 microversion: 2.1 time: 0.218832 Nov 06 21:00:21.820399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2111/4175] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:00:21 2021] DELETE /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments/52646cb2-a717-4fe2-97f2-d75adef114f7 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:00:21.833546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:21.840347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:21.852027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.853084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.854423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:21.855907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:21.907009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-004dade4-0667-4983-b916-307d1373cdaf tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080171 Nov 06 21:00:21.910666 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2065/4176] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:00:21 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:22.086238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:22.086820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:22.097841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.098560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.099527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.100197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.258232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:22.267001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e17f6ef5-fdbf-4b3a-8afa-2717fc596c00 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.184850 Nov 06 21:00:22.267817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2112/4177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:22 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:22.517193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:22.517812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:22.525071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.525774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.526634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.527731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.583192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:22.584602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:22.606411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.607284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.609099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.609775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.711378 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3fe8183-137f-47fa-937e-270f3b359206 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.132265 Nov 06 21:00:22.712687 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2113/4178] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:22 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:22.719017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-825fb56e-eb5a-4308-a318-56a9520746c4 req-bacae0fb-4754-41f5-9a6b-876ad9269a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8bcc56-9d6c-48c2-8709-785644d54d5d", "tag": "458a3855-57ff-483c-8950-b8fe5b516d3a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:22.722717 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:22.722717 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:22.732107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-825fb56e-eb5a-4308-a318-56a9520746c4 req-bacae0fb-4754-41f5-9a6b-876ad9269a11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.732544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-825fb56e-eb5a-4308-a318-56a9520746c4 req-bacae0fb-4754-41f5-9a6b-876ad9269a11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.746070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-825fb56e-eb5a-4308-a318-56a9520746c4 req-bacae0fb-4754-41f5-9a6b-876ad9269a11 service nova] Creating event network-changed:458a3855-57ff-483c-8950-b8fe5b516d3a for instance ad8bcc56-9d6c-48c2-8709-785644d54d5d on nch2-master-1 Nov 06 21:00:22.751858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-825fb56e-eb5a-4308-a318-56a9520746c4 req-bacae0fb-4754-41f5-9a6b-876ad9269a11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037770 Nov 06 21:00:22.753272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2114/4179] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:22.779724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:22.797313 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-389fc519-b4c4-40a0-96f6-91cf64907f85 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.283708 Nov 06 21:00:22.805229 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2066/4180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:22 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:22.921083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:22.922571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:22.929969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.930433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.931466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:22.931768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:22.965960 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e0e0380-68e2-406c-8c88-b0ef15ed9d22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050989 Nov 06 21:00:22.966789 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2115/4181] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:00:22 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:00:23.286072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:23.286868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:23.296490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.297162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.298581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.299193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.495681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:23.506255 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5eef3b49-862b-4f34-9abb-b62375cd051e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.226268 Nov 06 21:00:23.507970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2067/4182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:23 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:23.722567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:23.723489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:23.742373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.744116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.746748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.747978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.817383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:23.818006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:23.833094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.833604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.834407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:23.834847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:23.892522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a366ad46-2fb7-41c0-a868-3d1640718600 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.169078 Nov 06 21:00:23.893848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2116/4183] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:23 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:24.060159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:24.068497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed6fe3fd-348d-46a1-a46d-5d776266c11f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.255603 Nov 06 21:00:24.069254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2068/4184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:23 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:24.528646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:24.529692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:24.542396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:24.543453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:24.544786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:24.545950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:24.773845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:24.787892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1033a269-f488-4643-955f-ad4e1b1de327 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.267883 Nov 06 21:00:24.789082 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2117/4185] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:24 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:24.846737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f5763278-6efd-4422-a3de-8cd2e860513c req-ad88da6b-32ea-409b-b709-8d71d01702a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8589798a-c8b2-4307-aaac-b428310a5dbe", "tag": "699de106-65ec-469c-a13b-e1b51555cb83"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:24.848274 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:24.848274 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:24.858730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f5763278-6efd-4422-a3de-8cd2e860513c req-ad88da6b-32ea-409b-b709-8d71d01702a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:24.859513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f5763278-6efd-4422-a3de-8cd2e860513c req-ad88da6b-32ea-409b-b709-8d71d01702a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:24.890486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f5763278-6efd-4422-a3de-8cd2e860513c req-ad88da6b-32ea-409b-b709-8d71d01702a8 service nova] Creating event network-changed:699de106-65ec-469c-a13b-e1b51555cb83 for instance 8589798a-c8b2-4307-aaac-b428310a5dbe on nch2-master-1 Nov 06 21:00:24.905029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:24.905953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:24.912310 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f5763278-6efd-4422-a3de-8cd2e860513c req-ad88da6b-32ea-409b-b709-8d71d01702a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055667 Nov 06 21:00:24.918116 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2069/4186] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:24.924103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:24.925702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:24.927847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:24.929409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:25.003451 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a66c989-fc46-428c-99bf-ce9c43426d65 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.100931 Nov 06 21:00:25.007571 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2118/4187] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:24 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:25.085996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:25.087040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:25.094869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:25.095335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:25.096135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:25.096624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:25.258396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:25.270010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3feb053f-0b0f-41ad-abdb-5a079e092596 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.188128 Nov 06 21:00:25.271159 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2070/4188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:25 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:25.779339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-277881599", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a0d87934-0232-4205-a7f7-5ad3a2322d26"}], "block_device_mapping_v2": [{"uuid": "01801acc-999e-4e59-ba88-ced3b1ed63c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:25.812502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:25.815030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:25.835732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:25.839224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:25.840610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:25.841615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:25.880541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] validate_networks() for [('a0d87934-0232-4205-a7f7-5ad3a2322d26', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:26.180799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:26.190490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cca863b6-c52b-4cb1-a890-ff1835bb2acb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.387701 Nov 06 21:00:26.201122 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2071/4189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:25 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:26.210692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:26.212455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:26.225497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.226307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.229411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.230868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.323568 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-974449f5-3d09-479e-a9a0-691672fc2f8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.119740 Nov 06 21:00:26.324246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2072/4190] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:26 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:26.329362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:26.334742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:26.347569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.360345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.361505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.364229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.609082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:26.610192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:26.611157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:26.612034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:26.612667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:26.635419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.636871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.638135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.639224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.665118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:26.665599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:26.671682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Getting quotas for user 0cbe3496db994852a09c97ee075fbd4a and project a80ec8702cd94e0eaefdf3eb907a0cff. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:26.678690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4a31cbe-04fb-45fc-823c-f3b2e77c7505 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.352938 Nov 06 21:00:26.680129 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2073/4191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:26 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:26.692119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-44155d1d-707b-46ef-ad9e-43d40f9d82e2 req-4677f990-dfc3-49f8-9419-70c11013b963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae066647-0a6c-43ec-a209-5dcae549fabf", "name": "network-vif-plugged", "status": "completed", "tag": "2e0c8684-c658-4d36-99ae-c0dff5a0b3ae"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:26.695594 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:26.695594 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:26.710972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44155d1d-707b-46ef-ad9e-43d40f9d82e2 req-4677f990-dfc3-49f8-9419-70c11013b963 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:26.714806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44155d1d-707b-46ef-ad9e-43d40f9d82e2 req-4677f990-dfc3-49f8-9419-70c11013b963 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:26.747893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-44155d1d-707b-46ef-ad9e-43d40f9d82e2 req-4677f990-dfc3-49f8-9419-70c11013b963 service nova] Creating event network-vif-plugged:2e0c8684-c658-4d36-99ae-c0dff5a0b3ae for instance ae066647-0a6c-43ec-a209-5dcae549fabf on nch2-master-1 Nov 06 21:00:26.762532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-44155d1d-707b-46ef-ad9e-43d40f9d82e2 req-4677f990-dfc3-49f8-9419-70c11013b963 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079763 Nov 06 21:00:26.770102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2074/4192] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:26.817014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:26.819529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01801acc-999e-4e59-ba88-ced3b1ed63c5',volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:27.022900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247565 Nov 06 21:00:27.024026 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2119/4193] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:00:27.036038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c8789e1-a3ab-437c-ae40-47ccdbd95f02 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:27.037060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c8789e1-a3ab-437c-ae40-47ccdbd95f02 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:27.105420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0c8789e1-a3ab-437c-ae40-47ccdbd95f02 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:27.114555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c8789e1-a3ab-437c-ae40-47ccdbd95f02 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1052 microversion: 2.1 time: 0.083282 Nov 06 21:00:27.125815 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2075/4194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:27 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1052 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:27.207172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:27.207905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:27.221360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.221991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.223222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.224318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.336353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:27.337928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:27.351085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.353086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.356841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.357441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.420525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:27.428055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd7b31d3-7211-4e75-8e40-fc8071338905 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.224500 Nov 06 21:00:27.428691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2120/4195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:27 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:27.497026 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6eb6c86d-479d-4791-8c6f-541735709017 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.165573 Nov 06 21:00:27.497873 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2076/4196] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:27 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:27.695946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:27.696611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:27.708097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.708694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.709604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:27.710139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:27.866008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:27.876169 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9c757db-342c-46ff-aa45-dbc4541d8545 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.183849 Nov 06 21:00:27.878847 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2121/4197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:27 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:28.133270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:28.133990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:28.141963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.142417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.143215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.143656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.219224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:28.227968 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83597b61-657d-420a-8419-17b1db7825a5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1150 microversion: 2.1 time: 0.098533 Nov 06 21:00:28.229130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2077/4198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:28 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:28.446189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:28.446811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:28.457298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.457783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.458618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.459066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.509620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:28.510565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:28.530504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.530974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.531790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.532234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.599566 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5177eab4-7eca-404b-9a72-da85ab27490c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.093519 Nov 06 21:00:28.605389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2078/4199] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:28 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:28.717786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:28.733881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65dbf3fd-5a53-441d-8bae-23ba2f3208bb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.291575 Nov 06 21:00:28.735130 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2122/4200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:28 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:28.895919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:28.897019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:28.906282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.907233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:28.908288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:28.909268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.193530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:29.201908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b61f79b-54d8-4d86-8430-d70dd098ce33 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.310667 Nov 06 21:00:29.202484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2079/4201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:28 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:29.246883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:29.247534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:29.262790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.263253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.264063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.264538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.392869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:29.403000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4317698e-4bde-4fb7-9199-7fd5e33f3dc0 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1168 microversion: 2.1 time: 0.160815 Nov 06 21:00:29.404003 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2123/4202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:29 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:29.612909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:29.613936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:29.621471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.622015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.622887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.623400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.680721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56694d75-35bb-417b-993b-98feedff26a9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.071219 Nov 06 21:00:29.682156 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2080/4203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:29 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:29.751378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:29.751948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:29.757909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.758376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:29.759340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:29.759994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.003254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:30.003802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.013493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.019118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.020084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.023595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.083054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a2235ea-2e73-4460-8017-208b63cedb26 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments/009aa4f5-f40b-4281-b200-5544181221dc" status: 200 len: 194 microversion: 2.20 time: 0.083164 Nov 06 21:00:30.084835 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2081/4204] 10.222.0.13 () {60 vars in 1453 bytes} [Sat Nov 6 21:00:29 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments/009aa4f5-f40b-4281-b200-5544181221dc => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:30.165958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:30.167154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.174487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.175441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.176817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.177402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.220836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:30.232645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0d19626-80b1-41b2-91f6-82312dfa3674 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.484576 Nov 06 21:00:30.241092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2124/4205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:29 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:30.250951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:30.252882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.261999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.262714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.263885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.264919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.353820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lazy-loading 'services' on Instance uuid e9e2a717-8f31-430c-b427-215e5fa49de6 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:00:30.490060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments/009aa4f5-f40b-4281-b200-5544181221dc" status: 202 len: 0 microversion: 2.20 time: 0.329727 Nov 06 21:00:30.496550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2082/4206] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Nov 6 21:00:30 2021] DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments/009aa4f5-f40b-4281-b200-5544181221dc => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:00:30.513892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:30.515043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.531790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.532615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.533505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.536467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.669149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:30.681621 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c68e6618-a754-4684-916e-039ad7d8de4d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.437603 Nov 06 21:00:30.683440 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2125/4207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:30 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:30.692909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:30.694492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.707532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.708863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.709880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.710997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.759573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2000a1b1-e597-45fa-ae2e-25522b963883 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074744 Nov 06 21:00:30.761810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2126/4208] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 21:00:30 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:30.773642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f36835cc-e796-4680-95ea-c2ff5be4d9fb req-d013677c-ed11-4deb-9a48-2ee3ef06043c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8bcc56-9d6c-48c2-8709-785644d54d5d", "name": "network-vif-plugged", "status": "completed", "tag": "458a3855-57ff-483c-8950-b8fe5b516d3a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:30.776880 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:30.776880 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:30.796522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f36835cc-e796-4680-95ea-c2ff5be4d9fb req-d013677c-ed11-4deb-9a48-2ee3ef06043c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.799040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f36835cc-e796-4680-95ea-c2ff5be4d9fb req-d013677c-ed11-4deb-9a48-2ee3ef06043c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.816585 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f36835cc-e796-4680-95ea-c2ff5be4d9fb req-d013677c-ed11-4deb-9a48-2ee3ef06043c service nova] Creating event network-vif-plugged:458a3855-57ff-483c-8950-b8fe5b516d3a for instance ad8bcc56-9d6c-48c2-8709-785644d54d5d on nch2-master-1 Nov 06 21:00:30.822300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f36835cc-e796-4680-95ea-c2ff5be4d9fb req-d013677c-ed11-4deb-9a48-2ee3ef06043c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058789 Nov 06 21:00:30.824489 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2127/4209] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:30.832119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:30.833796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:30.841391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.842229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.843513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:30.844186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:30.918720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec7188b3-a006-4dff-b1eb-6075a33ee160 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.091411 Nov 06 21:00:30.920355 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2128/4210] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:30 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:31.145641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1b4db224-7296-40fa-9bad-12a14ac7ec77 req-7ecdee50-7b0a-447b-ac30-69661a1d823f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32dbf411-6b5d-4b0e-9075-cac0fce0c1ff", "tag": "11cecbe1-ab5d-441c-8e32-561b6889099e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:31.147505 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:31.147505 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:31.164986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b4db224-7296-40fa-9bad-12a14ac7ec77 req-7ecdee50-7b0a-447b-ac30-69661a1d823f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.170029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b4db224-7296-40fa-9bad-12a14ac7ec77 req-7ecdee50-7b0a-447b-ac30-69661a1d823f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.190556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1b4db224-7296-40fa-9bad-12a14ac7ec77 req-7ecdee50-7b0a-447b-ac30-69661a1d823f service nova] Creating event network-changed:11cecbe1-ab5d-441c-8e32-561b6889099e for instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff on nch2-master-1 Nov 06 21:00:31.196903 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1b4db224-7296-40fa-9bad-12a14ac7ec77 req-7ecdee50-7b0a-447b-ac30-69661a1d823f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055572 Nov 06 21:00:31.197580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2129/4211] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:00:31.255028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:31.256328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:31.265232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.265937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.267351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.268605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.319455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:31.329204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49eb2316-9acc-4b3c-b541-8fdaa118498e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.831171 Nov 06 21:00:31.330209 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2083/4212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:30 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:31.466238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:31.479681 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1801585-416e-43c0-8814-3b06a1ef7432 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.232164 Nov 06 21:00:31.480880 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2130/4213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:31 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:31.701315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:31.702643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:31.713383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.714449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.715957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.716735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.773110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:31.776924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:31.781750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.782739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.789256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.789738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.825739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a9f50a4-2a91-4343-8705-8c604a7960a6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056296 Nov 06 21:00:31.826303 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2131/4214] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 21:00:31 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:31.897819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:31.898678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:31.906843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.907586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.908685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:31.909794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:31.947357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:00:31.980700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:31.991596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36ffca70-89e5-44f9-af61-981001af4f31 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1323 microversion: 2.1 time: 0.296143 Nov 06 21:00:32.001340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2084/4215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:31 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:32.001340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:32.002385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:32.019037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.019540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.020779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.021474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.077813 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-640d805b-c7db-49ef-bcfc-15f1633700a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.082648 Nov 06 21:00:32.078845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2085/4216] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:31 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:32.084802 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5b7aa1de-2747-4de0-a80b-2f94d5328b75 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 204 len: 0 microversion: 2.20 time: 0.191259 Nov 06 21:00:32.088558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2132/4217] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 21:00:31 2021] DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:00:32.100560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:32.101271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:32.108975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.109426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.110255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.110927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.350668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:32.352001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:32.360400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.361197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.362481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.363032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.421281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:32.431359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:32.433749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:32.436884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c58d75c-b383-46f9-9a81-0a4774ffbbd2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.342502 Nov 06 21:00:32.436884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2086/4218] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:32 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:32.497052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:32.498194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:32.508724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.509097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.509918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.523899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.664126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:32.672114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d73a2329-8f6d-43ac-b71d-750bbe1c2c22 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.326981 Nov 06 21:00:32.680744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2133/4219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:32 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:32.832089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:32.843653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01076f44-2b3a-4b7d-964d-55c6d7df01ee tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.350004 Nov 06 21:00:32.844696 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2087/4220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:32 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:32.858569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e2c1ee-028d-486e-b826-f8b25247e8e7", "name": "network-vif-plugged", "status": "completed", "tag": "22e9e98b-1283-4123-bc56-db5286235acf"}, {"server_uuid": "8589798a-c8b2-4307-aaac-b428310a5dbe", "name": "network-vif-plugged", "status": "completed", "tag": "699de106-65ec-469c-a13b-e1b51555cb83"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:32.860685 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:32.860685 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:32.868768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:32.869218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:32.883737 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] Creating event network-vif-plugged:22e9e98b-1283-4123-bc56-db5286235acf for instance 31e2c1ee-028d-486e-b826-f8b25247e8e7 on nch2-master-1 Nov 06 21:00:32.884799 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] Creating event network-vif-plugged:699de106-65ec-469c-a13b-e1b51555cb83 for instance 8589798a-c8b2-4307-aaac-b428310a5dbe on nch2-master-1 Nov 06 21:00:32.891371 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-31b9a0b0-0b46-4876-93a0-4c54b55f5076 req-7e49f249-a61d-4802-befe-b4db00cf7799 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047462 Nov 06 21:00:32.892152 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2134/4221] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 06 21:00:33.008454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:33.009089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.018219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.018679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.019480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.019919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.091167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:33.092362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.101712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.102181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.111176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.111637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.165838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63de6d0c-1a79-4ebf-b4b7-eb9f45977f5c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.078864 Nov 06 21:00:33.171059 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2135/4222] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:33 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:33.265477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:33.273851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ab0536c-5d01-4661-ab1e-d544312e7507 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 200 len: 1517 microversion: 2.1 time: 0.268464 Nov 06 21:00:33.273851 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2088/4223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:33 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:33.290912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:33.291661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.299682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.300143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.301059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.301490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.456160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:33.457383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.466329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.467015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.468434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.469450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.580486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:33.588340 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f965f6eb-7390-4fbf-801f-b4bb834a8337 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1323 microversion: 2.1 time: 0.301476 Nov 06 21:00:33.589860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2136/4224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:33 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:33.694288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:33.694973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.708844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.710533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.711921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.715155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.739032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:33.747349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:33.749631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:33.751066 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60807777-f95d-45d1-b607-9b2cf2560481 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.300675 Nov 06 21:00:33.773062 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2089/4225] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:33 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:33.884869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:33.888066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:33.897776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.898218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:33.899106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:33.899623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.036541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:34.047759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a94ab7c-940a-480d-b3a6-65d0ad954f05 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.361250 Nov 06 21:00:34.048608 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2137/4226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:33 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:34.177098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:34.185139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abba3d43-44c3-48a3-81ce-ac966f21a5ab tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.328061 Nov 06 21:00:34.185730 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2090/4227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:33 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:34.185847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:34.193924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:34.201484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.201976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.202799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.203800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.268981 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83a1e901-1a60-4f98-b4e9-a220c2f2144b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.093779 Nov 06 21:00:34.275516 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2138/4228] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:34 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:34.606769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:34.607383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:34.614610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.615061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.616012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.616480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.772185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:34.775388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:34.776369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:34.786467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.789752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.791043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:34.791490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:34.794253 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55e4039e-afe7-4c80-ac90-0fc26bce62bd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1323 microversion: 2.1 time: 0.191119 Nov 06 21:00:34.800762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2091/4229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:34 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:35.004336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:35.014881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:35.017693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:35.019738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebaa56f3-888f-4947-99ff-4d3c37687a81 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.252480 Nov 06 21:00:35.020854 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2139/4230] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:34 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:35.066491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:35.067114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:35.075913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.076405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.078095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.078594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.202496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:35.204451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:35.215727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.217185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.218583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.219300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.323984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:35.331978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f6a3434-694d-4c34-9c42-c4a6771a779b tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.269140 Nov 06 21:00:35.335225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2092/4231] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:35 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:35.349453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:35.352419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:35.367197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.367910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.368928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.369473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.470801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de74678e-4abd-4c77-86b8-15f1b219a4e6 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.134054 Nov 06 21:00:35.471694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2093/4232] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:35 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:35.570989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:35.579582 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e17f0c38-381d-49b2-9ef3-5f923bd93e6c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1314 microversion: 2.1 time: 0.381550 Nov 06 21:00:35.587265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2140/4233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:35 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:35.822846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:35.824599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:35.832872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.833339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:35.834714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:35.835165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.033251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.038250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.039459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.045473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08bc4a77-6f43-4545-8435-613d22c25588 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1516 microversion: 2.1 time: 0.231817 Nov 06 21:00:36.046637 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2094/4234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:35 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:36.053602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.054255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.055847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.056480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.064539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.065166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.079865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.080715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.081939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.083162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.417209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.422900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.433154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25ba3ed4-05a0-4a39-b889-5b3bd8492430 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 200 len: 1517 microversion: 2.1 time: 0.371825 Nov 06 21:00:36.438202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2095/4235] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:36 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:36.442905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.443674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.446148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.451538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.452247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.453417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.454014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.456641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.463814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84af5d66-d288-4839-8650-7bce1b9e59f2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1721 microversion: 2.20 time: 0.428524 Nov 06 21:00:36.464451 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2141/4236] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:36 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1721 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:36.477551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.478063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.506759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.507372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.511785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.527154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.608475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:00:36.711885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:36.725261 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10cb2981-c24e-4449-accd-5ee449ac223e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.285759 Nov 06 21:00:36.725847 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2096/4237] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:36 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:36.740162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:36.742471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.755871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.756860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.757878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.758668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.793296 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e71d12a-f078-4d9c-87ca-fc856593b4cd tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 204 len: 0 microversion: 2.1 time: 0.327213 Nov 06 21:00:36.799500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2142/4238] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:36 2021] DELETE /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:00:36.811660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.812433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.823774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.824524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.824786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4757a24c-df3e-48b9-b64a-217a1496041b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.088038 Nov 06 21:00:36.825891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2097/4239] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:36 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:36.826273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.832177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:36.833106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:36.834516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.841509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.844322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:36.845342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:36.846518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.020504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:37.029230 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84634a7b-ff25-41c8-b81f-f434507e244b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1500 microversion: 2.1 time: 0.228333 Nov 06 21:00:37.029960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2143/4240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:36 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:37.046415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:37.047059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:37.062526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.062979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.063781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.064216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.313311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.network.security_group_api [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Removing security group cb292ac7-6010-45bf-b49c-4b8db3843a2c from port 699de106-65ec-469c-a13b-e1b51555cb83 Nov 06 21:00:37.326989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:37.338415 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51026fe5-a76b-4f33-8b92-b0e1ccb19b25 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 200 len: 1523 microversion: 2.1 time: 0.511243 Nov 06 21:00:37.353778 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2098/4241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:36 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:37.482093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:37.482807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:37.497304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.499628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.500630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.501171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.610358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:37.622317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:37.626901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:37.628144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec048a04-befc-473d-a717-6951fa4d139a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 200 len: 1654 microversion: 2.20 time: 0.149959 Nov 06 21:00:37.631278 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2099/4242] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:37 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:37.744671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:37.745759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:37.754153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.754611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.755557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.755998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.842329 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-790ef787-4e6a-4145-8cf7-d43a2b8cbfba tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe/action" status: 202 len: 0 microversion: 2.1 time: 0.799918 Nov 06 21:00:37.846160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2144/4243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:37 2021] POST /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:00:37.852753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:37.864890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:37.893476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.910007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:37.913787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:37.926674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.119669 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2860f79e-104c-4e97-96af-7539d493adf2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.270104 Nov 06 21:00:38.121752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2145/4244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:37 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:38.143441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.145866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:38.156861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.170408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.172256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.173351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.295648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:38.304377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85b6c9e5-5d09-4218-8025-d88562cc97af tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.565211 Nov 06 21:00:38.309785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2100/4245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:37 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:38.323986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b6449a8e-4f87-4289-acf6-036fc757a7b1 req-257b704b-2c5b-4fa6-8324-c69edcab33bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e2a717-8f31-430c-b427-215e5fa49de6", "name": "network-vif-deleted", "tag": "c861c6e0-04b1-4dec-a9f0-fbefa2f9e540"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:38.329099 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:38.329099 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:38.352152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b6449a8e-4f87-4289-acf6-036fc757a7b1 req-257b704b-2c5b-4fa6-8324-c69edcab33bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.354752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b6449a8e-4f87-4289-acf6-036fc757a7b1 req-257b704b-2c5b-4fa6-8324-c69edcab33bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.382982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:38.385109 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b6449a8e-4f87-4289-acf6-036fc757a7b1 req-257b704b-2c5b-4fa6-8324-c69edcab33bf service nova] Creating event network-vif-deleted:c861c6e0-04b1-4dec-a9f0-fbefa2f9e540 for instance e9e2a717-8f31-430c-b427-215e5fa49de6 on nch2-master-1 Nov 06 21:00:38.394068 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b6449a8e-4f87-4289-acf6-036fc757a7b1 req-257b704b-2c5b-4fa6-8324-c69edcab33bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082305 Nov 06 21:00:38.395769 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2101/4246] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:38.403078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-15941936-bf19-496e-9aa9-97cb85178703 req-4b260e25-20c4-46aa-b6bb-69cc09077b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8589798a-c8b2-4307-aaac-b428310a5dbe", "tag": "699de106-65ec-469c-a13b-e1b51555cb83"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:38.403308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bd06132-e5a9-4429-9826-62d6e08962b4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1458 microversion: 2.1 time: 0.276114 Nov 06 21:00:38.405258 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:38.405258 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:38.407328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2146/4247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:38 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1458 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:38.421650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.422473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:38.426334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15941936-bf19-496e-9aa9-97cb85178703 req-4b260e25-20c4-46aa-b6bb-69cc09077b05 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.432043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15941936-bf19-496e-9aa9-97cb85178703 req-4b260e25-20c4-46aa-b6bb-69cc09077b05 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.434055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.438583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.439473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.439915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.463022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-15941936-bf19-496e-9aa9-97cb85178703 req-4b260e25-20c4-46aa-b6bb-69cc09077b05 service nova] Creating event network-changed:699de106-65ec-469c-a13b-e1b51555cb83 for instance 8589798a-c8b2-4307-aaac-b428310a5dbe on nch2-master-1 Nov 06 21:00:38.471733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-15941936-bf19-496e-9aa9-97cb85178703 req-4b260e25-20c4-46aa-b6bb-69cc09077b05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072338 Nov 06 21:00:38.472816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2102/4248] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:38.491072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.492120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:38.508006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.509538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.514171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.515330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.804218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:38.812837 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f364b7b-080c-4083-8129-bd271e96f396 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 200 len: 1523 microversion: 2.1 time: 0.402289 Nov 06 21:00:38.814202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2147/4249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:38 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:38.827052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.827671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:38.841694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.842159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.842956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.844772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.873927 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. Nov 06 21:00:38.874796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:38.875819 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee630e37-a1b3-416d-86b2-3bc739994035 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 404 len: 111 microversion: 2.20 time: 0.061474 Nov 06 21:00:38.876582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2148/4250] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:38 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:00:38.886518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-020e6451-6021-44b7-bdaf-4a7beb0b8826 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '.version_select at 0x7f67151ddb80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.908893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-020e6451-6021-44b7-bdaf-4a7beb0b8826 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626765315" status: 204 len: 0 microversion: 2.20 time: 0.026451 Nov 06 21:00:38.910246 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2149/4251] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Nov 6 21:00:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626765315 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:00:38.922377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:38.939951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80d62416-28f8-4cbb-83db-6c2c308988a3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.462884 Nov 06 21:00:38.945710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2103/4252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:38 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:38.967424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:38.968144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:38.980138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.980943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:38.984463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:38.986145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:39.133118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:39.133984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:39.142163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:39.149018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:39.149872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:39.150313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:39.224365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-622ecbcf-16a7-4510-b520-d5607cc0ca6c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.095386 Nov 06 21:00:39.225030 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2104/4253] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:39 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:39.325607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:39.326309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:39.337342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:39.337808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:39.339153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:39.339595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:39.431177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:39.439013 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0592cb01-5963-4538-a653-4698e8b53f3f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.477301 Nov 06 21:00:39.449644 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2150/4254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:38 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:39.755038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1733294678", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "eb18f83c-d18b-4a29-9010-a6e673304a12"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:39.846620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] validate_networks() for [('eb18f83c-d18b-4a29-9010-a6e673304a12', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:40.275081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:40.292792 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9fa362a2-7dca-4c11-a793-9a8a990b3ed5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.968508 Nov 06 21:00:40.293440 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2105/4255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:39 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:40.302988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:40.308138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:40.321381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.322050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.323126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.323762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.444443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:40.465025 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10b514eb-c2ba-4382-828f-831b2b2c44a0 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 200 len: 1481 microversion: 2.1 time: 0.170181 Nov 06 21:00:40.479918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2106/4256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:40 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 1481 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:40.486229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:40.487490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:40.495732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.497221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.498823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.499970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.563691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f52be37-ad20-4ecb-ac4c-7e47b3c7f7a0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.081715 Nov 06 21:00:40.564752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2107/4257] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:40 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:40.577614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c34798ed-6483-42e2-93e9-6629224dcd94 req-e7b05c95-65c6-4d44-9b0c-00c7bc375388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae066647-0a6c-43ec-a209-5dcae549fabf", "name": "network-vif-deleted", "tag": "2e0c8684-c658-4d36-99ae-c0dff5a0b3ae"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:40.579395 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:40.579395 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:40.599104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c34798ed-6483-42e2-93e9-6629224dcd94 req-e7b05c95-65c6-4d44-9b0c-00c7bc375388 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.599849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c34798ed-6483-42e2-93e9-6629224dcd94 req-e7b05c95-65c6-4d44-9b0c-00c7bc375388 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.634691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c34798ed-6483-42e2-93e9-6629224dcd94 req-e7b05c95-65c6-4d44-9b0c-00c7bc375388 service nova] Creating event network-vif-deleted:2e0c8684-c658-4d36-99ae-c0dff5a0b3ae for instance ae066647-0a6c-43ec-a209-5dcae549fabf on nch2-master-1 Nov 06 21:00:40.654979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c34798ed-6483-42e2-93e9-6629224dcd94 req-e7b05c95-65c6-4d44-9b0c-00c7bc375388 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087004 Nov 06 21:00:40.656655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2108/4258] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:40.864091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6d310a43-5243-411a-a993-fed360ac5ef0 req-0a28331f-8816-4cc0-a407-9d4213308e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dbf411-6b5d-4b0e-9075-cac0fce0c1ff", "name": "network-vif-plugged", "status": "completed", "tag": "11cecbe1-ab5d-441c-8e32-561b6889099e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:40.865940 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:40.865940 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:40.883621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:40.884185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:40.886220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:40.886650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:40.887094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:40.889747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d310a43-5243-411a-a993-fed360ac5ef0 req-0a28331f-8816-4cc0-a407-9d4213308e9a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.890347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d310a43-5243-411a-a993-fed360ac5ef0 req-0a28331f-8816-4cc0-a407-9d4213308e9a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.902769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.903237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.914316 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6d310a43-5243-411a-a993-fed360ac5ef0 req-0a28331f-8816-4cc0-a407-9d4213308e9a service nova] Creating event network-vif-plugged:11cecbe1-ab5d-441c-8e32-561b6889099e for instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff on nch2-master-1 Nov 06 21:00:40.917803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:40.918465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:40.930477 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6d310a43-5243-411a-a993-fed360ac5ef0 req-0a28331f-8816-4cc0-a407-9d4213308e9a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071547 Nov 06 21:00:40.931905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2109/4259] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:40.966513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:40.972822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Getting quotas for user 9406ed96fdc944a0bdc1302374d0d56d and project a7fa6742333c428d864b6c5b2319997d. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:40.990006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:40.993851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:41.090825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb6edb27-fa75-471f-8d06-c74326f8423e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339420 Nov 06 21:00:41.093359 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2151/4260] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:00:41.103349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b16992d-566f-4fe6-8ab1-719118353610 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.104953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b16992d-566f-4fe6-8ab1-719118353610 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:41.156726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: .version_select at 0x7f67153aa9d0>, body: {"keypair": {"name": "tempest-keypair-853574294"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:41.231990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:41.250880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b16992d-566f-4fe6-8ab1-719118353610 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:41.260383 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b16992d-566f-4fe6-8ab1-719118353610 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1215 microversion: 2.1 time: 0.160417 Nov 06 21:00:41.262951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:41.265366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2110/4261] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:41.317873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.320915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:41.338323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.340400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.342181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.342801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.554313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:41.562472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3d89dad-9c11-45cb-8779-1d31537b18e1 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.255584 Nov 06 21:00:41.565068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2111/4262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:41.572239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.573289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:41.584753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.585577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.586946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.587605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.607933 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] HTTP exception thrown: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. Nov 06 21:00:41.608932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 404 to user: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:41.610071 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17899f5b-1708-42cc-9721-2499918a2c89 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 404 len: 111 microversion: 2.1 time: 0.043565 Nov 06 21:00:41.611266 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2112/4263] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:41.618008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:41.619258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:41.626196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.626862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.627984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.628642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.679391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b3e51fd-4b58-451e-872d-77839cb1157c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.064397 Nov 06 21:00:41.684653 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2113/4264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:41 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:41.694146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.707966 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:41.707966 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:41.709650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:41.711232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:41.728557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.730308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.732324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.732996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.827119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd77e7f3-2b2b-4c93-9d5f-b49a9c430956 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.140191 Nov 06 21:00:41.828195 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2114/4265] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:00:41.840768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfa8c63f-ec90-4686-a303-fbcf4c9107a6 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.843175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfa8c63f-ec90-4686-a303-fbcf4c9107a6 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:41.844346 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dfa8c63f-ec90-4686-a303-fbcf4c9107a6 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.008716 Nov 06 21:00:41.845339 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2115/4266] 10.222.0.13 () {58 vars in 1181 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:00:41.854605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.865029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:41.865946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:41.880603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.881074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.881914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:41.882355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:41.934973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:00:41.975183 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-281fb30e-ef71-480b-9457-98f24fb7b01f tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.124767 Nov 06 21:00:41.981735 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2116/4267] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers => generated 683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:41.989813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:41.994115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:41.999304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:42.001442 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:42.001442 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:42.006454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.007045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.servers [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Removing options 'limit' from query {{(pid=134828) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 06 21:00:42.007820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.016161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4859db20-e37b-4a7a-ad7a-c00cbc07fabc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.863615 Nov 06 21:00:42.017039 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2152/4268] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 21:00:41 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 865 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:00:42.022088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.026712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.027661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.028113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.085529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:00:42.124434 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b04938f5-cfad-4e24-8533-ac62fdd0bef1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.140137 Nov 06 21:00:42.127608 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2117/4269] 10.222.0.13 () {58 vars in 1143 bytes} [Sat Nov 6 21:00:41 2021] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:42.141284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ddedd080-7ce2-416d-b7c4-94616b1e3e9d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.143104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ddedd080-7ce2-416d-b7c4-94616b1e3e9d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:42.143904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ddedd080-7ce2-416d-b7c4-94616b1e3e9d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.007254 Nov 06 21:00:42.150642 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2153/4270] 10.222.0.13 () {58 vars in 1141 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:00:42.156563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df61a528-156d-41dc-953a-7748629a83ef tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.157800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df61a528-156d-41dc-953a-7748629a83ef tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:42.158668 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df61a528-156d-41dc-953a-7748629a83ef tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.008145 Nov 06 21:00:42.159430 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2118/4271] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:00:42.174260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92f0fdb5-efd7-4da4-8e65-e1ec79343b53 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.181061 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:42.181061 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:42.183619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92f0fdb5-efd7-4da4-8e65-e1ec79343b53 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.185255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92f0fdb5-efd7-4da4-8e65-e1ec79343b53 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.195952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.servers [None req-92f0fdb5-efd7-4da4-8e65-e1ec79343b53 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Flavor 'non_existing_flavor' could not be found {{(pid=134827) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Nov 06 21:00:42.197469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92f0fdb5-efd7-4da4-8e65-e1ec79343b53 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032830 Nov 06 21:00:42.205005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2154/4272] 10.222.0.13 () {58 vars in 1177 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:00:42.213738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.218028 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:42.218028 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:42.220091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.221953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.231515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.232337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.233731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.234188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.280760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.281383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:42.302083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.302908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.304050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.304683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.383880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c527969-e7e0-4641-82f3-6b0f3ffff717 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.176890 Nov 06 21:00:42.384628 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2119/4273] 10.222.0.13 () {58 vars in 1173 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:00:42.396956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.398448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.404626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.405694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.407196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d26898b7-ba96-465e-bcf5-981c9681b1da tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1267 microversion: 2.1 time: 0.130556 Nov 06 21:00:42.413234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.413999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.414879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.415591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.418470 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2155/4274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:42.501768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6471a293-f61f-4e87-81aa-350827d46c38 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.106880 Nov 06 21:00:42.502281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2120/4275] 10.222.0.13 () {58 vars in 1183 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:00:42.513819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.516983 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:42.516983 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:42.518122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.518890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.524284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.524764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.526378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.526821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.582036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.583384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:42.590625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.591444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.592672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.593392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.627064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:00:42.705138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.712827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.713563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.784481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.795554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96c11ebc-b594-45f3-ab83-aa97aba10dea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1198 microversion: 2.1 time: 0.217792 Nov 06 21:00:42.796883 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2121/4276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1198 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:42.801891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:42.803099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:42.811325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.812027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.814046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.814780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.883718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27714814-b156-42ab-b03e-01503a7e35ba tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.373236 Nov 06 21:00:42.884372 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2156/4277] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers/detail => generated 3026 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:42.903987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73046a14-c1d6-4066-b15e-0b19349ea576 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.908019 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:42.908019 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:42.909685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73046a14-c1d6-4066-b15e-0b19349ea576 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.910908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73046a14-c1d6-4066-b15e-0b19349ea576 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011998 Nov 06 21:00:42.920385 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2157/4278] 10.222.0.13 () {58 vars in 1177 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:00:42.936247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:42.940972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:42.942065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Searching by: {'deleted': False, 'project_id': '1eda26ab6485409184fe8eba4e51cad6'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:00:42.948767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.949508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.950513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:42.951110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:42.983951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:00:43.067823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0746466d-c77d-4f02-b607-350ff9e9c8d9 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.145830 Nov 06 21:00:43.069191 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2158/4279] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:00:42 2021] GET /compute/v2.1/servers => generated 683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:43.089073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.089492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.096155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.096543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.097367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.097367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.107798 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d5b216e-df11-4e8c-9731-37c2d1053c8d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.309333 Nov 06 21:00:43.112483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2122/4280] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:42 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:43.113691 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] HTTP exception thrown: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. Nov 06 21:00:43.114298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 404 to user: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:43.115123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f65af03e-7db6-4fe8-baf8-59cb1fcb2de5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 404 len: 111 microversion: 2.1 time: 0.038450 Nov 06 21:00:43.115662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2159/4281] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:43 2021] DELETE /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:00:43.125656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.126431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.144420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.146571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.148162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.149752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.191203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:00:43.350464 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb5ba1b6-02a2-460a-bc6a-0c0c13cfdff1 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 204 len: 0 microversion: 2.1 time: 0.230192 Nov 06 21:00:43.361927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.362418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.369439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.371002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.371153 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2123/4282] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:43 2021] DELETE /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:00:43.372131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.372785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.401112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:00:43.426474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.427347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.442447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.443642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.445118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.446324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.513449 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b319a04-2af0-4fdb-b619-43e166e40e52 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 204 len: 0 microversion: 2.1 time: 0.154779 Nov 06 21:00:43.514516 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2160/4283] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:00:43 2021] DELETE /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:00:43.531036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.531832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ae066647-0a6c-43ec-a209-5dcae549fabf] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.551461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.551913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.552849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.553287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.562663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:43.570649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] HTTP exception thrown: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. Nov 06 21:00:43.571541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 404 to user: Instance ae066647-0a6c-43ec-a209-5dcae549fabf could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:43.571719 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e71366f-6323-45f6-b28b-0624a5444815 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1273 microversion: 2.1 time: 0.149719 Nov 06 21:00:43.572478 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2124/4284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:43 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:43.572778 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-683224c6-9cb6-4354-ba51-627e2dfb6366 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf" status: 404 len: 111 microversion: 2.1 time: 0.052108 Nov 06 21:00:43.573787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2161/4285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:43 2021] GET /compute/v2.1/servers/ae066647-0a6c-43ec-a209-5dcae549fabf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:43.587423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.589053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.596085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.596589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.597598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.598212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.818888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:43.821413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:43.836061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.841095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.843505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:43.844662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:43.919090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:43.929812 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77bf3418-a5d7-4c8c-a1c8-47cba1088e97 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1522 microversion: 2.1 time: 0.346387 Nov 06 21:00:43.940157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2125/4286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:43 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:44.119142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:44.120174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:44.129104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.129570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.130378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.131104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.182342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e18d5d78-f283-4d19-8b76-dbff76e55da4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.066559 Nov 06 21:00:44.184160 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2126/4287] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:44 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:44.226984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:44.240001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61374d29-ef23-45fc-aaae-a47fec307c68 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1381 microversion: 2.1 time: 0.425028 Nov 06 21:00:44.252077 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2162/4288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:43 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1381 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:44.270689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:44.271581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:44.290944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.294079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.295192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.295852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.589182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:44.589805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:44.597944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.600018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.602003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.602780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.643303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a731ebb-bbe3-4044-88a3-7749aa8a0619 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1532 microversion: 2.1 time: 0.378635 Nov 06 21:00:44.644590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2127/4289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:44 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1532 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:44.661280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:44.662010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:44.669180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.670710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.671828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:44.672494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:44.969975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:44.978632 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e54c0a15-eb07-44e6-bd0e-98f1aec445fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.393361 Nov 06 21:00:44.981973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2163/4290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:44 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:44.995892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-234808418", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cef188b-2bc9-450f-890b-1de92b2534d5"}], "security_groups": [{"name": "tempest-securitygroup--279181896"}], "key_name": "tempest-keypair-853574294", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:45.195222 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54b2c68c-f6a8-4a85-8ab6-9df646ebe234 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1532 microversion: 2.1 time: 0.538002 Nov 06 21:00:45.196439 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2128/4291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:44 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1532 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:45.201933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:45.203611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:45.210667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] validate_networks() for [('3cef188b-2bc9-450f-890b-1de92b2534d5', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:45.225159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.226772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.228072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.228800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.472076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:45.481124 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-088c8155-2bc5-43b6-8f86-f25f6fb3e08e tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1522 microversion: 2.1 time: 0.283179 Nov 06 21:00:45.481969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2129/4292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:45 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:45.498915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:45.500148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:45.507699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.508156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.509180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.509622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.556665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49065ef4-cd86-497a-9293-aeb3109dde5d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.069781 Nov 06 21:00:45.557823 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2130/4293] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:45 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:45.563715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:45.565340 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:45.565340 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:45.568054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.568926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.570346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.571007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.602581 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51dc5fbe-2883-4a80-8510-72b1ad91cc10 tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043380 Nov 06 21:00:45.603244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2131/4294] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 21:00:45 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:45.614213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:45.615727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:45.623185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.624010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.625179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.625784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.654975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lazy-loading 'flavor' on Instance uuid 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:00:45.669641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Going to try to live migrate instance to nch1-master-1 {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 21:00:45.827018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:45.829564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:45.831567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:45.833130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:45.834160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:45.855368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.856775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.860502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:45.864459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:45.898311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:45.908007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Getting quotas for user 6f17807a206f49a1a165fe77aec4468c and project a0abfd854dfe46acaeedf288c6674c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:45.940536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:45.943232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:46.029716 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fec65ab5-ad58-43d5-b79a-804df2a52c52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.035493 Nov 06 21:00:46.030439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2164/4295] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 21:00:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 21:00:46.039591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:46.040651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:46.053019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.068853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.075785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.076545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.356865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:46.375815 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79b05916-7be0-448e-b0a0-9880d73b8c05 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.337634 Nov 06 21:00:46.377445 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2165/4296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:46 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:46.386525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:46.387614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:46.484644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:46.493725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:46.501216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:46.503884 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b606563-298e-414b-b65d-77f866a2593c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1280 microversion: 2.20 time: 0.125124 Nov 06 21:00:46.505417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2166/4297] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:46 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:46.512864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:46.513769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:46.524703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.525459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.526735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.527673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.801712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:46.813466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8469d23c-11ff-4463-86d6-823abb95e265 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1522 microversion: 2.1 time: 0.305279 Nov 06 21:00:46.817271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2167/4298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:46 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:46.830485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:46.832258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:46.848822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.849495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.851707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.852584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.926422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-689e6faf-491f-49cc-885c-ade84479b94e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.104705 Nov 06 21:00:46.927165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2168/4299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:46 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:46.935449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-547bbbb0-2e54-460f-ac56-e2c781f45af0 req-be8a3995-a32e-4a1d-a98d-2c2d8c6d873d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17805556-c997-414f-830f-56ceb14bfede", "tag": "ab0fa452-b78b-414c-8ab1-ee7539cbab2b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:46.938156 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:46.938156 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:46.955905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-547bbbb0-2e54-460f-ac56-e2c781f45af0 req-be8a3995-a32e-4a1d-a98d-2c2d8c6d873d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:46.956909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-547bbbb0-2e54-460f-ac56-e2c781f45af0 req-be8a3995-a32e-4a1d-a98d-2c2d8c6d873d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:46.976234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-547bbbb0-2e54-460f-ac56-e2c781f45af0 req-be8a3995-a32e-4a1d-a98d-2c2d8c6d873d service nova] Creating event network-changed:ab0fa452-b78b-414c-8ab1-ee7539cbab2b for instance 17805556-c997-414f-830f-56ceb14bfede on nch2-master-1 Nov 06 21:00:46.985044 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-547bbbb0-2e54-460f-ac56-e2c781f45af0 req-be8a3995-a32e-4a1d-a98d-2c2d8c6d873d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055546 Nov 06 21:00:46.986332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2169/4300] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:47.395767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:47.396626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:47.404266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.406110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:47.407889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.408362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:47.704726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:47.712246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e94c51e-0a05-429e-8fdb-def8af6a5233 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.321962 Nov 06 21:00:47.714803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2170/4301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:47 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:47.729963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:47.730609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:47.737959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.738624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:47.739524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.740123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:47.875611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:47.899025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:47.909390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:47.917857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ec263e1-00dc-4e25-8d77-5e0937139d49 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1338 microversion: 2.20 time: 0.189974 Nov 06 21:00:47.919406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2171/4302] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:47 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:47.946701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:47.947425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:47.956067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.956621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:47.957513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:47.958024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.079458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20811a983464fdba21701044f28d720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda26ab6485409184fe8eba4e51cad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:48.095299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8095fa38-f677-44e0-923b-1bfe7e10b04d tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 200 len: 1480 microversion: 2.1 time: 0.158800 Nov 06 21:00:48.097412 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2172/4303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:47 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:48.103471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:48.105338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:48.121043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.121684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.122658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.123248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.172636 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8f459b9-e8d7-4abc-a176-e76ee97a87d4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.072282 Nov 06 21:00:48.173916 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2173/4304] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:48 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:48.414119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17a0b6f6-f104-4d18-850b-25a0bcb329da tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff/action" status: 202 len: 0 microversion: 2.1 time: 2.803810 Nov 06 21:00:48.415748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2132/4305] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:45 2021] POST /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff/action => generated 0 bytes in 2806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:00:48.437131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:48.439802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:48.469597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.473156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.475556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.477377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.731097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:48.731973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:48.740741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.745549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.746529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.747564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.810045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:48.831907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-447537f7-5b6a-49fa-bbca-9a42ddc09ded tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.408719 Nov 06 21:00:48.836127 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2174/4306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:48 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:48.938361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:48.939739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:48.952212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.952735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:48.955638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:48.956106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.287139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:49.296918 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7199bdfd-a36b-4882-adf6-e0c643ad8bcd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.569770 Nov 06 21:00:49.298340 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2133/4307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:48 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:49.303054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:49.304035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: 31e2c1ee-028d-486e-b826-f8b25247e8e7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:49.314121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.314932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.315960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.316682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.334942 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] HTTP exception thrown: Instance 31e2c1ee-028d-486e-b826-f8b25247e8e7 could not be found. Nov 06 21:00:49.335925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 404 to user: Instance 31e2c1ee-028d-486e-b826-f8b25247e8e7 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:49.337065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3ca7b78-6bde-4ae2-95d9-782077e5c6e5 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7" status: 404 len: 111 microversion: 2.1 time: 0.037476 Nov 06 21:00:49.339014 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2134/4308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:49 2021] GET /compute/v2.1/servers/31e2c1ee-028d-486e-b826-f8b25247e8e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:49.344884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e2c1ee-028d-486e-b826-f8b25247e8e7", "name": "network-vif-deleted", "tag": "22e9e98b-1283-4123-bc56-db5286235acf"}, {"server_uuid": "ad8bcc56-9d6c-48c2-8709-785644d54d5d", "name": "network-vif-deleted", "tag": "458a3855-57ff-483c-8950-b8fe5b516d3a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:49.346831 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:49.346831 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:49.356318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.357187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.372654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] Creating event network-vif-deleted:22e9e98b-1283-4123-bc56-db5286235acf for instance 31e2c1ee-028d-486e-b826-f8b25247e8e7 on nch2-master-1 Nov 06 21:00:49.373892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] Creating event network-vif-deleted:458a3855-57ff-483c-8950-b8fe5b516d3a for instance ad8bcc56-9d6c-48c2-8709-785644d54d5d on nch2-master-1 Nov 06 21:00:49.381355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5d2befc1-c62a-48a1-b2c2-dc4f1c180eec req-a6e2673d-ceb5-4713-8004-083d1e73926c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040865 Nov 06 21:00:49.382314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2135/4309] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:49 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:49.390946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:49.392125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:49.399667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.401292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.402862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.403572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.450005 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bd34f70-fd37-4d96-b96a-5c00de320396 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.065379 Nov 06 21:00:49.451962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2136/4310] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:49 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:49.457274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:49.458284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] [instance: ad8bcc56-9d6c-48c2-8709-785644d54d5d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:49.466344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.466808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.467613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.468058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.486534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] HTTP exception thrown: Instance ad8bcc56-9d6c-48c2-8709-785644d54d5d could not be found. Nov 06 21:00:49.487667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] Returning 404 to user: Instance ad8bcc56-9d6c-48c2-8709-785644d54d5d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:00:49.489214 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b40836cb-182c-460d-be7c-8761e5156974 tempest-ListServersNegativeTestJSON-186276031 tempest-ListServersNegativeTestJSON-186276031-project] 10.222.0.13 "GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d" status: 404 len: 111 microversion: 2.1 time: 0.035821 Nov 06 21:00:49.490008 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2137/4311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:49 2021] GET /compute/v2.1/servers/ad8bcc56-9d6c-48c2-8709-785644d54d5d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:00:49.516276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:49.525321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:49.527419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:49.528572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b38628cf-11cf-4454-98c3-0769d1a45a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.594118 Nov 06 21:00:49.529330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2175/4312] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:48 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:49.850775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:49.851387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:49.858930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.860795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:49.861604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:49.862806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.637177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:50.645395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6b6fa42-1a88-4e06-9d7d-2a15bfa10a5e tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.799443 Nov 06 21:00:50.645962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2138/4313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:49 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:50.660356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:50.661303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:50.681814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.682292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.683675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.684004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.757268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5149c2dd-0c45-4bd6-b0f6-cf65d9b5521c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.104590 Nov 06 21:00:50.758179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2139/4314] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:50 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:50.766464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:50.768210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:50.788389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.789060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.789935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.790385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.830935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:50.831539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:50.858628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.860027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:50.861089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:50.861734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.288959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:51.305458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:51.308765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:51.310793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aac2c096-587c-4098-a8fa-46226b4750fa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.551345 Nov 06 21:00:51.311585 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2140/4315] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:50 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:51.320764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d52c8f8f-e1d7-4679-9e79-bb1bf3bcc4f8 req-26b72954-9b01-43a2-a082-e6a73fac9556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:51.324392 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:51.324392 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:51.339472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d52c8f8f-e1d7-4679-9e79-bb1bf3bcc4f8 req-26b72954-9b01-43a2-a082-e6a73fac9556 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:51.340473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d52c8f8f-e1d7-4679-9e79-bb1bf3bcc4f8 req-26b72954-9b01-43a2-a082-e6a73fac9556 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.358407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d52c8f8f-e1d7-4679-9e79-bb1bf3bcc4f8 req-26b72954-9b01-43a2-a082-e6a73fac9556 service nova] Creating event network-changed:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:00:51.364537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d52c8f8f-e1d7-4679-9e79-bb1bf3bcc4f8 req-26b72954-9b01-43a2-a082-e6a73fac9556 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051265 Nov 06 21:00:51.365721 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2141/4316] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:51.387492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:51.396634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ad083ad-d53e-46b6-a401-0239445911c0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 1.086112 Nov 06 21:00:51.397219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2176/4317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:50 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:51.663856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:51.664598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:51.680321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:51.680812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.681612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:51.682808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.772367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:51.773423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:51.789286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:51.789742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.790555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:51.790993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:51.855332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5b64ab87-289f-4f20-b800-8d66cbd8195c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.089311 Nov 06 21:00:51.859596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2177/4318] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:51 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:00:52.054247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:52.062813 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-319f24b2-6b8b-420b-b620-f30a4b7e2423 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.403483 Nov 06 21:00:52.068669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2142/4319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:51 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:52.329158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:52.329870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:52.346426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.346904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.348326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.348775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.416155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:52.417350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:52.429515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.429957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.433451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.434113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.787549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:52.798597 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16725a1b-cb43-4497-bc46-87933618fd87 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.386473 Nov 06 21:00:52.810456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2143/4320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:52 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:52.819980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:52.830361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:52.832732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:52.834759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41aa65af-7f69-488f-bcf0-1613bb408e07 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.509159 Nov 06 21:00:52.846831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2178/4321] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:52 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:52.871906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:52.872920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:52.881452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.882093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.883453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:52.884202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:52.936268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f64048d-3b8b-470f-91dc-1ced824b4198 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.067686 Nov 06 21:00:52.937334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2144/4322] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:52 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:53.080739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:53.082129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:53.091404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.092240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:53.094081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.094986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:53.341361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:53.350223 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-632718ad-c87b-449c-9840-2546c0aef30c tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.273952 Nov 06 21:00:53.364543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2179/4323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:53 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:53.816723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:53.818140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:53.827159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.828159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:53.829102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.829665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:53.860242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:53.861000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:53.873208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.873965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:53.875778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:53.876655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.359257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:54.364513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:54.372349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f837d39-e9ab-49f1-a566-353789ed6e43 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.559769 Nov 06 21:00:54.373372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:54.373785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2145/4324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:53 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:54.374894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:54.376023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1259162f-04f0-48a7-96d9-5fdc74982c9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.525700 Nov 06 21:00:54.376613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2180/4325] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:53 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:54.380593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:54.382081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:54.392224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:54.393012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.395079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:54.395987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.405854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:54.406484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:54.418968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:54.419808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.420856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:54.421467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.495901 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e81b4ab6-6c60-41e9-ad5a-091a736262e0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.119515 Nov 06 21:00:54.498137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2146/4326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:54 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:54.578864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2c07dfbc-b9a1-4425-b99a-0b2fd96fdbfa req-38fed962-3177-49ee-baab-f211e23aef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dbf411-6b5d-4b0e-9075-cac0fce0c1ff", "name": "network-vif-unplugged", "status": "completed", "tag": "11cecbe1-ab5d-441c-8e32-561b6889099e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:54.581571 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:54.581571 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:54.605660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c07dfbc-b9a1-4425-b99a-0b2fd96fdbfa req-38fed962-3177-49ee-baab-f211e23aef0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:54.606120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c07dfbc-b9a1-4425-b99a-0b2fd96fdbfa req-38fed962-3177-49ee-baab-f211e23aef0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:54.625796 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2c07dfbc-b9a1-4425-b99a-0b2fd96fdbfa req-38fed962-3177-49ee-baab-f211e23aef0a service nova] Creating event network-vif-unplugged:11cecbe1-ab5d-441c-8e32-561b6889099e for instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff on nch2-master-1 Nov 06 21:00:54.632519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2c07dfbc-b9a1-4425-b99a-0b2fd96fdbfa req-38fed962-3177-49ee-baab-f211e23aef0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061607 Nov 06 21:00:54.633508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2147/4327] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:54.788040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:54.809555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fc4b5aa-6c4b-47d8-af18-d1061b3f33de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.401505 Nov 06 21:00:54.810223 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2181/4328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:54 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:55.401712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:55.405169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:55.417677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:55.418966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:55.420573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:55.421335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:55.437861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1058206187", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "6f9b5bbd-1a3d-4564-b066-1400449a1443"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:55.531036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] validate_networks() for [('6f9b5bbd-1a3d-4564-b066-1400449a1443', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:00:55.733863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:55.762892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef0d9e01-f6a4-41ff-a277-17cf8b47f3fb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.377019 Nov 06 21:00:55.765419 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2182/4329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:55 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:55.770796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:55.771984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:55.783942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:55.789384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:55.790512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:55.792949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.087112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:56.099303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:56.108376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:56.129541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa0fcb4e-f45b-4b53-8738-37cb2828ecbc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.361344 Nov 06 21:00:56.141608 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2183/4330] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:55 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:56.142018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:00:56.142599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:00:56.143635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:00:56.144199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:00:56.145481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:00:56.158709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:56.159918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:56.161317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.161954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.163655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.164543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.167707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.168559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.169779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.170361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.191503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Getting quotas for project 0574cd1faec94a7e9cb5468995d6be4f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:00:56.196788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Getting quotas for user d1f72a7e81dc4765bd9e465be8ca31c4 and project 0574cd1faec94a7e9cb5468995d6be4f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:00:56.211369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:00:56.215034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:00:56.225347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df2e37d6-a0de-4e00-9ad5-ab1508d86fcf tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.081952 Nov 06 21:00:56.226707 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2184/4331] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:56 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:56.242411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:56.244543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:56.257449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.258368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.260315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.261117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.294979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8d19a2a-1b55-4773-9306-ce7ae684a469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200249 Nov 06 21:00:56.301077 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2148/4332] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:00:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:00:56.313729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c60300b-d7e8-4121-94c9-7570977197b9 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:56.314738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c60300b-d7e8-4121-94c9-7570977197b9 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:56.408261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4c60300b-d7e8-4121-94c9-7570977197b9 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:56.418327 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c60300b-d7e8-4121-94c9-7570977197b9 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1217 microversion: 2.1 time: 0.115202 Nov 06 21:00:56.420823 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2149/4333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:56 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:56.575958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:56.586336 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c89929d-c64d-49db-969b-74e803135b26 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.358355 Nov 06 21:00:56.589424 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2185/4334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:56 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:56.659068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8abfe1f4-07d9-4d67-8354-430e4b3ffa05 req-ba0c67c0-862c-4d29-b69a-59073652211b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32dbf411-6b5d-4b0e-9075-cac0fce0c1ff", "tag": "11cecbe1-ab5d-441c-8e32-561b6889099e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:56.660666 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:56.660666 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:56.675113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8abfe1f4-07d9-4d67-8354-430e4b3ffa05 req-ba0c67c0-862c-4d29-b69a-59073652211b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.675592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8abfe1f4-07d9-4d67-8354-430e4b3ffa05 req-ba0c67c0-862c-4d29-b69a-59073652211b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.701041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8abfe1f4-07d9-4d67-8354-430e4b3ffa05 req-ba0c67c0-862c-4d29-b69a-59073652211b service nova] Creating event network-changed:11cecbe1-ab5d-441c-8e32-561b6889099e for instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff on nch2-master-1 Nov 06 21:00:56.708564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8abfe1f4-07d9-4d67-8354-430e4b3ffa05 req-ba0c67c0-862c-4d29-b69a-59073652211b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053169 Nov 06 21:00:56.710253 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2150/4335] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:56.781679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:56.782322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:56.792577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.793112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.793804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.794222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.863867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cdcef57b-24dd-44a3-86c8-50ebb966c84a req-37eb3969-292b-42c2-be7a-8c02119ebea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17805556-c997-414f-830f-56ceb14bfede", "name": "network-vif-plugged", "status": "completed", "tag": "ab0fa452-b78b-414c-8ab1-ee7539cbab2b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:56.865378 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:56.865378 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:00:56.885220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cdcef57b-24dd-44a3-86c8-50ebb966c84a req-37eb3969-292b-42c2-be7a-8c02119ebea7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:56.888031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cdcef57b-24dd-44a3-86c8-50ebb966c84a req-37eb3969-292b-42c2-be7a-8c02119ebea7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:56.930584 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cdcef57b-24dd-44a3-86c8-50ebb966c84a req-37eb3969-292b-42c2-be7a-8c02119ebea7 service nova] Creating event network-vif-plugged:ab0fa452-b78b-414c-8ab1-ee7539cbab2b for instance 17805556-c997-414f-830f-56ceb14bfede on nch2-master-1 Nov 06 21:00:56.952474 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cdcef57b-24dd-44a3-86c8-50ebb966c84a req-37eb3969-292b-42c2-be7a-8c02119ebea7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092034 Nov 06 21:00:56.955635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2151/4336] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:00:57.165515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:57.167318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:57.180875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.181164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.182583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.183290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.240074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.252731 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f22fb135-e653-4630-9320-dd02b7a40679 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.470484 Nov 06 21:00:57.253343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2186/4337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:56 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:57.262843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:57.263820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:57.270851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.271551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.272794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.273404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.349659 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07d74b09-92f5-4c12-82f6-15d542748928 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 24570 microversion: 2.1 time: 0.094359 Nov 06 21:00:57.351601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2187/4338] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:57 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:57.438223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:57.439464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:57.449567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.450291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.451519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.452126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.537964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.546229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12ffca3d-8482-4042-801c-6571641a0348 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1269 microversion: 2.1 time: 0.112881 Nov 06 21:00:57.547074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2188/4339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:57 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:00:57.605724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:57.606338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:57.608478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.613052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.613499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.614289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:57.617716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.619286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.621022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f39cc037-3bcc-41de-8d75-1910ca3fa59e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.465555 Nov 06 21:00:57.622834 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2152/4340] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:57 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:00:57.636822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:57.981983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:57.991111 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-680c8bdf-4b45-4f22-b24d-b4e2a0ab4cc7 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.388401 Nov 06 21:00:57.992808 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2189/4341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:57 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:58.274045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:58.275636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:58.285805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.286521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.288398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.289209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.362244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:58.363356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:58.371111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.371965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.373021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.373966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.443031 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12ad19a2-3ede-4048-b729-9d5c727b269c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.084436 Nov 06 21:00:58.444736 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2190/4342] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:58 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:58.567983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:58.569523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:58.584133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.585400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.586707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.589093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.743572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:58.755247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8dfc4b9f-681b-4231-830e-9c29aa10c70e tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1275 microversion: 2.1 time: 0.194196 Nov 06 21:00:58.756167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2191/4343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:58 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:58.760646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:58.766023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:58.779780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.781159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.781997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:58.783819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:58.910280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:58.918674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24db67a2-fab0-44aa-ac1d-dfb679443b4e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1315 microversion: 2.1 time: 0.651521 Nov 06 21:00:58.922655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2153/4344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:58 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:59.010354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:59.011173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:59.017343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.018031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.019128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.019854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.253757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:59.262937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:59.264633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:59.266237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e710cfaf-e2e3-419d-a0ae-50988db6703e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.509024 Nov 06 21:00:59.267274 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2192/4345] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:00:58 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:00:59.272137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-64a9f692-df54-4ae2-a85f-21ab24b8e67f req-81b538c7-a3b7-45bc-a91c-967a0573073a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "name": "network-vif-plugged", "status": "completed", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:59.273777 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:00:59.273777 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:00:59.282333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-64a9f692-df54-4ae2-a85f-21ab24b8e67f req-81b538c7-a3b7-45bc-a91c-967a0573073a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.283062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-64a9f692-df54-4ae2-a85f-21ab24b8e67f req-81b538c7-a3b7-45bc-a91c-967a0573073a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.296395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-64a9f692-df54-4ae2-a85f-21ab24b8e67f req-81b538c7-a3b7-45bc-a91c-967a0573073a service nova] Creating event network-vif-plugged:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:00:59.303020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-64a9f692-df54-4ae2-a85f-21ab24b8e67f req-81b538c7-a3b7-45bc-a91c-967a0573073a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034051 Nov 06 21:00:59.307397 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2193/4346] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:00:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:00:59.414789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:59.431532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9f0658d-3591-4293-b665-8b7f55a80356 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.425406 Nov 06 21:00:59.432998 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2154/4347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:59 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:00:59.455433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:00:59.456453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:59.462606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.464465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.465430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.465868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.521091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f83831c-1535-453e-8f30-f49cc6406b3e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.069335 Nov 06 21:00:59.522420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2194/4348] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:00:59 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:00:59.773365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:59.775959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:59.783176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.784534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.785526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.786415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.943018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:00:59.943970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:00:59.952035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.953031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.954313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:00:59.954844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:00:59.969614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:00:59.976958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ddb19fc-39cd-4231-8f1f-b0a05da6c7af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.208075 Nov 06 21:00:59.996481 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2155/4349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:59 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:00.287228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:00.288212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:00.296287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.296801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.297841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.298291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.326462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:00.341064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ce91154-5778-46c9-b036-a9430cff5142 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1502 microversion: 2.1 time: 0.402114 Nov 06 21:01:00.349349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2195/4350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:00:59 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:00.362254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:00.362884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:00.370355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.371052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.372087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.372883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.458582 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1558a654-239f-4cae-a404-99edd4512a6a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede/action" status: 202 len: 0 microversion: 2.1 time: 0.099841 Nov 06 21:01:00.460723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2196/4351] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:00 2021] POST /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:00.475078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:00.476195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:00.484002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.484572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.485829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.487249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.774162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:00.782962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:00.785807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:00.787057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-985e448c-dcaa-43a4-b0e8-be64a501953f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1405 microversion: 2.20 time: 0.505013 Nov 06 21:01:00.799215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2156/4352] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:01:00 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:01:00.804858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:00.805482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:00.812274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.812966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:00.813769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:00.814212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.009385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:01.020398 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc44c661-c94f-444d-bf1f-e83025d2c589 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1391 microversion: 2.1 time: 0.558207 Nov 06 21:01:01.021248 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2197/4353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:00 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1391 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:01.029839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:01.031253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:01.037351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.037985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.038944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.039535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.138775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d4fba75-b2ab-4d30-8f2a-ffb60ea2cc9d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.116101 Nov 06 21:01:01.142985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2198/4354] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:01 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:01.144681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:01.145398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:01.153692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.154334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.155282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.155909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.270554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:01.282153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3081c7f1-147a-4700-8b02-296400c2aa9e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1487 microversion: 2.1 time: 0.480953 Nov 06 21:01:01.283104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2157/4355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:00 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1487 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:01.306351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:01.306938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:01.319026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.319737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.321027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.321476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.366958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lazy-loading 'flavor' on Instance uuid 17805556-c997-414f-830f-56ceb14bfede {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:01:01.563237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:01.578027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90c7708a-cf60-4be6-85e2-58834904a4fd tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.433065 Nov 06 21:01:01.578842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2199/4356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:01 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:01.642078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-69dd16bc-1815-421c-978f-0f39de36078f req-e8c7507f-9fc1-47aa-bd0b-7553b4aec1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c156c11-1083-4c2b-93fe-468f7336cd2c", "tag": "cc994223-3c09-4974-9bcf-82aa03fca83e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:01.644215 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:01.644215 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:01.672136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-69dd16bc-1815-421c-978f-0f39de36078f req-e8c7507f-9fc1-47aa-bd0b-7553b4aec1dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.672697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-69dd16bc-1815-421c-978f-0f39de36078f req-e8c7507f-9fc1-47aa-bd0b-7553b4aec1dc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.702254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-69dd16bc-1815-421c-978f-0f39de36078f req-e8c7507f-9fc1-47aa-bd0b-7553b4aec1dc service nova] Creating event network-changed:cc994223-3c09-4974-9bcf-82aa03fca83e for instance 5c156c11-1083-4c2b-93fe-468f7336cd2c on nch2-master-1 Nov 06 21:01:01.714854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-69dd16bc-1815-421c-978f-0f39de36078f req-e8c7507f-9fc1-47aa-bd0b-7553b4aec1dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081851 Nov 06 21:01:01.715448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2200/4357] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:01.784892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a25fd5c9-a7d0-4f0f-b539-203c2b8bf451 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede/action" status: 202 len: 0 microversion: 2.1 time: 0.485636 Nov 06 21:01:01.785887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2158/4358] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:01 2021] POST /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:01.803232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:01.805533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:01.818968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.820630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.821665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.822830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.831309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:01.832031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:01.849963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.850419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:01.852271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:01.852732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.266861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.279454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34261c22-f17d-42e6-b998-c2474a863055 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1493 microversion: 2.1 time: 0.488830 Nov 06 21:01:02.291663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2201/4359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:01 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1493 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:02.303844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:02.306159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:02.318935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.324220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.328841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.336370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.337943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.338619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.339165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.345714 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-034972c9-4204-4890-bfeb-bf61fac6db3b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1596 microversion: 2.20 time: 0.530256 Nov 06 21:01:02.348136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2159/4360] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:01:01 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1596 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:01:02.358353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:02.359884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:02.378859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.379419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.382458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.383167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.448845 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-027dd164-e5e0-4a0c-9387-4847be532a78 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.098674 Nov 06 21:01:02.451890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2160/4361] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:02 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:02.458152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:02.459067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:02.468162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.468985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.470440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.471112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.605024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3d2919b-e9e3-4ddc-9734-f39ce263da04 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151054 Nov 06 21:01:02.605917 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2161/4362] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 21:01:02 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:02.612103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:02.613026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:02.621922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.622642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.624078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.625531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.675647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.683880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e9b98bc-079a-4d25-95e8-d2e314c67afc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1381 microversion: 2.1 time: 0.389340 Nov 06 21:01:02.684667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2202/4363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:02 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1381 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:02.701769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d885bc11-1feb-46af-acac-c7b23f3720bc tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '.version_select at 0x7f67153940d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:02.703541 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:02.703541 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:02.705747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d885bc11-1feb-46af-acac-c7b23f3720bc tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.706400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d885bc11-1feb-46af-acac-c7b23f3720bc tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.717448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d885bc11-1feb-46af-acac-c7b23f3720bc tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.020391 Nov 06 21:01:02.725240 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2203/4364] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 21:01:02 2021] GET /compute/v2.1/os-migrations => generated 1553 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:02.730786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:02.731620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:02.739649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.741046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.742012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:02.742609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:02.925346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:02.933216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d5ce695-c364-488b-adfb-2cf3c3aa5c26 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.325699 Nov 06 21:01:02.934023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2162/4365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:02 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:03.063934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2dc77317-eb25-4ddb-942a-fcadce0458be tempest-LiveMigrationTest-2087109617 tempest-LiveMigrationTest-2087109617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1532 microversion: 2.1 time: 0.337196 Nov 06 21:01:03.064504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2204/4366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:02 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1532 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:03.085606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:03.086404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:03.094448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.094901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:03.095711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.096255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:03.122181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:03.269434 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b9233774-e08d-443b-b751-6d6994f6e651 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 204 len: 0 microversion: 2.1 time: 0.187008 Nov 06 21:01:03.270283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2163/4367] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:03 2021] DELETE /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:01:03.279862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:03.281141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:03.287753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.288206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:03.289087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.289820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:03.298273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:03.299271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:03.315231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.315737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:03.316672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:03.317121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.006885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:04.009068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:04.017629 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc638b12-71c1-4e91-9d6d-2f770d45c6e8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1493 microversion: 2.1 time: 0.723908 Nov 06 21:01:04.017809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4f7afac-fa20-4e90-be54-475df0b7fdea tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1387 microversion: 2.1 time: 0.743170 Nov 06 21:01:04.018397 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2164/4368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:03 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1493 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:04.028134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2205/4369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:03 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1387 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:04.028134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:04.028134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:04.034013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:04.035288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:04.039504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.040518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.041787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.042549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.049983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.051417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.052453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.053092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.112834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-576eb3d1-31c2-496a-972b-f24aa4e4ec8e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.092845 Nov 06 21:01:04.116932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2165/4370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:04 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:04.205313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:04.213308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9149b1d0-15ab-44cc-ae31-53833b24185d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.192176 Nov 06 21:01:04.214132 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2206/4371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:04 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:04.692198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:04.697029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-cd51eaf9-a673-438f-86fc-fdf4c16ce96a req-57eb601c-1670-4215-8af5-8db96f6446bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:04.698426 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:04.698426 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:04.701449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:04.720638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cd51eaf9-a673-438f-86fc-fdf4c16ce96a req-57eb601c-1670-4215-8af5-8db96f6446bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.721302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cd51eaf9-a673-438f-86fc-fdf4c16ce96a req-57eb601c-1670-4215-8af5-8db96f6446bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.721485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.722347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.723932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:04.724389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:04.746794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-cd51eaf9-a673-438f-86fc-fdf4c16ce96a req-57eb601c-1670-4215-8af5-8db96f6446bc service nova] Creating event network-changed:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:01:04.752657 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-cd51eaf9-a673-438f-86fc-fdf4c16ce96a req-57eb601c-1670-4215-8af5-8db96f6446bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059036 Nov 06 21:01:04.754359 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2207/4372] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:01:04.798654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8c1198c-5155-43df-92b2-9714e24aaea8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.110357 Nov 06 21:01:04.809278 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2166/4373] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:04 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:05.039997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:05.042664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:05.043695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:05.044540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:05.054214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.059468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.061146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.063626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.064462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.065650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.066973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.068079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.378923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:05.403765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bdabd22b-28df-4406-bb3a-38c81a812e93 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1387 microversion: 2.1 time: 0.369235 Nov 06 21:01:05.406391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2167/4374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:05 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1387 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:05.419347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:05.421016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:05.438943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.441356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.444224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.444722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.456753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:05.466929 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f25102f7-f135-46f1-be1b-21eb22bef824 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1514 microversion: 2.1 time: 0.435664 Nov 06 21:01:05.470433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2208/4375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:05 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:05.478895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:05.479528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:05.497433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.498407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.500190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.501434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.522557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bda1a99f-1762-4c46-aed6-290791070f04 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.114642 Nov 06 21:01:05.523739 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2168/4376] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:05 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:05.789223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:05.800263 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5899141-839b-4859-abfa-dc79fc65d0f7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.327468 Nov 06 21:01:05.811331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2209/4377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:05 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:05.819697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:05.820653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:05.829308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.829982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.831149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:05.831589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:05.873404 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac451c4a-61a3-4b44-88af-b6c6f7fae617 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.058064 Nov 06 21:01:05.874613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2169/4378] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:05 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:06.422539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:06.423218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:06.429854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.430692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.432370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.433129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.486104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:06.486807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:06.505914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.506747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.507923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.508810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.702991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:06.711064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8952be17-6c2e-4b5f-99a8-65d27e7261dc tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1387 microversion: 2.1 time: 0.292535 Nov 06 21:01:06.711747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2210/4379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:06 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1387 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:06.726942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:06.727912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:06.739667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:06.744371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.748625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1e2263b-ad4d-4cbe-88f2-e1c90da36398 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1514 microversion: 2.1 time: 0.266424 Nov 06 21:01:06.749672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2170/4380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:06 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:06.753851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.754696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.755137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.808897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-42154f27-df60-4fb5-b4cd-ad716f3a25fe req-6ef39514-b4f0-4e05-8c89-f9fefe8f48b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17805556-c997-414f-830f-56ceb14bfede", "name": "network-vif-plugged", "status": "completed", "tag": "ab0fa452-b78b-414c-8ab1-ee7539cbab2b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:06.811223 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:06.811223 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:01:06.812617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-756daeff-8a85-44e7-a535-91dde148fd15 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.088672 Nov 06 21:01:06.817125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2211/4381] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:06 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:06.825362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42154f27-df60-4fb5-b4cd-ad716f3a25fe req-6ef39514-b4f0-4e05-8c89-f9fefe8f48b3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.826080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42154f27-df60-4fb5-b4cd-ad716f3a25fe req-6ef39514-b4f0-4e05-8c89-f9fefe8f48b3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.827700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:06.829494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:06.841223 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-42154f27-df60-4fb5-b4cd-ad716f3a25fe req-6ef39514-b4f0-4e05-8c89-f9fefe8f48b3 service nova] Creating event network-vif-plugged:ab0fa452-b78b-414c-8ab1-ee7539cbab2b for instance 17805556-c997-414f-830f-56ceb14bfede on nch2-master-1 Nov 06 21:01:06.843423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.846789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.848263 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-42154f27-df60-4fb5-b4cd-ad716f3a25fe req-6ef39514-b4f0-4e05-8c89-f9fefe8f48b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047035 Nov 06 21:01:06.850120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2171/4382] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:06.851721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.852468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.887439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:06.888771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:06.899132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.900955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.902656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:06.904924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:06.983658 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9799be2e-debd-4ce4-9e23-fb5d5f0dbde4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.102521 Nov 06 21:01:06.986917 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2172/4383] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:06 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:07.172923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:07.180189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e9d66e4-283e-4f5b-a6d1-cada65d54286 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.364143 Nov 06 21:01:07.183026 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2212/4384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:06 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:07.585687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-100497b5-3449-44f9-8475-102c6c712761 req-95fb46a3-8252-4d58-953d-b1efc51ac63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dbf411-6b5d-4b0e-9075-cac0fce0c1ff", "name": "network-vif-deleted", "tag": "11cecbe1-ab5d-441c-8e32-561b6889099e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:07.588795 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:07.588795 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:01:07.598421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-100497b5-3449-44f9-8475-102c6c712761 req-95fb46a3-8252-4d58-953d-b1efc51ac63e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.598941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-100497b5-3449-44f9-8475-102c6c712761 req-95fb46a3-8252-4d58-953d-b1efc51ac63e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.614259 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-100497b5-3449-44f9-8475-102c6c712761 req-95fb46a3-8252-4d58-953d-b1efc51ac63e service nova] Creating event network-vif-deleted:11cecbe1-ab5d-441c-8e32-561b6889099e for instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff on nch1-master-1 Nov 06 21:01:07.620624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-100497b5-3449-44f9-8475-102c6c712761 req-95fb46a3-8252-4d58-953d-b1efc51ac63e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039993 Nov 06 21:01:07.626445 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2173/4385] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:07.728247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:07.729593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:07.738395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.739168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.740613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.741326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.767912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:07.768846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:07.781158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.781996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.786535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.788122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.898666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:07.911109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d06d2e7-526a-492b-8fa3-bdbcb5b337e5 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 200 len: 1183 microversion: 2.1 time: 0.185684 Nov 06 21:01:07.914083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2213/4386] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:07 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 1183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:07.928849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:07.935922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:07.954857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.955329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:07.956151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:07.968803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.079016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7cd7b23a-ccf0-425d-aca7-cb00ba7ceccd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.159280 Nov 06 21:01:08.084048 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2214/4387] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:07 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:08.113274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:08.114936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:08.125483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.130293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.131719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.132565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.184908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-811269e6-ae73-4a0e-bd7c-c0595235ec69 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.100418 Nov 06 21:01:08.189909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2215/4388] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:08 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:08.199976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:08.201142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:08.214582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.215568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.217460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.218249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.277540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:08.288785 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0175111-7f0f-4b3a-8f1b-0bb2dc61825d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1514 microversion: 2.1 time: 0.525757 Nov 06 21:01:08.289422 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2174/4389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:07 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:08.424028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:08.433322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fceea07-b9e5-463b-9c16-dd0e69c2a3e5 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.239162 Nov 06 21:01:08.434093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2216/4390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:08 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:08.931846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:08.932619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:08.942928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.943548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.944491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:08.945321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:08.961704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] HTTP exception thrown: Instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff could not be found. Nov 06 21:01:08.963345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Returning 404 to user: Instance 32dbf411-6b5d-4b0e-9075-cac0fce0c1ff could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:01:08.964416 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60b12338-ff51-439b-b2ee-9f91897456cd tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff" status: 404 len: 111 microversion: 2.1 time: 0.037683 Nov 06 21:01:08.965156 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2175/4391] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:08 2021] GET /compute/v2.1/servers/32dbf411-6b5d-4b0e-9075-cac0fce0c1ff => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:01:09.093744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:09.095498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:09.110785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.111423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.112274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.112729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.182037 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ca62f4f-bf85-41c6-b8ff-fd4ac53f88d8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.093339 Nov 06 21:01:09.182613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2217/4392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:09 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:09.201374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:09.202417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:09.209051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.209646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.210459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.210903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.258815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-089c1cf9-1e59-4811-9051-52e0e0fa3892 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.062016 Nov 06 21:01:09.262253 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2176/4393] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:09 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:09.309787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:09.310738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:09.318812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.319765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.320952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.322385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.474318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:09.478812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:09.495615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.496793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.499022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:09.499719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:09.631130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:09.641876 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a88e346-bae3-43de-9581-ea006564a5a0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.338432 Nov 06 21:01:09.643356 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2218/4394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:09 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:09.811688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:09.821415 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b154e691-46e6-436f-8cce-70b9b66b924d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.370776 Nov 06 21:01:09.822568 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2177/4395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:09 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:10.194398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:10.196058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:10.216055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.216516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.217396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.218143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.276373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:10.280441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:10.302211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5da5dcfb-d095-4106-bd67-63243b5efd0f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.110656 Nov 06 21:01:10.304606 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2219/4396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:10 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:10.309164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.312036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.316029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.318684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.412546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb275985-b02d-4669-a83b-5a9d43e008b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.142199 Nov 06 21:01:10.420489 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2178/4397] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:10 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:10.668807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:10.670502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:10.682815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.685246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.686553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.687910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.840961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:10.842031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:10.864323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.864799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:10.876033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:10.876812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.101213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:11.108780 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2900b1f9-52de-48cc-b004-e3b49a417c86 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.448080 Nov 06 21:01:11.113771 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2220/4398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:10 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:11.123199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8b352966-05c5-4227-87ea-aeaf6532b47d req-c0d827d0-ecaa-416c-8a39-dae04d1128f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c156c11-1083-4c2b-93fe-468f7336cd2c", "name": "network-vif-plugged", "status": "completed", "tag": "cc994223-3c09-4974-9bcf-82aa03fca83e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:11.129265 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:11.129265 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:11.142559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b352966-05c5-4227-87ea-aeaf6532b47d req-c0d827d0-ecaa-416c-8a39-dae04d1128f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.146997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b352966-05c5-4227-87ea-aeaf6532b47d req-c0d827d0-ecaa-416c-8a39-dae04d1128f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.181479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8b352966-05c5-4227-87ea-aeaf6532b47d req-c0d827d0-ecaa-416c-8a39-dae04d1128f9 service nova] Creating event network-vif-plugged:cc994223-3c09-4974-9bcf-82aa03fca83e for instance 5c156c11-1083-4c2b-93fe-468f7336cd2c on nch2-master-1 Nov 06 21:01:11.189520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8b352966-05c5-4227-87ea-aeaf6532b47d req-c0d827d0-ecaa-416c-8a39-dae04d1128f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074080 Nov 06 21:01:11.191544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2221/4399] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:11.227255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:11.264423 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea008a3a-6593-4c3c-818e-417a4c86df96 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.420612 Nov 06 21:01:11.274595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2179/4400] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:10 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:11.297829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:11.299055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:11.306646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.307438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.309158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.312337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.318694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:11.320903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:11.334863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.335620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.339724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.343220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.382450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:11.436044 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1482aaaf-c2ea-4201-a673-b6d6dbfa78ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.116542 Nov 06 21:01:11.438063 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2180/4401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:11 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:11.449032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:11.451714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:11.460832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.461539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.462946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.463655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.530752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bbc5c7b-9ba0-452a-ba49-fe7dcf84daf2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 204 len: 0 microversion: 2.1 time: 0.239270 Nov 06 21:01:11.533650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2222/4402] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:11 2021] DELETE /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:01:11.546503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:11.547549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:11.567838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.568730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.569767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:11.572396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:11.735376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50ae8041-dc68-4c80-b975-5d27d7b1c768 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.294443 Nov 06 21:01:11.736028 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2181/4403] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:11 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:11.833131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:11.845473 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-348f1245-1ad2-47fb-938b-b34c6acd3956 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1500 microversion: 2.1 time: 0.305973 Nov 06 21:01:11.849888 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2223/4404] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:11 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1500 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:12.132814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:12.133318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:12.162712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.163187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.165144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.165636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.281475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:12.282241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:12.294534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.294993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.295796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.296238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.615667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:12.628694 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc8a8661-8b2d-43d8-9f5c-f953e251a8a2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.498014 Nov 06 21:01:12.631991 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2182/4405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:12 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:12.642154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:12.647127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:12.662228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.665037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.667983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.668702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.685378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:12.693550 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87548ced-9a20-4e25-95d1-d233fb194b5d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1317 microversion: 2.1 time: 0.415614 Nov 06 21:01:12.697266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2224/4406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:12 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:12.743562 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-796be5b5-b020-4274-b137-cf2bd0b64fa1 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.109883 Nov 06 21:01:12.745959 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2183/4407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:12 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:12.746818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:12.747864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:12.757816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.758620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.759693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.762187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.830529 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce0c40cc-cbe1-4e3f-bbed-ed1300fd03dc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.087594 Nov 06 21:01:12.831557 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2225/4408] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:12 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:12.897086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:12.897946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:12.940518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.941064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:12.941896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:12.942363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:13.274294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:13.281846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-472e8b36-f008-41b8-aaf7-9dec56d633de tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 200 len: 1500 microversion: 2.1 time: 0.390772 Nov 06 21:01:13.282427 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2184/4409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:12 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:13.470454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5757a87e-b392-4a50-99ce-f6490ba6a591 req-bf34729c-2e80-4197-a005-41be78aafb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7675136e-8794-496a-a186-3531f5aa4d0f", "name": "network-vif-deleted", "tag": "be7b680a-e8bb-4f73-a40c-30b3e1f27383"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:13.483031 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:13.483031 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:13.505922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5757a87e-b392-4a50-99ce-f6490ba6a591 req-bf34729c-2e80-4197-a005-41be78aafb35 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:13.506372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5757a87e-b392-4a50-99ce-f6490ba6a591 req-bf34729c-2e80-4197-a005-41be78aafb35 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:13.522398 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5757a87e-b392-4a50-99ce-f6490ba6a591 req-bf34729c-2e80-4197-a005-41be78aafb35 service nova] Creating event network-vif-deleted:be7b680a-e8bb-4f73-a40c-30b3e1f27383 for instance 7675136e-8794-496a-a186-3531f5aa4d0f on nch1-master-1 Nov 06 21:01:13.529371 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5757a87e-b392-4a50-99ce-f6490ba6a591 req-bf34729c-2e80-4197-a005-41be78aafb35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064780 Nov 06 21:01:13.530691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2226/4410] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:13.647137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:13.649152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:13.661623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:13.662083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:13.662899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:13.663344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:13.716996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:13.719219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:13.727866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:13.728712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:13.729678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:13.730279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.126551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:14.134382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e14a8ab-7725-45d2-a3fd-436b8f81c890 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.492304 Nov 06 21:01:14.149762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2185/4411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:13 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:14.159318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:14.160398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.174046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:14.175674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.176373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.177394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.177997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.185561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c9bc783-6396-4188-af2a-764c119ee0af tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1507 microversion: 2.1 time: 0.473682 Nov 06 21:01:14.201188 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2227/4412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:13 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:14.218561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:14.220194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.235433 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6cca173-49c6-463e-a236-dad901b35830 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.083307 Nov 06 21:01:14.236656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2186/4413] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:14 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:14.256350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.257275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.259077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.260111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.260493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.261234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.280315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.287366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.288602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.289527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.342254 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d318a8c2-cbef-4b41-ae86-4e4297845df7 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips" status: 200 len: 110 microversion: 2.1 time: 0.099570 Nov 06 21:01:14.343508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2187/4414] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips => generated 110 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:14.351667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2dcea86-40dd-44f7-8872-2eed8bf90c7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.143198 Nov 06 21:01:14.353493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2228/4415] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:14 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:14.358958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.363225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.383037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.384067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7675136e-8794-496a-a186-3531f5aa4d0f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.393501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.398619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.400495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.402353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.402688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.405535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.406068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.408418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.442582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] HTTP exception thrown: Instance 7675136e-8794-496a-a186-3531f5aa4d0f could not be found. Nov 06 21:01:14.445252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Returning 404 to user: Instance 7675136e-8794-496a-a186-3531f5aa4d0f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:01:14.447170 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a58696ce-e934-47a6-b947-7680d71fe1a2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f" status: 404 len: 111 microversion: 2.1 time: 0.102274 Nov 06 21:01:14.448875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2188/4416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/7675136e-8794-496a-a186-3531f5aa4d0f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:01:14.465354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.471000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.490216 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a526476-f644-4fbd-9cdc-1cca185b1303 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips" status: 200 len: 110 microversion: 2.1 time: 0.135213 Nov 06 21:01:14.497803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2229/4417] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips => generated 110 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:14.499499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.505826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.509376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.519479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.522470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.527796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.565307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.569705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.572641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.576146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.629126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:14.647580 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54966042-5854-4b57-bb33-3f03eb7c509f tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips/tempest-ServerAddressesTestJSON-2111907271-network" status: 200 len: 95 microversion: 2.1 time: 0.140329 Nov 06 21:01:14.655124 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2230/4418] 10.222.0.13 () {58 vars in 1400 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c/ips/tempest-ServerAddressesTestJSON-2111907271-network => generated 95 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:01:14.668096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.669015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.676714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.677490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.679016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.680115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.706540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:14.847914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-169db38d-3368-4ef0-92b9-30a05105c469 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 204 len: 0 microversion: 2.1 time: 0.190580 Nov 06 21:01:14.851918 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2231/4419] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:14 2021] DELETE /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:01:14.867487 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5adc796-5b8b-4317-8c4a-60e12c0946df tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 204 len: 0 microversion: 2.1 time: 0.411897 Nov 06 21:01:14.868162 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2189/4420] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:14 2021] DELETE /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:01:14.877419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.878656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.893079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.893762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.893898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:14.894643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:14.895036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.895640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.906977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.907439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:14.908242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:14.912772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.177714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:15.179539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:15.189031 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f3065e7-cd3d-4588-a991-23ceb798a1b2 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1485 microversion: 2.1 time: 0.316448 Nov 06 21:01:15.189816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2190/4421] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1485 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:15.191088 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ef7cf9f-3dae-402e-a5df-c88fa220276d tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1513 microversion: 2.1 time: 0.333489 Nov 06 21:01:15.192339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2232/4422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:14 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:15.206765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:15.208663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:15.236650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.237882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.240177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.241439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.248624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:15.250047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:15.260599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.261062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.262228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.262681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.312173 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-299be742-d514-4019-8cec-1dd36c92c831 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.068192 Nov 06 21:01:15.313402 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2233/4423] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:15 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:15.363481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:15.365470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:15.383841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.385940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.388724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:15.389503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:15.453885 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-961075cf-56b9-4a37-972f-a916398d3d4e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 14 microversion: 2.20 time: 0.092615 Nov 06 21:01:15.463237 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2234/4424] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:15 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:15.503332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:15.513759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-827fc2ea-7389-450c-b0fb-2bf6afdbd09c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.322724 Nov 06 21:01:15.514342 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2191/4425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:15 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:16.214867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:16.216283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:16.219277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:16.221684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:16.252249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.262148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.265713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.266306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.270171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.270875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.278440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.282253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.523056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:16.537670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af047822-3669-45d7-9b3d-b9bc20c83724 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 200 len: 1443 microversion: 2.1 time: 0.332982 Nov 06 21:01:16.544653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2235/4426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:16 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 1443 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:16.555319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:16.557077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:16.572347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.573339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.575505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.575947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.660089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92115d26-f9f7-45e2-9b3c-1b224c21261a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.119185 Nov 06 21:01:16.662401 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2236/4427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:16 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:16.684097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5265f0c6-f646-4b60-99d2-dedba1955e71 req-36bcc6e1-2992-4bd0-8df0-216e149a06bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb50e55-c156-48b0-9e20-92e1599e1a46", "name": "network-vif-deleted", "tag": "4194ac97-448e-472f-b93d-2a03adcfb436"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:16.687672 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:16.687672 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:16.698394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5265f0c6-f646-4b60-99d2-dedba1955e71 req-36bcc6e1-2992-4bd0-8df0-216e149a06bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.698885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5265f0c6-f646-4b60-99d2-dedba1955e71 req-36bcc6e1-2992-4bd0-8df0-216e149a06bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.717458 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5265f0c6-f646-4b60-99d2-dedba1955e71 req-36bcc6e1-2992-4bd0-8df0-216e149a06bc service nova] Creating event network-vif-deleted:4194ac97-448e-472f-b93d-2a03adcfb436 for instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 on nch1-master-1 Nov 06 21:01:16.723477 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5265f0c6-f646-4b60-99d2-dedba1955e71 req-36bcc6e1-2992-4bd0-8df0-216e149a06bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053176 Nov 06 21:01:16.724622 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2237/4428] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:16.731158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:16.733259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:16.740330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.740788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.741863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.742394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.825161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:16.847576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d45726a-8149-4a81-96c8-baaac04a1f58 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1513 microversion: 2.1 time: 0.638599 Nov 06 21:01:16.848366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2192/4429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:16 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1513 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:16.865387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef9ca675-0ac5-4050-99c5-2d090d0636a3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 16397 microversion: 2.20 time: 0.138367 Nov 06 21:01:16.866526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2238/4430] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:16 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 16397 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:16.875747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:16.876593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:16.886221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.886684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:16.887535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:16.887981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.338932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:17.356864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7b1c464-4763-4512-b690-0f32e5a71ad7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.491443 Nov 06 21:01:17.360726 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2193/4431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:16 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:17.561585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:17.562145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: 7cb50e55-c156-48b0-9e20-92e1599e1a46] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:17.576138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.576626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.577439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.577879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.631150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] HTTP exception thrown: Instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 could not be found. Nov 06 21:01:17.631774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Returning 404 to user: Instance 7cb50e55-c156-48b0-9e20-92e1599e1a46 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:01:17.633590 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-06a5e113-9d68-45d0-8ca8-05ca4f194309 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46" status: 404 len: 111 microversion: 2.1 time: 0.075949 Nov 06 21:01:17.636990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2239/4432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:17 2021] GET /compute/v2.1/servers/7cb50e55-c156-48b0-9e20-92e1599e1a46 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:01:17.645488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:17.646977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:17.656336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.657272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.658370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.659229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.674878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:17.682989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:17.754420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.756190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.757282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:17.759819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.760275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.858478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f382408-2d5a-44b0-b94c-d33ff2a43c39 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.188446 Nov 06 21:01:17.864313 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2240/4433] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:17 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:17.891007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:17.891702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:17.914615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.914615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.936012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.937318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.939893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15a404f5-ecc0-431e-8ad4-82bf78a3f958 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 204 len: 0 microversion: 2.1 time: 0.297220 Nov 06 21:01:17.941922 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2194/4434] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:17 2021] DELETE /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:01:17.960879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:17.963035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:17.979461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.980443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:17.981625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:17.983972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.073708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f72a7e81dc4765bd9e465be8ca31c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0574cd1faec94a7e9cb5468995d6be4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:18.084429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-639d1084-d58a-407c-8f40-357d41ce72b6 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 200 len: 1302 microversion: 2.1 time: 0.214210 Nov 06 21:01:18.084715 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c09f0ba-7681-4143-adeb-af71b1843923 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 16397 microversion: 2.20 time: 0.136370 Nov 06 21:01:18.097462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2241/4435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:17 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 1302 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:18.097686 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2195/4436] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:17 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 16397 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:18.097785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:18.097785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:18.105279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.105828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.106700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.107274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.285150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:18.297564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a99123d-c16d-4c47-a820-c5c8745a8c12 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1500 microversion: 2.1 time: 0.210207 Nov 06 21:01:18.309022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2242/4437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:18 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:18.375483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:18.383752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:18.392375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.393147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.394292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.394990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.758766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-cffa7397-2f4a-4eff-8399-d6a18446321d req-3000ba34-b598-4979-9fdc-afa59f496931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c156c11-1083-4c2b-93fe-468f7336cd2c", "name": "network-vif-deleted", "tag": "cc994223-3c09-4974-9bcf-82aa03fca83e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:18.760633 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:18.760633 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:18.768889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:18.776654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ce41950-1cdf-49e2-bbdb-204f7c3aedfb tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.405272 Nov 06 21:01:18.777178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cffa7397-2f4a-4eff-8399-d6a18446321d req-3000ba34-b598-4979-9fdc-afa59f496931 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.777778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cffa7397-2f4a-4eff-8399-d6a18446321d req-3000ba34-b598-4979-9fdc-afa59f496931 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.788377 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2196/4438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:18 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:18.805301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-cffa7397-2f4a-4eff-8399-d6a18446321d req-3000ba34-b598-4979-9fdc-afa59f496931 service nova] Creating event network-vif-deleted:cc994223-3c09-4974-9bcf-82aa03fca83e for instance 5c156c11-1083-4c2b-93fe-468f7336cd2c on nch2-master-1 Nov 06 21:01:18.818575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-cffa7397-2f4a-4eff-8399-d6a18446321d req-3000ba34-b598-4979-9fdc-afa59f496931 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061126 Nov 06 21:01:18.819519 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2243/4439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:01:18.871271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:18.872736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:18.886961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.887165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.887984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:18.888462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:18.972904 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-097eada5-d99c-4aff-a54f-89220ee29da7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.106279 Nov 06 21:01:18.974582 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2197/4440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:18 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:19.108112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:19.108424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:19.108771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] [instance: 5c156c11-1083-4c2b-93fe-468f7336cd2c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:19.111549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:19.126620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.127073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.130403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.132790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.133940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.134396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.138599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.141247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.182814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] HTTP exception thrown: Instance 5c156c11-1083-4c2b-93fe-468f7336cd2c could not be found. Nov 06 21:01:19.183431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] Returning 404 to user: Instance 5c156c11-1083-4c2b-93fe-468f7336cd2c could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:01:19.185255 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f298ede-7344-4952-a256-dbba73c5f9c1 tempest-ServerAddressesTestJSON-1465591061 tempest-ServerAddressesTestJSON-1465591061-project] 10.222.0.13 "GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c" status: 404 len: 111 microversion: 2.1 time: 0.083998 Nov 06 21:01:19.185819 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2198/4441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:19 2021] GET /compute/v2.1/servers/5c156c11-1083-4c2b-93fe-468f7336cd2c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:01:19.232396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3518a002-42bf-4a95-bf46-4e7588712d31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 16397 microversion: 2.20 time: 0.131509 Nov 06 21:01:19.236087 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2244/4442] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:19 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 16397 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:19.315049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:19.315668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:19.338466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.339060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.339876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.340343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.808378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:19.809274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:19.825454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.825905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:19.826702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:19.827187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.148751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:20.159414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96137184-78b8-430a-9b7b-163ee86b64b4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1500 microversion: 2.1 time: 0.845350 Nov 06 21:01:20.170094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2199/4443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:19 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1500 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:20.179205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:20.180436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:20.195569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.197759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.199333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.200276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.287719 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d91eabf-77a2-4e94-934a-e26879459a3c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.116179 Nov 06 21:01:20.292540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2200/4444] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:20 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:20.347609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:20.359265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04a8a31c-d16d-46e5-9d2b-2537ca4938b1 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.556871 Nov 06 21:01:20.360234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2245/4445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:19 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:20.376917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:20.381899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:20.397438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.401421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.403386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.405945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.503025 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79c9e515-3b2a-4f82-a13f-871066adacd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 16397 microversion: 2.20 time: 0.141064 Nov 06 21:01:20.507073 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2246/4446] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:20 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 16397 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:20.595906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Calling method '.version_select at 0x7f671abdfd30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:20.596823 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:20.596823 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:01:20.598423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.598898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.616764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.617484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.629312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.630392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.648405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03fc055d-8cc1-4ac8-84c1-5e4a1b2eb1ee tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388440717-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.347338 Nov 06 21:01:20.650428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2201/4447] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:01:20 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:20.839234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-87deb75b-0e29-4fe6-b76c-007b47528d1a req-743884dd-d741-4099-bcef-bb7124286c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2434de4-2c14-4111-8b89-1a7a517e3a35", "name": "network-vif-deleted", "tag": "d9f96638-2b86-47db-ab65-f6ee62e849cd"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:20.841418 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:20.841418 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:20.862616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-87deb75b-0e29-4fe6-b76c-007b47528d1a req-743884dd-d741-4099-bcef-bb7124286c8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:20.864427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-87deb75b-0e29-4fe6-b76c-007b47528d1a req-743884dd-d741-4099-bcef-bb7124286c8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:20.903718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-87deb75b-0e29-4fe6-b76c-007b47528d1a req-743884dd-d741-4099-bcef-bb7124286c8e service nova] Creating event network-vif-deleted:d9f96638-2b86-47db-ab65-f6ee62e849cd for instance f2434de4-2c14-4111-8b89-1a7a517e3a35 on nch1-master-1 Nov 06 21:01:20.915964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-87deb75b-0e29-4fe6-b76c-007b47528d1a req-743884dd-d741-4099-bcef-bb7124286c8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077907 Nov 06 21:01:20.917534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2247/4448] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:21.179103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:21.180599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:21.220410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.232448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.243114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.245125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.313090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:21.314801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:21.333760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.335985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.340084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.341390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.366140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.366653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.367127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lazy-loading 'fault' on Instance uuid f2434de4-2c14-4111-8b89-1a7a517e3a35 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:01:21.486852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbe3496db994852a09c97ee075fbd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80ec8702cd94e0eaefdf3eb907a0cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:21.505090 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6a9ac05-aeaa-46c9-8bf9-5393c97ff03a tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 200 len: 1301 microversion: 2.1 time: 0.331521 Nov 06 21:01:21.507983 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2202/4449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:21 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 1301 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:21.522859 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-177de5cb-4019-4860-987a-ce64c622ada2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.225803 Nov 06 21:01:21.537957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:21.539143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:21.552123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.554239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.556697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.557408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.580218 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2248/4450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:21 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:21.600621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:21.610802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:21.627405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.627875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.630489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:21.631113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:21.729862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cd18c15-0163-41c7-8c10-f34e7c728cd0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 16397 microversion: 2.20 time: 0.144827 Nov 06 21:01:21.733571 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2249/4451] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:21 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 16397 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:21.810676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:21.819165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93c7587e-f225-4c65-907e-d444327f61b5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.309098 Nov 06 21:01:21.830694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2203/4452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:21 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:22.543104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:22.545024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:22.549237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:22.550041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] [instance: f2434de4-2c14-4111-8b89-1a7a517e3a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:22.553973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.561013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.564224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.565531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.567097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.567796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.572318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.573654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.607523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] HTTP exception thrown: Instance f2434de4-2c14-4111-8b89-1a7a517e3a35 could not be found. Nov 06 21:01:22.609384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] Returning 404 to user: Instance f2434de4-2c14-4111-8b89-1a7a517e3a35 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:01:22.612340 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-231e0a1b-015d-4dbc-8e39-1453a8f5f5a4 tempest-LiveMigrationTest-2007295791 tempest-LiveMigrationTest-2007295791-project] 10.222.0.13 "GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35" status: 404 len: 111 microversion: 2.1 time: 0.075404 Nov 06 21:01:22.613331 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2250/4453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:22 2021] GET /compute/v2.1/servers/f2434de4-2c14-4111-8b89-1a7a517e3a35 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:01:22.681513 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42afef00-3a4b-496d-beb2-f0ee7be6b42a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.145802 Nov 06 21:01:22.688639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2204/4454] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:22 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:22.742546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:22.743964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:22.753311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.756019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.760288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.760784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.839457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:22.840524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:22.855570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.856782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.857903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:22.858570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:22.863679 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d5411de-3c4f-44fb-913c-d8404eb2e35d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.125910 Nov 06 21:01:22.864407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2251/4455] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:22 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:23.298586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:23.316986 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f446666-ca23-4fb6-9383-7d93ace7dff2 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.482843 Nov 06 21:01:23.317577 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2205/4456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:22 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:23.694332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:23.695350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:23.709386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:23.709847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:23.710421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:23.710859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:23.777277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86d85c2c-f757-47e3-ac33-b43f2b1f139b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.087360 Nov 06 21:01:23.782447 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2252/4457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:23 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:23.876409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:23.877371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:23.889947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:23.890796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:23.891854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:23.892555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:23.945339 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55825d71-c7ac-4e03-8693-d8493ccd4c39 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.072442 Nov 06 21:01:23.950493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2206/4458] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:23 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:24.335498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:24.336219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:24.357446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.357922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:24.358722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.359159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:24.789966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:24.791829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:24.801524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:24.803138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.805974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:24.807121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.807793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:24.812195 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d231ef2-c830-4da8-8a71-d5176353ce3e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.481179 Nov 06 21:01:24.814128 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2253/4459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:24 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:24.895582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa564635-5c77-43a8-bd61-a8f19262b941 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.108282 Nov 06 21:01:24.897444 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2207/4460] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:24 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:24.957540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:24.958568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:24.970861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.976738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:24.978313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:24.978836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:25.057055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7baf049-d50e-44e8-bb09-43e166a664e9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.102921 Nov 06 21:01:25.058515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2254/4461] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:24 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:25.833781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:25.834932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:25.847517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:25.853787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:25.855545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:25.856847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:25.909272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:25.911666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:25.969007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:25.971136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:25.974375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:25.975786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:26.068262 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09e9a2d3-15f6-40f1-aa25-bfbc3134a6ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.163015 Nov 06 21:01:26.073794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2255/4462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:25 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:26.079492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:26.086338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:26.100057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:26.100559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:26.101371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:26.101816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:26.189484 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c753499-9c9e-487d-88a4-07990cb16331 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.113411 Nov 06 21:01:26.193966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2256/4463] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:26 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:26.379015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:26.390700 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b95cf0a-4ca2-459a-aa6b-6b2b1efd832c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.561350 Nov 06 21:01:26.395092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2208/4464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:25 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:27.106265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:27.110062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:27.138826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.144854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.145959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.146516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.202743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:27.203704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:27.206049 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35becc11-0685-4ca9-868a-86d207fa583d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.117208 Nov 06 21:01:27.212649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2257/4465] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:27 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:27.225379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.225839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.226653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.227098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.333328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c37ef318-494c-4bee-a3ed-af10812129b3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.134736 Nov 06 21:01:27.339588 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2209/4466] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:27 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:27.411819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:27.412968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:27.432850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.433549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.435130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:27.435800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:27.751058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:27.758750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-340cf5fb-0498-49d6-aabd-b74e5e8dccb0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.351578 Nov 06 21:01:27.759322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2258/4467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:27 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:28.220110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:28.222080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:28.241819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.242574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:28.243593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.244195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:28.345479 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d72801b3-d6f0-4956-9b53-464062fff69a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.128869 Nov 06 21:01:28.349689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2210/4468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:28 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:28.350990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:28.354115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:28.369831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.370084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:28.387461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.389369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:28.448722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7c82315-9f3b-4587-ba30-e45736af4f5a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.102778 Nov 06 21:01:28.449421 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2259/4469] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:28 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:28.779985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:28.781490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:28.794069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.796368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:28.799012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:28.800386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:29.068727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:29.080651 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-708226c3-0c11-435e-b265-740aae4125aa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1509 microversion: 2.1 time: 0.304923 Nov 06 21:01:29.084782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2211/4470] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:28 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:29.362587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:29.366715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:29.382600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:29.383387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:29.385061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:29.387368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:29.460221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:29.461130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:29.475879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0d48c37-3394-4469-b10b-81b9a4f89116 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.113057 Nov 06 21:01:29.476362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:29.476828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:29.478199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:29.479130 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2260/4471] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:29 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:29.484241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:29.553256 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8870d75f-49ae-4945-be1d-9a11f31ede30 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.096733 Nov 06 21:01:29.554457 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2212/4472] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:29 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:30.102023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:30.102328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebef273c-61f0-4107-9527-e06f4cb4bcda tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] Calling method '.version_select at 0x7f6715254d30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:30.102771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:30.103524 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:30.103524 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:30.111839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.112343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.113171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.113621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.121771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebef273c-61f0-4107-9527-e06f4cb4bcda tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.259155 Nov 06 21:01:30.128661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2261/4473] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 21:01:29 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:30.134111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08fed199-5279-49be-8bf0-da1b1cc86c58 tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] Action: 'update', calling method: .version_select at 0x7f671ac95ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:30.136107 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:30.136107 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:30.314565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:30.324603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8130138e-16f8-4e70-acf3-272688ccab41 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1506 microversion: 2.1 time: 0.227433 Nov 06 21:01:30.336740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2213/4474] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:30 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:30.491215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:30.492407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:30.502845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.503608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.505202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.505919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.540915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08fed199-5279-49be-8bf0-da1b1cc86c58 tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.410155 Nov 06 21:01:30.542479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2262/4475] 10.222.0.13 () {60 vars in 1205 bytes} [Sat Nov 6 21:01:30 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:30.552275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a40814e4-a5e5-41e2-a212-fdeb075378fd tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] Calling method '.version_select at 0x7f671ac95a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:30.563193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f76ee7f9-cbfd-4968-93cd-d5775189112f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.077482 Nov 06 21:01:30.564321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2214/4476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:30 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:30.569575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:30.570804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:30.574023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a40814e4-a5e5-41e2-a212-fdeb075378fd tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025158 Nov 06 21:01:30.574528 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2263/4477] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 21:01:30 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:30.578980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.579700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.580748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:30.581347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:30.586058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7dbed78f-eac3-490f-b19a-693eff881566 tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] Action: 'update', calling method: .version_select at 0x7f6715394160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:30.635471 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-684632f2-7f93-467e-913a-f3cab1a55da3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.069473 Nov 06 21:01:30.637344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2215/4478] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:30 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:30.722812 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7dbed78f-eac3-490f-b19a-693eff881566 tempest-QuotaClassesAdminTestJSON-254690089 tempest-QuotaClassesAdminTestJSON-254690089-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.140231 Nov 06 21:01:30.723777 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2264/4479] 10.222.0.13 () {60 vars in 1205 bytes} [Sat Nov 6 21:01:30 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:31.343483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:31.345680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:31.364997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.365822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.366665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.367110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.576511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:31.578151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:31.596833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.597471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.598470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.599075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.659031 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9f7d6ee-ff32-417c-b8b9-5ada8ff37a58 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.085547 Nov 06 21:01:31.670334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2265/4480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:31 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:31.683869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:31.707277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83bc20a5-e731-455e-9ce0-722ecf334066 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1506 microversion: 2.1 time: 0.367584 Nov 06 21:01:31.707891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2216/4481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:31 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:31.720800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:31.721889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:31.730129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.730596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.731455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:31.731903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:31.785310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f80bd282-38c1-4785-9987-98f7a4cace3c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.113215 Nov 06 21:01:31.793210 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2266/4482] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:31 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:32.672496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:32.674297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:32.687065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1674249739", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6af1d3b-e143-4670-b58f-a692b325ad8f"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:32.694820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:32.695644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:32.698047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:32.698657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:32.777353 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9dd1388-b3f8-4eff-b732-a4c92fdda488 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.108860 Nov 06 21:01:32.779308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2267/4483] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:32 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:32.792349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:32.793579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:32.809704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] validate_networks() for [('e6af1d3b-e143-4670-b58f-a692b325ad8f', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:01:32.810406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:32.811010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:32.813085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:32.819825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.169042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:34.181478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d196f604-0afc-4fc1-b862-0460169b1886 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 200 len: 1449 microversion: 2.1 time: 1.399101 Nov 06 21:01:34.184247 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2268/4484] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:32 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 1449 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:34.203904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:34.205281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:34.213035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.213453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.214308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.215326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.293290 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13c400c8-9558-404b-8d42-8f6469ddd24f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.095848 Nov 06 21:01:34.294377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2269/4485] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:34 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:34.301935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9c68bb9e-321b-4be0-8b9c-0d4bb1e37fc7 req-4147725d-08ad-4a31-8014-bff3eddf7840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17805556-c997-414f-830f-56ceb14bfede", "name": "network-vif-unplugged", "status": "completed", "tag": "ab0fa452-b78b-414c-8ab1-ee7539cbab2b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:34.303463 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:34.303463 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:34.326838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9c68bb9e-321b-4be0-8b9c-0d4bb1e37fc7 req-4147725d-08ad-4a31-8014-bff3eddf7840 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.328877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9c68bb9e-321b-4be0-8b9c-0d4bb1e37fc7 req-4147725d-08ad-4a31-8014-bff3eddf7840 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.355684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.server_external_events [req-9c68bb9e-321b-4be0-8b9c-0d4bb1e37fc7 req-4147725d-08ad-4a31-8014-bff3eddf7840 service nova] Unable to find a host for instance 17805556-c997-414f-830f-56ceb14bfede. Dropping event network-vif-unplugged {{(pid=134827) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 06 21:01:34.356711 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9c68bb9e-321b-4be0-8b9c-0d4bb1e37fc7 req-4147725d-08ad-4a31-8014-bff3eddf7840 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060071 Nov 06 21:01:34.359344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2270/4486] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 06 21:01:34.373042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:34.374109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:34.393084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.398224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.399329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.399929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.510297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af3e3587-5e92-4364-9e2d-b498b56160f2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.146744 Nov 06 21:01:34.511089 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2271/4487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:34 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:34.522346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:34.530033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:34.539368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.540789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:34.541819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:34.542758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.283592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:01:35.285973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:01:35.286314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:35.287919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:01:35.290688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:01:35.292438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:01:35.315051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-598b8902-ea2e-42ef-92d8-3cf363538e9f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.797936 Nov 06 21:01:35.317292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2272/4488] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:34 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:35.339799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.346385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.349134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:35.351412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.354693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:35.356654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.370169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.371223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.373721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.375571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.445036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Getting quotas for project c8182a523546466fa113050d28f19731. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:01:35.453715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b4b55fb-b5b5-4613-85ce-c3cf6540c2f6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.132331 Nov 06 21:01:35.455149 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2273/4489] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:35 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:35.460074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:35.465128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:35.468095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Getting quotas for user 5f93174d8e8d4c29b55724b1aeef6bc7 and project c8182a523546466fa113050d28f19731. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:01:35.475278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.482622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.483704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.484152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.502933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:01:35.505592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:01:35.590200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ceb56e34-b692-4a8f-b132-b2c06b4ef3e8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.228157 Nov 06 21:01:35.597224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2217/4490] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:01:32 2021] POST /compute/v2.1/servers => generated 383 bytes in 3236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:01:35.602720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:35.604050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:35.644777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.646529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.647388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:35.648766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:35.738192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32a04a5f-3347-4958-b8be-3b0a14abe7d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.139130 Nov 06 21:01:35.739141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2218/4491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:35 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:35.748679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e454aee7-d9cc-44c5-9c82-f448a188ca12 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:35.751087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e454aee7-d9cc-44c5-9c82-f448a188ca12 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:36.089246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e454aee7-d9cc-44c5-9c82-f448a188ca12 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:36.098743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e454aee7-d9cc-44c5-9c82-f448a188ca12 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1223 microversion: 2.1 time: 0.357975 Nov 06 21:01:36.099610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2219/4492] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:35 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1223 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:36.467849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:36.469123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:36.481479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:36.486413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:36.493488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:36.494452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:36.620523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba2f1868-8636-4ce5-a683-6cb3279e0115 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.156826 Nov 06 21:01:36.621692 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2220/4493] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:36 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:36.752324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:36.753786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:36.771380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:36.772680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:36.778347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:36.780813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:36.862851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:36.877160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-770dffa5-3606-42a3-b7f0-027fafdd3097 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.129790 Nov 06 21:01:36.879321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2221/4494] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:36 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:36.898131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a4f3789-f99a-48fc-89a0-bda07433995c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 1.441705 Nov 06 21:01:36.906105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2274/4495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:35 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:36.926841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18d4a85c-8bdf-4d89-98c3-534abc0d2d78 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:36.956672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18d4a85c-8bdf-4d89-98c3-534abc0d2d78 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:36.959557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18d4a85c-8bdf-4d89-98c3-534abc0d2d78 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.041104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18d4a85c-8bdf-4d89-98c3-534abc0d2d78 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Going to try to stop instance {{(pid=134828) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:01:37.129012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:37.129958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:37.142015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.145329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.147244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.149501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.199015 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18d4a85c-8bdf-4d89-98c3-534abc0d2d78 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.277036 Nov 06 21:01:37.199727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2222/4496] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:36 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:37.223626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:37.224343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:37.256338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.256901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.257890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.258900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.567431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:37.577679 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1f35c13-f3ed-4d43-b912-1f330074cbfe tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1227 microversion: 2.1 time: 0.456594 Nov 06 21:01:37.578268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2275/4497] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:37 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1227 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:37.633552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:37.634589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:37.645959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.646729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.649755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.652890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.754337 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1bbd6916-6fe4-49f1-a8ca-86e4cc2ce5f1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.125581 Nov 06 21:01:37.760334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2276/4498] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:37 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:37.809062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:37.817611 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20debf3f-6bf4-48ce-abe4-a0b8c52afc93 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.603775 Nov 06 21:01:37.818193 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2223/4499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:37 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:37.890977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:37.892006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:37.901766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.902551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.906074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:37.906520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:37.989042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87d6ef59-4e70-43a5-bf8c-c3217b16f1e3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.098849 Nov 06 21:01:37.989042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2277/4500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:37 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:38.443317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-800609146", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:38.510124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:01:38.595057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:38.595872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:38.606304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.606767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:38.607906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.608442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:38.785909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:38.796215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-776b323b-14ec-4f50-aaaa-4a9f91c52725 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1281 microversion: 2.1 time: 0.205142 Nov 06 21:01:38.799213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2278/4501] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:38 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:38.813065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:38.814058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:38.824437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.824903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:38.825766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.826404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:38.889523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a4bbb36-4920-4c52-9682-8dacdb519584 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.080066 Nov 06 21:01:38.893848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2279/4502] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:38 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:38.899658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:38.900851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:38.909802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.910457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:38.911513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:38.912135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.480920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:01:39.481947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:01:39.483183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:01:39.484331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:01:39.484855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:01:39.500586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.502140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.503577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.504172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.527461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:01:39.532826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for user cdaa84f1e2f940c684852fff39ac23a0 and project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:01:39.547916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:01:39.550777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:01:39.576970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:39.587421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1cbaa5ce-223d-4705-8fd6-ef9b99769217 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.694427 Nov 06 21:01:39.588484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2280/4503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:38 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:39.593316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:39.594478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:39.603723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.604498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.605653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.606467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.637421 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-537c1675-4cd8-4f55-af58-299eec34e75f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479048 Nov 06 21:01:39.638281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2224/4504] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:01:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:01:39.702440 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76557349-40f1-4cd7-a357-a84652691c05 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.111391 Nov 06 21:01:39.708784 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2281/4505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:39 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:39.822038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:39.822937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1559103844", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:39.825071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:39.843689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.853937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.854914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:39.855598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:39.923990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:01:40.524732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:40.535466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49f84c64-5ca6-48a3-8dfa-ac683b60d6f4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.722746 Nov 06 21:01:40.549015 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2282/4506] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:39 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:40.553911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:40.555738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:40.564687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.565151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.566431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.566880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.614217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fe3618d-e37c-4461-bc7d-3d432278b42d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.063923 Nov 06 21:01:40.614999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2283/4507] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:40 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:40.622433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:01:40.622910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:40.623464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:40.623855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:01:40.624521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:01:40.625250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:01:40.625911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:01:40.636105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.637257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.638356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.638647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.639164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.639884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.641501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.642302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.661772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:01:40.668167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for user cdaa84f1e2f940c684852fff39ac23a0 and project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:01:40.683520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:01:40.688053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:01:40.743741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b36d51d-f2cb-43ed-934d-ff9af8e3cd28 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932851 Nov 06 21:01:40.744421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2225/4508] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:01:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:01:40.749214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:40.750482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:40.756879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.757751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.758835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:40.759496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:40.812336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7663bd61-f1de-416f-b1f4-78981fa74e7c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.066295 Nov 06 21:01:40.813157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2226/4509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:40 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:40.824035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb6789f3-a06f-4891-82c4-86fe256ae05e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:40.828614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb6789f3-a06f-4891-82c4-86fe256ae05e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:40.968544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cb6789f3-a06f-4891-82c4-86fe256ae05e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:40.977914 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb6789f3-a06f-4891-82c4-86fe256ae05e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1214 microversion: 2.1 time: 0.161579 Nov 06 21:01:40.980094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2227/4510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:40 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:41.154616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:41.164719 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cb04ee96-971c-497a-8286-7234f67c91c4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.548260 Nov 06 21:01:41.175410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2284/4511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:40 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:41.553940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:41.555423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:41.563010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.563799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.564709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.565158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.627263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:41.629284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:41.639349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.639904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.641034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.641541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.696533 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9924193-b2ca-4ad8-958c-857107398786 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.072325 Nov 06 21:01:41.697330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2285/4512] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:41 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:41.829182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:41.830725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:41.847316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.849275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.851382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.852843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:41.882573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:41.919495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-943824bc-0309-4a97-9ea7-cacf952416c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.362618 Nov 06 21:01:41.920375 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2228/4513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:41 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:41.936677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-26dca2e8-cae0-4197-9cf0-83e689633b28 req-b5ee8537-03d0-4c6d-86a4-ca1d27b5d4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:41.941298 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:41.941298 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:01:41.942723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36c2f965-e3f3-4652-9769-a247f939514e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.121015 Nov 06 21:01:41.946788 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2286/4514] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:41 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:41.975182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-26dca2e8-cae0-4197-9cf0-83e689633b28 req-b5ee8537-03d0-4c6d-86a4-ca1d27b5d4d3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:41.976350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-26dca2e8-cae0-4197-9cf0-83e689633b28 req-b5ee8537-03d0-4c6d-86a4-ca1d27b5d4d3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.003773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:42.004661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:42.005163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-26dca2e8-cae0-4197-9cf0-83e689633b28 req-b5ee8537-03d0-4c6d-86a4-ca1d27b5d4d3 service nova] Creating event network-changed:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:01:42.015295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-26dca2e8-cae0-4197-9cf0-83e689633b28 req-b5ee8537-03d0-4c6d-86a4-ca1d27b5d4d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093088 Nov 06 21:01:42.018301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2229/4515] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:42.018755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.019227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.020323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.020564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.158469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:42.182332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:42.183751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:42.184348 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec6c52b9-9529-408d-ade0-cf975c4d894a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1284 microversion: 2.1 time: 0.190298 Nov 06 21:01:42.187212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2287/4516] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:41 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:42.202933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.203630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.204630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.205248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.710235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:42.712673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:42.721030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.722833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.725079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.725540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.775785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d36a38e5-6c93-4d1a-886e-7d43c961a908 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.069870 Nov 06 21:01:42.777828 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2288/4517] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:42 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:42.844749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:42.857920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-543b6d31-47a4-4ea1-bdc9-f5587333e30d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.679738 Nov 06 21:01:42.869284 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2230/4518] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:42 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:42.941859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:42.943611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:42.956888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:42.958229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:42.959139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.959582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.960680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.961166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.975302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.975884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:42.981753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:42.981753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.045385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6edf9ac-2bb2-4385-a789-272816f85a90 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.093949 Nov 06 21:01:43.046547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2231/4519] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:42 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:43.203224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:43.203732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:43.210436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.211163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.212116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.212740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.397939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:43.410213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:43.413958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eae491e0-3970-4580-945c-61b8a1792ac6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1272 microversion: 2.1 time: 0.214787 Nov 06 21:01:43.415315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2232/4520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:43 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:43.429452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de9b509c-c32e-48d9-b4f9-314904123109 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.494504 Nov 06 21:01:43.430947 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2289/4521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:42 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:43.787024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:43.788030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:43.810726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.811484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.812761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.812924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.879138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:43.879864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:43.886825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bfc2900c-d6a5-4d63-a5fd-1edbfd4aa297 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.103340 Nov 06 21:01:43.891915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.892249 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2233/4522] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:43 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:43.892600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:43.893564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:43.894231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.058184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:44.074812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:44.083919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.084757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.085778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.088029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.142997 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce49e2bf-e783-4a63-b33d-6da9fa014f2d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.089497 Nov 06 21:01:44.144110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2234/4523] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:44 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:44.427685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:44.432159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:44.432910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:44.439769 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad466ed9-e27f-46f4-acff-7ee9174d3a66 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.564134 Nov 06 21:01:44.446334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.446795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.452819 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2290/4524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:43 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:44.457513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.458131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.459702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:44.460517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:44.467670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.468132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:44.468967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:44.471433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.052743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:45.064065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:45.071937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2ad6a22-396e-4e7b-9b80-cefb972b6e17 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.617744 Nov 06 21:01:45.072959 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac2535e6-1869-4118-9f70-5aba7162cc3e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.645459 Nov 06 21:01:45.075491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2235/4525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:44 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:45.076586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2291/4526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:44 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:45.088818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-eaa67076-2bb8-40b1-9681-76fc81589d33 req-826cd5b7-340f-40d1-9b71-f8aa9f40c695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:45.089488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:45.090550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:45.098888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.099982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.102164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.102964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.106037 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:45.106037 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:45.113802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-eaa67076-2bb8-40b1-9681-76fc81589d33 req-826cd5b7-340f-40d1-9b71-f8aa9f40c695 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.114617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-eaa67076-2bb8-40b1-9681-76fc81589d33 req-826cd5b7-340f-40d1-9b71-f8aa9f40c695 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.133220 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-eaa67076-2bb8-40b1-9681-76fc81589d33 req-826cd5b7-340f-40d1-9b71-f8aa9f40c695 service nova] Creating event network-changed:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:01:45.143549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-eaa67076-2bb8-40b1-9681-76fc81589d33 req-826cd5b7-340f-40d1-9b71-f8aa9f40c695 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065537 Nov 06 21:01:45.145054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2292/4527] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:45.156220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:45.157394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:45.163026 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f5fa13c-523c-43f1-933d-2273533f169b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.085353 Nov 06 21:01:45.164999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2236/4528] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:45 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:45.170638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.170638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.170852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.171348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.222625 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac91a7ce-24db-4ef1-8604-76912f7e70f5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.070151 Nov 06 21:01:45.228681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2293/4529] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:45 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:45.459120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:45.460105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:45.467709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.468496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.469751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:45.470436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:45.856253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:45.878285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c10e99c0-f14f-45c3-a7f4-c3514d1606d9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.421319 Nov 06 21:01:45.890717 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2237/4530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:45 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:46.094004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:46.094574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:46.095069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:46.096327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:46.101899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.102552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.104344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.105115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.110599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.115758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.118625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.119367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.610252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:46.622569 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f873b13-6b16-4740-9f0b-c26322edff1d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.534189 Nov 06 21:01:46.632072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2238/4531] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:46 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:46.639095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:46.648247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ef7c0e0-40e7-4652-95a2-ff227067d1f5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.559550 Nov 06 21:01:46.649444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2294/4532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:46 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:46.653000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:46.654010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:46.658611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:46.659976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:46.668699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.669174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.669653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.669938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.670480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.670929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.671514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.672137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.732785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3873629f-b1f2-4287-89f1-fb08130bf391 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.081356 Nov 06 21:01:46.743392 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7f2da21-a2c7-479f-9aba-8dc395193d88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.108934 Nov 06 21:01:46.743857 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2239/4533] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:46 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:46.745361 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2295/4534] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:46 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:46.749364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-20f538b8-b242-408f-b142-358ce7513e72 req-bb84615f-8d47-4222-91ee-d718fc91aba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a3cebc-56c7-4387-9343-0de4c41f90b9", "tag": "688f6858-27d7-40ab-b4b1-48a4bfd5cdbd"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:46.750848 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:46.750848 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:01:46.763907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-20f538b8-b242-408f-b142-358ce7513e72 req-bb84615f-8d47-4222-91ee-d718fc91aba1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.764319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-20f538b8-b242-408f-b142-358ce7513e72 req-bb84615f-8d47-4222-91ee-d718fc91aba1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.777737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-20f538b8-b242-408f-b142-358ce7513e72 req-bb84615f-8d47-4222-91ee-d718fc91aba1 service nova] Creating event network-changed:688f6858-27d7-40ab-b4b1-48a4bfd5cdbd for instance 20a3cebc-56c7-4387-9343-0de4c41f90b9 on nch2-master-1 Nov 06 21:01:46.783187 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-20f538b8-b242-408f-b142-358ce7513e72 req-bb84615f-8d47-4222-91ee-d718fc91aba1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037710 Nov 06 21:01:46.785543 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2240/4535] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:46.897558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:46.899307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:46.906953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.907796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:46.908916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:46.909589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:47.357186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:47.365285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8e4f5ff-8455-4021-abb4-f9ae08cf8466 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1679 microversion: 2.1 time: 0.472569 Nov 06 21:01:47.365853 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2296/4536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:46 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1679 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:47.642402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:47.643518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:47.651029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:47.651835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:47.652766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:47.653380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:47.665125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:47.665721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:47.676154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:47.677542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:47.678891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:47.679580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.285079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:48.294257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b26b4efd-aec5-4148-aaa4-9a189852011f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.657463 Nov 06 21:01:48.295268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2241/4537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:47 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:48.300414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:48.301610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:48.308590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.309127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.310193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.310704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.317208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:48.325021 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-958f9549-e640-470f-a38f-5ca0eb828ea3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.663776 Nov 06 21:01:48.334659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2297/4538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:47 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:48.334659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:48.334659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:48.339360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.339903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.340792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.341579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.364405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86edc07f-863e-43a3-88cb-3633a8ebb4a4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.067699 Nov 06 21:01:48.365567 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2242/4539] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:48 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:48.381987 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dad8deb6-630f-4ee6-9d09-4ee9c0f385fc tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.054563 Nov 06 21:01:48.383034 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2298/4540] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:48 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:48.384341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:48.385381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:48.393296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.393757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.394550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.395173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.580118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:48.588557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df8290e5-48b2-4925-9b13-131bba066015 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1656 microversion: 2.1 time: 0.209154 Nov 06 21:01:48.589132 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2243/4541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:48 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1656 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:48.605581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcdd9092-edab-4cfb-88c5-ba6f4689a9ad tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:48.612693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcdd9092-edab-4cfb-88c5-ba6f4689a9ad tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.613222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcdd9092-edab-4cfb-88c5-ba6f4689a9ad tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.638870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcdd9092-edab-4cfb-88c5-ba6f4689a9ad tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Going to try to start instance {{(pid=134827) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 21:01:48.684579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcdd9092-edab-4cfb-88c5-ba6f4689a9ad tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.082978 Nov 06 21:01:48.688286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2299/4542] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:48 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:48.694574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:48.696541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:48.705179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.706169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.707199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:48.707858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:48.889234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:48.896592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35818e14-3f93-4633-8317-55a9438284f8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1665 microversion: 2.1 time: 0.206074 Nov 06 21:01:48.897160 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2244/4543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:48 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:49.313263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:49.314002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:49.320587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.321040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.321838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.322274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.342660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:49.343576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:49.350624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.351277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.352808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.353785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.532962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:49.540882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1ffe142-b019-4276-bb64-d94480b9e209 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.232648 Nov 06 21:01:49.541568 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2300/4544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:49 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:49.556047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:49.556282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:49.557246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:49.563373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.564021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.564171 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c2a69ff-6c67-41f1-9daf-3e09b5bfd137 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.225265 Nov 06 21:01:49.564754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2245/4545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:49 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:49.565167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.565615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.569775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:49.570739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:49.576975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.577742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.578600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.579107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.615287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25476497-c6e3-4e79-ad28-390647fbff4f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.063417 Nov 06 21:01:49.616183 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2301/4546] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:49 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:49.622081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b28a80ff-b569-41b0-9078-7eccc237ec40 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.055501 Nov 06 21:01:49.622730 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2246/4547] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:49 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:49.915379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:49.916173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:49.923966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.924667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:49.925606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:49.926050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.140607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:50.149487 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86a818be-339c-472b-af23-bb823656e93f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1665 microversion: 2.1 time: 0.238256 Nov 06 21:01:50.150165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2302/4548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:49 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1665 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:50.558645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:50.559303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:50.568585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.569040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.570150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.571226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.580594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:50.581443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:50.598009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.599455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.600320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.600747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.845781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:50.853952 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-989c286d-fa46-444e-a9cd-5edd94ce5fcd tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.300093 Nov 06 21:01:50.854539 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2247/4549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:50 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:50.868629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:50.872598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:50.885635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.886169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.887073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.887594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.940397 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1891af06-e396-453f-a4c9-7115fa13d9f8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.080678 Nov 06 21:01:50.942438 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2248/4550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:50 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:50.949243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:50.951147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:50.960789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.961206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:50.962164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.963441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:50.964154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:50.969322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bd9a570-c65e-498b-b680-482094dff90f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.392624 Nov 06 21:01:50.976337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2303/4551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:50 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:51.024430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ad9d512-8b36-40de-bf9d-fb06ebdb3e58 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.079590 Nov 06 21:01:51.026414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2249/4552] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:50 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:51.167857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-43604b20-5d2a-468a-bd2e-d3a065828281 req-aaa88724-9000-433a-a861-fcb99114842f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "name": "network-vif-plugged", "status": "completed", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:51.169758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:51.170097 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:51.170097 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:51.170480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:51.177603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.178066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.178869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.179213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-43604b20-5d2a-468a-bd2e-d3a065828281 req-aaa88724-9000-433a-a861-fcb99114842f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.179335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.180061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-43604b20-5d2a-468a-bd2e-d3a065828281 req-aaa88724-9000-433a-a861-fcb99114842f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.197779 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-43604b20-5d2a-468a-bd2e-d3a065828281 req-aaa88724-9000-433a-a861-fcb99114842f service nova] Creating event network-vif-plugged:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:01:51.204552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-43604b20-5d2a-468a-bd2e-d3a065828281 req-aaa88724-9000-433a-a861-fcb99114842f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042834 Nov 06 21:01:51.206433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2304/4553] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:51.325700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:51.333322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e6f5d9d-87af-4d8b-b0e7-917b06becf1a tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.167984 Nov 06 21:01:51.333913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2250/4554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:51 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:51.354855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:51.356124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:51.362884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.364050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.365124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.365573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.549145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:51.557087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da7bfc2b-3ca8-4be6-bfba-69e131d54ef3 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.209855 Nov 06 21:01:51.558410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2305/4555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:51 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:51.575717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:51.576347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:51.583240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.584081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.585491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.586705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.759661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:51.774912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb6473e2-f94f-4a35-a195-125b5f1dfb60 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.202679 Nov 06 21:01:51.776736 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2251/4556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:51 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:51.796019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:51.797440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:51.803517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.804095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.804837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.805282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.833750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lazy-loading 'flavor' on Instance uuid dd98a3f2-58d5-45ca-8cfd-38132b2c966f {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:01:51.878758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:51.886217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:51.894218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.894979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.895969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:51.896674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:51.988720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc06aa61-4db3-441d-a857-46994d60aba4 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.200094 Nov 06 21:01:51.989982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2306/4557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:51 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:52.014529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:52.015929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:52.030705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.031123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.031963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.032446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.081958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cfe60043-052f-4ed1-a485-7a504a94eb8f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.090142 Nov 06 21:01:52.082852 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2307/4558] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:51 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:52.089168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:52.097067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:52.112086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.115347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.116727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.121246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.222932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:52.231859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16a3c5c0-97af-4e14-be52-fdff93c7d554 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.358234 Nov 06 21:01:52.237059 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2252/4559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:51 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:52.263310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:52.264414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:52.282530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.288813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.292232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.294443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.333078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:52.346550 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c4d978f-ffdb-4850-aab0-40e39ed7b43e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.262708 Nov 06 21:01:52.347394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2308/4560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:52 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:52.353031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:52.354185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:52.361661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.362374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.363339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:52.364249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:52.413095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a3e1ec78-8b42-46bf-ac63-6a672292c988 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.063674 Nov 06 21:01:52.413786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2309/4561] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:52 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:52.491488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:52.503955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae14b74f-27a9-4809-a515-bddc9e927e59 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1677 microversion: 2.1 time: 0.265527 Nov 06 21:01:52.505581 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2253/4562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:52 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:53.093851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:53.094866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.102827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.103282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.104281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.104905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.160217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-246a9638-04d0-4d05-9c2f-4d00263d21c4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.070180 Nov 06 21:01:53.161367 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2310/4563] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:53 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:53.253505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:53.254830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.263128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.263827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.264868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.265673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.363687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:53.364743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.373378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.374306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.375525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.376172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.471805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:53.481686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8518a0b-818f-498c-a034-7a7b765c6bda tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1323 microversion: 2.1 time: 0.232245 Nov 06 21:01:53.482569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2254/4564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:53 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:53.490067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:53.491325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.498420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.499321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.500324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.501123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.550779 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70395163-88e4-4c17-950e-fe57403255c2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.065091 Nov 06 21:01:53.551918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2255/4565] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:53 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:53.567518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:53.568583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.580263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.581731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.582565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.583020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.595447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:53.603814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a60b041-a2fa-4b96-96c6-6414c74cfb52 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.244058 Nov 06 21:01:53.604738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2311/4566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:53 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:53.811848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:53.822547 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-489ef307-c960-4a88-88ab-25754412b659 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1660 microversion: 2.1 time: 0.262213 Nov 06 21:01:53.823184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2256/4567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:53 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1660 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:53.839281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:53.840176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.847663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.848205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.849107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.849805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.935131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03d32f1e-fb65-4a81-bde7-22d4deb0ebfc tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action" status: 202 len: 0 microversion: 2.1 time: 0.099140 Nov 06 21:01:53.938896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2312/4568] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:53 2021] POST /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:53.947102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:53.949015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:53.969126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.970481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:53.971727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:53.973386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.172128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:54.173291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:54.182558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.183442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.185000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.185764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.233078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-349e206f-2a68-464d-999d-ca38444669d9 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.064998 Nov 06 21:01:54.235277 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2313/4569] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:54 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:54.236032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:54.244336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe5c9712-7ff0-4ecd-92fc-829f940a41df tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1666 microversion: 2.1 time: 0.303401 Nov 06 21:01:54.245243 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2257/4570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:53 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1666 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:54.510137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:54.510977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:54.523202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.524379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.525582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.526084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.564730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:54.566373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:54.581429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.582333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.583386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.584019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.631467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fdbf960-bca7-454c-a905-ab37e3da6cff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.071482 Nov 06 21:01:54.633681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2258/4571] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:54 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:54.639451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:54.640557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:54.650417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.651277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.653403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.654247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.777088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:54.787121 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b8244832-5bec-424c-8435-0a4cce29f66a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1519 microversion: 2.1 time: 0.288464 Nov 06 21:01:54.788036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2314/4572] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:54 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:54.816236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:54.818048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:54.826157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.826956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.828006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:54.828683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:54.858747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lazy-loading 'flavor' on Instance uuid 55ec61b9-c53d-4f91-8efe-073a99ce48af {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:01:54.899081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:54.910265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63b1e92d-65b5-4971-84b0-5a00105f93c4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.273045 Nov 06 21:01:54.911921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2259/4573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:54 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:55.009972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16c5e6a6-6ff1-4c96-a7f4-83d489c2e7ab tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action" status: 200 len: 32 microversion: 2.1 time: 0.198659 Nov 06 21:01:55.021971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:55.023052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:55.027697 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2315/4574] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:54 2021] POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:01:55.033987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.034947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.037978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.039360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.248822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:55.250506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:55.268867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.269525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.270616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.272003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.339191 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d4be0fee-d985-4b11-bc79-e77ddfdd8d5a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.094994 Nov 06 21:01:55.340933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2316/4575] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:55 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:01:55.347389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-25981754-b3c5-4ad4-ba00-a47957eb255c req-42d980f5-0524-4b78-aae6-c0e406b910bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a3cebc-56c7-4387-9343-0de4c41f90b9", "name": "network-vif-plugged", "status": "completed", "tag": "688f6858-27d7-40ab-b4b1-48a4bfd5cdbd"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:55.349875 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:55.349875 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:55.364208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-25981754-b3c5-4ad4-ba00-a47957eb255c req-42d980f5-0524-4b78-aae6-c0e406b910bd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.365762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-25981754-b3c5-4ad4-ba00-a47957eb255c req-42d980f5-0524-4b78-aae6-c0e406b910bd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.384182 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-25981754-b3c5-4ad4-ba00-a47957eb255c req-42d980f5-0524-4b78-aae6-c0e406b910bd service nova] Creating event network-vif-plugged:688f6858-27d7-40ab-b4b1-48a4bfd5cdbd for instance 20a3cebc-56c7-4387-9343-0de4c41f90b9 on nch2-master-1 Nov 06 21:01:55.390467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-25981754-b3c5-4ad4-ba00-a47957eb255c req-42d980f5-0524-4b78-aae6-c0e406b910bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047555 Nov 06 21:01:55.391704 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2317/4576] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:55.398943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:55.411651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:55.422431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.422877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:55.423324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.425586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.426199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.435655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6333bbfd-3602-4d51-a8d7-895c0719fe2a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.415257 Nov 06 21:01:55.439713 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2260/4577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:55 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:55.647035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:55.649739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:55.665689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.669002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.670257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.670938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.796908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:55.805161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6a2906bc-f6c6-42ba-afe8-5afe856ca54f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1666 microversion: 2.1 time: 0.411443 Nov 06 21:01:55.816650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2318/4578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:55 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1666 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:55.929881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:55.930490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:55.936560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.937019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.937817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:55.938257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:55.973402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-703b45b1-fd7d-42cc-a626-4ccb7b99e689 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.333712 Nov 06 21:01:55.977816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2261/4579] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:55 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:56.238653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:56.250167 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17fc10bf-c443-49a0-8187-2b5f0f4c51df tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1314 microversion: 2.1 time: 0.323965 Nov 06 21:01:56.252054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2319/4580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:55 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:56.353951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:56.355356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:56.374136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.375113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.376768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.377583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.442361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-658e3bce-4d43-496c-a84c-8ad10dd920ec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.093119 Nov 06 21:01:56.443079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2262/4581] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:56 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:56.456329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:56.457102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:56.466539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.467246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.468310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.468976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.806799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:56.823976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:56.824933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36933abe-ecc9-4bf5-837e-427ac53b6aad tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.375001 Nov 06 21:01:56.826107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:56.827356 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2320/4582] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:56 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:56.852624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.854443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.857963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:56.859515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:56.985318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:56.986469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:56.999454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.000154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.001179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.001906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.074578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce4a76f6-b7b5-40e9-b86f-4fd81bf18821 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.092942 Nov 06 21:01:57.075264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2321/4583] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:56 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:01:57.143690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:57.156103 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b5a821d-7688-4b95-8a48-00d903206dd8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.336678 Nov 06 21:01:57.156729 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2263/4584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:56 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:57.176443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:57.177163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:57.187548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.188007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.188832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.189273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.269245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:57.270269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:57.281760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.288006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.289689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:57.290176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:57.913532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:57.923704 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dfc20848-7f64-49dc-8aa6-01895c0c202c tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1669 microversion: 2.1 time: 0.751831 Nov 06 21:01:57.926538 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2322/4585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:57 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1669 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:57.941532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e2f2e71d-6f09-4ac6-8e93-d2719da160b0 req-17d2cfaa-cdd2-4dde-a166-ca056b09ba6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-plugged", "status": "completed", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:57.950376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:57.962921 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:01:57.962921 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:01:57.969272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee89f9d3-8d29-42a3-b749-19b9bccc1c7c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1464 microversion: 2.1 time: 0.700435 Nov 06 21:01:57.970939 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2264/4586] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:57 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1464 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:01:57.987125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:57.988133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:57.992631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2f2e71d-6f09-4ac6-8e93-d2719da160b0 req-17d2cfaa-cdd2-4dde-a166-ca056b09ba6e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.000848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2f2e71d-6f09-4ac6-8e93-d2719da160b0 req-17d2cfaa-cdd2-4dde-a166-ca056b09ba6e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.013994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.015509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.016965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.018420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.025178 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e2f2e71d-6f09-4ac6-8e93-d2719da160b0 req-17d2cfaa-cdd2-4dde-a166-ca056b09ba6e service nova] Creating event network-vif-plugged:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:01:58.034821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e2f2e71d-6f09-4ac6-8e93-d2719da160b0 req-17d2cfaa-cdd2-4dde-a166-ca056b09ba6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106516 Nov 06 21:01:58.035986 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2323/4587] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:01:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:01:58.051625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:58.052381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:58.075917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.076410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.077500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.077955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.153347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af496626-3eff-408c-baff-ae3447bb5fb5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.180950 Nov 06 21:01:58.154018 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2265/4588] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:57 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:58.161569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:58.162188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:58.181426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.181891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.185613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.186139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.243937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:01:58.270291 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Working on deleting snapshot c083d717-532d-4ee4-94c5-83b88acc2892 from shelved instance... Nov 06 21:01:58.516101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:58.524412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4b5922e-5ed1-4d2f-90fe-f6b8ebcfbed7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.486998 Nov 06 21:01:58.529206 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2324/4589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:58 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:58.536682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:58.539720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:58.551804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.552265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.553091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.558818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.892127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:01:58.900546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fb3c725-9088-4e5d-b568-1d169be149a4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1313 microversion: 2.1 time: 0.370332 Nov 06 21:01:58.904789 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2325/4590] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:58 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:01:58.915000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:58.916013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:58.932017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.932543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.933397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:58.933874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:58.983495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5230e475-99b2-4421-a891-fab09ea2b357 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.077390 Nov 06 21:01:58.984167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2326/4591] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:01:58 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:01:59.165083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:01:59.166382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:59.173177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:59.181525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:59.183144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:59.183861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:59.208613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Doing local delete in cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) {{(pid=134828) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 06 21:01:59.210182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:59.212837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:59.213298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 06 21:01:59.221881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] deallocate_for_instance() {{(pid=134828) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1675}} Nov 06 21:01:59.244840 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ae7ed90-3ef5-47d6-befc-4055de4b71a2 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.083730 Nov 06 21:01:59.247425 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2327/4592] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:01:59 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:01:59.547580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:01:59.548339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:01:59.561708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:59.562167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:59.562979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:01:59.563418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:01:59.991394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:00.000136 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae117fec-e923-4db3-84fe-18dc76f2dc91 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.457916 Nov 06 21:02:00.003278 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2328/4593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:01:59 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:00.009309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:00.009917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:00.018448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.019249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.020170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.021415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.334190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Updating instance_info_cache with network_info: [] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 21:02:00.425062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:00.434425 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9300da99-2da7-41b9-adc9-0cd0e4192fab tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1313 microversion: 2.1 time: 0.429763 Nov 06 21:02:00.436020 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2329/4594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:00 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:00.446314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:00.447526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:00.467180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.467930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.469029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.469627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.541176 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ea67870-2597-4fd2-824b-ae5d41e1f77b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.103658 Nov 06 21:02:00.544076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2330/4595] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:00 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:00.557636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:00.558666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:00.582685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.583643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.584671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.586142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.649749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15889daf-2aa1-4ada-9577-7bc7a85372a7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.101121 Nov 06 21:02:00.655107 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2331/4596] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:00 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:00.665772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-00cc640e-9aff-4b86-af4d-8fc014c0a5fa req-bb627ac2-a69a-4dd3-a25c-fa5c80635b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17805556-c997-414f-830f-56ceb14bfede", "name": "network-vif-deleted", "tag": "ab0fa452-b78b-414c-8ab1-ee7539cbab2b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:00.669513 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:00.669513 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:00.701439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-00cc640e-9aff-4b86-af4d-8fc014c0a5fa req-bb627ac2-a69a-4dd3-a25c-fa5c80635b75 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.702083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-00cc640e-9aff-4b86-af4d-8fc014c0a5fa req-bb627ac2-a69a-4dd3-a25c-fa5c80635b75 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.716428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.server_external_events [req-00cc640e-9aff-4b86-af4d-8fc014c0a5fa req-bb627ac2-a69a-4dd3-a25c-fa5c80635b75 service nova] Unable to find a host for instance 17805556-c997-414f-830f-56ceb14bfede. Dropping event network-vif-deleted {{(pid=134827) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 06 21:02:00.717632 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-00cc640e-9aff-4b86-af4d-8fc014c0a5fa req-bb627ac2-a69a-4dd3-a25c-fa5c80635b75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.060931 Nov 06 21:02:00.718717 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2332/4597] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:00 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 06 21:02:00.847782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f05dff1-b5e7-463f-b4c6-9ce1ea9bde50 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 204 len: 0 microversion: 2.1 time: 2.692147 Nov 06 21:02:00.848740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2266/4598] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:01:58 2021] DELETE /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 0 bytes in 2694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:00.857321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:00.858068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 17805556-c997-414f-830f-56ceb14bfede] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:00.864751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.865512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.866388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.867680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.883626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance 17805556-c997-414f-830f-56ceb14bfede could not be found. Nov 06 21:02:00.884511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 404 to user: Instance 17805556-c997-414f-830f-56ceb14bfede could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:00.885357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d2ad46a-c866-45e8-83c3-9d60ea121753 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede" status: 404 len: 111 microversion: 2.1 time: 0.032498 Nov 06 21:02:00.885915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2333/4599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:00 2021] GET /compute/v2.1/servers/17805556-c997-414f-830f-56ceb14bfede => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:00.893754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:00.894250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:00.900209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.900743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.901526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:00.901961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:00.927393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:01.004763 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-775cf56b-f0ac-4f19-bbfc-21a3ea583faa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 204 len: 0 microversion: 2.1 time: 0.114226 Nov 06 21:02:01.005664 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2267/4600] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:00 2021] DELETE /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:02:01.014290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:01.015530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:01.021456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:01.022173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:01.023443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.023958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.024969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.025559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.028467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.028931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.029784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.030267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.153965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:01.164737 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c450ed4c-f587-4551-8dcf-1d7e3aa4d4fd tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1464 microversion: 2.1 time: 0.154401 Nov 06 21:02:01.166052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2334/4601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:01 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:01.223722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:01.232039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b102650a-72c3-4940-809c-c916597ec51c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.215558 Nov 06 21:02:01.232829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2268/4602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:01 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:01.451880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:01.452422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:01.465993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.466711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.467501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.468100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.553311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:01.555749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:01.562675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.563218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.564123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.564689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.610880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5cafdbd9-9ae5-438d-b3c2-090f9a01d4b8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.061141 Nov 06 21:02:01.612592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2269/4603] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:01 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:01.661659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:01.662707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:01.670653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.671106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.671883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:01.672331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:01.716880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e6dcb5e-eb1f-4a16-909a-6afa5d071b56 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.058907 Nov 06 21:02:01.717930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2270/4604] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:01 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:01.854291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:01.869319 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd2b46d9-b8e9-45d5-bcd5-1fe3a2e831cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1463 microversion: 2.1 time: 0.421023 Nov 06 21:02:01.870515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2335/4605] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:01 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1463 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:01.988203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1680202580", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "73886535-1924-43e9-86fe-e2cdef2d59af"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:02.053290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:02:02.182268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:02.183491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:02.189712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.190162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.190942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.191370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.308875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:02.314350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:02:02.315094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:02:02.315685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:02:02.316206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:02:02.316758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:02:02.317969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d18ffc4c-d463-4829-9c35-16d1e8fbb1e0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1464 microversion: 2.1 time: 0.139626 Nov 06 21:02:02.329183 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2336/4606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:02 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:02.330280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.331193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.332131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.332848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.334109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:02.334711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:02.341675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.342121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.343119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.343547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.352463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:02.359237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Getting quotas for user cdaa84f1e2f940c684852fff39ac23a0 and project 4827eea3800c4ee9a5c097c565650229. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:02.375561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:02:02.378503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:02:02.431218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51b2b44b-0586-4c23-9e11-d45b273524a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447313 Nov 06 21:02:02.432235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2271/4607] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:02:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:02:02.446173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be1ada01-4ad2-4edc-83f9-a9e338ae86b1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:02.446930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be1ada01-4ad2-4edc-83f9-a9e338ae86b1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:02.547979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be1ada01-4ad2-4edc-83f9-a9e338ae86b1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:02.553178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:02.558677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be1ada01-4ad2-4edc-83f9-a9e338ae86b1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1214 microversion: 2.1 time: 0.119700 Nov 06 21:02:02.560931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2272/4608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:02 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:02.571240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea379f95-e036-4c60-bdd5-6af5d49292e9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.240505 Nov 06 21:02:02.572057 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2337/4609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:02 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:02.623834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:02.625305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:02.640822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.642332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.644016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.644693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.713364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10474259-1e72-47d9-b7df-e5a401ae0a0d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.094054 Nov 06 21:02:02.714047 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2273/4610] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:02 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:02.728407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:02.729499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:02.741367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.742880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.756103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:02.756681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:02.842048 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec29604a-0806-40fc-8c6c-5cfc80a548d7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.116799 Nov 06 21:02:02.843802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2338/4611] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:02 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:03.337406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:03.338107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:03.345224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.345960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.346744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.347348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.566944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:03.578839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8cf58f1d-19cf-4bab-93e9-17f87d44231f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 200 len: 1464 microversion: 2.1 time: 0.245824 Nov 06 21:02:03.588329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:03.588329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:03.589363 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2274/4612] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:03 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:03.594785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:03.595409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:03.596005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.596941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.598059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.598725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.601573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.602209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.603197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.603858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.799169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:03.816092 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e739684c-0717-42b2-b4b1-2f2bce13cd83 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1266 microversion: 2.1 time: 0.241604 Nov 06 21:02:03.817469 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2339/4613] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:03 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:03.831933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:03.838262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:03.851371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.851830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.852775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.853250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.932981 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-beae551f-4835-4d12-af5b-2765ac5ba421 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.113728 Nov 06 21:02:03.933876 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2340/4614] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:03 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:03.944513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2ca1c5ac-cdd6-499e-8f48-bf58e5cacb65 req-79372e14-5b12-47aa-a2a8-ec75ae53e4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8589798a-c8b2-4307-aaac-b428310a5dbe", "name": "network-vif-deleted", "tag": "699de106-65ec-469c-a13b-e1b51555cb83"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:03.950891 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:03.950891 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:03.973057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2ca1c5ac-cdd6-499e-8f48-bf58e5cacb65 req-79372e14-5b12-47aa-a2a8-ec75ae53e4ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:03.974033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2ca1c5ac-cdd6-499e-8f48-bf58e5cacb65 req-79372e14-5b12-47aa-a2a8-ec75ae53e4ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:03.993063 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2ca1c5ac-cdd6-499e-8f48-bf58e5cacb65 req-79372e14-5b12-47aa-a2a8-ec75ae53e4ff service nova] Creating event network-vif-deleted:699de106-65ec-469c-a13b-e1b51555cb83 for instance 8589798a-c8b2-4307-aaac-b428310a5dbe on nch2-master-1 Nov 06 21:02:04.001945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2ca1c5ac-cdd6-499e-8f48-bf58e5cacb65 req-79372e14-5b12-47aa-a2a8-ec75ae53e4ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064671 Nov 06 21:02:04.003064 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2341/4615] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:04.020242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:04.023284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:04.030803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.031538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.032785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.033524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.084974 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9a03407-24ff-4c57-b0d4-c8e1af4abb2f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.079430 Nov 06 21:02:04.097459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2342/4616] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:04 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:04.564230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:04.573286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52337202-a924-4bea-8281-06fbd12193c7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.982679 Nov 06 21:02:04.583498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2275/4617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:03 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:04.600646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:04.602517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 8589798a-c8b2-4307-aaac-b428310a5dbe] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:04.610277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.610958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.611796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.612512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.628872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance 8589798a-c8b2-4307-aaac-b428310a5dbe could not be found. Nov 06 21:02:04.629781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 404 to user: Instance 8589798a-c8b2-4307-aaac-b428310a5dbe could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:04.630835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-abced528-516b-4f40-9b31-c2412a88d267 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe" status: 404 len: 111 microversion: 2.1 time: 0.034571 Nov 06 21:02:04.631473 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2343/4618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:04 2021] GET /compute/v2.1/servers/8589798a-c8b2-4307-aaac-b428310a5dbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:04.639454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:04.640077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:04.646429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.647031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.648648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.649966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.677785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:04.780216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11cd353f-bc1d-4d20-b792-7244dacffff7 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 204 len: 0 microversion: 2.1 time: 0.143833 Nov 06 21:02:04.781493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2276/4619] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:04 2021] DELETE /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:04.791502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:04.792857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:04.803521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.805805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.807163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.808451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.835948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:04.836654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:04.852901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.853452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:04.854307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:04.855007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.013922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:05.021561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-030c176a-07f3-4df5-8cf1-f23b8f1c180e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1272 microversion: 2.1 time: 0.191736 Nov 06 21:02:05.022058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2277/4620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:04 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:05.028441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:05.029906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:05.040419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.041159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.043041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.045435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.113759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8419fff4-8bf6-4413-b33f-bd57a4061210 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.090245 Nov 06 21:02:05.115186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2278/4621] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:05 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:05.126434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:05.127677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:05.136580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.137140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.138033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.138812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.184954 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc34e0a8-84f8-4552-ba2e-2a33b609db4d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.067182 Nov 06 21:02:05.188458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2279/4622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:05 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:05.233432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:05.242118 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcf7265a-4495-4669-8985-55be44707ae0 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1507 microversion: 2.1 time: 0.456594 Nov 06 21:02:05.242813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2344/4623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:04 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:05.590814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:05.591532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:05.598735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.599468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.600477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:05.601137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:05.876093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:05.916746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab24a738-84a6-48ad-8131-d8881fad09c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.329776 Nov 06 21:02:05.921809 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2280/4624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:05 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:06.040516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:06.041136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:06.058260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.058730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.059540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.059984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.129317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:06.130514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:06.147630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.149018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.150358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.150995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.218110 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2d38972-2b2d-4518-b5a5-e84b77867c31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.093770 Nov 06 21:02:06.219285 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2281/4625] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:06 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:06.255647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:06.258864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:06.273625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.274431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.276358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.277352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.339822 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-344a4678-242b-49db-9f3d-f201ee25293d tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.118253 Nov 06 21:02:06.341142 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2282/4626] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:06 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:06.349102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:06.350446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:06.360992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.362758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.364524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.365298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.534357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:06.549080 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81088f45-7ef6-4c44-bea4-600fdd95ba5a tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.512759 Nov 06 21:02:06.561821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2345/4627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:06 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:06.699088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:06.706690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5b643df-1bbd-4274-967d-4e7f921377a5 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1507 microversion: 2.1 time: 0.363986 Nov 06 21:02:06.707268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2283/4628] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:06 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:06.938648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:06.939517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:06.950576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.951231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:06.954129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:06.954779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.230106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:07.231426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:07.240287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.241234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.243386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.244069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.318107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edc8887a-aa5e-4af1-9457-3892b1237fe8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.090158 Nov 06 21:02:07.324612 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2284/4629] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:07 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:07.364201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:07.366036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:07.386044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.387088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.388775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.389566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.392430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:07.401606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb35ca2f-0641-4d77-9d3c-be431030f7d7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.466622 Nov 06 21:02:07.418332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2346/4630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:06 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:07.461457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1537fcc6-c730-49da-999d-9e86682b6ec0 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.104783 Nov 06 21:02:07.462828 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2285/4631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:07 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:07.575119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-95e8b215-9489-4e8f-ac38-78c806e1ef16 req-47163183-616e-4508-a141-97d1ea8ceba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0998fd-8d0a-4d20-b417-2e27da5f0697", "tag": "c06644e8-5f4d-439d-a579-ee85cd4ebfbc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:07.576280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:07.577984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:07.588651 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:07.588651 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:07.594128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.598194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.600768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.602289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.609820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-95e8b215-9489-4e8f-ac38-78c806e1ef16 req-47163183-616e-4508-a141-97d1ea8ceba2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.610526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-95e8b215-9489-4e8f-ac38-78c806e1ef16 req-47163183-616e-4508-a141-97d1ea8ceba2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.636196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-95e8b215-9489-4e8f-ac38-78c806e1ef16 req-47163183-616e-4508-a141-97d1ea8ceba2 service nova] Creating event network-changed:c06644e8-5f4d-439d-a579-ee85cd4ebfbc for instance ee0998fd-8d0a-4d20-b417-2e27da5f0697 on nch2-master-1 Nov 06 21:02:07.652739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-95e8b215-9489-4e8f-ac38-78c806e1ef16 req-47163183-616e-4508-a141-97d1ea8ceba2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082155 Nov 06 21:02:07.653698 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2286/4632] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:07.732854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:07.734403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:07.742809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.743064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.745761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:07.746700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:07.972897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:07.984356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b788cdf-932c-4b0a-b0aa-cc56f867cd2f tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 200 len: 1465 microversion: 2.1 time: 0.261772 Nov 06 21:02:07.986237 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2287/4633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:07 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 1465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:08.082416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:08.099574 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bea4c1af-9a78-405c-a254-c70b425e778d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.534968 Nov 06 21:02:08.100721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2347/4634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:07 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:08.175883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f7d73f78-3ecc-4959-9b0f-5a6f3f3c59ab req-cb85aacd-2be4-4049-a089-4785ebe93308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b981f8-9d0d-4885-92fd-36b67332203a", "name": "network-vif-deleted", "tag": "ac110983-e7fe-43d9-8d9e-d8bac8f7734c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:08.178594 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:08.178594 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:08.191300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f7d73f78-3ecc-4959-9b0f-5a6f3f3c59ab req-cb85aacd-2be4-4049-a089-4785ebe93308 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.192657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f7d73f78-3ecc-4959-9b0f-5a6f3f3c59ab req-cb85aacd-2be4-4049-a089-4785ebe93308 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.266409 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f7d73f78-3ecc-4959-9b0f-5a6f3f3c59ab req-cb85aacd-2be4-4049-a089-4785ebe93308 service nova] Creating event network-vif-deleted:ac110983-e7fe-43d9-8d9e-d8bac8f7734c for instance e9b981f8-9d0d-4885-92fd-36b67332203a on nch2-master-1 Nov 06 21:02:08.276966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f7d73f78-3ecc-4959-9b0f-5a6f3f3c59ab req-cb85aacd-2be4-4049-a089-4785ebe93308 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109225 Nov 06 21:02:08.279068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2288/4635] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:08.331599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:08.333006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:08.362527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.362885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.363598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.364024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.426937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:08.428946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:08.440143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.440680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.441471 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-897b312a-7f65-4bcd-9c31-b4d8fa02184b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.113423 Nov 06 21:02:08.442124 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2348/4636] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:08 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:08.442321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.443412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.475886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:08.477809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:08.485878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.486693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.487738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:08.488672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:08.566051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4daaef56-2e6c-4381-b6be-4ca5b41416ed tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.094871 Nov 06 21:02:08.568245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2349/4637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:08 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:08.667310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:08.677094 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82d485f0-6c85-4859-a1fd-bdff190f4c47 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.255532 Nov 06 21:02:08.678242 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2289/4638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:08 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:09.003658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:09.004442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: e9b981f8-9d0d-4885-92fd-36b67332203a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.013739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.014605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.015743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.016517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.034646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance e9b981f8-9d0d-4885-92fd-36b67332203a could not be found. Nov 06 21:02:09.036035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 404 to user: Instance e9b981f8-9d0d-4885-92fd-36b67332203a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:09.037504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0dbb918-67a3-440b-9fdc-7da27a32f49d tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a" status: 404 len: 111 microversion: 2.1 time: 0.038149 Nov 06 21:02:09.041731 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2350/4639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:08 2021] GET /compute/v2.1/servers/e9b981f8-9d0d-4885-92fd-36b67332203a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:09.048647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:09.049146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.077685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.079124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.080227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.080944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.118001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:09.119127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.131569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.135380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.137115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.140512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.163829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:09.330443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e0184c2-f256-4121-adf1-5ec8dc023e23 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 204 len: 0 microversion: 2.1 time: 0.284550 Nov 06 21:02:09.331428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2290/4640] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:09 2021] DELETE /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:09.344117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:09.345363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.357386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.358157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.359162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.359783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.863994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:09.876939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d61d117-2b64-4412-ac86-231a0f9c9de6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.763009 Nov 06 21:02:09.879109 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2351/4641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:09 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:09.892809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:09.896185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:09.897231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.904643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.905342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.906344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.906987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.910061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-044bd850-ca10-450d-87b2-881a45e0b25b tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1494 microversion: 2.1 time: 0.573733 Nov 06 21:02:09.910862 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2291/4642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:09 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1494 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:09.916235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:09.918178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.926586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.927485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.928595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.929735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.980179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15999f34-6101-491f-a374-aaf522fc5404 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 24570 microversion: 2.20 time: 0.098731 Nov 06 21:02:09.981369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2352/4643] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:09 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:09.986761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:09.987802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:09.991623 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc607af1-ac08-43a6-98fa-8f1fd0b83b06 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.079281 Nov 06 21:02:09.993175 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2292/4644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:09 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:09.996808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.997454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:09.998809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:09.999472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:10.212653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:10.221157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b01a117c-6533-4d54-be50-a967ab1f8b9c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.238412 Nov 06 21:02:10.221914 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2353/4645] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:09 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:10.888679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0670484e-cd0d-44da-ba01-f26bc0f46e44 req-da81f5e4-b56c-4831-9adf-182c4634d84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670bffa6-96e9-4c87-bbe6-fce23ab52b97", "name": "network-vif-deleted", "tag": "2d733483-6477-4ae9-8e46-4f85e80f4465"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:10.894752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:10.896046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:10.900801 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:10.900801 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:10.909497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:10.914571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0670484e-cd0d-44da-ba01-f26bc0f46e44 req-da81f5e4-b56c-4831-9adf-182c4634d84e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:10.915328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:10.916491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:10.917349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:10.926586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0670484e-cd0d-44da-ba01-f26bc0f46e44 req-da81f5e4-b56c-4831-9adf-182c4634d84e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:10.956675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0670484e-cd0d-44da-ba01-f26bc0f46e44 req-da81f5e4-b56c-4831-9adf-182c4634d84e service nova] Creating event network-vif-deleted:2d733483-6477-4ae9-8e46-4f85e80f4465 for instance 670bffa6-96e9-4c87-bbe6-fce23ab52b97 on nch2-master-1 Nov 06 21:02:10.965951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0670484e-cd0d-44da-ba01-f26bc0f46e44 req-da81f5e4-b56c-4831-9adf-182c4634d84e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081231 Nov 06 21:02:10.982222 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2293/4646] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:02:10.989176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:10.989901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:11.008962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.009461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.010245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.010685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.047165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.047807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.048276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lazy-loading 'fault' on Instance uuid 670bffa6-96e9-4c87-bbe6-fce23ab52b97 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:02:11.129306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:11.150807 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc5fda9d-d9ea-4818-b7fc-075364c16ea9 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 200 len: 1305 microversion: 2.1 time: 0.166589 Nov 06 21:02:11.152187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2294/4647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:10 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:11.162897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:11.164019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:11.174079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.174641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.175731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.176279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.219226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:11.228211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94a635fb-de6e-4763-b4f4-4181060680fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.335783 Nov 06 21:02:11.238291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2354/4648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:10 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:11.242690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f34aaab-55de-4f3c-b7a2-45ffdbd7a71a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.088423 Nov 06 21:02:11.243757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2295/4649] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:11 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:11.244623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:11.245709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:11.248822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:11.249530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:11.252181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.252830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.253973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.254647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.264411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.265114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.266427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:11.267050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:11.310246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ee5b438-57ad-488e-ac33-f246733e66e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.070331 Nov 06 21:02:11.310900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2355/4650] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:11 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:11.524092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:11.536261 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f17a887-07cd-49ef-830e-b1b75462c1c5 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.291156 Nov 06 21:02:11.539514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2296/4651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:11 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:12.170632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:12.172181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: 670bffa6-96e9-4c87-bbe6-fce23ab52b97] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.189484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.190294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.191404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.192063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.214953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance 670bffa6-96e9-4c87-bbe6-fce23ab52b97 could not be found. Nov 06 21:02:12.215859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 404 to user: Instance 670bffa6-96e9-4c87-bbe6-fce23ab52b97 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:12.217011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-985cd848-3962-4aa8-b186-9d78d588c14e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97" status: 404 len: 111 microversion: 2.1 time: 0.051751 Nov 06 21:02:12.217679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2356/4652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:12 2021] GET /compute/v2.1/servers/670bffa6-96e9-4c87-bbe6-fce23ab52b97 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:12.228435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:12.230416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.238743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.239435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.240592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.241218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.248641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:12.249402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.265044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.268338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.270902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.271578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.273857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:12.362262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff568ae3-45d6-4100-8f3f-aa0ceaa22767 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 204 len: 0 microversion: 2.1 time: 0.139670 Nov 06 21:02:12.362877 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2297/4653] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:12 2021] DELETE /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:12.368989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:12.370267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.377330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.377784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.378577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.379008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.423375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55f540b8-715e-4bcd-8613-73afee1b6e65 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.058189 Nov 06 21:02:12.424054 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2298/4654] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:12 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:12.429609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:12.430629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.438469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.439156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.439946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.440407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.492335 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85b6d389-558f-455a-9749-2fdbeddc1161 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.066466 Nov 06 21:02:12.492994 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2299/4655] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:12 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:12.497743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:12.498441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.506598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.507598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.508544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.509097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.621418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:12.636883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0fadf4d7-a8f1-4b69-a8f1-63b7a4c5e05b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.395711 Nov 06 21:02:12.637468 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2357/4656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:12 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:12.649392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:12.650423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:12.657888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.658570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.659567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:12.660417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:12.786344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:12.796081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6311cae-bf4c-467d-bc6c-b0ad549d2db8 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1675 microversion: 2.1 time: 0.301924 Nov 06 21:02:12.799123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2300/4657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:12 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1675 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:12.934514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:12.942368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df243e5f-a35f-4a94-ab00-538e3d92a166 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.303609 Nov 06 21:02:12.943153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2358/4658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:12 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:13.441996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:13.445821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:13.456549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.457016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.457809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.458249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.503924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:13.505418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:13.516283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.517122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.522066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.522784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.548241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3025487e-71a8-483a-95ab-1201e2f4aeb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.115609 Nov 06 21:02:13.549075 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2301/4659] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:13 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:13.577434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1d0bf64-8992-4d9f-abe6-242b935538b5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.076890 Nov 06 21:02:13.579195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2359/4660] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:13 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:13.663224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:13.664460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:13.678469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.679197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.680349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.680966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.816810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:13.817972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:13.826230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.826922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:13.828023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:13.828958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.042459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:14.049996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ea33326-9018-4a87-808a-d9ad47146af7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.394223 Nov 06 21:02:14.060774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2302/4661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:13 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:14.065743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:14.066734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:14.074212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.074765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.075645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.076349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.176391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:14.184283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b11cfac8-1685-4b6c-86ff-ebb468f66c58 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1675 microversion: 2.1 time: 0.372470 Nov 06 21:02:14.185020 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2360/4662] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:13 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1675 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:14.278975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:14.288551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80f0834a-3ff0-43d5-aa7f-64229a0b76ec tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.226529 Nov 06 21:02:14.289402 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2303/4663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:14 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:14.562817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:14.564087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:14.574531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.574987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.576176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.577348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.592710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:14.594421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:14.603541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.604742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.605791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:14.606461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:14.657130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b6705a45-ec92-4185-a548-3eb8cf1aa2d3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.095469 Nov 06 21:02:14.657995 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2361/4664] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:14 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:14.668865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b69683f-01f6-4530-8486-7d50a6fd7714 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.082642 Nov 06 21:02:14.674009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2304/4665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:14 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:15.067272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:15.067974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:15.074940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.075399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.076198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.076925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.204572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:15.205651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:15.213549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.214024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.215066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.215501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.398182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:15.405749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58e9dae7-c66e-4eba-be1d-a49b681f6381 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.342450 Nov 06 21:02:15.406621 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2362/4666] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:15 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:15.422349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:15.423266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:15.429840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.431023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.432063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.432886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.614659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:15.630198 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ca5cd49-337d-45d4-8392-3e249784c39e tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1675 microversion: 2.1 time: 0.431167 Nov 06 21:02:15.640997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2305/4667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:15 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1675 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:15.670076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:15.672460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:15.687396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.687984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.691028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.691500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.766793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e5843a2-2b89-4879-9713-304d3d8fc172 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.100571 Nov 06 21:02:15.771877 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2306/4668] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:15 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:15.773191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:15.774239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:15.790147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.791054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.792475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:15.793414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:15.801214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:15.812056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be25d33b-9d53-4a75-8501-bd3efb67fdb7 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.393297 Nov 06 21:02:15.813884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2363/4669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:15 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:15.860122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a6515ee-4661-4d91-a8b0-54f0bdae8804 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.089932 Nov 06 21:02:15.869611 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2307/4670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:15 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:16.024487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3311aa1e-4698-4efc-86e5-189487a369d5 req-76f9e93b-673e-4d62-9f30-0f8c7c8391dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd98a3f2-58d5-45ca-8cfd-38132b2c966f", "name": "network-vif-deleted", "tag": "d18e4680-1b28-4007-9364-246ce392f8a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:16.026459 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:16.026459 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:16.044923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3311aa1e-4698-4efc-86e5-189487a369d5 req-76f9e93b-673e-4d62-9f30-0f8c7c8391dd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.045364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3311aa1e-4698-4efc-86e5-189487a369d5 req-76f9e93b-673e-4d62-9f30-0f8c7c8391dd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.108886 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3311aa1e-4698-4efc-86e5-189487a369d5 req-76f9e93b-673e-4d62-9f30-0f8c7c8391dd service nova] Creating event network-vif-deleted:d18e4680-1b28-4007-9364-246ce392f8a2 for instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f on nch2-master-1 Nov 06 21:02:16.123983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3311aa1e-4698-4efc-86e5-189487a369d5 req-76f9e93b-673e-4d62-9f30-0f8c7c8391dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112059 Nov 06 21:02:16.126591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2364/4671] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:16.424319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:16.425023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:16.441784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.442897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.444219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.445095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.651381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:16.652198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:16.664187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.671045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.675657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.679082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.749400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.750052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.750716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lazy-loading 'fault' on Instance uuid dd98a3f2-58d5-45ca-8cfd-38132b2c966f {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:02:16.809631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:16.823427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22a5c638-3f62-45fc-839d-e98f5cf365a9 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.403785 Nov 06 21:02:16.824785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2308/4672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:16 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:16.831485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:16.832499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:16.847197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.847720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.848238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9406ed96fdc944a0bdc1302374d0d56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fa6742333c428d864b6c5b2319997d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:16.848737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.851367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.857209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1c10c42-f46b-4726-9f19-12387be3c651 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 200 len: 1328 microversion: 2.1 time: 0.212668 Nov 06 21:02:16.857790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2365/4673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:16 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 1328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:16.886341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:16.889738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:16.911357 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-395533de-5353-4dcb-9a3c-c56d73bdc2db tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.084966 Nov 06 21:02:16.912044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2309/4674] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:16 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:16.917679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.918147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.918956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.919400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.922178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:16.922854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:16.937073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.937538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:16.938468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:16.938797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.068082 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90ef4ba5-6616-47c1-8f2e-525ae48f2739 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.152987 Nov 06 21:02:17.068082 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2310/4675] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:16 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:17.242077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3af4fa52-7e85-422f-8e57-62d265e98cea req-211cdc7a-cace-4494-a13e-d2edeb19204d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0998fd-8d0a-4d20-b417-2e27da5f0697", "name": "network-vif-plugged", "status": "completed", "tag": "c06644e8-5f4d-439d-a579-ee85cd4ebfbc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:17.245206 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:17.245206 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:17.266390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:17.275065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35cf38e2-1d46-49ec-899b-2ef1a7c16f69 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.392277 Nov 06 21:02:17.278954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3af4fa52-7e85-422f-8e57-62d265e98cea req-211cdc7a-cace-4494-a13e-d2edeb19204d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.279430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3af4fa52-7e85-422f-8e57-62d265e98cea req-211cdc7a-cace-4494-a13e-d2edeb19204d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.279990 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2366/4676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:16 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:17.307025 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3af4fa52-7e85-422f-8e57-62d265e98cea req-211cdc7a-cace-4494-a13e-d2edeb19204d service nova] Creating event network-vif-plugged:c06644e8-5f4d-439d-a579-ee85cd4ebfbc for instance ee0998fd-8d0a-4d20-b417-2e27da5f0697 on nch2-master-1 Nov 06 21:02:17.314838 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3af4fa52-7e85-422f-8e57-62d265e98cea req-211cdc7a-cace-4494-a13e-d2edeb19204d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077228 Nov 06 21:02:17.315622 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2311/4677] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:02:17.842019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:17.842580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:17.858270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.860139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.861252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.861882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.880734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:17.881461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] [instance: dd98a3f2-58d5-45ca-8cfd-38132b2c966f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:17.889527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.890323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.891777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.892500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.920188 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] HTTP exception thrown: Instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f could not be found. Nov 06 21:02:17.921332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Returning 404 to user: Instance dd98a3f2-58d5-45ca-8cfd-38132b2c966f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:17.922377 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4e3afc1-9200-4a9a-8b66-166630ccb889 tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f" status: 404 len: 111 microversion: 2.1 time: 0.052089 Nov 06 21:02:17.923452 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2312/4678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:17 2021] GET /compute/v2.1/servers/dd98a3f2-58d5-45ca-8cfd-38132b2c966f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:17.930840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:17.932036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:17.939549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.941044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:17.942284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:17.944499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:18.007175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45868434-f539-4a90-a0fe-9a6fef53ad9b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.081545 Nov 06 21:02:18.008016 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2313/4679] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:17 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:18.013174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9efd26e-c34c-45ee-958b-e3ef4aaf08fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] Calling method '.version_select at 0x7f67153b5790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:18.058587 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9efd26e-c34c-45ee-958b-e3ef4aaf08fa tempest-ServerActionsTestJSON-356451525 tempest-ServerActionsTestJSON-356451525-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437948848" status: 202 len: 0 microversion: 2.1 time: 0.049122 Nov 06 21:02:18.059491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2314/4680] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:02:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437948848 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:18.078518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:18.079579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:18.112071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:18.112603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:18.113471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:18.125968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:18.227535 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-741d5293-9a3e-44b1-b24b-283a5ed660df tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.152393 Nov 06 21:02:18.228201 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2315/4681] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:18 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:18.296912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:18.297653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:18.314319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:18.314790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:18.315601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:18.316235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:18.379615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:18.394770 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-71ad6826-385c-4640-80e5-50df2a6dd328 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1314 microversion: 2.1 time: 0.552351 Nov 06 21:02:18.395456 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2367/4682] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:17 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:18.676893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:18.688416 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d20e5546-c8c7-4f94-959f-da705f04a878 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.395476 Nov 06 21:02:18.690140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2316/4683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:18 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:19.019607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:19.020730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:19.031372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.032331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.033552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.034201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.111880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74a00f34-9a3c-4cac-86f9-29a5473cc7e0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.095906 Nov 06 21:02:19.113640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2368/4684] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:19 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:19.239158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:19.240145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:19.251734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.253761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.254577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.257491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.313622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81db8a26-6d4c-46a8-83ac-5ef6d923cc53 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.078263 Nov 06 21:02:19.318855 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2317/4685] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:19 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:19.413909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:19.414520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:19.422249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.423114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.424060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.424799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.695867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:19.707318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:19.708033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:19.714831 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88438f0a-a392-451d-a846-a16eebcb1c1c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1463 microversion: 2.1 time: 0.306080 Nov 06 21:02:19.715419 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2369/4686] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:19 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1463 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:19.722746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.723421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.724449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.725060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.957571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:19.962088 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:19.962088 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:19.963661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'deleted': False, 'project_id': '9a12a3faa881402a8443e2b759aca513'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:19.970599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.971299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:19.972342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:19.973048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.007271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a901e7a-475c-4354-98f5-49ef918de05b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.276164 Nov 06 21:02:20.007271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2370/4687] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:02:19 2021] GET /compute/v2.1/servers/detail => generated 15 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:02:20.024377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:20.028635 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:20.028635 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:20.030367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'deleted': False} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:20.037189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.037988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.039927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.040787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.047004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:20.057369 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-295592ad-898e-402c-925b-341eb32b3079 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.354087 Nov 06 21:02:20.066343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2318/4688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:19 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:20.125522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:20.126769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:20.145717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.146542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.149384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.154840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.247533 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbbb1da3-4c0d-4975-bab0-b86f92e44011 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.126134 Nov 06 21:02:20.249423 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2319/4689] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:20 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:20.251765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:20.328001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:20.330225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:20.343362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.346005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.347052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.347654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.414765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:20.415583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:20.432554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4890bda9-01c8-487c-9177-2f46fdea42be tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.109322 Nov 06 21:02:20.433652 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2320/4690] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:20 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:21.074807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:21.076795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:21.085649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.086584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.087751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.088519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.406968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f2fcaab-2a18-49fe-b293-c22815861f12 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 10143 microversion: 2.1 time: 1.386719 Nov 06 21:02:21.407983 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2371/4691] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Nov 6 21:02:20 2021] GET /compute/v2.1/servers/detail?all_tenants= => generated 10143 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:21.413456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:21.415616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:21.427979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.429271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.430419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.431071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.483839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57444539-0ae7-49ef-8802-9bdbeb9d38ca tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.074742 Nov 06 21:02:21.488404 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2372/4692] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:21 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:21.493424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:21.496689 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:21.496689 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:21.498152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'deleted': False, 'project_id': '9a12a3faa881402a8443e2b759aca513'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:21.510351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.510802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.511819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.512437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.544876 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec08b801-c150-4e19-b04c-7ce29a9cf5d4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?tenant_id=4827eea3800c4ee9a5c097c565650229" status: 200 len: 15 microversion: 2.1 time: 0.055173 Nov 06 21:02:21.545493 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2373/4693] 10.222.0.13 () {58 vars in 1230 bytes} [Sat Nov 6 21:02:21 2021] GET /compute/v2.1/servers/detail?tenant_id=4827eea3800c4ee9a5c097c565650229 => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:02:21.550258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:21.551274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:21.559534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.560377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.561436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.562218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.566549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:21.575247 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c13ac21-e0da-4c4e-923a-7b4267b9930a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.505226 Nov 06 21:02:21.580255 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2321/4694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:21 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:21.585521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:21.592464 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:21.592464 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:21.594075 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:21.594075 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:21.605251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'tenant_id': '4827eea3800c4ee9a5c097c565650229', 'deleted': False} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:21.621900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.622375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.623227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.623663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:21.660347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-633ef578-de76-482b-a15c-4a7668bf0dc4 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.112507 Nov 06 21:02:21.664802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2374/4695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:21 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:21.843229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:21.973419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:21.973879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.497588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:22.498840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:22.517116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-911891e7-875b-467e-84c9-24d9ff2f1103 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4827eea3800c4ee9a5c097c565650229" status: 200 len: 4826 microversion: 2.1 time: 0.935627 Nov 06 21:02:22.517726 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2322/4696] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Nov 6 21:02:21 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4827eea3800c4ee9a5c097c565650229 => generated 4826 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:22.518289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.519567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.520881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.522580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.551559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:22.560393 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:22.560393 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:22.562264 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:22.562264 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:22.567846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'tenant_id': '9a12a3faa881402a8443e2b759aca513', 'deleted': False} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:22.583672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.590082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.591215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.591462 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03c158b5-5006-4a3b-a347-9f78b5918a21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.097429 Nov 06 21:02:22.595546 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2375/4697] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:22 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:22.596092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.610173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:22.611038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:22.633051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.633569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.634399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.634846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.664193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f596106-94dc-465b-a553-14869b9901df tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9a12a3faa881402a8443e2b759aca513" status: 200 len: 15 microversion: 2.1 time: 0.131212 Nov 06 21:02:22.665034 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2323/4698] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Nov 6 21:02:22 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9a12a3faa881402a8443e2b759aca513 => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:02:22.686585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:22.688396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:22.706088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.706835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.707868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.711802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.789766 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a372dae9-20db-49df-b9e5-1608aff76c9c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.116593 Nov 06 21:02:22.792824 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2324/4699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:22 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:22.801028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4e1cd2b-12de-4b6a-a48e-524f9d004afc tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:22.808416 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:22.808416 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:22.812123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4e1cd2b-12de-4b6a-a48e-524f9d004afc tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016939 Nov 06 21:02:22.813325 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2325/4700] 10.222.0.13 () {58 vars in 1188 bytes} [Sat Nov 6 21:02:22 2021] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:02:22.845865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:22.847378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:22.869583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.871344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.872510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:22.873652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:22.982813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:22.996026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fef9f12-1b57-468e-8abe-9e409596929d tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.400813 Nov 06 21:02:22.999221 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2376/4701] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:22 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:23.047882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad833f6f-09bd-4016-acfe-42bc7d09c0e4 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 0 microversion: 2.1 time: 0.213531 Nov 06 21:02:23.049270 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2326/4702] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:22 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:23.057778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:23.062463 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:23.062463 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:23.064808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:23.066651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4827eea3800c4ee9a5c097c565650229'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:23.078764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.079423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.081480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.082980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.301552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:23.447863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00b39bc6-4efc-44ba-ba71-be3ca05e1c3c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.394601 Nov 06 21:02:23.448500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2377/4703] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Nov 6 21:02:23 2021] GET /compute/v2.1/servers?status=error => generated 338 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:23.470376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:23.471387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:23.497290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.497856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.498857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.500834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.603090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:23.604245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:23.614376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.615472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.618408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.619693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.688107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce0f3be9-9dbe-4530-b0ca-1714531ad4b1 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.088336 Nov 06 21:02:23.688910 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2378/4704] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:23 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:23.702485 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-180cc760-94a9-47ab-a833-1a4d0eaee549 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 0 microversion: 2.1 time: 0.245953 Nov 06 21:02:23.704685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2327/4705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:23 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:23.713074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:23.714336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:23.728877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.729109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.733314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.734008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.802518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:23.804520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:23.828889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.830200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.831249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:23.831860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:23.893477 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0b23146-a131-4b7c-9ab2-911cfab37c5f tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.094614 Nov 06 21:02:23.894318 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2328/4706] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:23 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:02:24.017544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:24.018259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:24.036477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.036477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:24.037230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.037673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:24.536344 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14e1be9f-9855-4d43-bf58-d2c55142c1da tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1614 microversion: 2.1 time: 0.825624 Nov 06 21:02:24.536968 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2379/4707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:23 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1614 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:24.556656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:24.557555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:24.572352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.574733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:24.577308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.577760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:24.863943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:24.876437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e981a2d6-e6b4-4357-935e-8410400e1509 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.864610 Nov 06 21:02:24.877972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2329/4708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:24 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:24.891209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:24.892055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:24.910502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.910956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:24.911765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:24.912400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.014228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce4c591e-1b90-44bd-81ad-920fcec70af4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.134726 Nov 06 21:02:25.016353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2330/4709] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:24 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:25.027055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:25.028077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:25.051336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.051795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.052799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.053247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.123422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fc929dd-4bf8-429e-a2de-b2edcc9ec82a tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.101232 Nov 06 21:02:25.130385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2331/4710] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:25 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:25.225418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de143fb3-dfa1-45fb-b94c-f284e42d1b43 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1614 microversion: 2.1 time: 0.672459 Nov 06 21:02:25.240490 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2380/4711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:24 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1614 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:25.242748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:25.246733 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:25.246733 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:25.248435 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:25.248435 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:25.250895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:25.260565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.260981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.261776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.262401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.441857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:25.570466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e67b0113-db9a-48c3-a0a3-1605ae6bdcea tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1975 microversion: 2.1 time: 0.332510 Nov 06 21:02:25.572104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2332/4712] 10.222.0.13 () {58 vars in 1189 bytes} [Sat Nov 6 21:02:25 2021] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1975 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:25.587620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:25.594240 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:25.594240 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:25.598095 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:25.598095 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:25.601276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:25.610668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.611140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.611972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.612507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.895132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:25.895881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:25.910783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.915795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:25.917865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:25.918942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.099257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0776c88f-cd66-421f-b8d4-367c4c347772 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.519070 Nov 06 21:02:26.100406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2381/4713] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Nov 6 21:02:25 2021] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:02:26.105177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:26.106714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.115270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.115855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.117230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.118075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.190011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edcc9046-c53a-402b-aa4d-b7ca731224df tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.087762 Nov 06 21:02:26.191165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2382/4714] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:26 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:26.202856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:26.211752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.223618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.231245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.232667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.233302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.342950 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dfd648b8-4aa8-4614-9d6d-51665b427f0b tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 0 microversion: 2.1 time: 0.150294 Nov 06 21:02:26.344796 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2383/4715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:26 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:26.351245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:26.352844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.364144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.366749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.368473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.370940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.497331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3fc429e-2a77-49bb-baec-bcb95654d88e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.148539 Nov 06 21:02:26.498768 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2384/4716] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:26 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:26.502172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:26.512687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:26.515480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98e97333-42a3-4930-aacf-69300ef88d20 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.623666 Nov 06 21:02:26.515694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.516755 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2333/4717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:25 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:26.524410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.525880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.527529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.528492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.652704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:02:26.653116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:02:26.653612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:02:26.654043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:02:26.654486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:02:26.833471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.850748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.853076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.855956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.856673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.952824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93524da3-9ba9-454a-9893-a13e03cc91fc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 1067 microversion: 2.1 time: 0.452234 Nov 06 21:02:26.968175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:26.969007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:26.977277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.977882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.978540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:26.979079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:26.983040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2385/4718] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:26 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 1067 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 06 21:02:27.202550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:27.203545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:27.226532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.226994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.227837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.228282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.338381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e995937-9d9f-4186-9da4-012fa112dd6a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.139395 Nov 06 21:02:27.339014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2386/4719] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:27 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:27.512513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:27.513544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:27.562985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.568133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.570092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.570547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.622177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:27.630779 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c2a5c2d-7301-45cc-bc49-19511667f5a1 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.666101 Nov 06 21:02:27.632754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2334/4720] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:26 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:27.637480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:27.638646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:27.645299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.646141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-423c5f60-187e-4cc4-93be-a8f7d193b7d5 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.137552 Nov 06 21:02:27.646470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.646882 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2387/4721] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:27 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:27.648403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:27.649087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:27.980266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:27.993409 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e1887a8-eb73-4193-88a3-c1954f8d4e0c tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.359152 Nov 06 21:02:27.994157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2335/4722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:27 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:28.351658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:28.352628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:28.361004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.361004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.361611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.362262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.418354 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14c072a1-695a-43ea-9dd2-de2605e4d14b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.071172 Nov 06 21:02:28.419897 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2388/4723] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:28 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:28.662342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:28.663562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:28.677332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.678328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.678691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:28.679830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.680488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.683040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:28.726750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.727284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.728132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:28.728596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:28.837738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea7afe96-6f94-44be-a03f-41bf18e7a933 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.181171 Nov 06 21:02:28.844683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2389/4724] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:28 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:28.924019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:28.937709 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8dcecd9e-c4ef-4d0f-880a-335f765b1fc4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.287642 Nov 06 21:02:28.938813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2336/4725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:28 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:29.012152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:29.013161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:29.021101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.024913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.025981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.026586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.291076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:29.300653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0191586c-88f3-462a-ba6d-a13cd2f48723 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.292526 Nov 06 21:02:29.300876 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2390/4726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:29 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:29.431650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:29.432736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:29.465469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.466266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.467284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.468488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.547060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e051fc85-482b-4784-b35a-2d7e625d0a68 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.119790 Nov 06 21:02:29.548688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2337/4727] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:29 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:29.851232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:29.852896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:29.888840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.891773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.894454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.895145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.963651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:29.964861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:29.979065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2d410b4-8c89-4ba5-95fd-0c86a23e56e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.131898 Nov 06 21:02:29.982028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.982640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2391/4728] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:29 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:29.983525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:29.984661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:29.985347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:30.319860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:30.320901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:30.329153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:30.330104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:30.332167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:30.335160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:30.613120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:30.625335 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32ccf277-8f9e-490d-a812-4ede277024eb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.669642 Nov 06 21:02:30.626860 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2338/4729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:29 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:30.633351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:30.634518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:30.657725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:30.658189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:30.659000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:30.659443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:30.739858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:30.743368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05e85a50-4c1a-4bc3-96f6-1fee18be727f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.114979 Nov 06 21:02:30.745390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2339/4730] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:30 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:30.748720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fb23e2d-9c2c-4fb3-85ea-5fb6b1eafe26 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1525 microversion: 2.1 time: 0.434797 Nov 06 21:02:30.757083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2392/4731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:30 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1525 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:30.991487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:30.992583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:30.999769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.000515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.001475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.002246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.051727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b26d467-cc97-4179-81d6-886048506fcc tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.063980 Nov 06 21:02:31.053934 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2340/4732] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:30 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:31.644735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:31.645986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:31.655054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.655791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.656856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.657525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.760398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:31.763046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:31.773080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.773788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.774837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.775508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.824418 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bf111ab-3950-4236-b30f-1df3c60e2294 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.070538 Nov 06 21:02:31.825145 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2341/4733] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:31 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:31.914634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:31.925882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58291c53-6ddb-44f6-b955-3aa83dfd35c5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.286781 Nov 06 21:02:31.926842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2393/4734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:31 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:31.932714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:31.933772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:31.941203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.942297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:31.943339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:31.944863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.067025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: .version_select at 0x7f67152f6ca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-860406860", "policies": ["affinity"]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.106605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.119079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.123209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:32.141673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef641711-5560-4b64-b440-7e42aa3bb4b0 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1505 microversion: 2.1 time: 0.213109 Nov 06 21:02:32.153129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2394/4735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:31 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:32.159394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.160549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:32.168663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.169368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.170400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.171058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.185514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.199902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.219978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5db90c51-cbc8-4e4b-a78c-2b29febe0d8b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.389445 Nov 06 21:02:32.225941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2342/4736] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Nov 6 21:02:31 2021] POST /compute/v2.1/os-server-groups => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:32.232342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42609d59-f778-40bb-a399-3a8838a18bf4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'create', calling method: .version_select at 0x7f671549bdc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1007914130", "description": "tempest-description-1783104303"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.236346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-219ee68b-5de0-47e7-bd99-d92fb296b3f3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.081393 Nov 06 21:02:32.238515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2395/4737] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:32.246908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: .version_select at 0x7f67148d85e0>, body: {"server_group": {"name": "tempest-server-group-58346390", "policies": ["affinity"]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.270297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.282771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.345213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.351035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.374828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-752fd672-6f67-46dc-954e-8831eb5fe63e tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.134856 Nov 06 21:02:32.375528 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2396/4738] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/os-server-groups => generated 162 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:32.385716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: .version_select at 0x7f67148c24c0>, body: {"server_group": {"name": "tempest-server-group-58346390", "policies": ["affinity"]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.411949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.422312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.506061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.518109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.519892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42609d59-f778-40bb-a399-3a8838a18bf4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.292393 Nov 06 21:02:32.520804 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2343/4739] 10.222.0.13 () {60 vars in 1179 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:32.533228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1007914130"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.534533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:32.541471 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-195417c5-cdb2-4a81-84c5-d413b56dbadb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.159648 Nov 06 21:02:32.542559 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2397/4740] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/os-server-groups => generated 162 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:02:32.544751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.545441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.546559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.547082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.557215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61407b58-2dab-4cfb-bbe9-ffe1920c7035 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.593866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61407b58-2dab-4cfb-bbe9-ffe1920c7035 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/8ef1788e-6dc9-4630-93f0-6cfd4aede94a" status: 204 len: 0 microversion: 2.1 time: 0.044477 Nov 06 21:02:32.597333 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2398/4741] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:02:32 2021] DELETE /compute/v2.1/os-server-groups/8ef1788e-6dc9-4630-93f0-6cfd4aede94a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:32.605401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ced5658-f97c-4065-be9c-b759ddab9b67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.623706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ced5658-f97c-4065-be9c-b759ddab9b67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.021950 Nov 06 21:02:32.624656 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2399/4742] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:02:32 2021] GET /compute/v2.1/os-server-groups => generated 332 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:32.634361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3de1aac9-02d7-4d35-98d7-d26d6597b9a5 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.667399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3de1aac9-02d7-4d35-98d7-d26d6597b9a5 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/d0de281e-2c89-4675-a72c-e061a7e50aa7" status: 204 len: 0 microversion: 2.1 time: 0.036723 Nov 06 21:02:32.668268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2400/4743] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:02:32 2021] DELETE /compute/v2.1/os-server-groups/d0de281e-2c89-4675-a72c-e061a7e50aa7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:32.676163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bac76b9c-6a5b-4017-8f10-308b05f6886c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.686812 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bac76b9c-6a5b-4017-8f10-308b05f6886c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014405 Nov 06 21:02:32.687437 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2401/4744] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:02:32 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:02:32.697762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: .version_select at 0x7f67148d8c10>, body: {"server_group": {"name": "tempest-server-group-1697151809", "policies": ["affinity"]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.713386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Adding security group 2c10f513-75a1-44f3-b27e-79bd439b489e to port 27b61f7f-c710-4146-b2ae-d1f0a68b5d97 Nov 06 21:02:32.714441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.719867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.763874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:32.769287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:32.791654 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d97786c-017b-4801-92e4-06084f01ca48 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.097364 Nov 06 21:02:32.792566 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2402/4745] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:02:32.803400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1422135a-096c-43d0-af37-6a35c288714f tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.833138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1422135a-096c-43d0-af37-6a35c288714f tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/6238bbf2-a653-42ed-b505-31e2ff0718e9" status: 204 len: 0 microversion: 2.1 time: 0.033348 Nov 06 21:02:32.837281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2403/4746] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:02:32 2021] DELETE /compute/v2.1/os-server-groups/6238bbf2-a653-42ed-b505-31e2ff0718e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:32.844743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:32.846679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:32.854917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.855939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.857063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.858494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.920417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33835b4b-b13d-4b09-8abc-be9792fd9608 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.082325 Nov 06 21:02:32.921340 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2404/4747] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:32.926497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b41078db-3724-4bc2-89d2-d5ee0a109747 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.937491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b41078db-3724-4bc2-89d2-d5ee0a109747 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014783 Nov 06 21:02:32.938315 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2405/4748] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:02:32 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:32.944937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:32.945948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:32.954041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.954780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:32.955758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:32.956394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.201006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:33.230976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-50b8643f-d5c8-4d62-9728-e0fdcd009747 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.287980 Nov 06 21:02:33.231884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2406/4749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:32 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:33.246800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: .version_select at 0x7f67148c2d30>, body: {"server_group": {"name": "tempest-server-group-1995918343", "policies": ["anti-affinity"]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:33.264144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2092f44-690a-44b2-bcec-8654480e6cc9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action" status: 202 len: 0 microversion: 2.1 time: 0.734862 Nov 06 21:02:33.268130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2344/4750] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:32 2021] POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:02:33.270374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:33.271375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:33.282709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:33.285949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:33.286418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.290125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:33.290613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.296931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:33.375988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:33.391278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_groups'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:33.397839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fb94a79-17f5-452b-8f31-a4537e8744e8 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 32654 microversion: 2.1 time: 0.131034 Nov 06 21:02:33.398497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2345/4751] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:33 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 32654 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:33.406657 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea1d4fbb-3ba7-4e20-8f77-9da18934d697 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.170380 Nov 06 21:02:33.407613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2407/4752] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 21:02:33 2021] POST /compute/v2.1/os-server-groups => generated 169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:33.412451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1007914130"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:33.416034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:33.429672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:33.431878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.437501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:33.438186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.531280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-effcb5d6-c779-4431-9d3b-d6f7501c1093 req-357cc211-0eaf-48d1-a4a4-b075375689e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:33.533126 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:33.533126 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:33.544959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-effcb5d6-c779-4431-9d3b-d6f7501c1093 req-357cc211-0eaf-48d1-a4a4-b075375689e2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:33.545434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-effcb5d6-c779-4431-9d3b-d6f7501c1093 req-357cc211-0eaf-48d1-a4a4-b075375689e2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:33.577161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-effcb5d6-c779-4431-9d3b-d6f7501c1093 req-357cc211-0eaf-48d1-a4a4-b075375689e2 service nova] Creating event network-changed:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:02:33.586850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-effcb5d6-c779-4431-9d3b-d6f7501c1093 req-357cc211-0eaf-48d1-a4a4-b075375689e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177763 Nov 06 21:02:33.587965 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2408/4753] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:33.598100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46bb182f-7b3b-4ccb-ac98-5f1aa01525bb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:33.636455 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46bb182f-7b3b-4ccb-ac98-5f1aa01525bb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/80cb106d-6e74-4562-bbfb-a67844a3b306" status: 204 len: 0 microversion: 2.1 time: 0.046713 Nov 06 21:02:33.637179 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2409/4754] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:02:33 2021] DELETE /compute/v2.1/os-server-groups/80cb106d-6e74-4562-bbfb-a67844a3b306 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:33.650454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dffe8f18-09d0-4710-9097-3a26e85a649a tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:33.677135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dffe8f18-09d0-4710-9097-3a26e85a649a tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.033049 Nov 06 21:02:33.679060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2410/4755] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:02:33 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:33.690638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Removing security group 2c10f513-75a1-44f3-b27e-79bd439b489e from port 27b61f7f-c710-4146-b2ae-d1f0a68b5d97 Nov 06 21:02:33.755853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-587656274", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "6d105093-727c-4c31-8aaa-81cd57576182"}]}, "os:scheduler_hints": {"group": "55da93fc-5085-4ca9-a51e-a34d71bef090"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:33.857288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] validate_networks() for [('6d105093-727c-4c31-8aaa-81cd57576182', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:02:34.774041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b73f8e0d-89b7-4595-8608-5cd2b9837771 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action" status: 202 len: 0 microversion: 2.1 time: 1.367089 Nov 06 21:02:34.775420 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2346/4756] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:33 2021] POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action => generated 0 bytes in 1370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:34.790890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:34.793166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:34.804035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:34.804696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:34.806114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:34.806726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:34.885671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91e538c7-38f4-496d-9fbc-cee7f07e6466 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.100118 Nov 06 21:02:34.886557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2347/4757] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:34 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:34.892655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:34.893706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:34.905310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:34.906726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:34.908523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:34.909460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.184480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:02:35.187079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:02:35.188467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:02:35.189388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:02:35.191733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:02:35.223703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.226272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.230074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.232961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.238206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:35.250091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60cd6c41-5681-4425-81d5-f0804b1965fb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.362033 Nov 06 21:02:35.251264 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2348/4758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:34 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:35.255827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:35.261185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:35.278998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.279651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.280826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.281614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.286857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:35.305159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:35.329857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:02:35.333896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:02:35.365141 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c10d225-1712-4f2d-8c62-0811bbe164bd tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action" status: 200 len: 40777 microversion: 2.1 time: 0.111722 Nov 06 21:02:35.368369 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2349/4759] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:35 2021] POST /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1/action => generated 40777 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:02:35.380402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75b6efff-adec-440e-aca0-caa99d50b00a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'create', calling method: .version_select at 0x7f671539c160>, body: {"pool": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:35.394367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=134827) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Nov 06 21:02:35.443331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_group_members'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:35.452600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_group_members'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:35.561356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_group_members'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:02:35.571521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Getting quotas for user 716274b4665c4e7ba4478cbf2b126db6 and project ef3bcc53d0cc468a95f587efa7e9b444. Resources: {'server_group_members'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:02:35.624202 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b21ff9d-f3a1-49a8-8b00-0f3672af4bf6 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872802 Nov 06 21:02:35.626444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2411/4760] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:02:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:02:35.635255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:35.636240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:35.646126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.647206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:35.649209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:35.649863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.036784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:36.045147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-210c8548-c45e-4d22-9064-a28ab3788fec tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1693 microversion: 2.1 time: 0.417429 Nov 06 21:02:36.052831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2412/4761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:35 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1693 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:36.065629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3f24dc5d-af75-4f06-be0a-f309c8bb5dde req-efefb5a8-b03d-4641-bde4-abce58a0fdcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:36.067226 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:36.067226 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:36.101674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3f24dc5d-af75-4f06-be0a-f309c8bb5dde req-efefb5a8-b03d-4641-bde4-abce58a0fdcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.102627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3f24dc5d-af75-4f06-be0a-f309c8bb5dde req-efefb5a8-b03d-4641-bde4-abce58a0fdcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.125068 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3f24dc5d-af75-4f06-be0a-f309c8bb5dde req-efefb5a8-b03d-4641-bde4-abce58a0fdcb service nova] Creating event network-changed:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:02:36.133590 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3f24dc5d-af75-4f06-be0a-f309c8bb5dde req-efefb5a8-b03d-4641-bde4-abce58a0fdcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078932 Nov 06 21:02:36.134662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2413/4762] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:36.140514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a8737b6-5b7b-42c0-8726-379ce1ac4350 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:36.141551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a8737b6-5b7b-42c0-8726-379ce1ac4350 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:36.249400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9a8737b6-5b7b-42c0-8726-379ce1ac4350 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:36.261163 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a8737b6-5b7b-42c0-8726-379ce1ac4350 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1212 microversion: 2.1 time: 0.124919 Nov 06 21:02:36.262982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2414/4763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:36 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:36.273546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:36.274678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:36.287561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.288275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.289331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.289829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.346513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa58d7e4-6399-4071-bc45-75c31c5c1adb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.078088 Nov 06 21:02:36.351649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2415/4764] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:36 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:36.357131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:36.357799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:36.368395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.368940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.369901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.370492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.762700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:36.774804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-44ddf46a-535a-430d-9257-7f87e48a3d80 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.418209 Nov 06 21:02:36.775734 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2416/4765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:36 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:36.780536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:36.788735 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:36.788735 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:36.801736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:36.802939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Searching by: {'deleted': False, 'project_id': 'bde5e9d550d3483d977ecaff1085f735'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:36.809742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.810201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.811024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.811534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.866061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:36.955597 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e60d6f87-6afe-4bda-a49d-6daad9a5b40b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.178527 Nov 06 21:02:36.959730 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2417/4766] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:02:36 2021] GET /compute/v2.1/servers => generated 332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:36.971187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:36.975758 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:36.975758 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:36.977286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:36.978310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Searching by: {'deleted': False, 'project_id': 'bde5e9d550d3483d977ecaff1085f735'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:02:36.994972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.996116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:36.997138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:36.997767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.031175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:02:37.085193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:37.092616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.093941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.548568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b56f5d8-a662-4626-8aff-480e05cdae74 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.581571 Nov 06 21:02:37.549626 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2418/4767] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:02:36 2021] GET /compute/v2.1/servers/detail => generated 1696 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:37.565502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:37.566131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:37.574597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.575010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.575815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.577691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.748512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:37.766676 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07ada4f8-64f0-40bd-bf16-92e968da0c35 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1282 microversion: 2.1 time: 0.215931 Nov 06 21:02:37.770582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2419/4768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:37 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:37.786356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:37.790593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:37.802410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.806537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.809480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.814476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.920051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-399c2de5-f98c-46f5-b86f-713627d4cec9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.144714 Nov 06 21:02:37.920971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2420/4769] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:37 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:37.926321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-28ae5a32-3e9b-4230-93e7-6241161ecfe3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:37.936695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-28ae5a32-3e9b-4230-93e7-6241161ecfe3 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014136 Nov 06 21:02:37.937886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2421/4770] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:02:37 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:37.952478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:37.953505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:37.983697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.984230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:37.986486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:37.988322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:38.822099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:38.836050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0618c991-17d8-424f-92d6-485dae47c779 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1471 microversion: 2.1 time: 0.896866 Nov 06 21:02:38.836697 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2422/4771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:37 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1471 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:38.854624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:38.855070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:38.889681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:38.891667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:38.895960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:38.898497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:38.947501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:39.090700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b33c33b0-71f8-43c4-96ad-2e9a9223242c tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 204 len: 0 microversion: 2.1 time: 0.251483 Nov 06 21:02:39.092098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2423/4772] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:38 2021] DELETE /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:39.112937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:39.113985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:39.123190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.123910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:39.124966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.125717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:39.607227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:39.615901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53dc3887-316c-4b77-ac6a-6993cbc9c9ac tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1270 microversion: 2.1 time: 0.520372 Nov 06 21:02:39.618604 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2424/4773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:39 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1270 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:39.629635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:39.631387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:39.645450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.646166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:39.649164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.649851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:39.731784 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c8de55d-0867-4218-bc1b-f4881a8f024e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.110430 Nov 06 21:02:39.735902 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2425/4774] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:39 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:39.737568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:39.738126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:39.755179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.755632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:39.766681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:39.768086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:40.180129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:40.195318 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10af120a-9bba-43de-a3a4-70873e439005 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1699 microversion: 2.1 time: 0.461579 Nov 06 21:02:40.195913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2426/4775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:39 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1699 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:40.209081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:40.213064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:40.228094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:40.231199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:40.234596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:40.237563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:40.300777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75b6efff-adec-440e-aca0-caa99d50b00a tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.925305 Nov 06 21:02:40.301456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2350/4776] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 21:02:35 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:40.313070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.174"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:40.318384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:40.332809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:40.345714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:40.346593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:40.347041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:40.407937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Acquired lock "refresh_cache-55ec61b9-c53d-4f91-8efe-073a99ce48af" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 21:02:41.033296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:41.052413 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ad2f030-65d0-428e-8c87-d5cc59135683 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.851454 Nov 06 21:02:41.053390 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2427/4777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:40 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:41.057853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:41.077609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:41.084836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.086214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.095257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.096379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.208017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:41.218776 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0603aaa-6142-4bfe-8f69-1438cad13e9c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1270 microversion: 2.1 time: 0.164289 Nov 06 21:02:41.237484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2428/4778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:41 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:41.245772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:41.247602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:41.262322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.266954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.268247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.268942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.337421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-394302ad-ee40-4c0e-80a1-b4a79b3db01a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.097355 Nov 06 21:02:41.338617 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2429/4779] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:41 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:41.344933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:41.345580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:41.359782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.360674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.361996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:41.362627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:41.840578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:41.851823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc47cf31-bbb1-4401-b9ad-454c640ef27b tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1699 microversion: 2.1 time: 0.511924 Nov 06 21:02:41.853061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2430/4780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:41 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1699 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:42.069867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:42.070311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:42.078077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:42.078720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:42.080063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:42.081001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:42.433128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:42.440481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-169469dd-1974-42b6-aae4-5f9227348627 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.374411 Nov 06 21:02:42.455607 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2431/4781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:42 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:42.461314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:42.462257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:42.470940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:42.474075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:42.475792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:42.478304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.408591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:43.416798 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b15c2c7f-023b-48d7-bd61-f9d65c76d5f2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.959651 Nov 06 21:02:43.427378 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2432/4782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:42 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:43.432553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:43.433813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:43.440630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:43.441396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.442454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:43.443133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.499944 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-665e0b70-90b4-42fb-9b79-872b4e28c587 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.070833 Nov 06 21:02:43.502321 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2433/4783] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:43 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:43.510115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:43.511163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:43.520708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:43.521481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.523325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:43.525323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.701861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856a90ddc12344cabd39fd40bb39a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde5e9d550d3483d977ecaff1085f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:43.742057 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69973a98-ce11-424e-9318-fb2c7cb16147 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 200 len: 1631 microversion: 2.1 time: 0.226151 Nov 06 21:02:43.751029 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2434/4784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:43 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 1631 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:43.845069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Building network info cache for instance {{(pid=134828) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 21:02:43.903699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-db9d9c1f-da98-4185-acaf-d15b72b41e8b req-73e93e03-eaf0-4424-9d47-12ef5b2cc5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-unplugged", "status": "completed", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:43.906355 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:43.906355 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:43.926433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db9d9c1f-da98-4185-acaf-d15b72b41e8b req-73e93e03-eaf0-4424-9d47-12ef5b2cc5c6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:43.926878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db9d9c1f-da98-4185-acaf-d15b72b41e8b req-73e93e03-eaf0-4424-9d47-12ef5b2cc5c6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:43.956451 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-db9d9c1f-da98-4185-acaf-d15b72b41e8b req-73e93e03-eaf0-4424-9d47-12ef5b2cc5c6 service nova] Creating event network-vif-unplugged:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:02:43.964752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-db9d9c1f-da98-4185-acaf-d15b72b41e8b req-73e93e03-eaf0-4424-9d47-12ef5b2cc5c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.211944 Nov 06 21:02:43.966713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2435/4785] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:44.000601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:44.001822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:44.012010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:44.012831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:44.018317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:44.034629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.149223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:45.161687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d35e385f-5090-45c1-9915-837b5a968ea4 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 1.191028 Nov 06 21:02:45.164355 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2436/4786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:43 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:45.173508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-71c100c0-4d38-4d05-a5ab-58bb0cfd8832 req-1e5b9c0c-c52c-4aa6-8d82-daf5860bb3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:45.175904 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:45.175904 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:45.194931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-71c100c0-4d38-4d05-a5ab-58bb0cfd8832 req-1e5b9c0c-c52c-4aa6-8d82-daf5860bb3b7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.196075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-71c100c0-4d38-4d05-a5ab-58bb0cfd8832 req-1e5b9c0c-c52c-4aa6-8d82-daf5860bb3b7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.210945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-71c100c0-4d38-4d05-a5ab-58bb0cfd8832 req-1e5b9c0c-c52c-4aa6-8d82-daf5860bb3b7 service nova] Creating event network-changed:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:02:45.224874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-71c100c0-4d38-4d05-a5ab-58bb0cfd8832 req-1e5b9c0c-c52c-4aa6-8d82-daf5860bb3b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060249 Nov 06 21:02:45.226429 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2437/4787] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:45.336113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-de82cade-c307-4b45-a64a-1fb91385fefb req-704bb3e8-587b-48f0-8926-970122e2b21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1", "name": "network-vif-deleted", "tag": "9a28fc71-da6e-45a2-a80a-58faa0b40f48"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:45.338088 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:45.338088 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:45.355711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-de82cade-c307-4b45-a64a-1fb91385fefb req-704bb3e8-587b-48f0-8926-970122e2b21e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.356670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-de82cade-c307-4b45-a64a-1fb91385fefb req-704bb3e8-587b-48f0-8926-970122e2b21e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.383962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-de82cade-c307-4b45-a64a-1fb91385fefb req-704bb3e8-587b-48f0-8926-970122e2b21e service nova] Creating event network-vif-deleted:9a28fc71-da6e-45a2-a80a-58faa0b40f48 for instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 on nch2-master-1 Nov 06 21:02:45.406411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-de82cade-c307-4b45-a64a-1fb91385fefb req-704bb3e8-587b-48f0-8926-970122e2b21e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178126 Nov 06 21:02:45.408954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2438/4788] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:45.415944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:45.418006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:45.427370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.428846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.430849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.431784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.785533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Updating instance_info_cache with network_info: [{"id": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97", "address": "fa:16:3e:30:73:da", "network": {"id": "e6af1d3b-e143-4670-b58f-a692b325ad8f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1001109064-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c8182a523546466fa113050d28f19731", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap27b61f7f-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134828) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 21:02:45.805241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Releasing lock "refresh_cache-55ec61b9-c53d-4f91-8efe-073a99ce48af" {{(pid=134828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 21:02:45.806317 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4a10dd1-35a6-4493-8f1c-a655f4321ff9 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action" status: 202 len: 0 microversion: 2.1 time: 5.497594 Nov 06 21:02:45.807638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2351/4789] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:40 2021] POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action => generated 0 bytes in 5499 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 06 21:02:45.814942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:45.820849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:45.834509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.835379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.836448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.837115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.917237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:45.919412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f3990788-df9a-4b1c-a510-92dd71da0c50 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.106398 Nov 06 21:02:45.925198 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2352/4790] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:45 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:45.932396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-685e0dde-6a1c-4976-b6fb-5dd364f2175c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.521224 Nov 06 21:02:45.935399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2439/4791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:45 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:45.939973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:45.944813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] [instance: 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:45.945868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.174"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:45.954349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.954817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.955846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:45.958185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:45.984642 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] HTTP exception thrown: Instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 could not be found. Nov 06 21:02:45.985765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Returning 404 to user: Instance 7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:02:45.987843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0521959-7742-48b8-813e-f3c32540ddb7 tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1" status: 404 len: 111 microversion: 2.1 time: 0.057234 Nov 06 21:02:45.992881 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2353/4792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:45 2021] GET /compute/v2.1/servers/7c506bb6-338e-49e4-9f1d-fa0e5ac4d0a1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:02:45.998663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe01db6a-bb92-4019-ad89-09081c7db16e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] Calling method '.version_select at 0x7f67154f0040>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:46.045808 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe01db6a-bb92-4019-ad89-09081c7db16e tempest-ServersTestJSON-457819695 tempest-ServersTestJSON-457819695-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402375225" status: 202 len: 0 microversion: 2.1 time: 0.051394 Nov 06 21:02:46.046597 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2354/4793] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 21:02:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402375225 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:46.179339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:46.186150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:46.205433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:46.206331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:46.215303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:46.225707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:46.226182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:46.227927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:46.232524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:46.232719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:46.233466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.195004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:47.202411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7dd070d3-82f9-44a2-abc5-d6ec1ece8c67 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 1.026791 Nov 06 21:02:47.212888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2355/4794] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:46 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:47.219042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:47.220393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:47.227436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:47.228086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.228448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Acquired lock "refresh_cache-55ec61b9-c53d-4f91-8efe-073a99ce48af" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 21:02:47.229612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:47.230212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.288858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09d5a3f2-1c30-4af8-aa55-88df584cee8b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.073095 Nov 06 21:02:47.289734 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2356/4795] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:47 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:47.298556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:47.299964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:47.313077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:47.313991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.314974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:47.315710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.808147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:47.821163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c28806b-e2c6-4d64-bb1e-fa29a57ce438 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.529868 Nov 06 21:02:47.830999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2357/4796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:47 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:47.836624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e23dba72-7203-4f83-a447-aaa3b2b81549 req-ff113188-48b3-4225-9559-102d95a104fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1786b6b5-5024-4c7b-b9f0-b6d8d4da74da", "tag": "158ffcc4-7d97-4cb0-b54a-1617e604a896"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:47.838418 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:47.838418 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:47.845931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e23dba72-7203-4f83-a447-aaa3b2b81549 req-ff113188-48b3-4225-9559-102d95a104fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:47.846649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e23dba72-7203-4f83-a447-aaa3b2b81549 req-ff113188-48b3-4225-9559-102d95a104fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:47.858287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e23dba72-7203-4f83-a447-aaa3b2b81549 req-ff113188-48b3-4225-9559-102d95a104fe service nova] Creating event network-changed:158ffcc4-7d97-4cb0-b54a-1617e604a896 for instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da on nch2-master-1 Nov 06 21:02:47.866039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e23dba72-7203-4f83-a447-aaa3b2b81549 req-ff113188-48b3-4225-9559-102d95a104fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Nov 06 21:02:47.867220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2358/4797] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:48.219442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:48.221149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:48.227737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.228509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:48.229482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.230084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:48.594107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:48.607568 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8bcbab7-9dd8-4275-9a14-8e782bc48abc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.389136 Nov 06 21:02:48.616972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2359/4798] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:48 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:48.625431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:48.632057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:48.639765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.647902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:48.650048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.650665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:48.725674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a931feb-a34a-4857-bd86-3e7e73115f70 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.114108 Nov 06 21:02:48.738716 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2360/4799] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:48 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:48.848699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:48.851706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:48.884725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.885647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:48.886808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:48.887516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:49.075446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Building network info cache for instance {{(pid=134827) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1882}} Nov 06 21:02:49.264014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:49.278742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36b8bef2-7890-4122-9899-505e34d87d2c tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.443054 Nov 06 21:02:49.279966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2361/4800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:48 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:49.628146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:49.629182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:49.639088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:49.645036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:49.646306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:49.648891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:50.893751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:50.923704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbddb6e8-6f0d-407b-844d-07484812029b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 1.299622 Nov 06 21:02:50.927690 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2362/4801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:49 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:50.945015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:50.948388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:50.965491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:50.967350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:50.968552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:50.971550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:51.106210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79ada05a-d6fe-4f4b-9891-c74fd71ad819 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.172105 Nov 06 21:02:51.110309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2363/4802] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:50 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:51.118239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:51.120199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:51.144963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:51.148614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:51.156169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:51.158898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:51.755081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Updating instance_info_cache with network_info: [{"id": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97", "address": "fa:16:3e:30:73:da", "network": {"id": "e6af1d3b-e143-4670-b58f-a692b325ad8f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1001109064-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c8182a523546466fa113050d28f19731", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap27b61f7f-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134827) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 06 21:02:51.777948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Releasing lock "refresh_cache-55ec61b9-c53d-4f91-8efe-073a99ce48af" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 21:02:51.779592 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c53a7b4d-ef76-4234-bb6c-a9a9903646c8 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action" status: 202 len: 0 microversion: 2.1 time: 5.842937 Nov 06 21:02:51.780852 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2440/4803] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:45 2021] POST /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af/action => generated 0 bytes in 5845 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 06 21:02:51.786133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e78319af-a8a4-4819-8e52-0cbf98940d11 req-b83480a1-41f2-4948-a6df-cff539e1aa0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:51.790271 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:51.790271 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:51.805514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e78319af-a8a4-4819-8e52-0cbf98940d11 req-b83480a1-41f2-4948-a6df-cff539e1aa0b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:51.809371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e78319af-a8a4-4819-8e52-0cbf98940d11 req-b83480a1-41f2-4948-a6df-cff539e1aa0b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:51.835166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e78319af-a8a4-4819-8e52-0cbf98940d11 req-b83480a1-41f2-4948-a6df-cff539e1aa0b service nova] Creating event network-changed:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:02:51.872542 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e78319af-a8a4-4819-8e52-0cbf98940d11 req-b83480a1-41f2-4948-a6df-cff539e1aa0b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089885 Nov 06 21:02:51.874881 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2441/4804] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:51.891498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-907c09e8-e7d1-40a5-959f-ccfd1e13ec23 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '.version_select at 0x7f671ad73b80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:52.195637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:52.207511 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d47395ed-9c1c-41dc-b616-1c31c1a99f67 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 1.094282 Nov 06 21:02:52.214130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2364/4805] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:51 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:52.222085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:52.222696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:52.252265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:52.254816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:52.257653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:52.258330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.033028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:53.042490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e95e306-b006-4d63-a482-70a37e1bbad3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.827054 Nov 06 21:02:53.060875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2365/4806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:52 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:53.065789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:53.066794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:53.085438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:53.086205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.087182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:53.087810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.163444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09823606-fda5-4dba-b7a8-2099950c8f96 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.101132 Nov 06 21:02:53.164574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2366/4807] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:53 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:53.231514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:53.232227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:53.249820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:53.250285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.251104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:53.251739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.797118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:53.840648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e53c8659-2461-444d-8a19-98d657f72763 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.598619 Nov 06 21:02:53.841350 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2367/4808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:53 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:53.846367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-80ccc386-2717-4624-9155-b0da003226d3 req-9362461c-e1b8-4cd9-aa7d-74ed76585154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-plugged", "status": "completed", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:53.852125 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:53.852125 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:02:53.860424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-80ccc386-2717-4624-9155-b0da003226d3 req-9362461c-e1b8-4cd9-aa7d-74ed76585154 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:53.861064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-80ccc386-2717-4624-9155-b0da003226d3 req-9362461c-e1b8-4cd9-aa7d-74ed76585154 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:53.877691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-80ccc386-2717-4624-9155-b0da003226d3 req-9362461c-e1b8-4cd9-aa7d-74ed76585154 service nova] Creating event network-vif-plugged:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:02:53.883274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-80ccc386-2717-4624-9155-b0da003226d3 req-9362461c-e1b8-4cd9-aa7d-74ed76585154 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040561 Nov 06 21:02:53.884167 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2368/4809] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:54.069254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:54.069977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:54.085734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.086201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:54.087030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.087480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:54.629943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:54.643330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-907c09e8-e7d1-40a5-959f-ccfd1e13ec23 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/126e1377-f6a0-49a7-8295-99d4e37153c2" status: 202 len: 0 microversion: 2.1 time: 2.766667 Nov 06 21:02:54.645821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2442/4810] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:02:51 2021] DELETE /compute/v2.1/os-floating-ips/126e1377-f6a0-49a7-8295-99d4e37153c2 => generated 0 bytes in 2770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:54.662985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:54.666290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:54.675160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91df36e7-1efb-4f57-a302-0e8453d1d124 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.609614 Nov 06 21:02:54.676506 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2369/4811] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:54 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:54.683529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7c9e41b-8232-4ba6-8728-a74874cf0a6f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '.version_select at 0x7f67151a19d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:54.684569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.685035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:54.685847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.686283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:54.749814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6ff30b6-4261-4064-9c6b-05c3bae8d3ae tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.102039 Nov 06 21:02:54.754399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2443/4812] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:54 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:54.875622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:54.877781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:54.901749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.903124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:54.904397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:54.905079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:55.679975 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7c9e41b-8232-4ba6-8728-a74874cf0a6f tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/2c10f513-75a1-44f3-b27e-79bd439b489e" status: 202 len: 0 microversion: 2.1 time: 1.000790 Nov 06 21:02:55.684720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2370/4813] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 21:02:54 2021] DELETE /compute/v2.1/os-security-groups/2c10f513-75a1-44f3-b27e-79bd439b489e => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:55.690233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:55.691057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:55.712416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:55.713830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:55.716829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:55.718214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:55.744582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:55.752519 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-451aebf9-96f0-4411-9ea0-faf4f59bc4be tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.890668 Nov 06 21:02:55.768696 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2444/4814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:54 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:55.779962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:55.780625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:55.792541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:55.801187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:02:55.802690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:55.803760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:55.804405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.031117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e956e9ea-e7b3-43ec-b57f-7dbcfd06d7a4 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 204 len: 0 microversion: 2.1 time: 0.344156 Nov 06 21:02:56.032971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2371/4815] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:02:55 2021] DELETE /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:02:56.049006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:56.050464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:56.063996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.065063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.067594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.068680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.147585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c1faa01-57a8-4453-8d4e-5d719cf96f9a tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.109906 Nov 06 21:02:56.149168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2372/4816] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:56 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:56.155462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:56.156781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:56.168366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.169137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.170252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.171064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.431558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:56.451269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b5c397e-6909-4a5d-b4d1-81ca649a5474 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1477 microversion: 2.1 time: 0.681328 Nov 06 21:02:56.453751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2445/4817] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:55 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:56.601743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:56.612455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b410682d-f2db-42d1-a32f-86d4f26e51a1 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1511 microversion: 2.1 time: 0.461679 Nov 06 21:02:56.613392 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2373/4818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:56 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:56.729215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-31f28b0d-252a-4fe8-9c35-3e48f9fd8804 req-7a36dbca-b197-48c3-822b-d0d3e70f967a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1786b6b5-5024-4c7b-b9f0-b6d8d4da74da", "name": "network-vif-plugged", "status": "completed", "tag": "158ffcc4-7d97-4cb0-b54a-1617e604a896"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:56.730957 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:02:56.730957 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:02:56.741956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31f28b0d-252a-4fe8-9c35-3e48f9fd8804 req-7a36dbca-b197-48c3-822b-d0d3e70f967a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.745774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31f28b0d-252a-4fe8-9c35-3e48f9fd8804 req-7a36dbca-b197-48c3-822b-d0d3e70f967a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.770070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:56.770624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:56.775120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-31f28b0d-252a-4fe8-9c35-3e48f9fd8804 req-7a36dbca-b197-48c3-822b-d0d3e70f967a service nova] Creating event network-vif-plugged:158ffcc4-7d97-4cb0-b54a-1617e604a896 for instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da on nch2-master-1 Nov 06 21:02:56.784604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.785319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:56.785593 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-31f28b0d-252a-4fe8-9c35-3e48f9fd8804 req-7a36dbca-b197-48c3-822b-d0d3e70f967a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060720 Nov 06 21:02:56.787178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2446/4819] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:02:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:02:56.790974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:56.791456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.033116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:57.041775 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f14485e7-3994-4972-840d-54c30614e590 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.275490 Nov 06 21:02:57.052579 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2374/4820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:56 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:02:57.160171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:57.161534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:57.180660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.181325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.182286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.182897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.451725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fc0c7a6-fc97-416c-90f6-b56da3c3b934 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.296033 Nov 06 21:02:57.454004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2447/4821] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:57 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:57.472142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:57.473917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:57.491441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.492516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.494830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.495670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.632889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:57.633694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:57.651069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.652927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:57.655159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:57.655700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.079902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:58.087987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc07cdc7-d6c8-4cd4-b9f2-7be98fe103cb tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1463 microversion: 2.1 time: 0.620000 Nov 06 21:02:58.089737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2375/4822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:57 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1463 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:58.095675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:58.096656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:58.104504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.105226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.106894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.107529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.135844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:58.153699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1fe12791-a8a5-431d-942e-1093f0af6848 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1511 microversion: 2.1 time: 0.524864 Nov 06 21:02:58.156477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2448/4823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:57 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:58.173887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:58.175907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:58.197166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.200177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.201387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.202914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.701533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:58.723353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a19e8373-d4dc-48b1-8b80-4d237d07de4b tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1312 microversion: 2.1 time: 0.625922 Nov 06 21:02:58.724721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:02:58.726482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2376/4824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:58 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1312 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:58.736776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:58.737938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:58.747856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41772029-3acf-443d-95ff-f0acbab74ed8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1463 microversion: 2.1 time: 0.589799 Nov 06 21:02:58.752272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.753291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.754615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.755900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.760954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2449/4825] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:58 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1463 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:02:58.769342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:02:58.771227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:58.790920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.791630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.793094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:58.793810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:58.818648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89ae5ca7-03f5-44c9-aae7-74a45be311ff tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.089862 Nov 06 21:02:58.826277 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2377/4826] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:02:58 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:02:58.931571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:02:58.932070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:02:58.932639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:02:58.933215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:02:58.933652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:02:59.033104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:59.040733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.041572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:59.043154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.043619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:59.102515 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7bb6062a-4c36-412f-9ebe-0ad7224abf95 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 1067 microversion: 2.1 time: 0.339943 Nov 06 21:02:59.103817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2450/4827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:02:58 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 1067 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 06 21:02:59.119716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:59.121669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:59.150672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.153001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:59.155194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.164334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:59.175259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:02:59.176949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:02:59.187563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.198944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:02:59.205471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:02:59.207044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:00.085225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:00.094584 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d104eb18-d6a6-4fe1-8757-80acda737d4d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.980287 Nov 06 21:03:00.103794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f93174d8e8d4c29b55724b1aeef6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8182a523546466fa113050d28f19731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:00.112330 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2378/4828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:59 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:00.113687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d335743-5afc-4b8a-8bbe-7590ba872bf6 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 200 len: 1511 microversion: 2.1 time: 0.944612 Nov 06 21:03:00.128730 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2451/4829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:02:59 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 1511 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:00.133823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:00.135369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:00.138059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:00.141517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:00.151471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:00.152212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:00.157297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:00.158006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:00.158527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:00.162632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:00.165577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:00.166134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:00.225877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8299219-e780-4601-9cb9-14cf062af1f8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.094369 Nov 06 21:03:00.227023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2452/4830] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:00 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:00.512643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-209321782", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "f4a3bd34-3f4b-41d4-857c-20c8d5617610"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:00.623190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] validate_networks() for [('f4a3bd34-3f4b-41d4-857c-20c8d5617610', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:03:01.564717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:01.575606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c423ef3-19ae-477a-87ed-8fd94affc625 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1498 microversion: 2.1 time: 1.459471 Nov 06 21:03:01.580354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2379/4831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:00 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1498 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:01.588456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:01.591637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:01.607492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:01.608229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:01.610229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:01.617708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.229732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:02.242790 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e073d06-6c5c-425a-a6c2-c6e43333ae61 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.661034 Nov 06 21:03:02.247324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2380/4832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:01 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:02.262755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:02.263665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] [instance: 55ec61b9-c53d-4f91-8efe-073a99ce48af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:02.275227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.277669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.279303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.280835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.324401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] HTTP exception thrown: Instance 55ec61b9-c53d-4f91-8efe-073a99ce48af could not be found. Nov 06 21:03:02.324953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] Returning 404 to user: Instance 55ec61b9-c53d-4f91-8efe-073a99ce48af could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:02.326617 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44eed19e-698f-4ca9-89e9-293a7a0e7a80 tempest-ServerRescueTestJSONUnderV235-668311559 tempest-ServerRescueTestJSONUnderV235-668311559-project] 10.222.0.13 "GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af" status: 404 len: 111 microversion: 2.1 time: 0.076916 Nov 06 21:03:02.329576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2381/4833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:02 2021] GET /compute/v2.1/servers/55ec61b9-c53d-4f91-8efe-073a99ce48af => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:02.342521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:02.345419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:02.360456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.361204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.363250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.367011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.457461 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b3470bc-996e-4be3-800f-14e6b740cb4c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.125910 Nov 06 21:03:02.462102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2382/4834] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:02 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:02.466286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d9e2bd98-f23b-4317-b591-01ea8fca4d9d req-8a15475c-5f48-4ed9-a341-57039a752910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ec61b9-c53d-4f91-8efe-073a99ce48af", "name": "network-vif-deleted", "tag": "27b61f7f-c710-4146-b2ae-d1f0a68b5d97"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:02.472509 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:02.472509 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:02.497194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9e2bd98-f23b-4317-b591-01ea8fca4d9d req-8a15475c-5f48-4ed9-a341-57039a752910 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.497650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9e2bd98-f23b-4317-b591-01ea8fca4d9d req-8a15475c-5f48-4ed9-a341-57039a752910 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.532860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d9e2bd98-f23b-4317-b591-01ea8fca4d9d req-8a15475c-5f48-4ed9-a341-57039a752910 service nova] Creating event network-vif-deleted:27b61f7f-c710-4146-b2ae-d1f0a68b5d97 for instance 55ec61b9-c53d-4f91-8efe-073a99ce48af on nch2-master-1 Nov 06 21:03:02.560776 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d9e2bd98-f23b-4317-b591-01ea8fca4d9d req-8a15475c-5f48-4ed9-a341-57039a752910 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096488 Nov 06 21:03:02.561655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2383/4835] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:02.572812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98c6a448-3346-4ff4-af5b-65a311f3ee90 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:02.635141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.server_groups [None req-98c6a448-3346-4ff4-af5b-65a311f3ee90 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Querying cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) for 1 instances {{(pid=134828) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 06 21:03:02.636486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98c6a448-3346-4ff4-af5b-65a311f3ee90 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.636954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98c6a448-3346-4ff4-af5b-65a311f3ee90 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.685635 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98c6a448-3346-4ff4-af5b-65a311f3ee90 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090" status: 200 len: 221 microversion: 2.1 time: 0.122751 Nov 06 21:03:02.686285 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2384/4836] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:03:02 2021] GET /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090 => generated 221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:02.696642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:02.697266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:02.709877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.710358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.711172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.711616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.762404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:02.853342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:02.854665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:02.855489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:02.856079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:02.857362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:02.876180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.881372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.882806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.885739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:02.935433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Getting quotas for project e30d235fa30149029ee7ab72fa49c352. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:02.950643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Getting quotas for user 62de16dd96894ad281a8d225c40f5c7b and project e30d235fa30149029ee7ab72fa49c352. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:02.960460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b655461-b958-4073-89cf-6d0f454c6915 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 204 len: 0 microversion: 2.1 time: 0.267547 Nov 06 21:03:02.965155 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2385/4837] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:02 2021] DELETE /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:02.978744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:02.979822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:02.987263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:02.990677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:02.993128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:02.993796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.000673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:03.001264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.084604 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f170fef6-5ddb-4faa-9a42-673d60e947eb tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.855699 Nov 06 21:03:03.086456 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2453/4838] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:03:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:03:03.102437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bacef8b6-9d39-441a-bd73-f883fc474e8c tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:03.103065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bacef8b6-9d39-441a-bd73-f883fc474e8c tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:03.301594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bacef8b6-9d39-441a-bd73-f883fc474e8c tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:03.317331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bacef8b6-9d39-441a-bd73-f883fc474e8c tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1216 microversion: 2.1 time: 0.221132 Nov 06 21:03:03.317984 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2454/4839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:03 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:03.338533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:03.348793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:03.367331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:03.367794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.376401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:03.377284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.592077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:03.608815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed8ee4dc-67d2-4e75-9dcf-7cb629ca32ab tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1504 microversion: 2.1 time: 0.632786 Nov 06 21:03:03.611420 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2386/4840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:02 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1504 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:03.637563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:03.638900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:03.660101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:03.661026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.666003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:03.668074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:03.786472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67264c04-6f1f-49af-b2b9-fc0059c2b669 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.171127 Nov 06 21:03:03.788100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2387/4841] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:03 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:03.901030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:03.910177 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d557971d-6078-4b49-9bc9-ecff4639880b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.584807 Nov 06 21:03:03.915328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2455/4842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:03 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:04.336026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:04.336826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:04.359920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.361541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.363860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.366803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.567496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:04.580242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a92b7f8-45d1-4d40-94ba-210e28f04774 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1268 microversion: 2.1 time: 0.248854 Nov 06 21:03:04.581729 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2388/4843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:04 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:04.627089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:04.627922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:04.637567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.639797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.640705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.641151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.799460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:04.801253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:04.816777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.817548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.818497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.819109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.883824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f8f418c-27b6-4e1a-83db-52a8c2f581ab tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.088648 Nov 06 21:03:04.886232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2389/4844] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:04 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:04.934766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:04.935520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:04.947932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.948834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:04.962415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:04.963839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:05.784489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:05.803613 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-549d8683-5a10-431f-946e-a31a11da13c2 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1504 microversion: 2.1 time: 1.180174 Nov 06 21:03:05.805355 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2456/4845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:04 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1504 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:05.827102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:05.830835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:05.838449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:05.839299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:05.840272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:05.840969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.062761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:06.070889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-217c1574-dd79-4688-9767-5abb76dec681 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1274 microversion: 2.1 time: 0.264006 Nov 06 21:03:06.071432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2457/4846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:05 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1274 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:06.085836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:06.087101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:06.093354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:06.094045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.095034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:06.095680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.106825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:06.121857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f33190f-24f8-4fa6-bac6-82d3588d4a0e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 1.193023 Nov 06 21:03:06.134110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2390/4847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:04 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:06.155366 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97b2609c-0725-4882-9b15-9b94f9b34f52 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.072030 Nov 06 21:03:06.159759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2458/4848] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:06 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:06.822294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:06.823281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:06.832867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:06.833679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.834712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:06.836520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.861617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4f398d7f-25b7-4c7f-88e6-d48672fe0901 req-294e8430-532f-4011-a94b-89a673181de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1786b6b5-5024-4c7b-b9f0-b6d8d4da74da", "name": "network-vif-deleted", "tag": "158ffcc4-7d97-4cb0-b54a-1617e604a896"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:06.863820 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:06.863820 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:06.878733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f398d7f-25b7-4c7f-88e6-d48672fe0901 req-294e8430-532f-4011-a94b-89a673181de6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:06.879192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f398d7f-25b7-4c7f-88e6-d48672fe0901 req-294e8430-532f-4011-a94b-89a673181de6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:06.916513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4f398d7f-25b7-4c7f-88e6-d48672fe0901 req-294e8430-532f-4011-a94b-89a673181de6 service nova] Creating event network-vif-deleted:158ffcc4-7d97-4cb0-b54a-1617e604a896 for instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da on nch2-master-1 Nov 06 21:03:06.923159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4f398d7f-25b7-4c7f-88e6-d48672fe0901 req-294e8430-532f-4011-a94b-89a673181de6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065820 Nov 06 21:03:06.924989 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2459/4849] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:03:06.983818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716274b4665c4e7ba4478cbf2b126db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3bcc53d0cc468a95f587efa7e9b444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:07.003315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4d227df-0bf5-46c3-a607-4a6e55732da8 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 200 len: 1462 microversion: 2.1 time: 0.183063 Nov 06 21:03:07.017768 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2391/4850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:06 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 1462 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:07.089754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:07.090571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:07.096819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.097755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.098785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.099226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.143515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:07.144422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:07.152623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.153625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.154567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.155085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.290853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:07.300881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d0e0b2c-e97d-4b53-8200-44992ab322f0 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1274 microversion: 2.1 time: 0.215801 Nov 06 21:03:07.314580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2460/4851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:07 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:07.320837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:07.322308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:07.331851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.332780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.333836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:07.334633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:07.436767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4528b4e-98a6-434a-aac1-1c14e14b81b4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.120446 Nov 06 21:03:07.443343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2461/4852] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:07 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:07.711481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:07.739265 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1437825c-5a72-405a-aa84-2bb4947e7d60 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.599962 Nov 06 21:03:07.740900 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2392/4853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:07 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:08.023442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.024255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.046126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.047580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.048528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.051351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.086730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. Nov 06 21:03:08.087714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.089172 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4828e61e-039b-4ad6-a2e2-507f19f141a1 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 404 len: 111 microversion: 2.1 time: 0.070866 Nov 06 21:03:08.090326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2462/4854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.107041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e72525e0-feb2-4dfb-9838-63b3c9d34fdd tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.130833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.server_groups [None req-e72525e0-feb2-4dfb-9838-63b3c9d34fdd tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Querying cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) for 1 instances {{(pid=134828) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 06 21:03:08.133585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72525e0-feb2-4dfb-9838-63b3c9d34fdd tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.134270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e72525e0-feb2-4dfb-9838-63b3c9d34fdd tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.146514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e72525e0-feb2-4dfb-9838-63b3c9d34fdd tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042578 Nov 06 21:03:08.161544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3dc3a0b-5508-49d9-b10b-4eee6b91b630 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.168494 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2393/4855] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:08.180998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.server_groups [None req-b3dc3a0b-5508-49d9-b10b-4eee6b91b630 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Querying cell ea2938b3-fcb8-43d9-943e-9ad99487f8c0(cell1) for 1 instances {{(pid=134827) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 06 21:03:08.182037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3dc3a0b-5508-49d9-b10b-4eee6b91b630 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.182840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3dc3a0b-5508-49d9-b10b-4eee6b91b630 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.207599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3dc3a0b-5508-49d9-b10b-4eee6b91b630 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090" status: 200 len: 183 microversion: 2.1 time: 0.049069 Nov 06 21:03:08.209336 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2463/4856] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090 => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:08.222366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.223348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.231629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.232431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.233495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.234148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.260040 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. Nov 06 21:03:08.261956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.264646 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-deb086ea-d715-44f4-ac01-a71495b93b00 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 404 len: 111 microversion: 2.1 time: 0.046210 Nov 06 21:03:08.266998 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2394/4857] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.277306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.278029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] [instance: 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.288512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.291260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.298145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.298729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.318990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.319740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.334605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.336875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.337959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.340751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.344655 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. Nov 06 21:03:08.345501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance 1786b6b5-5024-4c7b-b9f0-b6d8d4da74da could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.346368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cfbf6a5a-fea8-4d61-81e3-172703f740e0 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da" status: 404 len: 111 microversion: 2.1 time: 0.073394 Nov 06 21:03:08.348647 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2464/4858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/servers/1786b6b5-5024-4c7b-b9f0-b6d8d4da74da => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.361718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d008d14-08de-49e6-ae68-4dc8529935e4 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.372141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-8d008d14-08de-49e6-ae68-4dc8529935e4 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance group 80cb106d-6e74-4562-bbfb-a67844a3b306 could not be found. Nov 06 21:03:08.376438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d008d14-08de-49e6-ae68-4dc8529935e4 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance group 80cb106d-6e74-4562-bbfb-a67844a3b306 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.377536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d008d14-08de-49e6-ae68-4dc8529935e4 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/80cb106d-6e74-4562-bbfb-a67844a3b306" status: 404 len: 117 microversion: 2.1 time: 0.026405 Nov 06 21:03:08.378567 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2465/4859] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/os-server-groups/80cb106d-6e74-4562-bbfb-a67844a3b306 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.386716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c429e2d0-f263-4da7-a0a3-6963c123a669 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.408481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c429e2d0-f263-4da7-a0a3-6963c123a669 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance group 6238bbf2-a653-42ed-b505-31e2ff0718e9 could not be found. Nov 06 21:03:08.409357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c429e2d0-f263-4da7-a0a3-6963c123a669 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance group 6238bbf2-a653-42ed-b505-31e2ff0718e9 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.410349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c429e2d0-f263-4da7-a0a3-6963c123a669 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/6238bbf2-a653-42ed-b505-31e2ff0718e9" status: 404 len: 117 microversion: 2.1 time: 0.027386 Nov 06 21:03:08.411414 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2466/4860] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/os-server-groups/6238bbf2-a653-42ed-b505-31e2ff0718e9 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.421199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c4c9fad-8305-4995-a5c9-6b0fcb301026 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.436273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3c4c9fad-8305-4995-a5c9-6b0fcb301026 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance group d0de281e-2c89-4675-a72c-e061a7e50aa7 could not be found. Nov 06 21:03:08.437300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c4c9fad-8305-4995-a5c9-6b0fcb301026 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance group d0de281e-2c89-4675-a72c-e061a7e50aa7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.450716 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c4c9fad-8305-4995-a5c9-6b0fcb301026 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/d0de281e-2c89-4675-a72c-e061a7e50aa7" status: 404 len: 117 microversion: 2.1 time: 0.020742 Nov 06 21:03:08.465081 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2467/4861] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/os-server-groups/d0de281e-2c89-4675-a72c-e061a7e50aa7 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.470010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:08.471141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.480882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.481333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.482159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.482650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.557297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a50d65db-15fe-4595-a568-1eee310253c4 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.090656 Nov 06 21:03:08.558265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2468/4862] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:08 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:08.563233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45741915-acae-40e9-8ff5-8bb2e43402eb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.574954 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-45741915-acae-40e9-8ff5-8bb2e43402eb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] HTTP exception thrown: Instance group 8ef1788e-6dc9-4630-93f0-6cfd4aede94a could not be found. Nov 06 21:03:08.587041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45741915-acae-40e9-8ff5-8bb2e43402eb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Returning 404 to user: Instance group 8ef1788e-6dc9-4630-93f0-6cfd4aede94a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:08.588216 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45741915-acae-40e9-8ff5-8bb2e43402eb tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/8ef1788e-6dc9-4630-93f0-6cfd4aede94a" status: 404 len: 117 microversion: 2.1 time: 0.028714 Nov 06 21:03:08.588988 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2469/4863] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/os-server-groups/8ef1788e-6dc9-4630-93f0-6cfd4aede94a => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:08.596671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f72a533c-c335-4566-91c4-bcef63c37963 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.659043 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f72a533c-c335-4566-91c4-bcef63c37963 tempest-ServerGroupTestJSON-1031273888 tempest-ServerGroupTestJSON-1031273888-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090" status: 204 len: 0 microversion: 2.1 time: 0.065759 Nov 06 21:03:08.660256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2470/4864] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Nov 6 21:03:08 2021] DELETE /compute/v2.1/os-server-groups/55da93fc-5085-4ca9-a51e-a34d71bef090 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:03:08.757672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:08.758413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:08.770100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.770524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:08.771321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:08.771734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:09.230029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:09.239735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-961079b6-ca4d-4258-9bd2-d73f7307bcd7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.924837 Nov 06 21:03:09.250167 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2395/4865] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:09.570560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:09.571568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:09.585831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:09.586292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:09.587126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:09.587579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:09.662694 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d3d48ba-b1f8-4645-bb75-d0ff5a8cbe80 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.096409 Nov 06 21:03:09.663818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2396/4866] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:09 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:09.734947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:09.747596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5514b05-c66c-4afc-94f0-c392c001d978 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.992452 Nov 06 21:03:09.749466 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2471/4867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:08 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:10.262114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:10.263961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:10.273870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.274814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.281091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.282995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.643467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:10.657532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cab3a427-3780-400d-a215-1bb414bcef22 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.404362 Nov 06 21:03:10.665107 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2397/4868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:10 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:10.675269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:10.676506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:10.722394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.728764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.734029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.736794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.775283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:10.776686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:10.794034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.795988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.799144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.799656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.858120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0db8c7e0-2984-4ec3-aa9a-49f0eb5ac139 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.187073 Nov 06 21:03:10.859544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2472/4869] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:10 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:10.866609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b32fd1ce-cce8-45e8-b753-dfc89803bcba req-9bbc7a97-148d-4318-b866-015c1da14881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b88c45c-0fa3-46c6-99c1-e4298593d59a", "tag": "76222a57-2718-4db9-8b49-e482a9bc1272"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:10.869617 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:10.869617 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:10.884693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b32fd1ce-cce8-45e8-b753-dfc89803bcba req-9bbc7a97-148d-4318-b866-015c1da14881 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:10.885691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b32fd1ce-cce8-45e8-b753-dfc89803bcba req-9bbc7a97-148d-4318-b866-015c1da14881 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:10.921924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b32fd1ce-cce8-45e8-b753-dfc89803bcba req-9bbc7a97-148d-4318-b866-015c1da14881 service nova] Creating event network-changed:76222a57-2718-4db9-8b49-e482a9bc1272 for instance 0b88c45c-0fa3-46c6-99c1-e4298593d59a on nch2-master-1 Nov 06 21:03:10.932854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b32fd1ce-cce8-45e8-b753-dfc89803bcba req-9bbc7a97-148d-4318-b866-015c1da14881 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069388 Nov 06 21:03:10.937060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2473/4870] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:11.503578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:11.524811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1d150c6-baa2-40d2-b9eb-3280f1b85a1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.760213 Nov 06 21:03:11.530722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2398/4871] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:10 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:11.681054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:11.682026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:11.706691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:11.707453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:11.708839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:11.709511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:11.880062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:11.881264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:11.896744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:11.897646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:11.901472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:11.902211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:11.987238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c7f3c3c-0b14-49ef-87fe-2fc9ffa63ad0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.118769 Nov 06 21:03:11.988638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2399/4872] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:11 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:12.340359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:12.358080 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10f189d9-50a1-4a08-8d42-8177fae201a6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.682229 Nov 06 21:03:12.369799 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2474/4873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:11 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:12.547463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:12.548820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:12.570077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:12.570536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:12.571344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:12.578096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:12.999170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:13.000163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:13.013072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.013536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:13.014339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.014784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:13.154618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6895500-f68b-4ded-a2a2-acb21fed4926 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.158864 Nov 06 21:03:13.156752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2475/4874] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:12 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:13.577987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-321922806", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": "none"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:13.664396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:13.664837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:13.665386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:13.665813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:13.666513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:13.681428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.682770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:13.684095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.684862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:13.724223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:13.731429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for user 1bff1eb1e64d4c00acdb0da32dfb3348 and project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:13.757636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:13.766726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:13.799767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:13.831590 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8658e974-c588-480c-a693-fa4986979971 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 1.286013 Nov 06 21:03:13.852505 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2400/4875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:12 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:13.905009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:13.906363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:13.927227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.927697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:13.928546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:13.928992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:14.036591 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7f3e247-36e6-4a99-8e01-fb6c24e29a17 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.728925 Nov 06 21:03:14.042533 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2476/4876] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 21:03:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 21:03:14.054839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:14.059588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:14.334968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:14.355605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:14.358368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:14.360562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e0900c2-c518-4003-b82d-63ecf8b040d1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1277 microversion: 2.54 time: 0.313559 Nov 06 21:03:14.361340 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2477/4877] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:14 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:14.373916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:14.390816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:14.429170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:14.429786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:14.430700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:14.431188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:14.517946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6dc91c3-fb9f-4c35-a347-4f2071b5a411 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.153586 Nov 06 21:03:14.522129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2478/4878] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:14 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:14.740032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:14.750940 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f06735c8-a45f-4c42-869a-2199bdc63aa3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.891930 Nov 06 21:03:14.753906 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2401/4879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:13 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:14.856416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:14.858051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:14.881592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:14.882069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:14.882886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:14.891753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.064434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:15.076612 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8182baf9-c327-489e-8b15-b1ab41e6c767 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.226379 Nov 06 21:03:15.077271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2479/4880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:14 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:15.383170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:15.384408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:15.391699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.392395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.393284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.393824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.475160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:15.484882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:15.487107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:15.488585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f54cce41-8133-42b1-9203-32d6e2433655 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1329 microversion: 2.54 time: 0.112695 Nov 06 21:03:15.489846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2402/4881] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:15 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:15.535357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:15.536842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:15.545350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.546246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.547585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.548450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.602267 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e597847c-70ab-45ee-b875-bd75079f7f77 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.071047 Nov 06 21:03:15.603170 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2480/4882] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:15 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:15.771710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:15.772436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:15.778988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.779559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.780465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:15.780984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:15.993348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:16.010022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37f03f56-9cbe-41ca-a551-147cb05e92d4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.242558 Nov 06 21:03:16.021466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2403/4883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:15 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:16.089175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1272055596", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:16.096200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:16.096875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:16.105477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.109546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.110476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.110933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.165173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:03:16.564997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:16.579878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-622e0f58-96a0-4d01-8ff4-9af2bca49a63 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.489044 Nov 06 21:03:16.581831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2404/4884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:16 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:16.595639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:16.597254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:16.606164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.607094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.608198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.608887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.711566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:16.749918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:16.753201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:16.754491 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-453dd329-4180-4db1-aa43-fbb6be61b256 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1335 microversion: 2.54 time: 0.169904 Nov 06 21:03:16.766744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2405/4885] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:16 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:16.772445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:16.779041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:16.786922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.787630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.788791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.789405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.839511 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95987ba5-ca9c-4d06-b932-3f27a22cd35f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.071101 Nov 06 21:03:16.841779 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2406/4886] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:16 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:16.924950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:16.924950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:16.925256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:16.925520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:16.926121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:16.937266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.938032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.939183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:16.939859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:16.962883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:16.970050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:16.989982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:16.993078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:17.028893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:17.030121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:17.043525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.044198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.045477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.046139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.081589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94053bed-1b23-4c1b-b3d5-efe7c96030ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059247 Nov 06 21:03:17.082963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2481/4887] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:03:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:03:17.093031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9874a3bf-f239-48c9-aecf-ac930fc26cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:17.094405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9874a3bf-f239-48c9-aecf-ac930fc26cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:17.227495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9874a3bf-f239-48c9-aecf-ac930fc26cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:17.247938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9874a3bf-f239-48c9-aecf-ac930fc26cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1193 microversion: 2.1 time: 0.159207 Nov 06 21:03:17.251545 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2482/4888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:17 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:17.582548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:17.596694 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b3a71e3-401e-42e0-987e-8399659d28ee tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.571927 Nov 06 21:03:17.601525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:17.602278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:17.618050 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2407/4889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:17 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:17.618274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.618274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.618274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.618274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.776783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:17.777675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:17.795584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.798049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.799351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:17.800040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:17.948108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:17.977086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8dc95324-61d0-4532-a12c-1f2e693b63bc tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.382674 Nov 06 21:03:17.997379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:18.003339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2483/4890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:17 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:18.030968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:18.037847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:18.039369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:18.042171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:18.042411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-69c0eb07-e3f5-4ac1-bf5f-2f39c24bc699 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1335 microversion: 2.54 time: 0.270295 Nov 06 21:03:18.044825 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2408/4891] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:17 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1335 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:18.061011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.061617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.062522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.063189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.115269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae4cb3a2-be19-46f0-8aa8-170095c32cee tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.094677 Nov 06 21:03:18.115933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2484/4892] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:18 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:18.268189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:18.269210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:18.276796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.277497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.278343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.279000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.346474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:18.355817 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b22a8ab3-4ca8-4caa-8aa5-a86b9bbb3630 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1245 microversion: 2.1 time: 0.092126 Nov 06 21:03:18.357316 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2409/4893] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:18 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:18.626709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:18.627430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:18.642968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.643418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.652022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:18.653598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:18.871690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:18.889502 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13760f61-1c92-42e1-b16b-b04fe5fce0a2 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.267183 Nov 06 21:03:18.908370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2485/4894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:18 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:18.994813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:18.995551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:19.002258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.002999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.004036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.004757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.069011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:19.070116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:19.080758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.084039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.085576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.086268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.230015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:19.246133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:19.248386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:19.250693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bfcbfa77-b364-4c00-bc64-4d333414598a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1335 microversion: 2.54 time: 0.187042 Nov 06 21:03:19.251963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2486/4895] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:19 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1335 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:19.258720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:19.261624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:19.269302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:19.276494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.277453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.279003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.279113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.301989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e917b43-681a-4d45-8b8a-3e685dbdc41e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.310763 Nov 06 21:03:19.302953 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2410/4896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:18 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:19.344570 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3873c0d3-e779-45c7-8a25-6670ac43da31 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.090780 Nov 06 21:03:19.346188 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2487/4897] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:19 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:19.377004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:19.378383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:19.391272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.391672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.392547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.392988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.510825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:19.529600 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6334358c-b956-46c6-a8a7-4bec8bf187a3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1251 microversion: 2.1 time: 0.157561 Nov 06 21:03:19.532789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2411/4898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:19 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1251 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:19.919227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:19.923626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:19.934012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.934867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:19.940045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:19.940567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.265653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:20.280639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:20.283001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:20.292471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.293177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.295101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.295754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.298905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-521e2edf-c707-450c-91d9-9e32aee6d5e7 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.384251 Nov 06 21:03:20.315463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2488/4899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:19 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:20.369571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:20.372475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:20.394865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.395870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.397472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.398102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.492611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:20.501339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:20.506567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:20.509366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33f2c7bc-9b70-4a65-80cb-3271a130189d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1356 microversion: 2.54 time: 0.237553 Nov 06 21:03:20.510119 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2412/4900] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:20 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:20.519175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:20.521109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:20.529027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.529777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.530892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.531622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.608016 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-704c1359-6c67-476d-a957-06b59f05626b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.096184 Nov 06 21:03:20.612173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2413/4901] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:20 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:20.619552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Action: 'create', calling method: .version_select at 0x7f671acbde50>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-862066936"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:20.659974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:20.666472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for user 1bff1eb1e64d4c00acdb0da32dfb3348 and project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:20.756449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:20.763594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Getting quotas for user 1bff1eb1e64d4c00acdb0da32dfb3348 and project 5bcc5031641f426b9b90bd4b503041ee. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:20.781639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a6c0dce-0868-4177-b843-ac78951908b3 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.54 time: 0.170562 Nov 06 21:03:20.782558 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2414/4902] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 21:03:20 2021] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:03:20.787582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:20.788667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:20.795995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.796499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.797315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.797754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.838188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:20.847671 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-481a7b29-45ab-4905-b909-ccff3838f465 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.529389 Nov 06 21:03:20.859950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2489/4903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:20 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:20.873346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-862066936", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:20.875041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:20.885429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.892644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:20.893821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:20.894356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.083917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:21.084757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:21.085604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:21.086271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:21.086908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:21.194080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:21.201224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.201982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.202991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.203749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.259254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab2b1c88-ae44-4674-a0ec-9656f0305e3c tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "POST /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce/action" status: 202 len: 1138 microversion: 2.54 time: 0.397876 Nov 06 21:03:21.264195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2490/4904] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Nov 6 21:03:20 2021] POST /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce/action => generated 1138 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 06 21:03:21.276518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:21.277840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:21.291473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.292572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.293548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.294060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.535515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:21.549954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:21.553993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:21.557861 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1932fbda-29d4-44fa-bfdf-360bfcba17b8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.285948 Nov 06 21:03:21.559691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2491/4905] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:21 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:21.576627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:21.578154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:21.591137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.594348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.595186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.596857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.681778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:21.692144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-612e50fa-528f-4d80-bb13-48f96637b726 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.908108 Nov 06 21:03:21.694125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2415/4906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:20 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:21.699402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3d870ccd-6bd4-493e-a9e7-9afe482a03d9 req-94148cc4-e65a-4e30-b28b-3cd39083b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b88c45c-0fa3-46c6-99c1-e4298593d59a", "name": "network-vif-plugged", "status": "completed", "tag": "76222a57-2718-4db9-8b49-e482a9bc1272"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:21.701266 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:21.701266 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:21.714769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3d870ccd-6bd4-493e-a9e7-9afe482a03d9 req-94148cc4-e65a-4e30-b28b-3cd39083b1fa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.715807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3d870ccd-6bd4-493e-a9e7-9afe482a03d9 req-94148cc4-e65a-4e30-b28b-3cd39083b1fa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.730748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3d870ccd-6bd4-493e-a9e7-9afe482a03d9 req-94148cc4-e65a-4e30-b28b-3cd39083b1fa service nova] Creating event network-vif-plugged:76222a57-2718-4db9-8b49-e482a9bc1272 for instance 0b88c45c-0fa3-46c6-99c1-e4298593d59a on nch2-master-1 Nov 06 21:03:21.739532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3d870ccd-6bd4-493e-a9e7-9afe482a03d9 req-94148cc4-e65a-4e30-b28b-3cd39083b1fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042071 Nov 06 21:03:21.740985 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2416/4907] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:21.749152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:21.750427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:21.761168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.761897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.762926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.764103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.822729 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5bfe437b-b9be-4151-b04f-c9ffc196d500 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.080081 Nov 06 21:03:21.824311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2417/4908] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:21 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:21.872115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:21.878882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:21.891568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.892036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:21.892879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:21.893960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.049525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:22.062109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a240e8d-664c-4da6-b859-893d808a7353 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.498878 Nov 06 21:03:22.064606 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2492/4909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:21 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:22.076572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6b1f3939-21cf-4098-b9bd-0eeba7b471ca req-80ea6cfc-31f4-43a8-9244-69c21644a1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e556d555-ac33-446d-a5c6-2bc4d404e921", "tag": "bbe58d3f-538b-46e3-b044-460af86c1b11"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:22.077515 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:22.077515 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:22.107094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6b1f3939-21cf-4098-b9bd-0eeba7b471ca req-80ea6cfc-31f4-43a8-9244-69c21644a1e0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.107578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6b1f3939-21cf-4098-b9bd-0eeba7b471ca req-80ea6cfc-31f4-43a8-9244-69c21644a1e0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.134564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6b1f3939-21cf-4098-b9bd-0eeba7b471ca req-80ea6cfc-31f4-43a8-9244-69c21644a1e0 service nova] Creating event network-changed:bbe58d3f-538b-46e3-b044-460af86c1b11 for instance e556d555-ac33-446d-a5c6-2bc4d404e921 on nch2-master-1 Nov 06 21:03:22.146453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6b1f3939-21cf-4098-b9bd-0eeba7b471ca req-80ea6cfc-31f4-43a8-9244-69c21644a1e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080580 Nov 06 21:03:22.148989 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2493/4910] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:22.268789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:22.278297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-984d1113-95a0-4009-ada1-32c990cbe4be tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.410323 Nov 06 21:03:22.279184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2418/4911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:21 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:22.577277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:22.577982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:22.587207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.587943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.588984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.589581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.713538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:22.716414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:22.742593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.743249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.744122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.753389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.778306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:22.794747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:22.796324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:22.797575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00bc634f-5354-4958-ac39-f6833c0d94b6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.224630 Nov 06 21:03:22.806540 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2494/4912] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:22 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:22.841088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:22.843230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:22.857553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.858459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.860095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:22.860763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:22.944424 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22c80fdf-c450-4da1-b211-7bee49810061 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.107019 Nov 06 21:03:22.946510 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2495/4913] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:22 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:23.082217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:23.083583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:23.096619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.097926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.099534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.100155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.294899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.305624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96da3451-6ece-4828-a66b-60c409c1f938 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.598258 Nov 06 21:03:23.306907 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2419/4914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:22 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:23.312359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:23.313304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:23.323669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.324892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.325952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.327336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.513302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.521756 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57671e6b-a9a9-4acd-867b-1297f9679abc tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1316 microversion: 2.1 time: 0.443396 Nov 06 21:03:23.531857 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2496/4915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:23 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:23.620347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.634101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f48837f7-8c85-4edb-a8a1-efc94bdd9f58 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.325869 Nov 06 21:03:23.634707 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2420/4916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:23 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:23.817652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:23.819072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:23.826547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.827348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.828148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.828854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.929030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.940023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.942622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:23.944117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea87c974-9809-442a-84c5-2fb29d16b3e6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.130836 Nov 06 21:03:23.947015 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2497/4917] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:23 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:23.956824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:23.958506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:23.965673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.966478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:23.967494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:23.968146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.013238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22b2cc65-844f-4933-85d5-426e26d68b88 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.059743 Nov 06 21:03:24.018123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2421/4918] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:23 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:24.325747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:24.326765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:24.338344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.340936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.343327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.345470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.545024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:24.545742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:24.558866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:24.568383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0cc2221-7d4c-4674-b7d5-db9d2a18f347 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.246330 Nov 06 21:03:24.569563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.570037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.570291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2498/4919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:24 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:24.572198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.572728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.651408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:24.652216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:24.659581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.662883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:24.663985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:24.664689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.006766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.011366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.019374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db296a4b-60a1-4beb-82ea-f08b52095e3b tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.371470 Nov 06 21:03:25.020504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2499/4920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:24 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:25.024181 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4337773d-714d-47a4-af69-5e66e059a4c3 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1505 microversion: 2.1 time: 0.487418 Nov 06 21:03:25.025200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:25.025993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.032580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.033039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.033838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.034278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.038054 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2422/4921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:24 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:25.044192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:25.045395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.054441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.055011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.055901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.056622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.106440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5907860-8a6d-4f06-8852-12b5e290c92f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.066861 Nov 06 21:03:25.107396 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2423/4922] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:25 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:25.117838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:25.118581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.125359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.125911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.126780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.127301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.140627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.150924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.153322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.154722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6512c2fa-6e11-44a1-89e7-8e00677f4169 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.133128 Nov 06 21:03:25.156075 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2500/4923] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:25 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:25.164861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.166338 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28f82656-028f-4bf2-9c53-70a6917cfa0d tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/os-instance-actions/req-f170fef6-5ddb-4faa-9a42-673d60e947eb" status: 200 len: 313 microversion: 2.1 time: 0.057699 Nov 06 21:03:25.167764 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2424/4924] 10.222.0.13 () {58 vars in 1418 bytes} [Sat Nov 6 21:03:25 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/os-instance-actions/req-f170fef6-5ddb-4faa-9a42-673d60e947eb => generated 313 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:25.181462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:25.182050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.188146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.188889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.189696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.190136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.292192 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d0b8726-0519-450d-b1cd-5a620ca93fc9 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "POST /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/action" status: 202 len: 0 microversion: 2.1 time: 0.115735 Nov 06 21:03:25.306753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:25.307308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2501/4925] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:03:25 2021] POST /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:25.307729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.319628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.320877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.326413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.328388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.518671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.528179 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-889ca787-edd8-4e53-b434-3cbf07f567ca tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1507 microversion: 2.1 time: 0.228139 Nov 06 21:03:25.529221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2425/4926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:25 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:25.588049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:25.588993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:25.595875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.596459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.597408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:25.598497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:25.751250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:25.760146 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75705139-9712-407a-b6b5-722888afdee9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.176652 Nov 06 21:03:25.761317 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2502/4927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:25 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:26.037827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:26.038519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:26.046186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.047052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.048037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.048731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.118289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:26.119432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:26.130481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.130934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.134518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.135199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.206568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bb6f144-7d7c-42c0-b648-599224d90485 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.091679 Nov 06 21:03:26.213086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2503/4928] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:26 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:26.227749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:26.232885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:26.248068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:26.250535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.251502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.252522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.253193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.256156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce06dcfe-498e-4ac6-b4ba-ad25a9871a94 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1472 microversion: 2.1 time: 0.222534 Nov 06 21:03:26.256771 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2426/4929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:26 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:26.346319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:26.356265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:26.358412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:26.360217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ecc30be7-0ea1-4417-9a64-225e9b7bdde7 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.144795 Nov 06 21:03:26.361387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2504/4930] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:26 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:26.547147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:26.548119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:26.555959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.556818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.557882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.558552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.781207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:26.782186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:26.795030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.796761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.797894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:26.799084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:26.828110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:26.842145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0f5ecac-0e13-47d7-a948-9b38097974e4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1507 microversion: 2.1 time: 0.298430 Nov 06 21:03:26.860209 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2427/4931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:26 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:27.123378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:27.132232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1efb2e1e-0147-4ab1-90d3-cc5a53525e4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.358681 Nov 06 21:03:27.133522 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2505/4932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:26 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:27.231835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:27.233488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:27.254293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.255085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.256688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.257137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.291729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:27.298434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:27.310079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.310454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.311309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.311958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.319950 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb1d80d2-c7c9-4196-9de9-917858c13fa9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.101723 Nov 06 21:03:27.320921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2428/4933] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:27 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:27.394071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:27.395628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:27.406928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.407689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.408660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.409275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.551532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:27.564979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:27.568952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:27.570862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43726b46-b188-4f46-bc28-1ba06ba058cc tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.181618 Nov 06 21:03:27.575364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2429/4934] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:27 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:27.609190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:27.617898 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42a2fd27-0554-4414-bdee-86c02258d501 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.348199 Nov 06 21:03:27.623427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2506/4935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:27 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:27.865444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:27.867004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:27.882220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.882895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:27.885987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:27.888397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.151784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:28.152428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.166682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.167386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.168199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.168790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.632164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:28.647101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:28.649211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-305df58a-11bd-4fdd-a8d6-c86146bdca8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.499958 Nov 06 21:03:28.656229 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2672c94b-d884-44bf-b848-f38e36e4bbf4 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1505 microversion: 2.1 time: 0.796998 Nov 06 21:03:28.661694 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2507/4936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:28 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:28.667527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:28.668860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.670266 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2430/4937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:27 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1505 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:28.674917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:28.675538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.677956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.679034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.681085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.682138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.683752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.684466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.685423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.685884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.733880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-469a7738-00ef-4a6c-8f77-0d85a7464a86 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.070421 Nov 06 21:03:28.734860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2508/4938] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:28 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:28.740337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:28.741320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.750666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.751428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.752485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.753489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.873122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:28.884614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:28.889286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:28.891226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7db2b790-aea1-4db0-aad8-488473a513f9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.154716 Nov 06 21:03:28.893088 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2509/4939] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:28 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:28.899641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '.version_select at 0x7f67157693a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:28.900326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.913689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.914233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.926411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.927527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.975508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-52db26f2-7095-4315-876c-79bc66a81d1b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.079807 Nov 06 21:03:28.982125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2510/4940] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Nov 6 21:03:28 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a/os-instance-actions => generated 611 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:28.987734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:28.988931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:28.996453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.996972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:28.997871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:28.998404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.031775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:29.050516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:29.063231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00d8ac3f-0be6-482f-a0bf-b6ecf23f7915 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.391808 Nov 06 21:03:29.065949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2431/4941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:28 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:29.147894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24be7003-d51b-4d4e-bb48-8f7bbcd89511 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 204 len: 0 microversion: 2.1 time: 0.163531 Nov 06 21:03:29.149221 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2511/4942] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:28 2021] DELETE /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:29.156925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:29.157703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:29.165646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.166414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.167825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.168263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.423768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:29.431444 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-361a26c2-cec7-4bad-aa7f-73c28478ccc6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1511 microversion: 2.1 time: 0.278184 Nov 06 21:03:29.432024 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2432/4943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:29 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:29.666791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:29.668436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:29.675381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.675826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.676895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.677493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.750419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:29.752072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:29.767182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.769160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.778308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.778789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.884712 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1c5cb65-3738-4110-aebd-5a5c5f765176 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.141948 Nov 06 21:03:29.886173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2433/4944] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:29 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:29.911664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:29.912278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:29.926179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.927884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:29.930752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:29.932317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.027680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.035343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.045365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.049152 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55fc5f4c-69e6-4f58-be64-8604b71c78da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.386330 Nov 06 21:03:30.050952 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2512/4945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:29 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:30.053542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.057100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abd270a5-a956-4e5f-9834-2a6e710e2190 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.150098 Nov 06 21:03:30.059237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d8e95b2c-3a97-4a02-b928-332824c8777f req-70633a6f-5234-42a6-ad5c-7f6ab5e32a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-unplugged", "status": "completed", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:30.059932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2434/4946] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:29 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:30.071259 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:30.071259 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:30.071259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d8e95b2c-3a97-4a02-b928-332824c8777f req-70633a6f-5234-42a6-ad5c-7f6ab5e32a7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.071259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d8e95b2c-3a97-4a02-b928-332824c8777f req-70633a6f-5234-42a6-ad5c-7f6ab5e32a7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.082202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:30.083377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:30.094241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.096129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d8e95b2c-3a97-4a02-b928-332824c8777f req-70633a6f-5234-42a6-ad5c-7f6ab5e32a7d service nova] Creating event network-vif-unplugged:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:03:30.097108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.101306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.101839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.106368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d8e95b2c-3a97-4a02-b928-332824c8777f req-70633a6f-5234-42a6-ad5c-7f6ab5e32a7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053994 Nov 06 21:03:30.108896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2513/4947] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:30.449910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:30.451205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:30.458008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.458847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.459906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.460613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.551982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.563551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a8a8d95-454f-4d64-8ae7-8cf3848a654c tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.484989 Nov 06 21:03:30.564937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2435/4948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:30 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:30.702994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:30.727068 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36e7549e-b6f4-437f-8614-4e5be3ba0ae6 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1511 microversion: 2.1 time: 0.281691 Nov 06 21:03:30.728249 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2514/4949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:30 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:30.897950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:30.899049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:30.905393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.906198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.907264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:30.907920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:30.950698 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01d1fca6-5a19-4539-b78e-e896e98b1686 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.057243 Nov 06 21:03:30.951368 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2436/4950] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:30 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:31.071784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:31.075545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:31.078865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:31.079789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:31.088491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.089218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.090228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.091031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.091302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.092457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.095414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.097003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.200456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.212620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.217226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.220145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f3631caa-4a12-4c7f-88c8-04c2ce20972f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.145171 Nov 06 21:03:31.233121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2437/4951] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:31 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:31.319021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.327186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-024f2096-6e43-4676-9a0d-8917fb663296 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.263070 Nov 06 21:03:31.327774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2515/4952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:31 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:31.581156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:31.582035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:31.590246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.591069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.592362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.593148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.748065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:31.749817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:31.760553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.761261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.762486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.763095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.772823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.789079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f539a41-d808-49f7-bfe6-52f4f0774b66 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.211392 Nov 06 21:03:31.797008 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2438/4953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:31 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:31.966984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:31.967579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:31.969895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:31.977703 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d8f5c9a-d91c-46b5-9db6-210086f6e6ab tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1511 microversion: 2.1 time: 0.235668 Nov 06 21:03:31.979190 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2516/4954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:31 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:31.985351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.986241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:31.987393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:31.988067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.035033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bb3a656-2478-4419-a54b-4935e56a783e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.074983 Nov 06 21:03:32.042948 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2439/4955] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:31 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:32.133439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-61017414-2230-4e7e-8397-79501048be0a req-1958a19f-363d-487e-9000-0635fb7ca617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e556d555-ac33-446d-a5c6-2bc4d404e921", "name": "network-vif-plugged", "status": "completed", "tag": "bbe58d3f-538b-46e3-b044-460af86c1b11"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:32.136840 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:32.136840 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:32.147206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61017414-2230-4e7e-8397-79501048be0a req-1958a19f-363d-487e-9000-0635fb7ca617 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.150180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61017414-2230-4e7e-8397-79501048be0a req-1958a19f-363d-487e-9000-0635fb7ca617 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.165173 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-61017414-2230-4e7e-8397-79501048be0a req-1958a19f-363d-487e-9000-0635fb7ca617 service nova] Creating event network-vif-plugged:bbe58d3f-538b-46e3-b044-460af86c1b11 for instance e556d555-ac33-446d-a5c6-2bc4d404e921 on nch2-master-1 Nov 06 21:03:32.186187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-61017414-2230-4e7e-8397-79501048be0a req-1958a19f-363d-487e-9000-0635fb7ca617 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060428 Nov 06 21:03:32.190270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2517/4956] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:32.243311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:32.244654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:32.273908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.277181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.278302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.278944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.347241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:32.349232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:32.366070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.373619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.374648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.375201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.441217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:32.450694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:32.452815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:32.454322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35beaef0-13b5-41ef-96c8-db0b92f791e9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.216938 Nov 06 21:03:32.467338 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2440/4957] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:32 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:32.568594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e883ef38-2e4b-4594-b0ed-225737f90fd6 req-b0cca041-96df-4c09-9cf3-766ce4f98bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b88c45c-0fa3-46c6-99c1-e4298593d59a", "name": "network-vif-deleted", "tag": "76222a57-2718-4db9-8b49-e482a9bc1272"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:32.571688 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:32.571688 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:32.581596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e883ef38-2e4b-4594-b0ed-225737f90fd6 req-b0cca041-96df-4c09-9cf3-766ce4f98bf7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.582317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e883ef38-2e4b-4594-b0ed-225737f90fd6 req-b0cca041-96df-4c09-9cf3-766ce4f98bf7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.606319 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e883ef38-2e4b-4594-b0ed-225737f90fd6 req-b0cca041-96df-4c09-9cf3-766ce4f98bf7 service nova] Creating event network-vif-deleted:76222a57-2718-4db9-8b49-e482a9bc1272 for instance 0b88c45c-0fa3-46c6-99c1-e4298593d59a on nch2-master-1 Nov 06 21:03:32.633772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e883ef38-2e4b-4594-b0ed-225737f90fd6 req-b0cca041-96df-4c09-9cf3-766ce4f98bf7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063856 Nov 06 21:03:32.645228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2441/4958] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:32.808760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:32.809838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:32.817593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.818179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:32.819428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:32.820029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.010095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.023628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-548aced5-aa84-4f90-ace9-3efe5c035221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.681707 Nov 06 21:03:33.024584 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2518/4959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:32 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:33.040723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:33.041356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:33.062673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.063434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.066997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.068162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.117410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.126009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e282035c-a792-450b-aca5-3b4556b51fe5 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.322408 Nov 06 21:03:33.127776 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2442/4960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:32 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:33.145940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:33.147013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:33.154341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.155011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.155814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lazy-loading 'fault' on Instance uuid 0b88c45c-0fa3-46c6-99c1-e4298593d59a {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:03:33.164821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.165285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.166097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.166549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.247436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62de16dd96894ad281a8d225c40f5c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30d235fa30149029ee7ab72fa49c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.250321 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0d138e9-7545-4cd1-9da3-a97413665879 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.116194 Nov 06 21:03:33.250981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2443/4961] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:33 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:33.258703 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d0bb1c7-bdef-4cc6-9058-8506156d9c62 tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 200 len: 1306 microversion: 2.1 time: 0.232907 Nov 06 21:03:33.259772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2519/4962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:33 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 1306 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:33.476669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:33.477800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:33.494062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.498564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.499640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:33.503060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:33.619009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.627738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.630148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:33.631873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eda17b9f-81cd-4758-85df-32b05a36f096 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.160573 Nov 06 21:03:33.633271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2444/4963] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:33 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:34.041409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:34.042387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:34.056401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.059108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.060122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.063228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.145610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:34.146937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:34.156821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.157379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.180870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.181661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.313147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:34.324888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b5bca0c-c233-414e-b932-50cceb273300 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1293 microversion: 2.1 time: 0.286349 Nov 06 21:03:34.325485 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2520/4964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:34 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:34.333593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:34.334663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:34.343578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.348191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.351369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.352094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.425073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:34.434432 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-43a801b6-4072-4e71-b550-3f26884e6f6c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.102350 Nov 06 21:03:34.436559 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2521/4965] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:34 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:34.441123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5321214f-e74e-4d21-aa13-72af81bf1d11 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.295557 Nov 06 21:03:34.451866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2445/4966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:34 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:34.452077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:34.453713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] [instance: 0b88c45c-0fa3-46c6-99c1-e4298593d59a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:34.473183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.475107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.496935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.497732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.529717 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] HTTP exception thrown: Instance 0b88c45c-0fa3-46c6-99c1-e4298593d59a could not be found. Nov 06 21:03:34.530720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] Returning 404 to user: Instance 0b88c45c-0fa3-46c6-99c1-e4298593d59a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:34.531719 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b564ac8-0e36-43c0-9f14-b606485c1c7b tempest-InstanceActionsTestJSON-1606055736 tempest-InstanceActionsTestJSON-1606055736-project] 10.222.0.13 "GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a" status: 404 len: 111 microversion: 2.1 time: 0.093094 Nov 06 21:03:34.532728 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2522/4967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:34 2021] GET /compute/v2.1/servers/0b88c45c-0fa3-46c6-99c1-e4298593d59a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:34.651370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:34.651989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:34.665387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.666440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.670139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:34.670663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:34.756816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:34.767988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:34.769822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:34.771020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5170a17-15d4-4dca-a851-869291868c9f tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.123687 Nov 06 21:03:34.783279 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2446/4968] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:34 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:35.345817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:35.346689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:35.355077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.355862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.357076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.357762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.447879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:35.449450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:35.465799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.466201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.467029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.467478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.595337 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63e0ad2c-3c81-40e9-b83e-c9a337b5588f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.150351 Nov 06 21:03:35.596006 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2447/4969] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:35 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:35.601172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:35.605640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:35.622856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.623595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.624434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.627392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.751160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:35.767306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a794fe3-095f-45c1-8238-82fde546d8f3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1473 microversion: 2.1 time: 0.428229 Nov 06 21:03:35.768446 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2523/4970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:35 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:35.791770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:35.794057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:35.805188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.809395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.812942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:35.813398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:35.958695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:35.976542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:35.980399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:35.985640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31b97e47-4485-48bb-a106-2e0a689a4428 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.198241 Nov 06 21:03:35.989769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2524/4971] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:35 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:36.001689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f6d8d228-cc0f-4242-ba2e-f8c9f9cf8bcb req-d33d8f49-edac-4628-9d8d-67141e59bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-plugged", "status": "completed", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:36.009660 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:36.009660 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:36.026870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f6d8d228-cc0f-4242-ba2e-f8c9f9cf8bcb req-d33d8f49-edac-4628-9d8d-67141e59bc70 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:36.027317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f6d8d228-cc0f-4242-ba2e-f8c9f9cf8bcb req-d33d8f49-edac-4628-9d8d-67141e59bc70 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:36.059135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f6d8d228-cc0f-4242-ba2e-f8c9f9cf8bcb req-d33d8f49-edac-4628-9d8d-67141e59bc70 service nova] Creating event network-vif-plugged:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:03:36.065422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f6d8d228-cc0f-4242-ba2e-f8c9f9cf8bcb req-d33d8f49-edac-4628-9d8d-67141e59bc70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073820 Nov 06 21:03:36.067339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2525/4972] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:36.078000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1660517696", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:36.146003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:03:36.151874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:36.177508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a97c1fd-26b1-4524-803c-e51587df6f22 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.579968 Nov 06 21:03:36.178443 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2448/4973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:35 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:36.609352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:36.610808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:36.621138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:36.622001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:36.623129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:36.623799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:36.846061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7447c10b-a14e-4903-b69f-53d8d51a76e5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.242090 Nov 06 21:03:36.846845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2449/4974] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:36 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:37.008329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:37.011474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:37.021745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.022525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.023807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.024530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.250300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:37.260309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:37.262170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:37.263797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2080fdd2-fd2d-4382-a3c1-e3902feba2c9 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.261072 Nov 06 21:03:37.265005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2450/4975] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:37 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:37.271155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:37.273454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:37.280839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.282280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.283240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.283850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.507458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:37.507940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:37.508545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:37.509031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:37.509522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:37.519120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.520028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.521114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.521559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.539570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:37.545682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:37.560566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:37.563437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:37.619067 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b43ebb7-3f3f-4268-8f4b-10dfe9c5f3b1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549746 Nov 06 21:03:37.620572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2526/4976] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:03:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:03:37.634809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d424c0be-8919-4069-855d-0aa3211b5e38 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:37.635988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d424c0be-8919-4069-855d-0aa3211b5e38 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:37.642881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:37.650966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71a8579f-db72-4c33-bcb9-295a4ce0f732 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1478 microversion: 2.1 time: 0.384442 Nov 06 21:03:37.663541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2451/4977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:37 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1478 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:37.669127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d424c0be-8919-4069-855d-0aa3211b5e38 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:37.857380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:37.858522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:37.882242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.883964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.886598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:37.888239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:37.969865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bffa13a8-ddbb-46e9-9c5a-7ed512493811 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.115946 Nov 06 21:03:37.972100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2452/4978] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:37 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:38.283798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:38.284561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:38.295967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:38.296415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:38.297195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:38.297649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:38.315411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-d424c0be-8919-4069-855d-0aa3211b5e38 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Instance Mapping does not exist while attempting local delete cleanup. Nov 06 21:03:38.318185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d424c0be-8919-4069-855d-0aa3211b5e38 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad" status: 204 len: 0 microversion: 2.1 time: 0.688217 Nov 06 21:03:38.326257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2527/4979] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:37 2021] DELETE /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:38.342172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef8baefd-9d16-4171-b70c-1595bd21b3a6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:38.345458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef8baefd-9d16-4171-b70c-1595bd21b3a6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:38.355726 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ef8baefd-9d16-4171-b70c-1595bd21b3a6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. Nov 06 21:03:38.362708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef8baefd-9d16-4171-b70c-1595bd21b3a6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:38.366651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef8baefd-9d16-4171-b70c-1595bd21b3a6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad" status: 404 len: 111 microversion: 2.1 time: 0.036787 Nov 06 21:03:38.370898 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2528/4980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:38 2021] GET /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:38.433958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:38.448795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:38.451031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:38.454115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37557253-5fe4-4f79-88e9-a4e679a4fd4a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.173103 Nov 06 21:03:38.455656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2453/4981] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:38 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:38.497605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-426157736", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:38.555785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:03:38.670256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:38.671498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:38.678778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:38.679664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:38.680674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:38.681281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.108673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:39.119061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-468ac13c-f7b3-481d-9046-cc8ecabd675d tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1463 microversion: 2.1 time: 0.453637 Nov 06 21:03:39.129530 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2454/4982] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:38 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1463 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:39.147595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:39.148795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:39.174256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.174713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.175548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.175989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.251069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2b80cdf-05ac-442a-8a48-cce263100dc2 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.120233 Nov 06 21:03:39.253020 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2455/4983] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:39 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:39.258638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:39.263127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:39.286382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.287110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.288708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.291375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.457958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb0aad5d-022c-4012-b0d4-5546f680a0d2 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 0 microversion: 2.1 time: 0.202559 Nov 06 21:03:39.461722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2456/4984] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:03:39 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:39.467007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:39.467639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:39.482141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.482589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.486750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.488610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.554627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:39.558076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:39.561194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:39.561890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:39.563364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.563814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.564364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:39.569909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lazy-loading 'fault' on Instance uuid 73886535-1924-43e9-86fe-e2cdef2d59af {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:03:39.598485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.599538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.601542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.603350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.648007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:39.657270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:39.677020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:39.680864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:39.725152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d57956de-158c-4b2b-93e6-61170d8765a8 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1597 microversion: 2.1 time: 0.261502 Nov 06 21:03:39.725863 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2457/4985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:39 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1597 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:39.731485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:39.732570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:39.739717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.740613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.741774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.742458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.755479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c1f2e19-f984-42e0-a6c9-06e088529a3d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262262 Nov 06 21:03:39.761714 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2529/4986] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:03:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:03:39.831170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:39.841718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:39.845228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:39.846753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa5af309-efcb-47be-bc0f-bf93c11b006a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.119581 Nov 06 21:03:39.848026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2458/4987] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:39 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:39.852735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:39.854401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:39.862196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.862885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.864877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:39.865549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:39.994900 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a147f009-d885-429c-9c1b-ecb9c5cf7348 tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action" status: 202 len: 0 microversion: 2.1 time: 0.143846 Nov 06 21:03:39.996242 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2459/4988] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:03:39 2021] POST /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:40.002348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a68e8a20-5470-4c10-a25e-e246d73b7aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:40.004517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a68e8a20-5470-4c10-a25e-e246d73b7aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.017267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-270876696", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "7b9a89ab-47f1-4a79-95e4-0484eda86131"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:40.085001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a68e8a20-5470-4c10-a25e-e246d73b7aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:40.100927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] validate_networks() for [('7b9a89ab-47f1-4a79-95e4-0484eda86131', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:03:40.101777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a68e8a20-5470-4c10-a25e-e246d73b7aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1220 microversion: 2.1 time: 0.103560 Nov 06 21:03:40.111578 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2460/4989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:39 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:40.111578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:40.111578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.130857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.131311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.134783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.136975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.459655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c28572a3-9e32-4657-b1f7-542fe285a8db tempest-ServersAdminTestJSON-1069184103 tempest-ServersAdminTestJSON-1069184103-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1614 microversion: 2.1 time: 0.355455 Nov 06 21:03:40.463476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2461/4990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:40 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1614 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:40.479683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:40.481834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.505011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.505673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.506643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.507186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.574098 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd7a0ec3-22b9-49a0-a0de-e75b26bd8538 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.108644 Nov 06 21:03:40.576908 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2462/4991] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:40 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:40.589015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:40.590560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.629060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.631029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.631889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.632349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.713820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:40.770492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:03:40.771489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:03:40.772371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:03:40.772978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:03:40.773556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:03:40.784612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.787297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.788414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.789198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.812704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Getting quotas for project b9054e505e3e4d6a9f2f5919ad5523c2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:03:40.819357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Getting quotas for user 6d8ce52f3b6a4c7f972e23a53ba054ba and project b9054e505e3e4d6a9f2f5919ad5523c2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:03:40.840489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae2e51eb-d495-4814-bb9e-803dd784f7d6 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 204 len: 0 microversion: 2.1 time: 0.260386 Nov 06 21:03:40.845123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2463/4992] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:40 2021] DELETE /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:40.845444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:03:40.857432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:03:40.859097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:40.859812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.885781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.886987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.889365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.889833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.963130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23144714-7baa-499e-a829-f629f9ed56b8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200154 Nov 06 21:03:40.964637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2530/4993] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:03:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:03:40.973404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:40.974210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:40.981883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.983382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:40.984708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:40.985402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:41.112331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.125147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.126986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.131743 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca8527a9-4c4d-40c9-a664-ac8d94e2a385 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.165842 Nov 06 21:03:41.139435 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2531/4994] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:40 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:41.147870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6026d013-d2a4-44c0-9bbe-43cccdd2c0d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:41.148515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6026d013-d2a4-44c0-9bbe-43cccdd2c0d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:41.280645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6026d013-d2a4-44c0-9bbe-43cccdd2c0d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.306968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6026d013-d2a4-44c0-9bbe-43cccdd2c0d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1224 microversion: 2.1 time: 0.162257 Nov 06 21:03:41.307772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2532/4995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:41 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:41.317576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:41.318380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:41.331426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.350098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:41.351569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:41.351708 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea71ceb7-6e75-4764-aaa9-bb68b9bec9ae tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1469 microversion: 2.1 time: 0.504907 Nov 06 21:03:41.354539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:41.357014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:41.363438 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2464/4996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:40 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1469 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:41.589394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:41.592197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:41.614499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:41.615277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:41.616767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:41.620272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:41.643364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:41.655129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9020ce5e-e7bc-4077-b2d3-a99a66d67fee tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1272 microversion: 2.1 time: 0.344398 Nov 06 21:03:41.655985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2533/4997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:41 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:41.744680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea258402-2cdb-4d7f-9ad5-d2889aa58526 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.160776 Nov 06 21:03:41.749065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2465/4998] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:41 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:03:42.157342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:42.158539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:42.169761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.170212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.171002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.171434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.327178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:42.327922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:42.361182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.363890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.367508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.368153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.379410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:42.397945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:42.400317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:42.402030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f0a2cb9-eeda-4c6f-ace7-570086608c5d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.248389 Nov 06 21:03:42.403301 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2534/4999] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:42 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:42.408790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:42.410545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:42.418539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.419606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.420922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.421669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.509521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:42.517861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-550e7ac6-f05c-46ae-bd85-2ce9791009d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1276 microversion: 2.1 time: 0.196541 Nov 06 21:03:42.518447 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2466/5000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:42 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:42.672696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:42.681591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:42.695816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.696560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.697619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.698226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.901682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:42.926716 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72d36f70-2d0f-4710-bea8-7e118e308881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1278 microversion: 2.1 time: 0.257430 Nov 06 21:03:42.927566 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2467/5001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:42 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:42.947681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:42.951686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:42.968020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.970082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:42.971435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:42.972210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.011381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:43.019661 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5437baa0-be08-4990-9308-37855313bf1f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1469 microversion: 2.1 time: 0.614937 Nov 06 21:03:43.020251 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2535/5002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:42 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:43.024368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-674bd23c-1b03-483c-a75e-79717734ca11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 32638 microversion: 2.20 time: 0.095361 Nov 06 21:03:43.025026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2468/5003] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:42 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 32638 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:43.421433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:43.422105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:43.429701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.436684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.437716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.438162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.536464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:43.537844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:43.545023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.545711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.546679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.547825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.677558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:43.685934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:43.692140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:43.693396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a117c1ca-7a4b-418b-b381-f937cb8e1d51 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.275724 Nov 06 21:03:43.693964 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2536/5004] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:43 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:43.720683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:43.739593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3acead50-8200-4608-a2b6-6b8505f09e7e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1282 microversion: 2.1 time: 0.207180 Nov 06 21:03:43.753030 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2469/5005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:43 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:43.944550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:43.945561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:43.952460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.953473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:43.954773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:43.955595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.039299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:44.040702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:44.052017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.052891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.055068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.055701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.178030 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0502e6b3-3b4c-470c-a3d2-f209f74de0e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 200 len: 40792 microversion: 2.20 time: 0.144163 Nov 06 21:03:44.179138 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2470/5006] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:44 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 40792 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:03:44.186032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:44.186558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:44.219360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.220576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.226191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.227722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.644089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:44.656106 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1cda1b1d-040f-48b2-8a5c-a348896836f3 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 200 len: 1299 microversion: 2.1 time: 0.475538 Nov 06 21:03:44.657650 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2471/5007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:44 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 1299 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:44.662606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-56f0759b-c838-4520-9285-7177032d7113 req-955137b6-c934-47f9-a785-a9c4bab87bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0998fd-8d0a-4d20-b417-2e27da5f0697", "name": "network-vif-deleted", "tag": "c06644e8-5f4d-439d-a579-ee85cd4ebfbc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:44.669832 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:44.669832 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:44.685274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-56f0759b-c838-4520-9285-7177032d7113 req-955137b6-c934-47f9-a785-a9c4bab87bf3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.686077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-56f0759b-c838-4520-9285-7177032d7113 req-955137b6-c934-47f9-a785-a9c4bab87bf3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.700934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-56f0759b-c838-4520-9285-7177032d7113 req-955137b6-c934-47f9-a785-a9c4bab87bf3 service nova] Creating event network-vif-deleted:c06644e8-5f4d-439d-a579-ee85cd4ebfbc for instance ee0998fd-8d0a-4d20-b417-2e27da5f0697 on nch2-master-1 Nov 06 21:03:44.708241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-56f0759b-c838-4520-9285-7177032d7113 req-955137b6-c934-47f9-a785-a9c4bab87bf3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049070 Nov 06 21:03:44.710023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2472/5008] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:44.727042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:44.729853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:44.743618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.745548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.746665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.747332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.823217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3dd25e71-cdc8-4034-ba1f-6401d5e17fe9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/ips" status: 200 len: 150 microversion: 2.20 time: 0.111528 Nov 06 21:03:44.829601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2473/5009] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Nov 6 21:03:44 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/ips => generated 150 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:03:44.858915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:44.860197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:44.884105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:44.884650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.885015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.885865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.886309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.893709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-441c26af-6d5b-4c41-9f35-686bf902d68a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.952878 Nov 06 21:03:44.894963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2537/5010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:43 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:44.901294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:44.902133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:44.912450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.913046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:44.913964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:44.914672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.153702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:45.171010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:45.177760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:45.181983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-225eccba-b484-44b3-8f3b-49487f315c33 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.348593 Nov 06 21:03:45.189319 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2474/5011] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:44 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:45.624553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:45.645052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6478f6c-b366-41a1-94fb-9ad5cf9142d1 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.747750 Nov 06 21:03:45.653463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2538/5012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:44 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:45.675090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:45.676420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: ee0998fd-8d0a-4d20-b417-2e27da5f0697] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:45.689426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.689883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.690707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.691676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.730182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] HTTP exception thrown: Instance ee0998fd-8d0a-4d20-b417-2e27da5f0697 could not be found. Nov 06 21:03:45.730954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Returning 404 to user: Instance ee0998fd-8d0a-4d20-b417-2e27da5f0697 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:45.731832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9189686e-c521-49e2-8919-08a94e7416dd tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697" status: 404 len: 111 microversion: 2.1 time: 0.061907 Nov 06 21:03:45.735862 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2475/5013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:45 2021] GET /compute/v2.1/servers/ee0998fd-8d0a-4d20-b417-2e27da5f0697 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:45.745958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:45.746446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:45.757880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.758354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.759154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.759597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.798324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:45.910941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:45.911643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:45.928069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.928963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.929539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.930082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.953644 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4612aa23-e9f5-4c12-afa0-07dcf954ee05 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 204 len: 0 microversion: 2.1 time: 0.211245 Nov 06 21:03:45.956641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2539/5014] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:45 2021] DELETE /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:45.976902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:45.979456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:45.991412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:45.991412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:45.992988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.006324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.379356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:46.412544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47e67ced-c52f-45e1-8c89-1dd954b88d65 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.505243 Nov 06 21:03:46.413141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2476/5015] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:45 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:46.421128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-43276b90-e28c-46df-8959-31c635f2e5f5 req-b04c5b2c-5d08-48a4-901c-0763e7d6ce32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad43190b-c3fb-42dc-914d-50260df910d5", "tag": "08564426-2778-4687-822f-d632265f23a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:46.428708 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:46.428708 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:46.436979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-43276b90-e28c-46df-8959-31c635f2e5f5 req-b04c5b2c-5d08-48a4-901c-0763e7d6ce32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.437428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-43276b90-e28c-46df-8959-31c635f2e5f5 req-b04c5b2c-5d08-48a4-901c-0763e7d6ce32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.448593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-43276b90-e28c-46df-8959-31c635f2e5f5 req-b04c5b2c-5d08-48a4-901c-0763e7d6ce32 service nova] Creating event network-changed:08564426-2778-4687-822f-d632265f23a2 for instance ad43190b-c3fb-42dc-914d-50260df910d5 on nch2-master-1 Nov 06 21:03:46.453937 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-43276b90-e28c-46df-8959-31c635f2e5f5 req-b04c5b2c-5d08-48a4-901c-0763e7d6ce32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036870 Nov 06 21:03:46.454990 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2477/5016] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:46.463520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:46.464448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:46.471916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.473228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.474184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.474787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.552098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:46.570966 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a45d0de2-bccc-43c3-9638-937c86bd32d2 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1470 microversion: 2.1 time: 0.606837 Nov 06 21:03:46.572042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2540/5017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:45 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1470 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:46.575336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:46.588095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:46.590006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:46.591609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3875c1b-127c-4232-a772-ffa2df68689a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.135367 Nov 06 21:03:46.592563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2478/5018] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:46 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:46.665903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:46.666669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:46.673901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.674427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.675542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.676073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.951139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6fc632ad-b949-439c-ac7e-9f8938568cbe req-b4994607-98d2-4d0f-b83e-d4b4a07d10c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21342b3-82e5-4ccd-ae33-973e56e45341", "tag": "4770d39c-789f-48aa-8d30-4836c69caeff"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:46.952926 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:46.952926 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:03:46.961753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6fc632ad-b949-439c-ac7e-9f8938568cbe req-b4994607-98d2-4d0f-b83e-d4b4a07d10c1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:46.962397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6fc632ad-b949-439c-ac7e-9f8938568cbe req-b4994607-98d2-4d0f-b83e-d4b4a07d10c1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:46.979738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6fc632ad-b949-439c-ac7e-9f8938568cbe req-b4994607-98d2-4d0f-b83e-d4b4a07d10c1 service nova] Creating event network-changed:4770d39c-789f-48aa-8d30-4836c69caeff for instance f21342b3-82e5-4ccd-ae33-973e56e45341 on nch2-master-1 Nov 06 21:03:46.985800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6fc632ad-b949-439c-ac7e-9f8938568cbe req-b4994607-98d2-4d0f-b83e-d4b4a07d10c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038359 Nov 06 21:03:46.987620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2479/5019] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:47.044255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:47.057537 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88c2427e-c112-4edb-9f28-1d05af7ed843 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.395656 Nov 06 21:03:47.058558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2541/5020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:46 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:47.433043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:47.433983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:47.443725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.445306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.447159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.448122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.459363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:47.459883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:47.476602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.476602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.477194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.477944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.501585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lazy-loading 'flavor' on Instance uuid fa56ba73-ff91-44bb-9129-a967bbaad7d0 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:03:47.824193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:47.828387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c294ad15-dd80-47dd-99ac-d95f4f5c812e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 202 len: 0 microversion: 2.20 time: 0.373898 Nov 06 21:03:47.832327 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2542/5021] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:03:47 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:47.839004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:47.839915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:47.846905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c63372a0-8a94-4e71-82e3-10ef8f8c0fed tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.417615 Nov 06 21:03:47.850696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.853633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.854496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.854949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.859064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2480/5022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:47 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:47.880170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:47.881490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:47.891317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.892058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:47.893327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:47.894193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.010613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.019076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.020809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.022460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c2d131a-6c1d-4c6c-86aa-ae334c803f82 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.161656 Nov 06 21:03:48.023191 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2481/5023] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:47 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:48.029146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:48.030131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:48.038882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.039492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.040597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.041278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.158072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.168468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f202eed-7fd2-4b85-90dc-2c465fd4a64e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1470 microversion: 2.1 time: 0.334526 Nov 06 21:03:48.169612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2543/5024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:47 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:48.178226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:48.180381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:48.186654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.187102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.188020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.188466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.241039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.249762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.251255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.252839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3e67219-245c-4e56-bbbc-09520946868e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.228469 Nov 06 21:03:48.253633 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2482/5025] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:48 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:48.338913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:48.350113 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f51c1c92-08bc-474b-aed2-56248dfd8c8b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.179759 Nov 06 21:03:48.351012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2544/5026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:48 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:48.882341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:48.882983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:48.893537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.894271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:48.895277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:48.896019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.028521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-cfc52e20-a86f-4977-a4d5-4f9db6b3a7d9 req-b3a1ab7f-5afe-4f88-a208-6bd58ba8cc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a3cebc-56c7-4387-9343-0de4c41f90b9", "name": "network-vif-deleted", "tag": "688f6858-27d7-40ab-b4b1-48a4bfd5cdbd"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:49.033851 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:49.033851 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:49.057573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cfc52e20-a86f-4977-a4d5-4f9db6b3a7d9 req-b3a1ab7f-5afe-4f88-a208-6bd58ba8cc8a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.058209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cfc52e20-a86f-4977-a4d5-4f9db6b3a7d9 req-b3a1ab7f-5afe-4f88-a208-6bd58ba8cc8a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.071732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-cfc52e20-a86f-4977-a4d5-4f9db6b3a7d9 req-b3a1ab7f-5afe-4f88-a208-6bd58ba8cc8a service nova] Creating event network-vif-deleted:688f6858-27d7-40ab-b4b1-48a4bfd5cdbd for instance 20a3cebc-56c7-4387-9343-0de4c41f90b9 on nch2-master-1 Nov 06 21:03:49.078123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-cfc52e20-a86f-4977-a4d5-4f9db6b3a7d9 req-b3a1ab7f-5afe-4f88-a208-6bd58ba8cc8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052903 Nov 06 21:03:49.079426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2545/5027] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:03:49.086720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:49.087798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:49.095400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.096171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.097932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.098612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.187592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.200129 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29206108-1b39-4dba-b732-7d5adcb43405 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.331234 Nov 06 21:03:49.201627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2483/5028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:48 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:03:49.214261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:49.215321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:49.225273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.225519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.226376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.227256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.227905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.238776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.241774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.243218 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a23936f-6e73-4d61-b59c-476f32d01bc5 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.162344 Nov 06 21:03:49.244737 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2546/5029] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:49 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:49.283211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:49.284154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:49.299740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.301046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.301752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lazy-loading 'fault' on Instance uuid 20a3cebc-56c7-4387-9343-0de4c41f90b9 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:03:49.309158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.309616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.310424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.310867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.518642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.530500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25e62d38-fd5f-4618-8571-7610ff7e4549 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 200 len: 1304 microversion: 2.1 time: 0.324227 Nov 06 21:03:49.534362 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2484/5030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:49 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 1304 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:49.549828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:49.551062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:49.560756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.561207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.564344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:49.565057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:49.834808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.842885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.844525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.845710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bccfa88-1bb0-4a80-8f42-ec4f56a59f7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.577516 Nov 06 21:03:49.850817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2547/5031] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:49 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:49.978068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:49.985574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d9bf49d-c8e2-4b68-92a9-305f073a16ce tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.449612 Nov 06 21:03:49.986233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2485/5032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:49 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:50.218090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.218797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.226421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.227068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.227973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.228522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.268153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.269831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.276080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.279690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.281032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.281701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.378102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:50.392471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:50.394717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:50.395925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6cbc0397-1980-4699-b650-85ae30e053ef tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.131798 Nov 06 21:03:50.396871 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2486/5033] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:50 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:50.442780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:50.451124 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c10ef102-a7a8-42f8-84cb-6f0586d96bd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.236918 Nov 06 21:03:50.451719 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2548/5034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:50 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:50.552077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.553725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 20a3cebc-56c7-4387-9343-0de4c41f90b9] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.563612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.565928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.566998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.567289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.584417 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] HTTP exception thrown: Instance 20a3cebc-56c7-4387-9343-0de4c41f90b9 could not be found. Nov 06 21:03:50.585455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Returning 404 to user: Instance 20a3cebc-56c7-4387-9343-0de4c41f90b9 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:50.586575 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42761025-32b7-47f1-9d73-409b37d52df7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9" status: 404 len: 111 microversion: 2.1 time: 0.038610 Nov 06 21:03:50.587702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2487/5035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:50 2021] GET /compute/v2.1/servers/20a3cebc-56c7-4387-9343-0de4c41f90b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:50.597002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.598945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.609766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.612487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.612487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.612487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.642702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:50.757870 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d7e8a07-caf8-4047-bcf9-329fbdcb43a8 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 204 len: 0 microversion: 2.1 time: 0.165400 Nov 06 21:03:50.759414 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2549/5036] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:50 2021] DELETE /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:50.767862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.769566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.775763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.776220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.777044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.777487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.865642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:50.866917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:50.878971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.879674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:50.880699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:50.881446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.145659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.153950 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-479d65f6-a769-41ca-914f-a7d3bd5272e7 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1469 microversion: 2.1 time: 0.390422 Nov 06 21:03:51.163751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2488/5037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:50 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:51.169464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:51.170089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:51.170641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.179607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.181142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.182339 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7ef4ff3-9e4b-477f-9e9f-5e21dfab4c4b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.321007 Nov 06 21:03:51.182905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2550/5038] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:50 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:51.183803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.184273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.185122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.185570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.414352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:51.414957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:51.432167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.433056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.434308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.435037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.484729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.492538 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b4cac4b-cd42-400d-9d14-73aff329fee0 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.327548 Nov 06 21:03:51.498120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2489/5039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:51 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:51.498682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:51.499499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:51.506596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.507270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.508248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:51.508909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:51.558972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.570307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.571832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.573097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bd44df5-6af3-46aa-bd5f-12515f09579e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.162530 Nov 06 21:03:51.573665 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2551/5040] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:51 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:51.808035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:51.822622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-709b01d8-f5c9-44fb-99c3-512ad7c0f596 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.326577 Nov 06 21:03:51.823974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2490/5041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:51 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:52.171675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:52.174831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:52.183960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.185846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.187929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.188814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.208749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:52.208749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:52.215387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.224377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.225662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.226319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.622199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.646564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.652285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.655263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.659410 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05904a2f-1ba6-4ae6-a0c3-849ce6a2990f tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1469 microversion: 2.1 time: 0.492016 Nov 06 21:03:52.659988 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2552/5042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:52 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1469 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:52.660401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b954dad-0c84-41c6-960f-09119656651d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.454350 Nov 06 21:03:52.674435 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2491/5043] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:52 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:52.676965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:52.677662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:52.680925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:52.681547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:52.683807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.684258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.685094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.685529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.694748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.695383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.696197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.696667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.794383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.805455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.808508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.810632 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f4daf3d-5e9e-4653-a9fd-ee1cba8e8cb8 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1407 microversion: 2.54 time: 0.134628 Nov 06 21:03:52.811885 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2492/5044] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:52 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:52.841832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:52.842829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:52.850641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.851453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.852525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:52.853796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:52.883879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:52.893083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d199a96b-8649-46c5-9433-e6e7b2442aa3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.221112 Nov 06 21:03:52.893975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2553/5045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:52 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:53.009841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:53.019598 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d50afd76-9bcf-421a-830f-14e5d05dd0e5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.182878 Nov 06 21:03:53.020564 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2493/5046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:52 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:53.678262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:53.678844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:53.679397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:53.680102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:53.686995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.688188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:53.689557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.690178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:53.691490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.692241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:53.693239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.694020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:53.881163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdaa84f1e2f940c684852fff39ac23a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4827eea3800c4ee9a5c097c565650229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:53.902172 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-978d7140-e591-4260-942e-4ae1ef669a03 tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 200 len: 1427 microversion: 2.1 time: 0.227364 Nov 06 21:03:53.924472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2554/5047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:53 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 1427 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:53.938631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:53.942063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:53.949538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.950255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:53.953185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:53.954043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.096672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.115794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.124543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.126151 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bc183f0-822f-4ef7-97fa-b9171201f7c1 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1413 microversion: 2.54 time: 0.200512 Nov 06 21:03:54.141411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2555/5048] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:53 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1413 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:54.147609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-cdc2bef0-2442-47f1-93dc-7a4e8c7d1b6a req-baf6b0b3-854b-4093-9e1e-dc912d3533f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73886535-1924-43e9-86fe-e2cdef2d59af", "name": "network-vif-deleted", "tag": "b9f0b33e-c0e3-430d-b234-0a6318475b33"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:54.149610 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:54.149610 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:54.159278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cdc2bef0-2442-47f1-93dc-7a4e8c7d1b6a req-baf6b0b3-854b-4093-9e1e-dc912d3533f8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.160129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-cdc2bef0-2442-47f1-93dc-7a4e8c7d1b6a req-baf6b0b3-854b-4093-9e1e-dc912d3533f8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.168589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.189106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.191405 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-cdc2bef0-2442-47f1-93dc-7a4e8c7d1b6a req-baf6b0b3-854b-4093-9e1e-dc912d3533f8 service nova] Creating event network-vif-deleted:b9f0b33e-c0e3-430d-b234-0a6318475b33 for instance 73886535-1924-43e9-86fe-e2cdef2d59af on nch2-master-1 Nov 06 21:03:54.192039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.193559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8d8209a-3211-4337-92d6-f3d6e596d535 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.518691 Nov 06 21:03:54.194762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2494/5049] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:53 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:54.199238 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-cdc2bef0-2442-47f1-93dc-7a4e8c7d1b6a req-baf6b0b3-854b-4093-9e1e-dc912d3533f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055844 Nov 06 21:03:54.200116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2556/5050] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:54.204246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:54.205914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:54.207381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:54.208613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:54.213452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.214024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.214917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.215475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.216199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.217115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.218242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.218975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.592876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.602173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:54.605516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a4fee39-3372-43f7-8c62-4f2a44bd5285 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.409385 Nov 06 21:03:54.607329 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2495/5051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:54 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:54.619112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f491ade-8efb-4402-9f36-ba3be3b785fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.417223 Nov 06 21:03:54.619987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2557/5052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:54 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:54.923330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:54.924253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] [instance: 73886535-1924-43e9-86fe-e2cdef2d59af] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:54.937459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.938516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.939838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:54.940826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:54.965344 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] HTTP exception thrown: Instance 73886535-1924-43e9-86fe-e2cdef2d59af could not be found. Nov 06 21:03:54.967864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] Returning 404 to user: Instance 73886535-1924-43e9-86fe-e2cdef2d59af could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:54.969201 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbb48df4-b233-4bfa-b1f4-c010f708222e tempest-ServersAdminTestJSON-1586429958 tempest-ServersAdminTestJSON-1586429958-project] 10.222.0.13 "GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af" status: 404 len: 111 microversion: 2.1 time: 0.051213 Nov 06 21:03:54.970407 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2496/5053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:54 2021] GET /compute/v2.1/servers/73886535-1924-43e9-86fe-e2cdef2d59af => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:03:55.147883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:55.148737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:55.169403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.169823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.172048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.172537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.214476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:55.218318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:55.242633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.243193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.244043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.246692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.505015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.520411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.522792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.524131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-105bc4c6-c381-489c-b6f0-3213b8d9684d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1413 microversion: 2.54 time: 0.381616 Nov 06 21:03:55.528409 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2558/5054] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:55 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1413 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:55.623979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:55.624680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:55.636970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.637438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.638311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.638756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.676106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.689848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.692018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:55.693238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1393d955-e2fe-4f31-966d-2997b4de5eb6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.482398 Nov 06 21:03:55.697738 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2497/5055] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:55 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:55.708469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:55.711961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:55.718434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.719179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:55.720205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:55.720830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.025304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.037866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33a0132d-344b-4635-ac0e-adcffbd704d8 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.417700 Nov 06 21:03:56.038683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2559/5056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:55 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:56.042678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.051693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b622cdb-efd4-4b20-8d51-514ac28d1754 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.352646 Nov 06 21:03:56.052678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2498/5057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:55 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:56.122935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-137dc3f9-8936-4090-ae80-a29c544c2349 req-10e9753c-4363-4468-b024-ae4a17823ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21342b3-82e5-4ccd-ae33-973e56e45341", "name": "network-vif-plugged", "status": "completed", "tag": "4770d39c-789f-48aa-8d30-4836c69caeff"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:56.124785 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:56.124785 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:56.132128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-137dc3f9-8936-4090-ae80-a29c544c2349 req-10e9753c-4363-4468-b024-ae4a17823ebb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:56.132952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-137dc3f9-8936-4090-ae80-a29c544c2349 req-10e9753c-4363-4468-b024-ae4a17823ebb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.147603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-137dc3f9-8936-4090-ae80-a29c544c2349 req-10e9753c-4363-4468-b024-ae4a17823ebb service nova] Creating event network-vif-plugged:4770d39c-789f-48aa-8d30-4836c69caeff for instance f21342b3-82e5-4ccd-ae33-973e56e45341 on nch2-master-1 Nov 06 21:03:56.153670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-137dc3f9-8936-4090-ae80-a29c544c2349 req-10e9753c-4363-4468-b024-ae4a17823ebb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037786 Nov 06 21:03:56.155582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2560/5058] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:03:56.560844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:56.561722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:56.579276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:56.580055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.583671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:56.584129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.712568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:56.713629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:56.726202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.740401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:56.741221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.745541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.746700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:56.750227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:56.750864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.755791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5de86e41-ebc0-4071-94d1-0d4d2ea8375d tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1413 microversion: 2.54 time: 0.213441 Nov 06 21:03:56.762612 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2499/5059] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:56 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1413 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:56.986215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:56.997691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.001454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.002803 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84ec1ef5-08f7-42c7-b1c7-8dffe4dbd601 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.294343 Nov 06 21:03:57.003906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2561/5060] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:56 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:57.055615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:57.056400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:57.072806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.073315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.073917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:57.075110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:57.075237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.075677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.091689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.092527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.093665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.095486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.409827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.417506 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f7dd42c-076a-4826-b148-ac31daa6bfb9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.351718 Nov 06 21:03:57.430601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2562/5061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:57 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:57.451969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.460116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3bc42c63-0e88-488c-8cd9-7ecf5bfbd89f tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1324 microversion: 2.1 time: 0.408916 Nov 06 21:03:57.461304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2500/5062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:57 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:57.784018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:57.784700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:57.799963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.800465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.801480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:57.802096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:57.920400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.933368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.937034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:57.940471 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b89749c-96e2-430e-8f7c-40554e8651c6 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1413 microversion: 2.54 time: 0.160791 Nov 06 21:03:57.958168 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2563/5063] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:57 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1413 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:58.024953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:58.025635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:58.051309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.051918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.052806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.053457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.283154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-77adae92-cfed-4a5d-9681-e4159fcfa5b3 req-3cae5406-dbba-4848-a11c-f9d98514a150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad43190b-c3fb-42dc-914d-50260df910d5", "name": "network-vif-plugged", "status": "completed", "tag": "08564426-2778-4687-822f-d632265f23a2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:03:58.286022 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:03:58.286022 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:03:58.304016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77adae92-cfed-4a5d-9681-e4159fcfa5b3 req-3cae5406-dbba-4848-a11c-f9d98514a150 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.304856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77adae92-cfed-4a5d-9681-e4159fcfa5b3 req-3cae5406-dbba-4848-a11c-f9d98514a150 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.322885 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-77adae92-cfed-4a5d-9681-e4159fcfa5b3 req-3cae5406-dbba-4848-a11c-f9d98514a150 service nova] Creating event network-vif-plugged:08564426-2778-4687-822f-d632265f23a2 for instance ad43190b-c3fb-42dc-914d-50260df910d5 on nch2-master-1 Nov 06 21:03:58.348204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-77adae92-cfed-4a5d-9681-e4159fcfa5b3 req-3cae5406-dbba-4848-a11c-f9d98514a150 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073213 Nov 06 21:03:58.351041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2564/5064] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:03:58.382298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:58.410454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:58.414391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:58.417303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b76c3c51-863a-4a2f-94c9-bceb565102f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.397868 Nov 06 21:03:58.422662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2501/5065] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:58 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:58.449827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:58.451220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:58.470156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.472156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.496676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:58.497560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:58.501332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.505813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.518302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.519327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.520131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.528713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.915176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:58.922755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:58.927009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e1815b9-4c21-433a-a197-38af70baf48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.483101 Nov 06 21:03:58.927530 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2565/5066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:58 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:58.943129 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1437df11-50df-480a-bab8-6c23be401829 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1521 microversion: 2.1 time: 0.469425 Nov 06 21:03:58.944710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2502/5067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:58 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:58.960567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:58.961526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:58.964989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:58.965968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:58.968463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.968924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.970016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.970465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.978583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.979103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:58.979992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:58.980473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.005014 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] HTTP exception thrown: Action 999 not found Nov 06 21:03:59.005845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Returning 404 to user: Action 999 not found {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:59.006879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90e7cac6-3bde-4ccd-8df7-47a7f317e40c tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.050652 Nov 06 21:03:59.007950 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2566/5068] 10.222.0.13 () {58 vars in 1307 bytes} [Sat Nov 6 21:03:58 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341/os-instance-actions/999 => generated 66 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:03:59.017095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26c142ff-cbbe-4acb-a802-654db3e18df9 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '.version_select at 0x7f6715769a60>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.021118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-26c142ff-cbbe-4acb-a802-654db3e18df9 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: e0c5a439-dfd0-451d-ad4e-eb7cf7c62e4f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.036174 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-26c142ff-cbbe-4acb-a802-654db3e18df9 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] HTTP exception thrown: Instance e0c5a439-dfd0-451d-ad4e-eb7cf7c62e4f could not be found. Nov 06 21:03:59.037159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26c142ff-cbbe-4acb-a802-654db3e18df9 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Returning 404 to user: Instance e0c5a439-dfd0-451d-ad4e-eb7cf7c62e4f could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:03:59.038026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26c142ff-cbbe-4acb-a802-654db3e18df9 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/e0c5a439-dfd0-451d-ad4e-eb7cf7c62e4f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024691 Nov 06 21:03:59.038579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2567/5069] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Nov 6 21:03:59 2021] GET /compute/v2.1/servers/e0c5a439-dfd0-451d-ad4e-eb7cf7c62e4f/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:03:59.053523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.054032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.061548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.062201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.067662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.069575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.106928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.117651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.120548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.128907 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b9e30c0-5ccc-46ba-8fec-d44ae29f7c3a tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1398 microversion: 2.54 time: 0.160603 Nov 06 21:03:59.129569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2503/5070] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:58 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1398 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:03:59.133063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:59.150476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9f24c54-0c3a-41ac-ad53-050ea0e8d1ed tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '.version_select at 0x7f67148ac1f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.178696 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9f24c54-0c3a-41ac-ad53-050ea0e8d1ed tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-862066936" status: 204 len: 0 microversion: 2.54 time: 0.032546 Nov 06 21:03:59.187627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2504/5071] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 21:03:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-862066936 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:03:59.210815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.211548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.223651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.224121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.225143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.227779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.281592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:03:59.288369 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8b9f6e5-6d74-49c0-b0a2-79bc13a6465b tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 204 len: 0 microversion: 2.1 time: 0.244162 Nov 06 21:03:59.289802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2568/5072] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:59 2021] DELETE /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:59.310419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.311557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.319323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.320053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.321247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.321918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.516472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49ae7119-9bb1-43c7-9300-83362ca19550 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 204 len: 0 microversion: 2.1 time: 0.323923 Nov 06 21:03:59.521076 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2505/5073] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:03:59 2021] DELETE /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:03:59.531816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.544415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.555056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.556920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.557758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.558196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.701793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.715112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-881f2f13-f4c2-44dc-a5ef-5ef012656ad4 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1527 microversion: 2.1 time: 0.420439 Nov 06 21:03:59.715924 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2569/5074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:59 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:59.732597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.733460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.742991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.743451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.749175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.749366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.878408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.887807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea3dbf2b-72c1-4a10-90be-cebea5f35c87 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1338 microversion: 2.1 time: 0.158853 Nov 06 21:03:59.889725 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2570/5075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:59 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1338 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:03:59.915592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.924498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.926812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:03:59.928202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4cb0b6cd-38a7-4ef2-9060-dbf603bf8fdd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1741 microversion: 2.20 time: 0.405761 Nov 06 21:03:59.938017 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2506/5076] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:03:59 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1741 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:03:59.944470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:03:59.945208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:03:59.952063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.953304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:03:59.954308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:03:59.956240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:00.129680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:00.148056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68aa1dfd-c526-4204-960c-40fbf42b8cd5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1320 microversion: 2.1 time: 0.208082 Nov 06 21:04:00.158921 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2571/5077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:03:59 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:00.732985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:00.733658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:00.749462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:00.749953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:00.761053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:00.762898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:00.906645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:00.907352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:00.917523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:00.917974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:00.919003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:00.919492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.011910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.019387 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec23de5d-9a2a-4edc-bd13-21a9b2517782 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1338 microversion: 2.1 time: 0.116327 Nov 06 21:04:01.019981 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2572/5078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:00 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:01.037746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.039076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:01.039933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:01.047036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99c40b8b-566b-45dd-9038-fb8f9227e934 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1527 microversion: 2.1 time: 0.318529 Nov 06 21:04:01.048705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.050566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.052145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.053044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.053778 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2507/5079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:00 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1527 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:01.167379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:01.168561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:01.175464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.176604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.177630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.178514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.353084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.361583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.376944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.378309 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b406fc7-070b-4210-81df-dc92c8c66eb0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1741 microversion: 2.20 time: 0.345016 Nov 06 21:04:01.378943 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2573/5080] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:01 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:01.431196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.445211 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2555166e-0b8a-4f8f-952b-676778949156 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1501 microversion: 2.1 time: 0.282467 Nov 06 21:04:01.446496 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2508/5081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:01 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1501 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:01.461998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:01.462613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:01.468747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.469332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.470370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.471091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.655420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:01.666716 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc67f6e5-6298-46cd-9b7b-fb1033d1ec7c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1501 microversion: 2.1 time: 0.208295 Nov 06 21:04:01.667565 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2574/5082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:01 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:01.686556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:01.687050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:01.693072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.693806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.694867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:01.695504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:01.762043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:04:01.979381 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45dc7182-bfbe-4232-8060-3cb2cb1ae2f5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 204 len: 0 microversion: 2.1 time: 0.296147 Nov 06 21:04:01.980501 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2509/5083] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:04:01 2021] DELETE /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:04:01.990170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:01.990931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:02.007523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.009905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.012088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.014572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.036592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:02.037304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:02.056477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.061548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.062520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.063105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.243881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bff1eb1e64d4c00acdb0da32dfb3348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcc5031641f426b9b90bd4b503041ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:02.262857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50572bc7-44a1-41c6-8993-65aae1465d2e tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 200 len: 1338 microversion: 2.1 time: 0.229097 Nov 06 21:04:02.276172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2510/5084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:02 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 1338 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:02.300087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:02.314058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:02.344931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.345396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.354311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.355445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.490062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:02.498491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3cd9758-2c66-4180-bec1-e0c28b967346 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1507 microversion: 2.1 time: 0.513189 Nov 06 21:04:02.499081 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2575/5085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:01 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:02.520976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:02.521585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:02.536008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.536498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.537295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.537746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.916873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8ce52f3b6a4c7f972e23a53ba054ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9054e505e3e4d6a9f2f5919ad5523c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:02.936036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b09719b2-80e9-4553-a3d3-3306ccb4e7c3 tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 200 len: 1527 microversion: 2.1 time: 0.655937 Nov 06 21:04:02.937048 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2511/5086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:02 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 1527 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:02.944187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-94984e93-f1f0-4725-aa34-b7765a0bcfbc req-8a38e4e8-6062-4b57-898f-aaa5da9df339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21342b3-82e5-4ccd-ae33-973e56e45341", "name": "network-vif-deleted", "tag": "4770d39c-789f-48aa-8d30-4836c69caeff"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:02.947761 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:02.947761 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:02.960032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-94984e93-f1f0-4725-aa34-b7765a0bcfbc req-8a38e4e8-6062-4b57-898f-aaa5da9df339 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:02.961375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-94984e93-f1f0-4725-aa34-b7765a0bcfbc req-8a38e4e8-6062-4b57-898f-aaa5da9df339 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:02.979872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-94984e93-f1f0-4725-aa34-b7765a0bcfbc req-8a38e4e8-6062-4b57-898f-aaa5da9df339 service nova] Creating event network-vif-deleted:4770d39c-789f-48aa-8d30-4836c69caeff for instance f21342b3-82e5-4ccd-ae33-973e56e45341 on nch2-master-1 Nov 06 21:04:02.986867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-94984e93-f1f0-4725-aa34-b7765a0bcfbc req-8a38e4e8-6062-4b57-898f-aaa5da9df339 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047982 Nov 06 21:04:02.988345 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2512/5087] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:03.088254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:03.098874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:03.100714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:03.104570 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1fdea516-b851-43bb-837e-4c3a50e501f0 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1741 microversion: 2.20 time: 0.604445 Nov 06 21:04:03.109005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2576/5088] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:02 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1741 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:03.281383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:03.283010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] [instance: 01527fba-cecf-4f89-8596-edf6b108d4ce] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:03.291655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.292735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:03.294300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.295974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:03.330674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] HTTP exception thrown: Instance 01527fba-cecf-4f89-8596-edf6b108d4ce could not be found. Nov 06 21:04:03.337004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] Returning 404 to user: Instance 01527fba-cecf-4f89-8596-edf6b108d4ce could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:03.338930 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fb9f184-36ba-44d2-8010-b7da6e50fa65 tempest-ServerShowV254Test-717651635 tempest-ServerShowV254Test-717651635-project] 10.222.0.13 "GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce" status: 404 len: 111 microversion: 2.1 time: 0.061962 Nov 06 21:04:03.346809 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2513/5089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:03 2021] GET /compute/v2.1/servers/01527fba-cecf-4f89-8596-edf6b108d4ce => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:04:03.516890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:03.517493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:03.529394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.529555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:03.538601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.539090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:03.954829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:03.955536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] [instance: f21342b3-82e5-4ccd-ae33-973e56e45341] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:03.974389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.975162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:03.976179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:03.976835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:04.004264 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] HTTP exception thrown: Instance f21342b3-82e5-4ccd-ae33-973e56e45341 could not be found. Nov 06 21:04:04.009019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] Returning 404 to user: Instance f21342b3-82e5-4ccd-ae33-973e56e45341 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:04.010143 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87193688-8b54-41f9-a374-b8ab191ec94e tempest-InstanceActionsNegativeTestJSON-482257076 tempest-InstanceActionsNegativeTestJSON-482257076-project] 10.222.0.13 "GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341" status: 404 len: 111 microversion: 2.1 time: 0.059951 Nov 06 21:04:04.011013 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2514/5090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:03 2021] GET /compute/v2.1/servers/f21342b3-82e5-4ccd-ae33-973e56e45341 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:04:04.093861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:04.106403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6227b2e-d08d-44f1-9a77-a42bdda81018 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1507 microversion: 2.1 time: 0.592984 Nov 06 21:04:04.112751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2577/5091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:03 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:04.127081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:04.127774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:04.141376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:04.142051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:04.143034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:04.145894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:04.359899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c43fda83-299e-4002-b208-07d97d4bc47d req-4c8e9497-9fa0-46ea-9c7d-3baf10457329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "name": "network-vif-plugged", "status": "completed", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:04.361807 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:04.361807 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:04.372397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c43fda83-299e-4002-b208-07d97d4bc47d req-4c8e9497-9fa0-46ea-9c7d-3baf10457329 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:04.380065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c43fda83-299e-4002-b208-07d97d4bc47d req-4c8e9497-9fa0-46ea-9c7d-3baf10457329 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:04.397192 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c43fda83-299e-4002-b208-07d97d4bc47d req-4c8e9497-9fa0-46ea-9c7d-3baf10457329 service nova] Creating event network-vif-plugged:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:04:04.419695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c43fda83-299e-4002-b208-07d97d4bc47d req-4c8e9497-9fa0-46ea-9c7d-3baf10457329 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064026 Nov 06 21:04:04.421068 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2578/5092] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:05.089214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:05.110064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:05.113364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:05.128596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:05.130190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:05.136877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-289f004c-51bb-44b9-b5fb-5b7bea6dc09f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1741 microversion: 2.20 time: 1.013628 Nov 06 21:04:05.145690 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2515/5093] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:04 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1741 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:05.151711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:05.167472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:05.172011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:05.172652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:05.215784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-983ce5e5-4925-429b-a7f5-66517b99b745 req-3504c614-62b2-49ee-82f4-b17f943561db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad43190b-c3fb-42dc-914d-50260df910d5", "name": "network-vif-deleted", "tag": "08564426-2778-4687-822f-d632265f23a2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:05.217899 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:05.217899 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:05.230083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-983ce5e5-4925-429b-a7f5-66517b99b745 req-3504c614-62b2-49ee-82f4-b17f943561db service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:05.231712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-983ce5e5-4925-429b-a7f5-66517b99b745 req-3504c614-62b2-49ee-82f4-b17f943561db service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:05.261638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-983ce5e5-4925-429b-a7f5-66517b99b745 req-3504c614-62b2-49ee-82f4-b17f943561db service nova] Creating event network-vif-deleted:08564426-2778-4687-822f-d632265f23a2 for instance ad43190b-c3fb-42dc-914d-50260df910d5 on nch2-master-1 Nov 06 21:04:05.279485 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-983ce5e5-4925-429b-a7f5-66517b99b745 req-3504c614-62b2-49ee-82f4-b17f943561db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065515 Nov 06 21:04:05.281347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2516/5094] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:05.369358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:05.400769 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac2ca4ea-1644-4f65-9604-ebde85759faa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 200 len: 1465 microversion: 2.1 time: 0.276920 Nov 06 21:04:05.402490 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2579/5095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:05 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 1465 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:06.179300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:06.181790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:06.197076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:06.198306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:06.201492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:06.202118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:06.225383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2146671573", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0396204f-65fa-4fd3-8d40-a7a6d712672e"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:06.332219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] validate_networks() for [('0396204f-65fa-4fd3-8d40-a7a6d712672e', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:06.538946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:06.551717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:06.553615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:06.561924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e733993b-4d14-4f9b-ac58-70a2d08bb05f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.398306 Nov 06 21:04:06.562866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2580/5096] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:06 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:06.568597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:06.569566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:06.575847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:06.579925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:06.588046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:06.589088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:06.620979 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. Nov 06 21:04:06.621615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:06.622662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65b79c92-98f0-4e9c-90dd-2450559fb3c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 404 len: 111 microversion: 2.1 time: 0.057984 Nov 06 21:04:06.623403 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2581/5097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:06 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:04:06.638597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: .version_select at 0x7f6715adbc10>, body: {"keypair": {"name": "tempest-key-1150261781"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:06.682643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:06.688594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:07.769839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:07.771382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:07.772175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:07.772816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:07.774334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:07.788507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:07.789233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:07.790853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:07.791688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:07.818362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Getting quotas for project c4a348daabdd46089d7f635ca36b9f83. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:07.828595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Getting quotas for user 54f0d0ae2ec04c7d83345adde94ecfeb and project c4a348daabdd46089d7f635ca36b9f83. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:07.844601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:07.848048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:07.970634 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82031647-64de-4470-9283-b943632efc5d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960107 Nov 06 21:04:07.979594 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2517/5098] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:08.127628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:08.137788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:08.159969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-362001f0-0120-4838-8fe3-70267dd0e594 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 1.524970 Nov 06 21:04:08.161069 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2582/5099] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:04:06 2021] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:08.171324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:08.172154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:08.345439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:08.354078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1218 microversion: 2.1 time: 0.187190 Nov 06 21:04:08.368086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2583/5100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:08 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:08.368086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:08.368086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c619f845-0ba6-430c-a942-d74bf93f3062 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001239 Nov 06 21:04:08.368086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2584/5101] 10.222.0.13 () {56 vars in 885 bytes} [Sat Nov 6 21:04:08 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 06 21:04:08.378976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a9fb708-c8b3-4703-bb21-508978e64683 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '.version_select at 0x7f671513ab80>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:08.387961 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-5a9fb708-c8b3-4703-bb21-508978e64683 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 21:04:08.400872 ncdv-master-1 devstack@n-api.service[134827]: WARNING oslo_db.sqlalchemy.utils [None req-5a9fb708-c8b3-4703-bb21-508978e64683 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 06 21:04:08.419989 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a9fb708-c8b3-4703-bb21-508978e64683 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.056511 Nov 06 21:04:08.436122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2585/5102] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:04:08 2021] GET /compute/v2.1/os-keypairs => generated 545 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:08.726841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:08.728414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:08.748993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:08.754091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:08.759693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:08.761191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:08.887670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-326629189", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "key_name": "tempest-key-1150261781", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:09.003239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:10.001479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:10.024710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:10.028565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:10.033543 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85f19baa-ddc4-4ef4-b8a2-bccf97db9b25 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 2.047205 Nov 06 21:04:10.050433 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2518/5103] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:07 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:10.063444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:10.070299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:10.109089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:10.110439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:10.114732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:10.115738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:10.342487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:10.350351 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d821bda0-eaa9-4c48-bae3-9f86cfef9d9f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1288 microversion: 2.1 time: 0.296190 Nov 06 21:04:10.350926 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2519/5104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:10 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1288 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:11.058290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:11.059305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:11.069790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.070265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.074295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.074766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.153568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:11.154805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:11.155545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:11.156202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:11.156887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:11.186482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.197036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.199163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.202073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.257476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:11.284681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:11.330221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:11.334617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:11.410720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-590f0187-75e9-4972-a7ac-b3d1c4855051 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527974 Nov 06 21:04:11.417298 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2586/5105] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:11.422423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:11.424149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:11.433570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.434426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.435538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:11.436236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:11.609276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:11.625452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:11.626723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73d05025-9cb7-4cfe-9d0b-dc275c09c07d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1276 microversion: 2.1 time: 0.206889 Nov 06 21:04:11.633084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2587/5106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:11 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:11.639985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:11.646642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:11.653063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81f56e76-6e0b-4aca-afe4-8f645345a415 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.598529 Nov 06 21:04:11.654828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0c9e871-ce8e-4102-88d0-634d8ce481ec tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:11.655419 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2520/5107] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:11 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:11.657449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0c9e871-ce8e-4102-88d0-634d8ce481ec tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:11.780751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0c9e871-ce8e-4102-88d0-634d8ce481ec tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:11.794350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0c9e871-ce8e-4102-88d0-634d8ce481ec tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1228 microversion: 2.1 time: 0.159100 Nov 06 21:04:11.796594 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2588/5108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:11 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:12.648501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:12.649081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:12.667424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:12.671560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:12.676073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:12.676239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:12.676923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:12.682128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:12.699133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:12.704059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:12.705131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:12.705616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:13.464313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:13.468633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:13.478413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:13.484504 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-360ed14a-b1f3-4797-b56e-2e792e1628d5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 0.841292 Nov 06 21:04:13.485263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:13.487465 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f526339-e198-465e-8616-a5b0a2c9b465 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.818344 Nov 06 21:04:13.489497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2521/5109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:12 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:13.511610 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2589/5110] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:12 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:04:13.513278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:13.525716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:13.569461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:13.570811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:13.574428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:13.578890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:13.850195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:13.883162 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db71c254-4a25-4aab-92b8-c1d4ae7d5f5a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1298 microversion: 2.1 time: 0.382614 Nov 06 21:04:13.889751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2522/5111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:13 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1298 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:14.466398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2004035721", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "53170c66-3550-452a-b484-26c412d80e72"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:14.491076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Action: 'create', calling method: .version_select at 0x7f67153e7d30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1071119647"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:14.597986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] validate_networks() for [('53170c66-3550-452a-b484-26c412d80e72', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:14.599619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for project f2513646a2fc417d9b601006a57d5693. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:14.614941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for user dac5721604a146aa9c840c2aa546805a and project f2513646a2fc417d9b601006a57d5693. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:15.630815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:15.631332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:15.631799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:15.632491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:15.633187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:15.647964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.649687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:15.653053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.653696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:15.699145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:15.709791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for user d56d0365c4ea4f63bb9265661de94231 and project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:15.744025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:15.747548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:15.762780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for project f2513646a2fc417d9b601006a57d5693. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:15.773769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for user dac5721604a146aa9c840c2aa546805a and project f2513646a2fc417d9b601006a57d5693. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:15.811789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25e92f3d-209e-462d-baf1-8aab63d3c201 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 2.004896 Nov 06 21:04:15.819327 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2590/5112] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:04:13 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:15.824482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:15.828689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:15.845167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.845869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:15.846910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.852817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:15.858979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-584d3378-2831-47e6-b241-0da1d381e706 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.600791 Nov 06 21:04:15.889048 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2523/5113] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:15.897454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:15.899165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:15.906138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.906824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:15.907800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:15.908437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:16.827234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:16.838279 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35d26f0e-9f00-4664-9da8-9369d7df5757 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 1.017395 Nov 06 21:04:16.850650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2591/5114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:15 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:16.858541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:16.859263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:16.909528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:16.910376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:16.911409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:16.912067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:17.205894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:17.225535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:17.232015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:17.235143 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cdb8073d-26c7-4b76-91f0-a983d4ba581b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 1.344288 Nov 06 21:04:17.248566 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2524/5115] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:15 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:17.266232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-29376941-bd0c-4914-aebc-c7bfdb9edad8 req-1891d2bb-4402-4849-aada-b7cf48fdfbab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79fdfc6-af27-4e6a-922f-79691509293f", "tag": "ee23c91d-21d9-4c38-8b57-b3b665ebe030"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:17.268091 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:17.268091 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:17.289403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29376941-bd0c-4914-aebc-c7bfdb9edad8 req-1891d2bb-4402-4849-aada-b7cf48fdfbab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:17.289859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29376941-bd0c-4914-aebc-c7bfdb9edad8 req-1891d2bb-4402-4849-aada-b7cf48fdfbab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:17.325150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-29376941-bd0c-4914-aebc-c7bfdb9edad8 req-1891d2bb-4402-4849-aada-b7cf48fdfbab service nova] Creating event network-changed:ee23c91d-21d9-4c38-8b57-b3b665ebe030 for instance a79fdfc6-af27-4e6a-922f-79691509293f on nch2-master-1 Nov 06 21:04:17.339572 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-29376941-bd0c-4914-aebc-c7bfdb9edad8 req-1891d2bb-4402-4849-aada-b7cf48fdfbab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085790 Nov 06 21:04:17.340691 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2525/5116] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:17.354571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2053501941", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "53170c66-3550-452a-b484-26c412d80e72"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:17.461361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] validate_networks() for [('53170c66-3550-452a-b484-26c412d80e72', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:18.070321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:18.082047 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cca38c92-dd4e-41da-999f-39a983ce05ac tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 1.226456 Nov 06 21:04:18.082679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2592/5117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:16 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:18.115665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:18.118794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:18.151011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:18.151628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:18.159740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:18.168191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:20.074937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:20.083662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d659114c-3eaa-4fef-a772-0e0ecb20cf25 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 1.988034 Nov 06 21:04:20.088563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2593/5118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:18 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:20.099866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:20.100811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:20.119201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:20.125715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:20.126812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:20.128275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.076501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:21.095444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:21.109136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:21.113141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db0cc1a0-b281-4243-820e-03dc20962bef tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 1.023232 Nov 06 21:04:21.134346 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2594/5119] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:20 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:21.141633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:21.142185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:21.142556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:21.144167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:21.144872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:21.156747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:21.157967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:21.163461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.163929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.164786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.165246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.185343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.185799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.191361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.194807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.249885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:21.271357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for user d56d0365c4ea4f63bb9265661de94231 and project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:21.320516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:21.323133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:21.494651 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc169d32-c046-4b2c-96d3-d4b7d53a9b54 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.151213 Nov 06 21:04:21.498514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2526/5120] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 4156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:21.515773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7f58073e-b033-4785-83ff-e364f7eff42f req-3024e370-fb3b-4d90-9012-b2eb329f8edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca1947e-e0cb-4178-9921-7758f415d600", "tag": "4118adfa-926d-4d90-bed9-cdd9086aec94"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:21.522375 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:21.522375 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:21.551043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7f58073e-b033-4785-83ff-e364f7eff42f req-3024e370-fb3b-4d90-9012-b2eb329f8edc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.559115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7f58073e-b033-4785-83ff-e364f7eff42f req-3024e370-fb3b-4d90-9012-b2eb329f8edc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.610882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7f58073e-b033-4785-83ff-e364f7eff42f req-3024e370-fb3b-4d90-9012-b2eb329f8edc service nova] Creating event network-changed:4118adfa-926d-4d90-bed9-cdd9086aec94 for instance aca1947e-e0cb-4178-9921-7758f415d600 on nch2-master-1 Nov 06 21:04:21.623133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7f58073e-b033-4785-83ff-e364f7eff42f req-3024e370-fb3b-4d90-9012-b2eb329f8edc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122968 Nov 06 21:04:21.624571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2527/5121] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:21.639700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:21.641558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:21.660484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.662771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:21.664379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:21.668779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:22.039140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:22.063137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c9e72af-5491-4127-bb18-4555128b5aa9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 0.923888 Nov 06 21:04:22.063775 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2595/5122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:21 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:22.076339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1366765340", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "451", "networks": [{"uuid": "53170c66-3550-452a-b484-26c412d80e72"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:22.193177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] validate_networks() for [('53170c66-3550-452a-b484-26c412d80e72', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:22.771869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:22.779653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3584ffa2-a893-4c82-b2a8-4bad5e914634 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 1.153636 Nov 06 21:04:22.789078 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2528/5123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:21 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:22.794575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:22.795396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:22.806607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:22.810666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:22.811725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:22.812375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:23.590246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:23.618804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:23.620639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:23.622036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ede51a7b-7047-4e56-9179-c0eaf45c0d55 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.831528 Nov 06 21:04:23.638544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2529/5124] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:22 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:23.657993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:23.659632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:23.693725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:23.694487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:23.695466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:23.697214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:23.758423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:23.759623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:23.762516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:23.762724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:23.764574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:23.816332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:23.817755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:23.823998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:23.839394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:23.933739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:23.939740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Getting quotas for user d56d0365c4ea4f63bb9265661de94231 and project 84a119dc29614d80a2a5c5378eb09590. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:23.969597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:23.973668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:24.077540 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c8060d0-b86f-4490-89a1-12b944985a83 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.011385 Nov 06 21:04:24.096951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2596/5125] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:24.107415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:24.111078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:24.122666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:24.127745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:24.129845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:24.132758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:24.685003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:24.700330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8fcc367-e6ad-408b-8000-b12071c3c0b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 1.056211 Nov 06 21:04:24.701406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2530/5126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:23 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:24.711085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b35a6fe-0d97-4a71-a2aa-7d0120de3ee9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:24.713423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b35a6fe-0d97-4a71-a2aa-7d0120de3ee9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:24.946141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0b35a6fe-0d97-4a71-a2aa-7d0120de3ee9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:24.957924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b35a6fe-0d97-4a71-a2aa-7d0120de3ee9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1221 microversion: 2.1 time: 0.255150 Nov 06 21:04:24.969686 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2531/5127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:24 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:24.983896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:24.984760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:25.008146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:25.008647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:25.009689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:25.010295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:25.528065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:25.538284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f8d8820-4482-4d2f-baa1-33dc191edf3f tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 1.437454 Nov 06 21:04:25.540255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2597/5128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:24 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:25.551524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1907080a-59e5-44d0-a626-49cacef8c198 req-7e0ee93f-6cc6-4e69-b346-841040529329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f43a8-ffe2-4f74-8af1-57b56325b235", "tag": "81ff9899-aaca-4601-85a6-c941334b6ac2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:25.556660 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:25.556660 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:25.594526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1907080a-59e5-44d0-a626-49cacef8c198 req-7e0ee93f-6cc6-4e69-b346-841040529329 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:25.595005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1907080a-59e5-44d0-a626-49cacef8c198 req-7e0ee93f-6cc6-4e69-b346-841040529329 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:25.662639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1907080a-59e5-44d0-a626-49cacef8c198 req-7e0ee93f-6cc6-4e69-b346-841040529329 service nova] Creating event network-changed:81ff9899-aaca-4601-85a6-c941334b6ac2 for instance 164f43a8-ffe2-4f74-8af1-57b56325b235 on nch2-master-1 Nov 06 21:04:25.679440 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1907080a-59e5-44d0-a626-49cacef8c198 req-7e0ee93f-6cc6-4e69-b346-841040529329 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137673 Nov 06 21:04:25.680396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2598/5129] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:25.718895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:25.721775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:25.740685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:25.741566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:25.743458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:25.744849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:26.427477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:26.441160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:26.444588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:26.445829 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62133899-c416-4608-8451-92955ffa2240 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 1.474009 Nov 06 21:04:26.464706 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2532/5130] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:24 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:26.469389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:26.474546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:26.501408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:26.502113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:26.503281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:26.503742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:26.727823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:26.744379 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-832550a0-715b-43c3-80eb-79005f1bc16a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1279 microversion: 2.1 time: 0.274933 Nov 06 21:04:26.756339 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2533/5131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:26 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1279 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:26.763991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:26.764970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:26.785287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:26.786021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:26.786999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:26.789019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:26.804202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:26.818803 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef44ea37-238f-4921-a5a9-8fe205baaf01 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 1.099784 Nov 06 21:04:26.833749 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2599/5132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:25 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:27.234514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8e7faa95-46d7-47e7-a38d-0c6a4d78b545 req-0bbb97af-e4d8-4d45-975e-72705c5b690e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79fdfc6-af27-4e6a-922f-79691509293f", "name": "network-vif-plugged", "status": "completed", "tag": "ee23c91d-21d9-4c38-8b57-b3b665ebe030"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:27.237687 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:27.237687 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:27.256146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8e7faa95-46d7-47e7-a38d-0c6a4d78b545 req-0bbb97af-e4d8-4d45-975e-72705c5b690e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:27.256624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8e7faa95-46d7-47e7-a38d-0c6a4d78b545 req-0bbb97af-e4d8-4d45-975e-72705c5b690e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:27.297633 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8e7faa95-46d7-47e7-a38d-0c6a4d78b545 req-0bbb97af-e4d8-4d45-975e-72705c5b690e service nova] Creating event network-vif-plugged:ee23c91d-21d9-4c38-8b57-b3b665ebe030 for instance a79fdfc6-af27-4e6a-922f-79691509293f on nch2-master-1 Nov 06 21:04:27.316934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8e7faa95-46d7-47e7-a38d-0c6a4d78b545 req-0bbb97af-e4d8-4d45-975e-72705c5b690e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087503 Nov 06 21:04:27.317542 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2600/5133] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:27.427517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:27.438955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f08f859-c053-4421-8ba5-921e7a03a9c5 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 0.679178 Nov 06 21:04:27.442707 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2534/5134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:26 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:27.467758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:27.468472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:27.477181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:27.477633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:27.478450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:27.481949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:27.762185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:27.763110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:27.782476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:27.783642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:27.784690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:27.785302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:28.495155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:28.507462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35ec11fb-950e-40bb-be8f-2a09b2df95df tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1279 microversion: 2.1 time: 0.749079 Nov 06 21:04:28.525672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2535/5135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:27 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1279 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:28.531857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:28.532970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:28.540827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:28.541568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:28.542802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:28.546781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:28.654259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:28.673522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:28.678829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:28.680204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7ac3789-593a-403d-a043-c8786b25da79 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 1.217014 Nov 06 21:04:28.681787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2601/5136] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:27 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:28.690970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:28.697027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:28.713991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:28.716418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:28.718887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:28.720700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:29.061932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:29.085575 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e099ef92-7482-4a93-8e0a-1b8006325438 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 0.558500 Nov 06 21:04:29.091450 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2536/5137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:28 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:29.110585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:29.123321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a98a418-75b4-45e8-b7e9-4b4f6d9ab175 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1318 microversion: 2.1 time: 0.438871 Nov 06 21:04:29.136387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2602/5138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:28 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:29.525518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:29.526131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:29.547718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:29.548170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:29.552759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:29.555769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:29.703972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:29.706036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:29.717502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:29.724505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:29.726060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:29.726695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:29.890541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:29.921536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fbbfa1a9-abe0-4546-8af7-92d74894b09f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1279 microversion: 2.1 time: 0.399591 Nov 06 21:04:29.934625 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2537/5139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:29 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1279 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:30.113362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:30.114050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:30.134343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:30.136620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:30.142936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:30.146455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:30.531848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:30.547691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:30.549667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:30.561000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9f4f00b-15bd-4772-af0a-f3b0a99efa21 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.860685 Nov 06 21:04:30.564597 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2603/5140] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:29 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:30.582499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:30.583135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:30.619038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:30.619503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:30.620341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:30.620796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.170491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:31.183674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7b4b92a-cb66-4d77-bb66-d1a066c9b41a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 1.079393 Nov 06 21:04:31.192781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2538/5141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:30 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:31.212760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-15a117bf-77bd-4dcd-9cb1-49ca732928d3 req-f0c8b806-4116-427e-bb44-095368ec0477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca1947e-e0cb-4178-9921-7758f415d600", "name": "network-vif-plugged", "status": "completed", "tag": "4118adfa-926d-4d90-bed9-cdd9086aec94"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:31.235456 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:31.235456 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:31.260390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15a117bf-77bd-4dcd-9cb1-49ca732928d3 req-f0c8b806-4116-427e-bb44-095368ec0477 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.260851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15a117bf-77bd-4dcd-9cb1-49ca732928d3 req-f0c8b806-4116-427e-bb44-095368ec0477 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.331107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-15a117bf-77bd-4dcd-9cb1-49ca732928d3 req-f0c8b806-4116-427e-bb44-095368ec0477 service nova] Creating event network-vif-plugged:4118adfa-926d-4d90-bed9-cdd9086aec94 for instance aca1947e-e0cb-4178-9921-7758f415d600 on nch2-master-1 Nov 06 21:04:31.355147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-15a117bf-77bd-4dcd-9cb1-49ca732928d3 req-f0c8b806-4116-427e-bb44-095368ec0477 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160743 Nov 06 21:04:31.355737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2539/5142] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:31.377562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:31.378292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:31.390305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.390784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.401422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.401895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.512610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:31.521064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1cd0ee3-4164-463b-b918-bc8cd99ce615 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1507 microversion: 2.1 time: 0.953152 Nov 06 21:04:31.521653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2604/5143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:30 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1507 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:31.544574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-27d04e03-a426-4877-9392-84d4eb19a6ce req-ea1d3f70-59e7-4cdc-9fa8-b9676942c4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8719dd5-4131-46f9-ba2e-3db7a5a416c0", "tag": "1e809a15-6c60-4eeb-9725-78d9421cf79d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:31.546131 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:31.546131 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:31.586403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-27d04e03-a426-4877-9392-84d4eb19a6ce req-ea1d3f70-59e7-4cdc-9fa8-b9676942c4a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.587055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-27d04e03-a426-4877-9392-84d4eb19a6ce req-ea1d3f70-59e7-4cdc-9fa8-b9676942c4a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.637797 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-27d04e03-a426-4877-9392-84d4eb19a6ce req-ea1d3f70-59e7-4cdc-9fa8-b9676942c4a8 service nova] Creating event network-changed:1e809a15-6c60-4eeb-9725-78d9421cf79d for instance d8719dd5-4131-46f9-ba2e-3db7a5a416c0 on nch2-master-1 Nov 06 21:04:31.651994 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-27d04e03-a426-4877-9392-84d4eb19a6ce req-ea1d3f70-59e7-4cdc-9fa8-b9676942c4a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119407 Nov 06 21:04:31.652945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2605/5144] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:31.672626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:31.679116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:31.697797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.698701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:31.699708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:31.700350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:32.073163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:32.081041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c86de31d-6e55-49e7-9970-58826819ab47 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.719997 Nov 06 21:04:32.090860 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2540/5145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:31 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:32.203827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:32.204545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:32.212391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:32.212847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:32.213643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:32.224763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:32.445942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:32.453939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:32.456021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:32.476800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96334d25-e079-40ee-adb9-22c54b0362b7 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.822350 Nov 06 21:04:32.477410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2606/5146] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:31 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:32.832046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:32.843551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38575c65-0c5b-45de-8b5b-ee35f36f0c40 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1328 microversion: 2.1 time: 0.642299 Nov 06 21:04:32.846718 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2541/5147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:32 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1328 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:33.113291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:33.113291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:33.133871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.134332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.135162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.135608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.301189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5104c4cd-a1b4-49a7-bb16-8de397ad2092"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:33.303660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:33.322330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.323118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.324191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.326832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.752030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:33.765270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-296425c1-65cb-4812-89f3-2a2e0058f609 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.660567 Nov 06 21:04:33.766141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2607/5148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:33 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:33.775725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:33.790416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:33.806442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.807298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.809275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.813960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.898289 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10df4254-4e60-4b32-a0be-c287b34a73cd tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "POST /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601083 Nov 06 21:04:33.906727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2542/5149] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:04:33 2021] POST /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:33.914654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:33.914986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:33.926133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.926694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:33.927741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:33.928181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.381207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:34.390447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bbd9c1e-0756-4e33-9723-a6157b0a1e94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1509 microversion: 2.1 time: 0.478212 Nov 06 21:04:34.391650 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2543/5150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:33 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:34.406780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:34.407165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:34.434421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.434897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.444533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.445507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.473464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:34.484056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:34.491787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:34.496985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-354a12a0-32b4-46db-9e1e-1f5b4d6da513 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.729515 Nov 06 21:04:34.498825 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2608/5151] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:33 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:34.767646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:34.775524 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09b862f6-dd42-4fc0-99a3-b869158dc244 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1509 microversion: 2.1 time: 0.372576 Nov 06 21:04:34.782644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:34.783931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:34.784717 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2544/5152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:34 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:34.800604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:34.801113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:34.812371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.812840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.813640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.813903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.814124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.814697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.815581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:34.816092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:34.949473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:04:35.233796 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fcded3d0-7649-43c1-8bda-2f82ca0f8399 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 204 len: 0 microversion: 2.1 time: 0.433945 Nov 06 21:04:35.240759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2545/5153] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:04:34 2021] DELETE /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:04:35.246386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:35.248162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:35.255449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:35.256689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:35.257770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:35.258433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:36.137150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:36.149224 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b3f9a41-8d3e-4fe6-802d-b055c687bf37 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 1.369145 Nov 06 21:04:36.153587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2609/5154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:34 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:36.177924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:36.182860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:36.183662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:36.196210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6eed36b-962b-40c0-b428-ad150dfa5157 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1515 microversion: 2.1 time: 0.953147 Nov 06 21:04:36.197091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2546/5155] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:35 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1515 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:36.211192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:36.212849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:36.229755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:36.231276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:36.616627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cdceceb2-79a1-400d-891b-c9c8cf6baaf8 req-639df616-0397-4234-8c7b-15d5a646a87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25636bb5-127e-4800-a20f-4153bee09788", "tag": "35035f2f-8929-4edc-86d0-3f2e5d1182ab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:36.620277 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:36.620277 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:36.643141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cdceceb2-79a1-400d-891b-c9c8cf6baaf8 req-639df616-0397-4234-8c7b-15d5a646a87e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:36.644143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cdceceb2-79a1-400d-891b-c9c8cf6baaf8 req-639df616-0397-4234-8c7b-15d5a646a87e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:36.671027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cdceceb2-79a1-400d-891b-c9c8cf6baaf8 req-639df616-0397-4234-8c7b-15d5a646a87e service nova] Creating event network-changed:35035f2f-8929-4edc-86d0-3f2e5d1182ab for instance 25636bb5-127e-4800-a20f-4153bee09788 on nch2-master-1 Nov 06 21:04:36.681284 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cdceceb2-79a1-400d-891b-c9c8cf6baaf8 req-639df616-0397-4234-8c7b-15d5a646a87e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070647 Nov 06 21:04:36.683149 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2547/5156] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:36.771276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:36.780389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:36.781906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:36.783146 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd0040d5-f16b-457d-965a-cc989f0b1d7c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1736 microversion: 2.20 time: 0.628448 Nov 06 21:04:36.783716 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2610/5157] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:36 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1736 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:37.109665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-db8b7446-dc1d-4a8e-aa24-31b0d2420383 req-cc1973cf-17de-4814-8da8-20c0d98bfe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f43a8-ffe2-4f74-8af1-57b56325b235", "name": "network-vif-plugged", "status": "completed", "tag": "81ff9899-aaca-4601-85a6-c941334b6ac2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:37.111721 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:37.111721 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:37.130875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-db8b7446-dc1d-4a8e-aa24-31b0d2420383 req-cc1973cf-17de-4814-8da8-20c0d98bfe4c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:37.131675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-db8b7446-dc1d-4a8e-aa24-31b0d2420383 req-cc1973cf-17de-4814-8da8-20c0d98bfe4c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:37.147665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-db8b7446-dc1d-4a8e-aa24-31b0d2420383 req-cc1973cf-17de-4814-8da8-20c0d98bfe4c service nova] Creating event network-vif-plugged:81ff9899-aaca-4601-85a6-c941334b6ac2 for instance 164f43a8-ffe2-4f74-8af1-57b56325b235 on nch2-master-1 Nov 06 21:04:37.152579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-db8b7446-dc1d-4a8e-aa24-31b0d2420383 req-cc1973cf-17de-4814-8da8-20c0d98bfe4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046735 Nov 06 21:04:37.153757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2548/5158] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:37.171399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:37.172735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:37.180999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:37.181798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:37.182854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:37.183493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:37.216384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:37.217770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:37.232436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:37.233183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:37.235096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:37.237153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:38.568775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:38.579286 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6eb936ba-1785-4954-8339-c1de6627b10e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 1.413278 Nov 06 21:04:38.596651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2611/5159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:37 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:38.607999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:38.624973 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5643f676-7e00-4422-8605-1ad9ddef535a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1515 microversion: 2.1 time: 1.409741 Nov 06 21:04:38.626111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2549/5160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:37 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1515 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:38.651767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:38.652933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:38.699252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:38.700111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:38.702779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:38.703451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.124202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "807edead-58ae-4a8e-8f70-cdd9e60a82e4"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:39.125483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:39.136046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.136468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.137272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.137707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.175556 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:39.175556 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:39.180143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:39.223898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:39.239526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:39.241910 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b55308e7-84b5-452e-850f-f15b51525420 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1718 microversion: 2.20 time: 0.643963 Nov 06 21:04:39.259999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2612/5161] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:38 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1718 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:39.355512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] HTTP exception thrown: Volume 807edead-58ae-4a8e-8f70-cdd9e60a82e4 could not be found. Nov 06 21:04:39.356247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Returning 400 to user: Volume 807edead-58ae-4a8e-8f70-cdd9e60a82e4 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:39.357258 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4b67cbc-7c1c-4f45-8141-1a8372445501 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/5104c4cd-a1b4-49a7-bb16-8de397ad2092" status: 400 len: 107 microversion: 2.1 time: 0.628797 Nov 06 21:04:39.358442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2550/5162] 10.222.0.13 () {60 vars in 1432 bytes} [Sat Nov 6 21:04:38 2021] PUT /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/5104c4cd-a1b4-49a7-bb16-8de397ad2092 => generated 107 bytes in 631 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 21:04:39.494359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:39.496711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:39.531432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.532741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.535686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.537669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.604655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:39.605669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:39.624124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.625749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.628811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.632551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.713972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lazy-loading 'services' on Instance uuid a79fdfc6-af27-4e6a-922f-79691509293f {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:04:39.840763 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c15fc66c-6547-4805-87c7-199d7ebd101c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/5104c4cd-a1b4-49a7-bb16-8de397ad2092" status: 202 len: 0 microversion: 2.1 time: 0.355965 Nov 06 21:04:39.844798 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2613/5163] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:04:39 2021] DELETE /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/5104c4cd-a1b4-49a7-bb16-8de397ad2092 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:04:39.865196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:39.867206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:39.876147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.877589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:39.881658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:39.885277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.234407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:40.242853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89837365-46e0-4817-9fe9-5f133f0bdccf tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.646834 Nov 06 21:04:40.243429 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2551/5164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:39 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:40.258999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:40.259977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:40.271598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:40.272047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.272879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:40.273317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.335017 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8a93acf-076a-4922-bacf-afe61c555e3c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090521 Nov 06 21:04:40.346980 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2552/5165] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:04:40 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:40.351838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:40.352473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:40.366319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:40.367278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.367565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:40.367993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.428921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:40.440205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce0e9db7-b75d-4e0a-bd81-41f609d971fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 200 len: 1515 microversion: 2.1 time: 0.585431 Nov 06 21:04:40.452956 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2614/5166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:39 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 1515 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:40.478680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-561f423f-5587-4ec2-b83b-e005fb84cb4b req-f4285760-7548-4863-b500-2f7e0846fc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca1947e-e0cb-4178-9921-7758f415d600", "name": "network-vif-deleted", "tag": "4118adfa-926d-4d90-bed9-cdd9086aec94"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:40.480347 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:40.480347 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:40.495411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-561f423f-5587-4ec2-b83b-e005fb84cb4b req-f4285760-7548-4863-b500-2f7e0846fc74 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:40.497206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-561f423f-5587-4ec2-b83b-e005fb84cb4b req-f4285760-7548-4863-b500-2f7e0846fc74 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:40.538525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-561f423f-5587-4ec2-b83b-e005fb84cb4b req-f4285760-7548-4863-b500-2f7e0846fc74 service nova] Creating event network-vif-deleted:4118adfa-926d-4d90-bed9-cdd9086aec94 for instance aca1947e-e0cb-4178-9921-7758f415d600 on nch2-master-1 Nov 06 21:04:40.556943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-561f423f-5587-4ec2-b83b-e005fb84cb4b req-f4285760-7548-4863-b500-2f7e0846fc74 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081380 Nov 06 21:04:40.559116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2615/5167] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:04:41.055336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-409e23b3-87b8-4929-9109-428c14a027c6 req-ae4c5b07-4d3b-44e0-9c23-64caa55ee9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "name": "network-vif-unplugged", "status": "completed", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:41.056898 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:41.056898 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:41.074285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-409e23b3-87b8-4929-9109-428c14a027c6 req-ae4c5b07-4d3b-44e0-9c23-64caa55ee9fc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.076793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-409e23b3-87b8-4929-9109-428c14a027c6 req-ae4c5b07-4d3b-44e0-9c23-64caa55ee9fc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.114675 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-409e23b3-87b8-4929-9109-428c14a027c6 req-ae4c5b07-4d3b-44e0-9c23-64caa55ee9fc service nova] Creating event network-vif-unplugged:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:04:41.126936 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-409e23b3-87b8-4929-9109-428c14a027c6 req-ae4c5b07-4d3b-44e0-9c23-64caa55ee9fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076778 Nov 06 21:04:41.129717 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2616/5168] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:41.133218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:41.148001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:41.149883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:41.151288 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4388e62b-f1ac-4b62-a53f-9a757272b0aa tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1718 microversion: 2.20 time: 0.803210 Nov 06 21:04:41.153642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2553/5169] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:40 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1718 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:41.261971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:41.263058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:41.284133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.285081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.286166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.286815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.362546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:41.363517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:41.397398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.398376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.399485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.404537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.514258 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7a4e153f-e213-4099-a03c-2f5c2afd03d2 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160549 Nov 06 21:04:41.515783 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2554/5170] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:04:41 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:04:41.531147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:41.533964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:41.547549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.550274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.552510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:41.553091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:41.597322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. Nov 06 21:04:41.602035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:41.602927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc81e3fd-5167-488f-8c32-bf2354cde9b5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 404 len: 111 microversion: 2.1 time: 0.084610 Nov 06 21:04:41.603478 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2555/5171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:41 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:04:41.615365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11410247-ee01-4106-a5c6-b1e47acd1136 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '.version_select at 0x7f671ad44ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:41.669271 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11410247-ee01-4106-a5c6-b1e47acd1136 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-key-1150261781" status: 202 len: 0 microversion: 2.1 time: 0.059091 Nov 06 21:04:41.676893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2556/5172] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Nov 6 21:04:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-key-1150261781 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:04:41.792274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:41.805682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1550a39-25e6-4f90-914e-fef6656eb89f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.546683 Nov 06 21:04:41.806863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2617/5173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:41 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:41.823728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-707919793-access_point-557224967", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8545d18d-53f1-4e44-8979-ca61a655f6b2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1071119647", "security_groups": [{"name": "tempest-secgroup_access--208954336"}, {"name": "tempest-secgroup_general--96229155"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:42.034030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-468499016", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:42.113226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:42.375142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] validate_networks() for [('8545d18d-53f1-4e44-8979-ca61a655f6b2', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:04:43.516741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:43.518134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:43.518843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:43.519447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:43.520075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:43.537840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.538634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.540366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.543372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.593393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:43.605968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:43.627463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:04:43.627994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:04:43.628255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:43.629014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:04:43.631976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:43.637090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:04:43.637669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:04:43.669647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.671538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.677274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.678646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.713246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for project f2513646a2fc417d9b601006a57d5693. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:04:43.718234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a9c7e95-aa22-442e-b173-fd8fa10c05e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689058 Nov 06 21:04:43.722518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2618/5174] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:04:43.728023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for user dac5721604a146aa9c840c2aa546805a and project f2513646a2fc417d9b601006a57d5693. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:04:43.731816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:43.737266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:43.758663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.759453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.760309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.762322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.768625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:04:43.771242 ncdv-master-1 devstack@n-api.service[134828]: WARNING nova.utils [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-707919793-access_point-557224967 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-707919793-acc Nov 06 21:04:43.771978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:04:43.959794 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b44e9d82-6d53-4eed-9808-836ea27f9522 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 2.136026 Nov 06 21:04:43.968419 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2557/5175] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:04:41 2021] POST /compute/v2.1/servers => generated 455 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:04:43.979558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:43.980694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:43.995145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.996763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:43.997899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:43.998557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:44.333598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:44.356234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:44.359247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:44.362783 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6699156-4c18-4072-b2af-3bf67a7c1585 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1661 microversion: 2.20 time: 0.639244 Nov 06 21:04:44.389691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2619/5176] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:43 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1661 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:44.407230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-77ddac16-eaad-4f00-ba28-ae3e70cf653d req-cbf2ede4-a6b2-4329-a9aa-b8ee3b006c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8719dd5-4131-46f9-ba2e-3db7a5a416c0", "name": "network-vif-plugged", "status": "completed", "tag": "1e809a15-6c60-4eeb-9725-78d9421cf79d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:44.409493 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:44.409493 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:44.440373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77ddac16-eaad-4f00-ba28-ae3e70cf653d req-cbf2ede4-a6b2-4329-a9aa-b8ee3b006c87 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:44.445873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-77ddac16-eaad-4f00-ba28-ae3e70cf653d req-cbf2ede4-a6b2-4329-a9aa-b8ee3b006c87 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:44.490933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-77ddac16-eaad-4f00-ba28-ae3e70cf653d req-cbf2ede4-a6b2-4329-a9aa-b8ee3b006c87 service nova] Creating event network-vif-plugged:1e809a15-6c60-4eeb-9725-78d9421cf79d for instance d8719dd5-4131-46f9-ba2e-3db7a5a416c0 on nch2-master-1 Nov 06 21:04:44.507385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-77ddac16-eaad-4f00-ba28-ae3e70cf653d req-cbf2ede4-a6b2-4329-a9aa-b8ee3b006c87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112776 Nov 06 21:04:44.512832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2620/5177] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:44.542377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7067467a-0595-42c6-be1b-b1b0a45a83c4"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:44.545648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:44.548899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:44.575684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20dc93a1-ff3b-4b33-b292-c090f844ee17 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.604162 Nov 06 21:04:44.584671 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2558/5178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:43 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:44.596380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:44.603061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:44.605934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-955dd67b-8a3b-4985-8d07-d9f82582d759 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:44.611334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:44.612206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:44.614226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-955dd67b-8a3b-4985-8d07-d9f82582d759 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:44.731904 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:44.731904 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:44.779752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] HTTP exception thrown: Volume c9c655cd-f4f4-4791-a0ba-db1456aad786 could not be found. Nov 06 21:04:44.780672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] Returning 404 to user: Volume c9c655cd-f4f4-4791-a0ba-db1456aad786 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:04:44.783492 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c1818c0-5022-42d5-ac1a-a848785fda87 tempest-VolumesAdminNegativeTest-410753894 tempest-VolumesAdminNegativeTest-410753894-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/c9c655cd-f4f4-4791-a0ba-db1456aad786" status: 404 len: 109 microversion: 2.1 time: 0.266438 Nov 06 21:04:44.788426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2621/5179] 10.222.0.13 () {60 vars in 1432 bytes} [Sat Nov 6 21:04:44 2021] PUT /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f/os-volume_attachments/c9c655cd-f4f4-4791-a0ba-db1456aad786 => generated 109 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:04:44.795469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07c0232b-927b-4710-8ea2-a4480130badb tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:44.799325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07c0232b-927b-4710-8ea2-a4480130badb tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:44.827909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-955dd67b-8a3b-4985-8d07-d9f82582d759 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:44.837707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-955dd67b-8a3b-4985-8d07-d9f82582d759 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1208 microversion: 2.1 time: 0.249742 Nov 06 21:04:44.838324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2559/5180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:44 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1208 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:44.856933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b64a67e-6923-49a0-aee9-6485b5c59a82"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:44.862457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:44.899495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:44.900860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:44.904217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:44.907001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.031684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-07c0232b-927b-4710-8ea2-a4480130badb tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:45.044939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07c0232b-927b-4710-8ea2-a4480130badb tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1293 microversion: 2.1 time: 0.254070 Nov 06 21:04:45.046458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2622/5181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:44 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:45.558639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab4986c3-db4c-499c-9ce8-10773c85362d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.719187 Nov 06 21:04:45.559482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2560/5182] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Nov 6 21:04:44 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments => generated 188 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:04:45.600873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:45.601512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:45.624620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.625464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.626719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.627417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.788727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:45.789507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:45.813365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.814862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.816145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.819813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.942290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:45.953742 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-832cc3f7-026e-4b78-9510-2bb85ba78eba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.358224 Nov 06 21:04:45.954946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2623/5183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:45 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:45.965783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:45.966587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:45.973543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.974300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:45.975987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:45.976644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.085422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:46.101962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5757c5ee-a258-40c6-bd0c-758acbdec4c6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1204 microversion: 2.1 time: 0.143983 Nov 06 21:04:46.103228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2624/5184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:45 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1204 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:46.111977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:46.117637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:46.131815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.132268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.134091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.135130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.283488 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments/9b64a67e-6923-49a0-aee9-6485b5c59a82" status: 202 len: 0 microversion: 2.20 time: 0.500513 Nov 06 21:04:46.284513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2561/5185] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Nov 6 21:04:45 2021] DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments/9b64a67e-6923-49a0-aee9-6485b5c59a82 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:04:46.389463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:46.390031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:46.399228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.399685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.400513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.400946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.452212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:46.466850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b684c6cf-f06c-4730-be0f-79ff99b66904 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1345 microversion: 2.1 time: 0.359652 Nov 06 21:04:46.468089 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2625/5186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:46 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1345 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:46.559481 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-853d1805-2272-472e-9ff9-c43e701254e8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action" status: 202 len: 0 microversion: 2.20 time: 0.171194 Nov 06 21:04:46.560478 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2562/5187] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:04:46 2021] POST /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:04:46.569043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:46.569648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:46.592024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.592932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.609332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.614149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.971667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:46.972535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:46.991391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:46.992526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:46.997929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:47.002330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:47.295239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:47.314484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:47.316333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:47.322084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2acf15e6-efff-4b82-a680-a59350263d66 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1669 microversion: 2.20 time: 0.756557 Nov 06 21:04:47.323870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2626/5188] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:46 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1669 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:04:47.344467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:47.355677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:47.406834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:47.410988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:47.414284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:47.415252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:47.562123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:47.572564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e467c2b5-8689-4d8a-adf6-82baf3aeaf49 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1266 microversion: 2.1 time: 0.244888 Nov 06 21:04:47.586926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2627/5189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:47 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:47.596766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:47.598272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:47.625706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:47.627388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:47.628532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:47.629391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.006170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:48.016953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b5d0add-de74-4ae2-98ce-10c55c134dff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1351 microversion: 2.1 time: 0.428701 Nov 06 21:04:48.021194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2628/5190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:47 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1351 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:48.026338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:48.027106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:48.037429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.038177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.038354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:48.040224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.041188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.066645 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-174fd69f-754d-40cd-a582-177c693abe94 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 1.097499 Nov 06 21:04:48.069563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2563/5191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:46 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:48.105509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:04:48.113449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3bc4a4fa-a6a5-4d92-805b-36b92ac87dfa req-30549e50-d6ac-4260-bf6c-ec418b46ffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25636bb5-127e-4800-a20f-4153bee09788", "name": "network-vif-plugged", "status": "completed", "tag": "35035f2f-8929-4edc-86d0-3f2e5d1182ab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:48.115841 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:48.115841 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:48.132313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3bc4a4fa-a6a5-4d92-805b-36b92ac87dfa req-30549e50-d6ac-4260-bf6c-ec418b46ffb1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.133445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3bc4a4fa-a6a5-4d92-805b-36b92ac87dfa req-30549e50-d6ac-4260-bf6c-ec418b46ffb1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.211239 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3bc4a4fa-a6a5-4d92-805b-36b92ac87dfa req-30549e50-d6ac-4260-bf6c-ec418b46ffb1 service nova] Creating event network-vif-plugged:35035f2f-8929-4edc-86d0-3f2e5d1182ab for instance 25636bb5-127e-4800-a20f-4153bee09788 on nch2-master-1 Nov 06 21:04:48.227231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3bc4a4fa-a6a5-4d92-805b-36b92ac87dfa req-30549e50-d6ac-4260-bf6c-ec418b46ffb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118294 Nov 06 21:04:48.227836 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2564/5192] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:48.343616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:48.344465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:48.360713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.361577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.362902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.363619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.426340 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf797838-5d52-444f-bc05-5bb20246ce73 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 204 len: 0 microversion: 2.1 time: 0.403669 Nov 06 21:04:48.429322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2629/5193] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:04:48 2021] DELETE /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:04:48.456784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:48.460285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:48.477967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.478819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:48.480669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:48.486640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:49.233184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:49.244078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:49.246135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:49.247636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d4e95a8-50af-452f-82ea-924b165116ea tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.910189 Nov 06 21:04:49.260569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2565/5194] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:48 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:49.266389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:49.267246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:49.274487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:49.275176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:49.276156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:49.276807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:49.277898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:49.294089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0811a434-48a2-4556-a6dc-e86e6bbf8610 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1513 microversion: 2.1 time: 0.859420 Nov 06 21:04:49.304064 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2630/5195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:48 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1513 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:49.353948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:49.365220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:49.376341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:49.376927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:49.377807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:49.378546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.041672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:50.049604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:50.051576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e410a8e8-11a9-4998-b871-5edd4fa3fc9a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.789230 Nov 06 21:04:50.053222 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2566/5196] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:49 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:50.064866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb24e173-a345-4c50-ba25-10e640da7d32 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.767720 Nov 06 21:04:50.074604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:50.074604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:50.075971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2631/5197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:49 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:50.078740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.079980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.080824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.081272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.269194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:50.269816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:50.281556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.282051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.282689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.290660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.575383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:50.608164 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b19f215a-95a2-4d2d-bc37-cdfd8ba4d53c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1321 microversion: 2.1 time: 0.553377 Nov 06 21:04:50.621820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2567/5198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:50 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:50.628562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:50.630373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:50.654450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.655279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:50.656543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:50.659405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:51.038402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:51.060423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:51.065347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:51.075693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f65d119d-2e3b-4534-8f70-cfa930f5b90e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.811509 Nov 06 21:04:51.076409 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2632/5199] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:50 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:51.092931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:51.095145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:51.122579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:51.132366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:51.133509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:51.136311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:51.310756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:51.325662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5af04463-3479-4d5d-8998-4e19c4b40a2d tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1513 microversion: 2.1 time: 0.702126 Nov 06 21:04:51.328874 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2568/5200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:50 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1513 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:51.340317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:51.343369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:51.359309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:51.361139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:51.362231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:51.364097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:52.261849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:52.270890 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-621160e8-9004-4579-bf6e-d33bb3c262b6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 1.192036 Nov 06 21:04:52.271259 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2633/5201] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:51 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:52.286738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8b9f091e-a524-4986-b2ec-d838af3f8e44 req-2e9dffb0-126b-497e-adee-ba4e020050c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc2b920-2680-4f38-acce-5220d6dcc981", "tag": "90b8b9b0-a8f0-48a1-905b-e533c76adf75"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:52.290289 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:52.290289 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:52.343284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b9f091e-a524-4986-b2ec-d838af3f8e44 req-2e9dffb0-126b-497e-adee-ba4e020050c9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:52.343751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b9f091e-a524-4986-b2ec-d838af3f8e44 req-2e9dffb0-126b-497e-adee-ba4e020050c9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:52.366002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8b9f091e-a524-4986-b2ec-d838af3f8e44 req-2e9dffb0-126b-497e-adee-ba4e020050c9 service nova] Creating event network-changed:90b8b9b0-a8f0-48a1-905b-e533c76adf75 for instance bcc2b920-2680-4f38-acce-5220d6dcc981 on nch2-master-1 Nov 06 21:04:52.372103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8b9f091e-a524-4986-b2ec-d838af3f8e44 req-2e9dffb0-126b-497e-adee-ba4e020050c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095587 Nov 06 21:04:52.373324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2634/5202] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:52.379353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:52.382224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:52.398305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:52.399074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:52.400082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:52.400973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:52.568711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:52.581237 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07e45fd7-63a4-4851-8759-b51adb34175c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 1.250538 Nov 06 21:04:52.592025 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2569/5203] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:51 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:52.619784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:52.623480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:52.639586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:52.644074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:52.647393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:52.649799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.149804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.160421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce5e9823-0d5c-49df-91d9-14148c9c8298 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1512 microversion: 2.1 time: 0.785425 Nov 06 21:04:53.161026 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2635/5204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:52 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1512 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:53.176626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:53.178160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:53.190386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.190841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.191647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.200854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.360889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.371273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b6a5612-3f69-4fe4-bf2d-c49a862f243e tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.206804 Nov 06 21:04:53.372792 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2636/5205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:53 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:53.380875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a666cea7-4a73-4406-928f-a1685118a170 req-836c302c-c322-4c83-8782-0b08635ba558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91687b9e-e2f0-4d54-b588-03aedc5067a4", "tag": "a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:53.383703 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:53.383703 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:53.392211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.393985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a666cea7-4a73-4406-928f-a1685118a170 req-836c302c-c322-4c83-8782-0b08635ba558 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.394809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a666cea7-4a73-4406-928f-a1685118a170 req-836c302c-c322-4c83-8782-0b08635ba558 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.405786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.409041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.412607 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a666cea7-4a73-4406-928f-a1685118a170 req-836c302c-c322-4c83-8782-0b08635ba558 service nova] Creating event network-changed:a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a for instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 on nch2-master-1 Nov 06 21:04:53.419016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a666cea7-4a73-4406-928f-a1685118a170 req-836c302c-c322-4c83-8782-0b08635ba558 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044649 Nov 06 21:04:53.420973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2637/5206] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:53.422202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc20dbd4-5db3-4265-adfd-bd154f4c52d6 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.827431 Nov 06 21:04:53.429129 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2570/5207] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:52 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:53.431933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:53.432982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:53.442895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.444422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.445877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:53.446082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.446820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.449714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:53.464801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.472576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.473923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.474588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.836030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.843915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-210651db-3f56-40ed-bd5c-0b2ebd6f90e4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1513 microversion: 2.1 time: 0.421568 Nov 06 21:04:53.850216 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2638/5208] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:53 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:53.864011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:53.866764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:53.876161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.876685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.877528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.878598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.884657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:53.907759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c68c7754-4889-4083-bd5b-9ebc56cc94b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.474092 Nov 06 21:04:53.908635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2571/5209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:53 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:53.934013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:53.934636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:53.948438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.948910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:53.950590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:53.951045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.196007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.205288 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b43e7ef0-d7b7-4b83-aec8-dcf88e0420ae tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.353578 Nov 06 21:04:54.220807 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2639/5210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:53 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:54.388953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.393085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:54.394344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:54.401193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.404676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.405730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.406362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.410751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a476e05-31dd-4e43-91e4-6e1ae5c1c857 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1512 microversion: 2.1 time: 0.501029 Nov 06 21:04:54.423084 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2572/5211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:53 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:54.429123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:54.432706 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:54.432706 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:54.433686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.434548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:54.449747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.450211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.451194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.451642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.541380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.550878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-817c1f60-58c4-4090-a132-baa9e659f9c8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.162383 Nov 06 21:04:54.561258 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2640/5212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:54 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:54.567990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:54.568832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:54.598375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.598831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.605657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.606120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.629050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:54.723698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.734228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.734750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.909456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.929495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.938575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:54.939803 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b8db8889-cad1-41ac-b540-d4ced5c96e22 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.377199 Nov 06 21:04:54.941018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2641/5213] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:54 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:54.954509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9b011ddc-8279-4686-b1a3-e0c484b97a06 req-6a3d4c40-0ee4-4cf1-aef6-fe0c8245551f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79fdfc6-af27-4e6a-922f-79691509293f", "name": "network-vif-deleted", "tag": "ee23c91d-21d9-4c38-8b57-b3b665ebe030"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:54.956073 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:54.956073 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:54.964985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9b011ddc-8279-4686-b1a3-e0c484b97a06 req-6a3d4c40-0ee4-4cf1-aef6-fe0c8245551f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:54.965441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9b011ddc-8279-4686-b1a3-e0c484b97a06 req-6a3d4c40-0ee4-4cf1-aef6-fe0c8245551f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:54.978582 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9b011ddc-8279-4686-b1a3-e0c484b97a06 req-6a3d4c40-0ee4-4cf1-aef6-fe0c8245551f service nova] Creating event network-vif-deleted:ee23c91d-21d9-4c38-8b57-b3b665ebe030 for instance a79fdfc6-af27-4e6a-922f-79691509293f on nch2-master-1 Nov 06 21:04:54.990578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9b011ddc-8279-4686-b1a3-e0c484b97a06 req-6a3d4c40-0ee4-4cf1-aef6-fe0c8245551f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048144 Nov 06 21:04:54.991674 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2642/5214] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:04:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:54.998223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:54.999401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:55.010860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.011618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.012829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.013448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.027430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c3a6f33-743e-40f1-98b5-a3500084f9dd tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.601826 Nov 06 21:04:55.028145 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2573/5215] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 21:04:54 2021] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:55.046851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:55.050529 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:55.050529 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:55.051902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:55.052710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2004035721', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:55.058588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.059384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.071846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.072656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.330141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:55.338866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac853a78-9c2a-46ac-a497-c31a21b9415c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.345651 Nov 06 21:04:55.340494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2643/5216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:54 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:55.358365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:55.359486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:55.372880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.383177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.384401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.385076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.524387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:55.709699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:55.717895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:55.721245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.722034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.746452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebbf1b9c-787a-403d-92f6-092e4de54285 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.390249 Nov 06 21:04:55.752437 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2644/5217] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:55 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:55.761852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:55.762924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:55.769495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.770398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.771572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.773290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.879065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:55.905585 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb21b652-04d3-405f-8e8c-3b16ad98abe0 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.151741 Nov 06 21:04:55.906180 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2645/5218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:55 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:55.965757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:55.966660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:55.976864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.977589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:55.981880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:55.982669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.039609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9465f86-ff70-446c-a67a-72862d6af58c tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2004035721" status: 200 len: 1516 microversion: 2.1 time: 0.996630 Nov 06 21:04:56.042409 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2574/5219] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:04:55 2021] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2004035721 => generated 1516 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:56.065093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:56.076356 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:56.076356 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:56.081548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.082436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:56.096615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.100183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.114028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.114946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.296857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:56.301283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.316884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.322370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.327470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d5ff97b-880c-421a-9c74-39545cb555cb tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.367199 Nov 06 21:04:56.329770 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2646/5220] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:55 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:04:56.362233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:56.363044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:56.372062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.386264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.387305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.387890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.509350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.551860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.552547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.845856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:56.857937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9bd8832e-0487-49c1-875e-1db5c4ece51f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.501808 Nov 06 21:04:56.858806 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2647/5221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:56 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:04:56.869892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:56.873074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:56.891420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.891873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.892711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:56.893323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:56.995257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49cb1642-6263-4c04-9c1e-65684f5aea18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.938854 Nov 06 21:04:56.997685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2575/5222] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Nov 6 21:04:56 2021] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:57.002996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:57.003704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:57.028361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.030174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.031874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.034181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.193161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.215951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4c6ae3d-f773-4792-b126-a35ae9752878 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.214373 Nov 06 21:04:57.229506 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2576/5223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:56 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:57.241319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:57.243019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.251598 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e300e90b-ca63-4d51-b09f-d203d25ca075 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.389559 Nov 06 21:04:57.258459 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:57.258459 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:57.262562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.263288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.servers [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Removing options 'limit' from query {{(pid=134828) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 06 21:04:57.264080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:57.273660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.273831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2648/5224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:56 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:57.274462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.275286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.275789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.348419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:57.349043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:57.362707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.367506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.367967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.368813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.368947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.369255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.369381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.692878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d6b14be-aaa3-42e1-98a2-5b3a028d4402 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.462132 Nov 06 21:04:57.694098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2577/5225] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 21:04:57 2021] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:57.702267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.721237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:57.724539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.725007 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:57.725007 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:57.726094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.726808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:57.726977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:57.730156 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe151b20-c682-48ba-bf4b-060f0aefbe41 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.386934 Nov 06 21:04:57.731527 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2649/5226] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:57 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:57.754208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.754665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.755615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.756055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.886952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:57.888191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:57.896872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.901169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.902664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:57.903791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:57.946333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:58.107631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87f3882a-4678-4cd0-997d-43be3173edec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.392241 Nov 06 21:04:58.117136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2578/5227] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:04:57 2021] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.122086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.126305 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:58.126305 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:04:58.127817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.128601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.servers [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Removing options 'limit' from query {{(pid=134828) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 06 21:04:58.130475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:58.152747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.153421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.154428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.155116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.209431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:58.236591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.244877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33c4d133-daea-4c8e-9380-692e7d2e52b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.373537 Nov 06 21:04:58.251953 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2650/5228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:57 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.263492 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc697f7f-5e72-4fe9-b033-4dd9a4b035fb tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.143982 Nov 06 21:04:58.270392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.281228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:58.283978 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2579/5229] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.293718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.294268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.294935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.295833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:58.296928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.299839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.314466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.321060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.322180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.322897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.450419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.459589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a398c609-6a72-4c42-b5e7-772e4c164c36 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.206145 Nov 06 21:04:58.469969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2651/5230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.474960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.479225 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:58.479225 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:58.489416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.490695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:58.496807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.501483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.502912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.503590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.585452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:58.665478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-30a7145d-488c-4037-9434-7628e548b752 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.193274 Nov 06 21:04:58.674941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2652/5231] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers => generated 1012 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.684419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.712463 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:58.712463 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:58.713906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.714761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:58.754702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.755487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.757069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.757727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.788002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:58.801847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de9ccf01-9fe2-4597-ba31-501f9148b4a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.516466 Nov 06 21:04:58.802750 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2580/5232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:04:58.810644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:58.811265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:58.827561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.828416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.831149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:58.832854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:58.924561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:59.028901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afda2345-0deb-4976-af0c-dcab3378c257 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.352603 Nov 06 21:04:59.029801 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2653/5233] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:59.048638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:59.061769 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:59.061769 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:59.063807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:59.064478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.compute.servers [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Removing options 'limit' from query {{(pid=134827) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 06 21:04:59.065324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:59.071235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.071941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.074923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.075695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.118038 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edc441ea-9609-4995-ba12-a5f7131f83d0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.072914 Nov 06 21:04:59.127948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2654/5234] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Nov 6 21:04:59 2021] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:59.133528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:59.137806 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:04:59.137806 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:04:59.139475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:59.140464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2004035721', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:04:59.146586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.147364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.148891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.149649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.205204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:59.219980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:59.222842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:04:59.227689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7035f1f1-509b-47bc-8b9a-777f99de648e tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.421293 Nov 06 21:04:59.229826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2581/5235] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:04:58 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:04:59.270736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:59.271362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:59.284286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:04:59.287221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.287742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.289184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.295174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.390874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac7f3215-a613-4330-85ce-611951df1f3a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2004035721" status: 200 len: 346 microversion: 2.1 time: 0.261101 Nov 06 21:04:59.391619 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2655/5236] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 21:04:59 2021] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2004035721 => generated 346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:04:59.424520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b84396b-7377-4eb3-a5ea-789d5e0eb1fa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:04:59.445478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b84396b-7377-4eb3-a5ea-789d5e0eb1fa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.459994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b84396b-7377-4eb3-a5ea-789d5e0eb1fa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.548254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b84396b-7377-4eb3-a5ea-789d5e0eb1fa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:04:59.680190 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b84396b-7377-4eb3-a5ea-789d5e0eb1fa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "POST /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235/action" status: 202 len: 0 microversion: 2.1 time: 0.274871 Nov 06 21:04:59.682359 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2656/5237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:04:59 2021] POST /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:04:59.695151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:04:59.696198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:04:59.713349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.714198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:04:59.718583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:04:59.719918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.262617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:00.282416 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf5c5e2d-62f7-49f7-bb88-2c607621319c tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.598228 Nov 06 21:05:00.304133 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2657/5238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:59 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:00.309381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:00.309995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:00.316728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.317210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.318008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.318651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.546135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:00.591759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06431ad0-533f-459a-9943-ccdf72ffe881 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 1.332497 Nov 06 21:05:00.596534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2582/5239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:04:59 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:00.606579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:00.620720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:00.630118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.630850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.632026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.633898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.793028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:00.814682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88a1df32-6468-4720-9256-97ae8737a5e6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.497781 Nov 06 21:05:00.818232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2658/5240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:00 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:00.831567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:00.834131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:00.847217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.847976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:00.861957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:00.863038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.036451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.048669 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81ad85b1-8f62-4a26-b733-3f7ac16aa797 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.448842 Nov 06 21:05:01.050216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2583/5241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:00 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:01.191575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.204414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.208935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.211235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afc81543-03b7-495a-b7e1-cd4abba0308d tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.391969 Nov 06 21:05:01.223941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2659/5242] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:00 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:01.312682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:01.313490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:01.322433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.322881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.323723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.324168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.488175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.503368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5286ac5d-90dc-4a9b-9717-246561842ce8 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.195659 Nov 06 21:05:01.503965 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2584/5243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:01 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:01.619879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:01.621447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:01.634542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.634982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.635784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.636222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.835374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:01.836772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:01.845263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.845805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.846700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:01.847244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:01.893222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:01.904964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa15d120-2d03-41f8-932c-bc597e2544ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.288339 Nov 06 21:05:01.905740 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2660/5244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:01 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:02.068249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:02.070288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:02.076674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.077126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.077919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.078360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.117450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.126691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1eb6a8b-cd11-44c5-b25c-069ccce401a2 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.294907 Nov 06 21:05:02.144124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2585/5245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:01 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:02.232744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:02.234164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:02.242077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.242541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.243376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.244046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.358587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.367911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-848eb11d-1b10-49bb-a36a-c74467f18229 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.305184 Nov 06 21:05:02.371498 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2661/5246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:02 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:02.525158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:02.525158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:02.529502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.530028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.530838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.531285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.578940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.593728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.595589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.597031 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41805d34-3a3f-4434-9d9e-d2eafe427f29 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.369290 Nov 06 21:05:02.608100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2586/5247] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:02 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:05:02.627756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:02.635792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f9b9e65-ad14-4bb8-b83e-0b490eb47fc4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.117091 Nov 06 21:05:02.636397 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2662/5248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:02 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:02.934385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:02.935816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:02.945353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.946096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:02.947117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:02.947563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.133939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:03.143216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-150e2349-b0f5-40e0-885b-f50a2d375a78 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.222934 Nov 06 21:05:03.143963 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2587/5249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:02 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:03.145485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:03.148326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:03.159291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.163269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.163269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.163269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.366854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:03.373222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-861a5779-b9ad-4787-ac1d-af3ca0ae2531 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.231958 Nov 06 21:05:03.374143 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2663/5250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:03 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:03.392681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:03.393614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:03.402273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.408553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.409606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.410152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.622165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:03.622712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:03.637790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.638458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.648656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.649522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.658090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:03.677701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac490d3b-fe75-40cd-acef-7eba7a6ec054 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.290480 Nov 06 21:05:03.687035 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2588/5251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:03 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:03.693874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:03.694806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:03.714430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.717108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.718015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:03.719622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:03.919826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:03.935077 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-320c4114-8f33-4363-b2de-198c569b9fa3 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.246903 Nov 06 21:05:03.936456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2589/5252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:03 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:04.130279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.140054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.142542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.143702 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6c8716ee-683b-43a0-987c-97525b9c9d38 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.528940 Nov 06 21:05:04.144441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2664/5253] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:03 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:05:04.160044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:04.160685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:04.174515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.174982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.175794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.176237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.350054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.364322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53979140-6eba-4091-a87d-70143549a1dc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.208398 Nov 06 21:05:04.365278 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2590/5254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:04 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:04.393298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:04.393821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:04.402389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.403734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.404627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.405124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.547405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.554787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a143a1bf-ec2d-47e4-ade2-83203610c265 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.168153 Nov 06 21:05:04.555494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2665/5255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:04 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:04.694739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:04.695359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:04.701290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.701749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.702536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.702976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.863129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:04.873117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-02acb379-90a0-432e-83fa-9687c70b625b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.181984 Nov 06 21:05:04.873887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2591/5256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:04 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:04.954644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:04.955263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:04.961073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.961522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:04.962302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:04.962963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.029774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.040720 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54f11375-bd65-42bb-8d29-b86b0135a317 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.089764 Nov 06 21:05:05.041301 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2666/5257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:04 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:05.162672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:05.163296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:05.170345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.170833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.171654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.172102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.312269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.315418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.319559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.319559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17e5c41d-f1b2-4c4b-a8a6-9fc981ddb507 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.159771 Nov 06 21:05:05.319559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2592/5258] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:05 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:05.386248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:05.387148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:05.393601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.394081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.394873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.395308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.532236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.539945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59412bef-09c7-4541-8e1d-bb31064bace3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.162123 Nov 06 21:05:05.540788 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2667/5259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:05 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:05.572566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:05.573193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:05.580190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.580729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.582847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.583321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.718333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:05.726266 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f05f6f3b-745e-4b69-bf4d-d4a9d94be124 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.157755 Nov 06 21:05:05.726839 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2593/5260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:05 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:05.890677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:05.893332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:05.897662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.898110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:05.898892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:05.899323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.040811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.048517 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb1d2410-b23f-4ffb-a5e6-a33ae14c82cd tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.161715 Nov 06 21:05:06.049084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2668/5261] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:05 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:06.058784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:06.059394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:06.066051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.066507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.067290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.067728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.133543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.141637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32e76627-f8d5-4ea4-b7ac-415968b456ec tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.086962 Nov 06 21:05:06.151805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2594/5262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:06 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:06.335817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:06.336454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:06.342427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.342880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.343653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.344120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.488979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.497507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.499149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.501095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c17f7f1-dc63-4e05-85f4-4b0b5f6c1673 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.168407 Nov 06 21:05:06.501963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2669/5263] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:06 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:05:06.557760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:06.558371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:06.565262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.565772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.566582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.567045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.703126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.710769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6cec53e-ab75-4602-81f0-0545470b7e8c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.156447 Nov 06 21:05:06.711113 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2595/5264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:06 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:06.742522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:06.743162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:06.749158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.749611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.750430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:06.750859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:06.886820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:06.894934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07ec1cfe-6580-41f4-8f7c-aab209a0d567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.156028 Nov 06 21:05:06.895641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2670/5265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:06 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:07.065118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:07.065735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:07.071621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.072083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.072904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.073348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.159346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:07.160320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:07.168801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.169638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.171155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.172040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.303747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f0d0ae2ec04c7d83345adde94ecfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a348daabdd46089d7f635ca36b9f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:07.314868 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a5e7817-c24b-4b35-9b1a-7932fae41677 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 200 len: 1471 microversion: 2.1 time: 0.159700 Nov 06 21:05:07.315485 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2671/5266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:07 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:07.394558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:07.402145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c75df91-fff9-470e-8ad2-d7f9c23e53da tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.340568 Nov 06 21:05:07.402895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2596/5267] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:07 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:07.519514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:07.520133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:07.527178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.527689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.528531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.528971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.730634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:07.735976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:07.757371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.758924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.761796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.762264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.945495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:07.953539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:07.955053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:07.956209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aba7cf8d-f9e3-49f1-890c-38025039d22c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.441218 Nov 06 21:05:07.956790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2672/5268] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:07 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:07.961066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:07.961849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:07.967709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.968164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:07.969034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:07.969469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.172862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:08.180627 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67ce56a8-3326-4a1a-b4c8-30d014e75186 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.455931 Nov 06 21:05:08.192981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2597/5269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:07 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:08.333149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:08.334691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] [instance: a79fdfc6-af27-4e6a-922f-79691509293f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:08.345847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.346448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.348542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.349810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.379570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:08.393928 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d276bdf-a611-4368-af57-6411cfd0b8c4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.432691 Nov 06 21:05:08.395718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2673/5270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:07 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:08.406352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] HTTP exception thrown: Instance a79fdfc6-af27-4e6a-922f-79691509293f could not be found. Nov 06 21:05:08.407541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] Returning 404 to user: Instance a79fdfc6-af27-4e6a-922f-79691509293f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:08.408449 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbfa54f8-a2b9-4ec0-914a-9bb8392f84f4 tempest-VolumesAdminNegativeTest-1108999452 tempest-VolumesAdminNegativeTest-1108999452-project] 10.222.0.13 "GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f" status: 404 len: 111 microversion: 2.1 time: 0.080869 Nov 06 21:05:08.409232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2598/5271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:08 2021] GET /compute/v2.1/servers/a79fdfc6-af27-4e6a-922f-79691509293f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:05:08.422575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:08.427800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:08.449931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.455358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.456708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.457418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.845954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:08.854404 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8b95063-3b01-4a8f-9c4e-e7660807ead4 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.437155 Nov 06 21:05:08.855119 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2674/5272] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:08 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:08.974573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:08.975433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:08.983410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.984007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:08.984986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:08.985694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.148454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:09.156479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:09.158345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:09.159535 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-139fc17d-41db-4786-8ecb-e88b57af2159 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.188934 Nov 06 21:05:09.160102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2599/5273] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:08 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:09.208178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:09.208848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:09.214583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.215036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.215815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.216246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.349764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:09.360266 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3db35783-c554-4bef-a5f5-e9615d856dce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.155300 Nov 06 21:05:09.369684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2675/5274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:09 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:09.411598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:09.412216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:09.418853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.419326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.420095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.420566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.654675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:09.667300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec847abb-acb5-4d46-83c3-f037e775d8ba tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.255888 Nov 06 21:05:09.667300 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2600/5275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:09 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:09.872866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:09.874540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:09.886123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.886880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:09.887921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:09.888529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.180045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:10.181425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:10.192000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.192686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.193766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.201309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.409922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.418824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f44a449-3e53-426c-8e6e-7954f26d09a5 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.551118 Nov 06 21:05:10.429368 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2676/5276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:09 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:10.434397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:10.435010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:10.443165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.443629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.445009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.445452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.534524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.543177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.544795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.546059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f787dfdb-b430-4a22-81b6-5b1fac294f11 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.371509 Nov 06 21:05:10.556530 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2601/5277] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:10 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:10.647097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.654301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10354b0a-a720-4bb6-8478-1584c5123dfd tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.223644 Nov 06 21:05:10.654873 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2677/5278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:10 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:10.681806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:10.682590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:10.689342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.689811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.690612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:10.691063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:10.837363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:10.845422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2a49e4e-f2f9-46df-ac30-dfc6806880b6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.167248 Nov 06 21:05:10.846151 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2602/5279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:10 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:11.441466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:11.442236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:11.450599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.451380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.452328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.454421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.564520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:11.566659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:11.574462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.575139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.575941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.576594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.753649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:11.761995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b00ad33-4259-40d6-943c-7b4415e2aa30 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.329551 Nov 06 21:05:11.763136 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2678/5280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:11 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:11.768775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:11.769606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:11.775790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.780732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.781901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.783915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.894383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:11.905005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:11.906609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:11.908084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12e1d557-c0be-42b8-aac0-f084a137bf5b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.347340 Nov 06 21:05:11.909421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2603/5281] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:11 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:05:11.914365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:11.915206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:11.922226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.923246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:11.924236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:11.924866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:12.075299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:12.084184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5beefa6-d456-4795-a1cb-c99a920828ea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.319834 Nov 06 21:05:12.092608 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2679/5282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:11 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:12.159498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:12.169920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-282e085a-2f03-491d-9c70-f24f4057a562 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.259132 Nov 06 21:05:12.171044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2604/5283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:11 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:12.622886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bb768a4-9c11-4151-ac7b-719d59fda45c tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.636311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bb768a4-9c11-4151-ac7b-719d59fda45c tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.169474 Nov 06 21:05:12.637725 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2680/5284] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:12.648520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25d87d13-1cec-4688-afaf-7ee6516d149d tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.668436 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25d87d13-1cec-4688-afaf-7ee6516d149d tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.023453 Nov 06 21:05:12.669188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2605/5285] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors => generated 2594 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:12.681365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86c4477e-89b5-4cc0-a290-1c287b6dae76 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.690843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86c4477e-89b5-4cc0-a290-1c287b6dae76 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012983 Nov 06 21:05:12.698360 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2681/5286] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:12.710952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-197cc8a0-f0b1-449c-877e-e8404821dfd8 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.720611 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-197cc8a0-f0b1-449c-877e-e8404821dfd8 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013783 Nov 06 21:05:12.721370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2606/5287] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:12.732820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e6a5f72-e2cd-4a18-b09a-f30a1fd4c56a tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.758969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e6a5f72-e2cd-4a18-b09a-f30a1fd4c56a tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.030545 Nov 06 21:05:12.759922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2682/5288] 10.222.0.13 () {58 vars in 1164 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:12.773394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b896585c-1cf8-43a9-bee6-a3af3dfba231 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.779471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.780383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:12.782277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b896585c-1cf8-43a9-bee6-a3af3dfba231 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012260 Nov 06 21:05:12.782861 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2607/5289] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:12.787011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:12.787459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:12.788683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:12.789339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:12.793384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8dd3669-ef66-4ab5-a0ae-650e0fb31d93 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.817089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8dd3669-ef66-4ab5-a0ae-650e0fb31d93 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.027721 Nov 06 21:05:12.819064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2608/5290] 10.222.0.13 () {58 vars in 1168 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:12.831462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fef997f-adc9-4371-8829-7105a2098b76 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.842638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fef997f-adc9-4371-8829-7105a2098b76 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.014862 Nov 06 21:05:12.843304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2609/5291] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:12.855555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3d55c26-a660-41c5-b27d-4ce99a3902ac tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.864241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3d55c26-a660-41c5-b27d-4ce99a3902ac tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012233 Nov 06 21:05:12.865019 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2610/5292] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:12.875256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae9d935b-51b4-4e8e-80dc-3e41f7a305ec tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.916342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae9d935b-51b4-4e8e-80dc-3e41f7a305ec tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044868 Nov 06 21:05:12.917370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2611/5293] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:12.928214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:12.928938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:12.934843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:12.935306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:12.936110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:12.936594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:13.079476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.097735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15b9af62-76a2-47b3-a9c8-e2a193a5399a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.322186 Nov 06 21:05:13.100152 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2683/5294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:13.112249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-807c7f2d-e05f-468d-a308-741a20358852 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.124208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-807c7f2d-e05f-468d-a308-741a20358852 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015466 Nov 06 21:05:13.124828 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2684/5295] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:13.129969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.130884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:13.136699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:13.137413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:13.138209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:13.139033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:13.252591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.262332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.264134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.265619 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17a7cd5a-0868-42aa-a580-6fa12d539d1b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.342432 Nov 06 21:05:13.277143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2612/5296] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:12 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:05:13.282125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b053c504-5089-4e50-b389-43b691f71cc3 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.307545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b053c504-5089-4e50-b389-43b691f71cc3 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.028819 Nov 06 21:05:13.308580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2613/5297] 10.222.0.13 () {58 vars in 1143 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:13.313610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.315327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:13.322290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:13.323176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:13.324166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:13.324808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:13.460119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.467960 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e67e86e-8c38-4406-8fa9-8eb861aced94 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.341834 Nov 06 21:05:13.468474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2685/5298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:13.473643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2059c8c5-c948-4279-91e9-e4d6a1c7ab77 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.482538 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2059c8c5-c948-4279-91e9-e4d6a1c7ab77 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012945 Nov 06 21:05:13.483403 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2686/5299] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:13.493532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4bcc701-84bb-48b4-b90c-f7ec0a2c7564 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.517301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4bcc701-84bb-48b4-b90c-f7ec0a2c7564 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.027215 Nov 06 21:05:13.517828 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2687/5300] 10.222.0.13 () {58 vars in 1147 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:13.529206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12333b20-2590-43a0-b1ab-e828e74e37e3 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.540713 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12333b20-2590-43a0-b1ab-e828e74e37e3 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.014889 Nov 06 21:05:13.541258 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2688/5301] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:13.551886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f932e21f-9da1-4727-aae3-76212e1437f9 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.559540 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f932e21f-9da1-4727-aae3-76212e1437f9 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011127 Nov 06 21:05:13.560092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2689/5302] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:13.566973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:13.570317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e20768d0-6d58-4d30-b544-68388e19ec03 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.574772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e754a06f-6fef-4fd1-9146-cf8e1b30e788 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.265020 Nov 06 21:05:13.575441 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2614/5303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:13.605144 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e20768d0-6d58-4d30-b544-68388e19ec03 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.037981 Nov 06 21:05:13.605932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2690/5304] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:13.618186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62bfc802-14f0-413c-9414-58806198efa6 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.637490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62bfc802-14f0-413c-9414-58806198efa6 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023020 Nov 06 21:05:13.638169 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2615/5305] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:13.653109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da1062cd-8b24-4dee-a043-701594e781e4 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:13.661733 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da1062cd-8b24-4dee-a043-701594e781e4 tempest-FlavorsV2TestJSON-794856025 tempest-FlavorsV2TestJSON-794856025-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013379 Nov 06 21:05:13.662503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2691/5306] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:05:13 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:14.115654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:14.116273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:14.123867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.124623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.125470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.125919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.286601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:14.287302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:14.301850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.302398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.303955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.304512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.314058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.325819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1615d6fd-d96c-466f-8184-6a495742449e tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.213572 Nov 06 21:05:14.327376 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2616/5307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:14 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:14.498014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:14.502337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:14.519213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.527879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.529322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.532171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.533075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.539048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.545051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.548147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2425b75-8c50-4739-b809-fbeede9d3ae8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.266842 Nov 06 21:05:14.548831 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2692/5308] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:14 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:14.594752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:14.595687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:14.602994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.603687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.604666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:14.605264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:14.834411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.841720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6529465b-b458-4372-bccf-c3f2fbb7d064 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.360296 Nov 06 21:05:14.842507 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2617/5309] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:14 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:14.914103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:14.935344 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8439067-361f-43d9-b36c-0951e949dce1 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.345575 Nov 06 21:05:14.936574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2693/5310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:14 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:15.345770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:15.346992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:15.359135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.360095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.364769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.365626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.566214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:15.566926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:15.580521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.581389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.583504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.584235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.660115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:15.671311 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f27549aa-473f-4fe7-a716-47305b5e81e2 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.330327 Nov 06 21:05:15.672825 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2618/5311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:15 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:15.858680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:15.860058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:15.887139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.887467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.888323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.888769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:15.925097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:15.936016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:15.941728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:15.947405 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73516776-a072-4cc3-bf78-b46c1e7407c8 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.385256 Nov 06 21:05:15.948231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2694/5312] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:15 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:15.963470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4f657e9a-aaa8-42ca-a7ce-44e32568595b req-b8494e4c-93e2-4e6f-9667-035733abac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc2b920-2680-4f38-acce-5220d6dcc981", "name": "network-vif-plugged", "status": "completed", "tag": "90b8b9b0-a8f0-48a1-905b-e533c76adf75"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:15.965327 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:15.965327 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:15.986426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f657e9a-aaa8-42ca-a7ce-44e32568595b req-b8494e4c-93e2-4e6f-9667-035733abac0b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:15.987045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f657e9a-aaa8-42ca-a7ce-44e32568595b req-b8494e4c-93e2-4e6f-9667-035733abac0b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.012920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4f657e9a-aaa8-42ca-a7ce-44e32568595b req-b8494e4c-93e2-4e6f-9667-035733abac0b service nova] Creating event network-vif-plugged:90b8b9b0-a8f0-48a1-905b-e533c76adf75 for instance bcc2b920-2680-4f38-acce-5220d6dcc981 on nch2-master-1 Nov 06 21:05:16.034191 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4f657e9a-aaa8-42ca-a7ce-44e32568595b req-b8494e4c-93e2-4e6f-9667-035733abac0b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076578 Nov 06 21:05:16.035420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2695/5313] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:16.040581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:16.041523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:16.057868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.058898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.060139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.060851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.327148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:16.336089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa94f7e8-6f12-49cb-816b-fe5d1d5abed6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.481118 Nov 06 21:05:16.336712 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2619/5314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:15 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:16.519648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:16.534388 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eead07f2-a419-4957-87cb-6a37fc94cd18 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.497611 Nov 06 21:05:16.535018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2696/5315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:16 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:16.695966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:16.697526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:16.706265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.707050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.708227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.709484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.966931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:16.968929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:16.971097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:16.975062 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8a56679-0a08-473c-8cc5-891baf318339 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.288134 Nov 06 21:05:16.981722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.983449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:16.985637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:16.986095 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2620/5316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:16 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:16.987013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:17.355227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:17.356314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:17.363424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:17.363974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:17.365287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:17.365982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:17.421404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:17.430228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:17.431755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:17.432965 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-705d3471-3f2f-46ba-8f72-4e1985eb633b tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.470194 Nov 06 21:05:17.433652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2697/5317] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:16 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:17.551172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:17.551992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:17.558673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:17.559471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:17.560441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:17.560990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.103191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.120721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29a743a2-99aa-404e-abf7-f7dff67fa566 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1308 microversion: 2.1 time: 0.771362 Nov 06 21:05:18.121314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2621/5318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:17 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1308 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:18.126309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:18.126915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:18.132717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:18.133172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.133964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:18.134409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.168526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.178738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5bab5d3-ae48-41fa-84d8-b776cb3e2f35 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1523 microversion: 2.1 time: 0.630989 Nov 06 21:05:18.183146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2698/5319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:17 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:18.192995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "name": "network-vif-plugged", "status": "completed", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}, {"server_uuid": "91687b9e-e2f0-4d54-b588-03aedc5067a4", "name": "network-vif-plugged", "status": "completed", "tag": "a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:18.194754 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:18.194754 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:18.202939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:18.204160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.222845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] Creating event network-vif-plugged:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:05:18.223358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] Creating event network-vif-plugged:a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a for instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 on nch2-master-1 Nov 06 21:05:18.229862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8aad8112-3eab-47e9-a978-2ce7f429c14f req-f18d11a3-2b34-4a37-9c3e-4f310634f625 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043062 Nov 06 21:05:18.230463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2699/5320] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:18.454477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:18.455524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:18.463603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:18.464728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.466211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:18.466915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:18.621028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.635120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-234f958e-f701-4b9d-9588-c916405237c3 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.512314 Nov 06 21:05:18.644909 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2622/5321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:18 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:18.817248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.831397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.833959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:18.835402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8762c1c-c65c-43e1-984f-8e087d2e8fcd tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.386016 Nov 06 21:05:18.836494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2700/5322] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:18 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:19.137782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:19.139170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:19.147787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.148786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.149814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.150609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.196829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:19.197996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:19.215304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.216012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.217040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.217668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.482712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:19.492085 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66397437-2d34-465a-b6e6-d554027f8aea tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1488 microversion: 2.1 time: 0.357445 Nov 06 21:05:19.507031 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2623/5323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:19 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1488 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:19.612776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:19.627069 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38a6422c-da9f-46d3-bf79-505af3d03a0a tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1500 microversion: 2.1 time: 0.433844 Nov 06 21:05:19.627658 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2701/5324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:19 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:19.633899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-468499016", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:19.650748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:19.654557 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:19.654557 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:19.660817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:19.662217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:19.675336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.676081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.678464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.679093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.693907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:05:19.717614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:19.755682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0941802c-048f-4245-bd36-c623caff9761 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.108705 Nov 06 21:05:19.756652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2702/5325] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Nov 6 21:05:19 2021] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:19.761766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:19.771123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:19.777093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.777845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:19.778896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:19.780227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.139873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:20.147391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74a64b21-866a-4a9e-ae16-1cfbde915687 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1468 microversion: 2.1 time: 0.389455 Nov 06 21:05:20.151813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2703/5326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:19 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:20.158275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54dd6fe7-806a-4041-acd1-fdee68d4d1af tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:20.174258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54dd6fe7-806a-4041-acd1-fdee68d4d1af tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.176525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54dd6fe7-806a-4041-acd1-fdee68d4d1af tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.212683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54dd6fe7-806a-4041-acd1-fdee68d4d1af tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Going to try to start instance {{(pid=134827) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 21:05:20.289488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54dd6fe7-806a-4041-acd1-fdee68d4d1af tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "POST /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235/action" status: 202 len: 0 microversion: 2.1 time: 0.135083 Nov 06 21:05:20.290637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2704/5327] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:05:20 2021] POST /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:05:20.301792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:20.307688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:20.321091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.322495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.324776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.325907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.900281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:20.911765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:20.913397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:20.914603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c89f57e1-1dc8-4238-8db4-8fa11aaac9e3 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1727 microversion: 2.20 time: 0.620592 Nov 06 21:05:20.933905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2705/5328] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:20 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1727 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:20.939161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:20.943965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:20.963155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:05:20.963639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:05:20.964429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:05:20.964818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:05:20.965435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:05:20.966277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.966742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.967571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.968188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.989245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.989918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:20.992053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:20.992549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:21.071031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:21.089966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:21.128866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:05:21.131348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:05:21.264918 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d52f7dbf-98d3-409b-9cba-146471c461bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624978 Nov 06 21:05:21.274196 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2624/5329] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:05:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:05:21.288116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:21.294356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:21.318111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:21.320346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:21.321402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:21.322872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:21.607387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:21.618399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbbef849-d780-45ca-acad-2b63bf140145 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1509 microversion: 2.1 time: 0.683331 Nov 06 21:05:21.627501 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2706/5330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:20 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:21.636907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c22b22ab-acd1-44a7-8b34-ee3cdd05b6ad tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:21.637746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c22b22ab-acd1-44a7-8b34-ee3cdd05b6ad tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:22.287976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c22b22ab-acd1-44a7-8b34-ee3cdd05b6ad tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.306228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.336553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c22b22ab-acd1-44a7-8b34-ee3cdd05b6ad tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1208 microversion: 2.1 time: 0.704738 Nov 06 21:05:22.342374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2707/5331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:21 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1208 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:22.345724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26ba6fb5-1b03-4428-9517-550cec461857 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1640 microversion: 2.1 time: 1.067535 Nov 06 21:05:22.349426 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2625/5332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:21 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1640 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:22.374139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:22.375589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:22.380599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:22.381321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:22.395710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.399717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.400342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.400676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.401918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.403717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.404239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.404993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.845438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.854691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.863105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.871738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca609266-31e7-42c6-b36e-06faf26de353 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1714 microversion: 2.20 time: 0.526250 Nov 06 21:05:22.876374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2708/5333] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:05:22 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1714 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:05:22.885703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:22.892556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:22.893437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:22.908905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c7593d4-2bb3-4508-92bb-9394f55f65e1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1640 microversion: 2.1 time: 0.546371 Nov 06 21:05:22.910773 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2626/5334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:22 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1640 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:22.914637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.927073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.936032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.940641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.943772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:22.944826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:22.957482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.959092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:22.960880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:22.962539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:23.450826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:23.459351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a061b15d-81ed-4229-855b-4735997b18e0 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1509 microversion: 2.1 time: 0.581627 Nov 06 21:05:23.462209 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2709/5335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:22 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1509 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:23.473748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:23.475589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:23.514854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:23.517273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:23.518939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:23.523035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:23.644577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:23.661127 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2a13fb5-265d-4f50-8f83-db1b738592bb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1266 microversion: 2.1 time: 0.192660 Nov 06 21:05:23.662773 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2710/5336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:23 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:23.979697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8997fe75-ecd8-41b6-a0b1-f3dfa955fc28 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1791 microversion: 2.1 time: 1.049941 Nov 06 21:05:23.992482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2627/5337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:22 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1791 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:24.273960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49ec68b6-76b1-4444-b2f2-4f69fd992f2f tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Calling method '.version_select at 0x7f6714a62790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:24.367854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49ec68b6-76b1-4444-b2f2-4f69fd992f2f tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.308693 Nov 06 21:05:24.368014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2711/5338] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 21:05:24 2021] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:05:24.382041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1747d40-5125-4b63-b849-8bc7764c4f67 tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Action: 'create', calling method: .version_select at 0x7f6715adb310>, body: {"pool": "non_exist_pool"} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:24.469657 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c1747d40-5125-4b63-b849-8bc7764c4f67 tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] HTTP exception thrown: Floating IP pool not found. Nov 06 21:05:24.471725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1747d40-5125-4b63-b849-8bc7764c4f67 tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Returning 404 to user: Floating IP pool not found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:24.472896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1747d40-5125-4b63-b849-8bc7764c4f67 tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.095767 Nov 06 21:05:24.473970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2628/5339] 10.222.0.13 () {60 vars in 1169 bytes} [Sat Nov 6 21:05:24 2021] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:05:24.493930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3134d810-ff42-4361-be06-0a6606a0e32b tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Calling method '.version_select at 0x7f6714a163a0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:24.504353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:24.504961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:24.537947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:24.538714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:24.541363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:24.542268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:24.606957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG neutronclient.v2_0.client [None req-3134d810-ff42-4361-be06-0a6606a0e32b tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e226a8e0-37ff-45db-b75c-5625dead06a9 could not be found", "detail": ""}} {{(pid=134827) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 06 21:05:24.608040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-3134d810-ff42-4361-be06-0a6606a0e32b tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] HTTP exception thrown: Floating IP not found for ID e226a8e0-37ff-45db-b75c-5625dead06a9 Nov 06 21:05:24.609756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3134d810-ff42-4361-be06-0a6606a0e32b tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] Returning 404 to user: Floating IP not found for ID e226a8e0-37ff-45db-b75c-5625dead06a9 {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:24.611056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3134d810-ff42-4361-be06-0a6606a0e32b tempest-FloatingIPsNegativeTestJSON-475458625 tempest-FloatingIPsNegativeTestJSON-475458625-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/e226a8e0-37ff-45db-b75c-5625dead06a9" status: 404 len: 111 microversion: 2.1 time: 0.130453 Nov 06 21:05:24.611807 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2712/5340] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:05:24 2021] DELETE /compute/v2.1/os-floating-ips/e226a8e0-37ff-45db-b75c-5625dead06a9 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:05:24.680829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:24.681804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:24.693536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:24.696283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:24.697613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:24.700038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:24.980157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:24.993387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7538a747-328b-4ae1-aecf-c13bdfec1717 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1513 microversion: 2.1 time: 0.494362 Nov 06 21:05:24.994174 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2629/5341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:24 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:25.019212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:25.022796 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:25.022796 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:25.024159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:25.025034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.compute.servers [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Removing options 'limit' from query {{(pid=134828) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 06 21:05:25.025885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:25.027481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.028105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.029341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.029961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.031903 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-230a7dd7-985f-47b6-9ccb-5fff8ec9e430 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.017503 Nov 06 21:05:25.041405 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2630/5342] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Nov 6 21:05:25 2021] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:05:25.046338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:25.047190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:25.053792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.054478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.055464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.056074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.114645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:25.124937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-196b9cc6-29cb-4f0d-8da2-20dae450a0e6 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.449761 Nov 06 21:05:25.125515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2713/5343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:24 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:25.471182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:25.494324 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4275e9cd-d3bd-47ad-896f-8479dd539995 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1513 microversion: 2.1 time: 0.445477 Nov 06 21:05:25.495654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2631/5344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:25 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:25.511648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:25.512250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:25.528161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.529016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.530044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.532487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.930139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:25.938402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f474e214-e030-4255-a67b-9314a4136f39 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1512 microversion: 2.1 time: 0.430443 Nov 06 21:05:25.948661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2714/5345] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:25 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:25.954113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:25.954712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:25.972616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.975228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:25.975228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:25.975228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:26.147036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:26.147650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:26.164150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:26.164838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:26.165828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:26.166439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:26.434124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:26.444860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-690ca76a-dca0-43e2-aead-0e94c9e04000 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1512 microversion: 2.1 time: 0.493549 Nov 06 21:05:26.447164 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2632/5346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:25 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:26.476727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:26.493218 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:26.493218 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:26.496672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:26.501294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:26.742797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:26.756022 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f0ea8c9-e8d8-4b4e-8695-61eab94493df tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.616096 Nov 06 21:05:26.768084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2715/5347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:26 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:26.842337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:26.842785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:26.844424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:26.845135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:26.986420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e453ae0a-255a-4874-913b-d83358d5acb5 req-9e9a6ed0-467a-46b6-83e0-e91961c26062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6123f97a-1c1d-4334-b05e-edb8cd2172de", "tag": "6903fd3d-34db-44a4-ad2d-fb2ddf711efe"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:26.988231 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:26.988231 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:27.004913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e453ae0a-255a-4874-913b-d83358d5acb5 req-9e9a6ed0-467a-46b6-83e0-e91961c26062 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:27.006449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e453ae0a-255a-4874-913b-d83358d5acb5 req-9e9a6ed0-467a-46b6-83e0-e91961c26062 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:27.028947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e453ae0a-255a-4874-913b-d83358d5acb5 req-9e9a6ed0-467a-46b6-83e0-e91961c26062 service nova] Creating event network-changed:6903fd3d-34db-44a4-ad2d-fb2ddf711efe for instance 6123f97a-1c1d-4334-b05e-edb8cd2172de on nch2-master-1 Nov 06 21:05:27.036258 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e453ae0a-255a-4874-913b-d83358d5acb5 req-9e9a6ed0-467a-46b6-83e0-e91961c26062 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055532 Nov 06 21:05:27.037433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2716/5348] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:27.073850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:27.194328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-412e73ad-0d79-4a02-ae3f-55e41b5bdebe tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.730111 Nov 06 21:05:27.196973 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2633/5349] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Nov 6 21:05:26 2021] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:27.211205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:27.211953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:27.227341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:27.227797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:27.229794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:27.231038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:27.775827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:27.777156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:27.790960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:27.791418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:27.792504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:27.797007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:28.089025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:28.099417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73a065d3-0b7e-439f-a68c-981f1b0a6f29 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1513 microversion: 2.1 time: 0.893551 Nov 06 21:05:28.102893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2717/5350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:27 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1513 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:28.119409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:28.120883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:28.134173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:28.134930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:28.135894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:28.139699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:28.479690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:28.490060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e91f894f-9b72-4aec-a1e4-a5ff90b4dd0b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.718966 Nov 06 21:05:28.492459 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2634/5351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:27 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:28.782954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:28.803097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f58a13d-9e09-4958-9c1e-3f8ab59ae417 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1512 microversion: 2.1 time: 0.681638 Nov 06 21:05:28.815487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2718/5352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:28 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1512 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:28.820580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:28.821756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:28.838808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:28.840939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:28.841862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:28.844842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:29.314194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:29.327014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31be774e-765b-47a2-afba-ddf3e609945d tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1512 microversion: 2.1 time: 0.510018 Nov 06 21:05:29.335580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2635/5353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:28 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:29.345849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:29.350304 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:29.350304 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:29.352097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:29.353336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:29.392619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:29.394737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:29.395591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:29.396039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:29.475983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:29.510260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:29.511025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:29.520006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:29.520920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:29.522934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:29.527273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:29.545505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:29.555604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:29.556349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:30.139890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:30.151778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b8dccae-b022-48b0-a23d-8fc9cd8c60f0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.645715 Nov 06 21:05:30.154148 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2636/5354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:29 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:30.173005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f0dd977-d940-4a22-8862-5e9696da21c9 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.832161 Nov 06 21:05:30.186444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2719/5355] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:05:29 2021] GET /compute/v2.1/servers/detail => generated 4520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:30.193838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:30.195335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9a8d7e60-1d45-4b35-be0a-321ea7cf8950 req-d11637fb-3368-47c9-90d0-afcbe28c2190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91687b9e-e2f0-4d54-b588-03aedc5067a4", "tag": "a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:30.196889 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:30.196889 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:30.198840 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:30.198840 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:30.204529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:30.206193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:30.225978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9a8d7e60-1d45-4b35-be0a-321ea7cf8950 req-d11637fb-3368-47c9-90d0-afcbe28c2190 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:30.226949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9a8d7e60-1d45-4b35-be0a-321ea7cf8950 req-d11637fb-3368-47c9-90d0-afcbe28c2190 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:30.264061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9a8d7e60-1d45-4b35-be0a-321ea7cf8950 req-d11637fb-3368-47c9-90d0-afcbe28c2190 service nova] Creating event network-changed:a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a for instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 on nch2-master-1 Nov 06 21:05:30.299041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9a8d7e60-1d45-4b35-be0a-321ea7cf8950 req-d11637fb-3368-47c9-90d0-afcbe28c2190 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141242 Nov 06 21:05:30.301321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2637/5356] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:30.711677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:30.712779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:30.714090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:30.714965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:30.986960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:31.172024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:31.173435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:31.178383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7a78746-b602-4f20-be65-1852f25cf4b5 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.990120 Nov 06 21:05:31.180669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2720/5357] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Nov 6 21:05:30 2021] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:31.194920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.196434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:31.199757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:31.201364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.204996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:31.211035 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:31.211035 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:31.212160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:31.220267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:31.232443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.232891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:31.233733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.234168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:31.498202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:31.655583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ff944b5-23e0-48e6-85b0-f3eeea923dce tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.465846 Nov 06 21:05:31.661945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2721/5358] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Nov 6 21:05:31 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:31.675506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:31.679647 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:31.679647 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:31.686000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:31.690921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:31.705290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.706828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:31.712941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:31.714149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.024063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:32.163511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c30e2cc-562c-45ff-8040-e0d72f84a789 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.493873 Nov 06 21:05:32.170148 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2722/5359] 10.222.0.13 () {58 vars in 1195 bytes} [Sat Nov 6 21:05:31 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:32.177187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:32.192767 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:32.192767 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:32.194366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:32.195625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': '2004035721', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:32.200718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:32.202053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.203177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.204094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.204674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.215029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3afad68-e36f-48ee-9b07-fd9459361a98 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 1.047624 Nov 06 21:05:32.215741 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2638/5360] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:31 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:32.338089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:32.710739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba970953-41eb-4721-bb52-93f46abe1201 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=2004035721" status: 200 len: 346 microversion: 2.1 time: 0.537066 Nov 06 21:05:32.711328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2723/5361] 10.222.0.13 () {58 vars in 1155 bytes} [Sat Nov 6 21:05:32 2021] GET /compute/v2.1/servers?name=2004035721 => generated 346 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:32.722605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:32.726069 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:32.726069 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:32.727072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:32.727825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:32.733577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.734623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.735440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.735881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.824790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:32.910515 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27305987-994f-46a0-9a57-fa87d1189c49 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.191403 Nov 06 21:05:32.917678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2639/5362] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Nov 6 21:05:32 2021] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:32.923636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:32.927327 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:32.927327 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:32.928619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:32.930722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-200403572', 'deleted': False, 'project_id': '84a119dc29614d80a2a5c5378eb09590'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:05:32.947095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.948492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:32.949367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:32.949807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.103383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:05:33.211750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7508c41-dba6-409b-9a14-7b8f189159ec tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-200403572" status: 200 len: 346 microversion: 2.1 time: 0.293097 Nov 06 21:05:33.212760 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2724/5363] 10.222.0.13 () {58 vars in 1227 bytes} [Sat Nov 6 21:05:32 2021] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-200403572 => generated 346 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:33.224715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:33.225295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:33.239820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.240440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.244322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.246198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:33.246455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:33.249285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.253606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.254663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.255658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.256272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.306049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:05:33.420778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ac76146-6b09-4e96-88b8-2b62eaa08bb3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 204 len: 0 microversion: 2.1 time: 0.199920 Nov 06 21:05:33.421678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2640/5364] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:05:33 2021] DELETE /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:05:33.430025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:33.431024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:33.437972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.438755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.439813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:33.440802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:33.563112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:33.573446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ce127c2-6380-4e6a-8acf-dd017e4ed618 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.339189 Nov 06 21:05:33.575368 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2725/5365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:33 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:33.637480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:33.647602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-991ee76b-5321-4ae8-9139-1c62c8f3fe8e tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1518 microversion: 2.1 time: 0.221569 Nov 06 21:05:33.648647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2641/5366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:33 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:34.597327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:34.600166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:34.618356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:34.619869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:34.620971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:34.622424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:34.664827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:34.665982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:34.674788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:34.675477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:34.676609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:34.677231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:34.958055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:34.977980 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e74761e1-dc0f-40d5-88cf-53041c094b25 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.379577 Nov 06 21:05:34.988256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2726/5367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:34 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:35.048070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:35.057039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87cc78cb-4833-499c-88c4-4e4eff25b2b8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1518 microversion: 2.1 time: 0.395984 Nov 06 21:05:35.068111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2642/5368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:34 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:36.006395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:36.007027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:36.022525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.022995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.023812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.024258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.075220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:36.075766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:36.087431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.088243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.093710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.095164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.254638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:36.287958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9215afcc-30e2-45e9-91d3-8cbf4ec212f4 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 200 len: 1476 microversion: 2.1 time: 0.216349 Nov 06 21:05:36.304782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2643/5369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:36 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:36.317369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-28a1703c-ecd2-495c-844d-de3c7a469871 req-0ce9e3d9-ef5b-4ffc-a2d3-1d5aa0237b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25636bb5-127e-4800-a20f-4153bee09788", "name": "network-vif-deleted", "tag": "35035f2f-8929-4edc-86d0-3f2e5d1182ab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:36.327220 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:36.327220 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:36.367419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-28a1703c-ecd2-495c-844d-de3c7a469871 req-0ce9e3d9-ef5b-4ffc-a2d3-1d5aa0237b9e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.367834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-28a1703c-ecd2-495c-844d-de3c7a469871 req-0ce9e3d9-ef5b-4ffc-a2d3-1d5aa0237b9e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.418267 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-28a1703c-ecd2-495c-844d-de3c7a469871 req-0ce9e3d9-ef5b-4ffc-a2d3-1d5aa0237b9e service nova] Creating event network-vif-deleted:35035f2f-8929-4edc-86d0-3f2e5d1182ab for instance 25636bb5-127e-4800-a20f-4153bee09788 on nch2-master-1 Nov 06 21:05:36.436208 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-28a1703c-ecd2-495c-844d-de3c7a469871 req-0ce9e3d9-ef5b-4ffc-a2d3-1d5aa0237b9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129852 Nov 06 21:05:36.442046 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2644/5370] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:36.482616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:36.500641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01608cb6-aacb-4c71-bd17-494ed347e3cb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.497337 Nov 06 21:05:36.501767 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2727/5371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:35 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:36.742555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ad0530ff-a73a-4761-ae45-ef5798cdcaba req-baa47e7e-3f1e-42da-a5f1-819d409a657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6123f97a-1c1d-4334-b05e-edb8cd2172de", "name": "network-vif-plugged", "status": "completed", "tag": "6903fd3d-34db-44a4-ad2d-fb2ddf711efe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:36.744255 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:36.744255 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:36.771671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ad0530ff-a73a-4761-ae45-ef5798cdcaba req-baa47e7e-3f1e-42da-a5f1-819d409a657b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:36.772123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ad0530ff-a73a-4761-ae45-ef5798cdcaba req-baa47e7e-3f1e-42da-a5f1-819d409a657b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:36.813482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ad0530ff-a73a-4761-ae45-ef5798cdcaba req-baa47e7e-3f1e-42da-a5f1-819d409a657b service nova] Creating event network-vif-plugged:6903fd3d-34db-44a4-ad2d-fb2ddf711efe for instance 6123f97a-1c1d-4334-b05e-edb8cd2172de on nch2-master-1 Nov 06 21:05:36.834757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ad0530ff-a73a-4761-ae45-ef5798cdcaba req-baa47e7e-3f1e-42da-a5f1-819d409a657b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101717 Nov 06 21:05:36.836620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2645/5372] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:37.307688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:37.308147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 25636bb5-127e-4800-a20f-4153bee09788] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:37.320190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.320689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.323814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.326456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.361138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] HTTP exception thrown: Instance 25636bb5-127e-4800-a20f-4153bee09788 could not be found. Nov 06 21:05:37.365362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Returning 404 to user: Instance 25636bb5-127e-4800-a20f-4153bee09788 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:37.366247 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f52ecdae-0474-4a10-aba2-ce9fba856a6f tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788" status: 404 len: 111 microversion: 2.1 time: 0.063205 Nov 06 21:05:37.366817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2728/5373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:37 2021] GET /compute/v2.1/servers/25636bb5-127e-4800-a20f-4153bee09788 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:05:37.377985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:37.378560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:37.391928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.396975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.397989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.398561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.457472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:05:37.518579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:37.519234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:37.527565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.527985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.528824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.532214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.671909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50a46146-2694-482b-abc9-63c28c23aee6 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 204 len: 0 microversion: 2.1 time: 0.297876 Nov 06 21:05:37.678320 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2646/5374] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:05:37 2021] DELETE /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:05:37.694569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:37.695431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:37.714533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.714992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.715799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:37.716478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:37.895636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:37.907954 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35503edc-a783-4add-9c92-f3c074b8ace2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.393684 Nov 06 21:05:37.908976 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2729/5375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:37 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:38.022911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:38.034637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-211772f1-cb19-43e4-9d99-7345d78fe722 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1518 microversion: 2.1 time: 0.351251 Nov 06 21:05:38.036570 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2647/5376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:37 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1518 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:38.926603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:38.928279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:38.943260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:38.944083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:38.945207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:38.946432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:39.053461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:39.056079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:39.073186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:39.074218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:39.076193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:39.076922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:39.304006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:39.327056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15940438-ddb2-45ab-87a3-978db4b18c84 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1308 microversion: 2.1 time: 0.404248 Nov 06 21:05:39.342420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2730/5377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:38 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:39.422786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:39.431161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db587b0a-afde-4b5b-b274-5dd4e0adf3c3 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1518 microversion: 2.1 time: 0.381754 Nov 06 21:05:39.444354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2648/5378] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:39 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1518 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:39.827437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'create', calling method: .version_select at 0x7f671ad43940>, body: {"keypair": {"name": "tempest-keypair-2124541079"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:39.879601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for project 23c3196631494be38ca11b2167bbc4bb. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:39.889234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for user b51fe86b5589475da23e549e5e4128aa and project 23c3196631494be38ca11b2167bbc4bb. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:40.039059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for project 23c3196631494be38ca11b2167bbc4bb. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:40.048163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for user b51fe86b5589475da23e549e5e4128aa and project 23c3196631494be38ca11b2167bbc4bb. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:40.070878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4779692-1176-46ba-a0bd-05c12efb6679 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.486660 Nov 06 21:05:40.072076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2731/5379] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:05:39 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:40.347311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:40.348022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:40.362179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.364845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.365913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.368933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.425315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4703c6f9-f752-474c-a2ca-f3ef0b60b97b req-0f4de3f5-4a3b-4fbd-a909-c3f8fb867561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8719dd5-4131-46f9-ba2e-3db7a5a416c0", "name": "network-vif-deleted", "tag": "1e809a15-6c60-4eeb-9725-78d9421cf79d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:40.427282 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:40.427282 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:40.452158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4703c6f9-f752-474c-a2ca-f3ef0b60b97b req-0f4de3f5-4a3b-4fbd-a909-c3f8fb867561 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.463443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4703c6f9-f752-474c-a2ca-f3ef0b60b97b req-0f4de3f5-4a3b-4fbd-a909-c3f8fb867561 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.497511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4703c6f9-f752-474c-a2ca-f3ef0b60b97b req-0f4de3f5-4a3b-4fbd-a909-c3f8fb867561 service nova] Creating event network-vif-deleted:1e809a15-6c60-4eeb-9725-78d9421cf79d for instance d8719dd5-4131-46f9-ba2e-3db7a5a416c0 on nch2-master-1 Nov 06 21:05:40.513901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4703c6f9-f752-474c-a2ca-f3ef0b60b97b req-0f4de3f5-4a3b-4fbd-a909-c3f8fb867561 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091968 Nov 06 21:05:40.515402 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2732/5380] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:40.523496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:40.524364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:40.538867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.539347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.542686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.544407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.600590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.601322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.601952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lazy-loading 'fault' on Instance uuid d8719dd5-4131-46f9-ba2e-3db7a5a416c0 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:05:40.673360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:40.687611 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6605301b-c586-48a4-bde7-a14da9fafd10 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 200 len: 1311 microversion: 2.1 time: 0.170354 Nov 06 21:05:40.688384 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2733/5381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:40 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:40.726445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:40.735707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-964f5fb1-0c8d-4b4d-a9b8-022f3c4cb2ef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1488 microversion: 2.1 time: 0.392367 Nov 06 21:05:40.739069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2649/5382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:40 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1488 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:40.756492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:40.757414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:40.767004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.768399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:40.770945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:40.771640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.143456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:41.151235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1f548d1-fa13-498b-8f6d-b36195d6f412 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1488 microversion: 2.1 time: 0.398725 Nov 06 21:05:41.151787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2734/5383] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:40 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1488 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:41.172209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:41.173994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:41.185033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.187624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.189888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.191076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.697165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:41.704669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:41.706069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: d8719dd5-4131-46f9-ba2e-3db7a5a416c0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:41.714248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.714988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.715413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f373bbba-e51c-446b-823b-b91cc8f54ed0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1488 microversion: 2.1 time: 0.550196 Nov 06 21:05:41.716385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.717052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.729314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2650/5384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:41 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1488 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:41.732982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] HTTP exception thrown: Instance d8719dd5-4131-46f9-ba2e-3db7a5a416c0 could not be found. Nov 06 21:05:41.734487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Returning 404 to user: Instance d8719dd5-4131-46f9-ba2e-3db7a5a416c0 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:41.735419 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-601aa2bc-dec2-4874-b46e-635c4eff5190 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0" status: 404 len: 111 microversion: 2.1 time: 0.034466 Nov 06 21:05:41.736433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2735/5385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:41 2021] GET /compute/v2.1/servers/d8719dd5-4131-46f9-ba2e-3db7a5a416c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:05:41.741905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:41.742892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:41.750742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.752516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.753758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.755397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.755828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:41.758514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:41.776874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.777422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.779559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:41.780769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:41.807115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:05:41.817546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:05:41.979437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27ccbdc4-e7b2-4703-ad05-41bcff6630aa tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "DELETE /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 204 len: 0 microversion: 2.1 time: 0.238131 Nov 06 21:05:41.980255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2736/5386] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:05:41 2021] DELETE /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:05:41.985812 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d511f97-86cf-4ace-bb02-709f10c3de80 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 204 len: 0 microversion: 2.1 time: 0.252276 Nov 06 21:05:41.986750 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2651/5387] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:05:41 2021] DELETE /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:05:41.989424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:41.995339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:42.006761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:42.007486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:42.011198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:42.011654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:42.012493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:42.012936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:42.022452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:42.022916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:42.032796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:42.033763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:42.477893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:42.487022 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b5b7f27-51bf-425c-b4d0-bbd21ad17f97 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1519 microversion: 2.1 time: 0.501529 Nov 06 21:05:42.489952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:42.490433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2737/5388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:41 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:42.516414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8f3c53a-be82-4e01-a409-010af0aabfa8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1494 microversion: 2.1 time: 0.523077 Nov 06 21:05:42.528733 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2652/5389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:41 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1494 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:43.512049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:43.514432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:43.532943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:43.533400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:43.534197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:43.534463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:43.535871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:43.542914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:43.565769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:43.566235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:43.567226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:43.568983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:44.018102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:44.026283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b3cc55b-1f8e-482f-a725-0e078883f48a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1494 microversion: 2.1 time: 0.496774 Nov 06 21:05:44.027248 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2653/5390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:43 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1494 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:44.041710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:44.051571 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d873b5b-1eb2-484d-9bd2-5cd5f3a443c8 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1519 microversion: 2.1 time: 0.546011 Nov 06 21:05:44.052155 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2738/5391] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:43 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:44.741342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2df13778-0e1b-41af-a3f6-9208af551fca req-253b1c4d-f8e8-4ba4-acde-f9470fa9511a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6123f97a-1c1d-4334-b05e-edb8cd2172de", "name": "network-vif-deleted", "tag": "6903fd3d-34db-44a4-ad2d-fb2ddf711efe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:44.743544 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:44.743544 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:44.754155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2df13778-0e1b-41af-a3f6-9208af551fca req-253b1c4d-f8e8-4ba4-acde-f9470fa9511a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:44.754984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2df13778-0e1b-41af-a3f6-9208af551fca req-253b1c4d-f8e8-4ba4-acde-f9470fa9511a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:44.771066 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2df13778-0e1b-41af-a3f6-9208af551fca req-253b1c4d-f8e8-4ba4-acde-f9470fa9511a service nova] Creating event network-vif-deleted:6903fd3d-34db-44a4-ad2d-fb2ddf711efe for instance 6123f97a-1c1d-4334-b05e-edb8cd2172de on nch2-master-1 Nov 06 21:05:44.777155 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2df13778-0e1b-41af-a3f6-9208af551fca req-253b1c4d-f8e8-4ba4-acde-f9470fa9511a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039495 Nov 06 21:05:44.783283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2654/5392] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:45.046344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:45.047507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:45.072041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:45.074911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:45.076913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.079618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.080621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.083264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.084778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.085928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.086614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.087256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.156010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.156770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.157458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lazy-loading 'fault' on Instance uuid 6123f97a-1c1d-4334-b05e-edb8cd2172de {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:05:45.216822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56d0365c4ea4f63bb9265661de94231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a119dc29614d80a2a5c5378eb09590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:45.229542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8236aa27-a8f9-4303-ba1b-11eae7dc3948 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 200 len: 1477 microversion: 2.1 time: 0.161994 Nov 06 21:05:45.236426 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2655/5393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:45 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:45.247277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c1dda716-8a27-4afd-bf3a-fc1646fc6999 req-15ee4677-58b1-40e1-bf41-103bf26564f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f43a8-ffe2-4f74-8af1-57b56325b235", "name": "network-vif-deleted", "tag": "81ff9899-aaca-4601-85a6-c941334b6ac2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:45.251357 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:45.251357 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:45.267862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c1dda716-8a27-4afd-bf3a-fc1646fc6999 req-15ee4677-58b1-40e1-bf41-103bf26564f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:45.270034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c1dda716-8a27-4afd-bf3a-fc1646fc6999 req-15ee4677-58b1-40e1-bf41-103bf26564f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:45.292601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c1dda716-8a27-4afd-bf3a-fc1646fc6999 req-15ee4677-58b1-40e1-bf41-103bf26564f2 service nova] Creating event network-vif-deleted:81ff9899-aaca-4601-85a6-c941334b6ac2 for instance 164f43a8-ffe2-4f74-8af1-57b56325b235 on nch2-master-1 Nov 06 21:05:45.296633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:45.303147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c1dda716-8a27-4afd-bf3a-fc1646fc6999 req-15ee4677-58b1-40e1-bf41-103bf26564f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063132 Nov 06 21:05:45.306795 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2656/5394] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:45.329985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7dbc40eb-4aec-4a15-b9fc-2a9d5d1f8c74 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 200 len: 1298 microversion: 2.1 time: 0.288960 Nov 06 21:05:45.330586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2739/5395] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:45 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:46.253509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:46.254866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] [instance: 164f43a8-ffe2-4f74-8af1-57b56325b235] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:46.261408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.261866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.262690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.263131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.276329 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] HTTP exception thrown: Instance 164f43a8-ffe2-4f74-8af1-57b56325b235 could not be found. Nov 06 21:05:46.276927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] Returning 404 to user: Instance 164f43a8-ffe2-4f74-8af1-57b56325b235 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:46.277804 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6465e0fc-04c2-46c9-849b-ae0bd4a52567 tempest-ListServerFiltersTestJSON-253079339 tempest-ListServerFiltersTestJSON-253079339-project] 10.222.0.13 "GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235" status: 404 len: 111 microversion: 2.1 time: 0.031240 Nov 06 21:05:46.278349 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2657/5396] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:46 2021] GET /compute/v2.1/servers/164f43a8-ffe2-4f74-8af1-57b56325b235 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:05:46.347802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:46.349307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:46.369805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.370295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.371165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.371613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.391307 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. Nov 06 21:05:46.391932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:46.392895 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53fd47e0-8cf9-4504-8b3e-12981112b010 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 404 len: 111 microversion: 2.1 time: 0.049138 Nov 06 21:05:46.398774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2740/5397] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:46 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:05:46.402777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:46.403287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:46.412750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.413436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.414524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.415721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.428865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2062405446", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "790f1050-361a-4854-a34f-09bff15f0aba"}], "security_groups": [{"name": "tempest-securitygroup--1978375294"}], "key_name": "tempest-keypair-2124541079", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "638379a3-bc48-41a4-a0c4-976ee1563a2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:46.452358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:05:46.592402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-69b9ea7f-07da-413b-b3b7-185d289002c0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 204 len: 0 microversion: 2.1 time: 0.192392 Nov 06 21:05:46.597751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2658/5398] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:05:46 2021] DELETE /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:05:46.605952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:46.606719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:46.614042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.614506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.615989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:46.616766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:46.643227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] validate_networks() for [('790f1050-361a-4854-a34f-09bff15f0aba', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:05:47.011712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:47.020665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b241971-3e47-46b8-9948-e404edfc2142 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1494 microversion: 2.1 time: 0.421197 Nov 06 21:05:47.027109 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2659/5399] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:46 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1494 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:47.415243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for project 23c3196631494be38ca11b2167bbc4bb. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:47.432175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for user b51fe86b5589475da23e549e5e4128aa and project 23c3196631494be38ca11b2167bbc4bb. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:47.467332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:05:47.468550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:05:47.469157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:05:47.469573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:05:47.470028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:05:47.485806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:47.486271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:47.487158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:47.487604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:47.512171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for project 23c3196631494be38ca11b2167bbc4bb. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:47.521910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Getting quotas for user b51fe86b5589475da23e549e5e4128aa and project 23c3196631494be38ca11b2167bbc4bb. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:47.627781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:05:47.630523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='638379a3-bc48-41a4-a0c4-976ee1563a2c',volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:05:47.832732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca390cd2-761c-45dd-b92c-27e9ca982f9e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.409110 Nov 06 21:05:47.834476 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2741/5400] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:05:46 2021] POST /compute/v2.1/servers => generated 407 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:05:47.844265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43142b3c-79f5-4755-aee7-f4eb9f320444 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:47.844905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43142b3c-79f5-4755-aee7-f4eb9f320444 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:47.944152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43142b3c-79f5-4755-aee7-f4eb9f320444 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:47.952503 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43142b3c-79f5-4755-aee7-f4eb9f320444 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1122 microversion: 2.1 time: 0.112245 Nov 06 21:05:47.953600 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2660/5401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:47 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1122 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:48.044235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:48.044971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:48.057322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:48.057862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:48.058743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:48.059242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:48.325896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:48.335196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d705d16-f754-4081-8c0f-8d267bd6d4e1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1494 microversion: 2.1 time: 0.294797 Nov 06 21:05:48.339680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2742/5402] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:48 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1494 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:48.971796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:48.972716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:48.994312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:48.994902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:48.995825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:48.997089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:49.078431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-29862603-d1c0-45f4-a70e-1e440d2149b7 req-081c4243-cc00-45ff-8b0c-19ee0f9f53b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc2b920-2680-4f38-acce-5220d6dcc981", "name": "network-vif-deleted", "tag": "90b8b9b0-a8f0-48a1-905b-e533c76adf75"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:49.080449 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:49.080449 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:49.109132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-29862603-d1c0-45f4-a70e-1e440d2149b7 req-081c4243-cc00-45ff-8b0c-19ee0f9f53b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:49.109709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-29862603-d1c0-45f4-a70e-1e440d2149b7 req-081c4243-cc00-45ff-8b0c-19ee0f9f53b0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:49.122485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:49.135047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-689cb88d-1419-435c-bf88-2ab11b28cce5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1220 microversion: 2.1 time: 0.166576 Nov 06 21:05:49.136210 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2661/5403] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:48 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1220 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:49.148499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-29862603-d1c0-45f4-a70e-1e440d2149b7 req-081c4243-cc00-45ff-8b0c-19ee0f9f53b0 service nova] Creating event network-vif-deleted:90b8b9b0-a8f0-48a1-905b-e533c76adf75 for instance bcc2b920-2680-4f38-acce-5220d6dcc981 on nch2-master-1 Nov 06 21:05:49.155830 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-29862603-d1c0-45f4-a70e-1e440d2149b7 req-081c4243-cc00-45ff-8b0c-19ee0f9f53b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081106 Nov 06 21:05:49.156973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2743/5404] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:49.355080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:49.356004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:49.369247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:49.369849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:49.370947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:49.371614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:49.415930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:49.416580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:49.417385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lazy-loading 'fault' on Instance uuid bcc2b920-2680-4f38-acce-5220d6dcc981 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:05:49.517235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:49.546466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a9118dc-92a5-431c-a57d-e19560c2685e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 200 len: 1298 microversion: 2.1 time: 0.194964 Nov 06 21:05:49.559861 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2662/5405] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:49 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 1298 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:50.155852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:50.156662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:50.180137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:50.180862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:50.181692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:50.182705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:50.306233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:50.320866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b8ffc7c-4026-42b7-bc4e-f56abec57bb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1238 microversion: 2.1 time: 0.170037 Nov 06 21:05:50.326625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2744/5406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:50 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1238 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:50.567583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:50.568202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:50.584391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:50.586032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:50.588815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:50.590152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:50.620908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. Nov 06 21:05:50.625240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:05:50.626513 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6792077-0048-4c6c-aa12-f6fc2e8f3fab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 404 len: 111 microversion: 2.1 time: 0.063330 Nov 06 21:05:50.634036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2663/5407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:50 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:05:50.775563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1339968598", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:50.844115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:05:51.304808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1576815901", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0ab5e469-5d79-43ce-b217-e9352380d952"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:51.371194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] validate_networks() for [('0ab5e469-5d79-43ce-b217-e9352380d952', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:05:51.381721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:05:51.382207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:05:51.382753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:05:51.383387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:05:51.383655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:05:51.393894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:51.394355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:51.395230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:51.395674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:51.425914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:51.431408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:51.446932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:05:51.451181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:05:51.531490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c90f548-032a-4dd6-99b6-fd91dc25cab3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759901 Nov 06 21:05:51.537230 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2745/5408] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:05:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:05:51.544825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:51.546232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:51.552985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:51.553723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:51.554702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:51.555322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.288478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:52.299049 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42758ed3-8a86-4923-aad5-34f66388ea8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.760037 Nov 06 21:05:52.300526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2746/5409] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:51 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:52.306310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:52.307264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:52.316774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:52.317232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.318073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:52.321161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.323877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:05:52.325147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:05:52.326686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:05:52.327288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:05:52.327893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:05:52.338620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:52.339354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.340424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:52.341147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.385982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Getting quotas for project 0cf03418aeba4a469e09111804ee7a2f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:05:52.399925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:52.403169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Getting quotas for user b26ad84c89e84478bc05aebf56168b93 and project 0cf03418aeba4a469e09111804ee7a2f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:05:52.411254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9836666a-0b5f-4146-a1d6-8c987167a92a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1205 microversion: 2.1 time: 0.109231 Nov 06 21:05:52.412229 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2747/5410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:52 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:52.417911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:05:52.421225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:05:52.426670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7c3500d5-2eec-453c-8927-9146fe3ce683 req-a11e1604-a409-40fa-99dd-ae2092041d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c608206-049f-45dd-ad2c-c73bd68927eb", "tag": "6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:52.430084 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:52.430084 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:52.451472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7c3500d5-2eec-453c-8927-9146fe3ce683 req-a11e1604-a409-40fa-99dd-ae2092041d95 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:52.452271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7c3500d5-2eec-453c-8927-9146fe3ce683 req-a11e1604-a409-40fa-99dd-ae2092041d95 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:52.476842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7c3500d5-2eec-453c-8927-9146fe3ce683 req-a11e1604-a409-40fa-99dd-ae2092041d95 service nova] Creating event network-changed:6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8 for instance 5c608206-049f-45dd-ad2c-c73bd68927eb on nch2-master-1 Nov 06 21:05:52.480219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66510350-2732-4a7f-b889-818768b1f0e9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319370 Nov 06 21:05:52.481468 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2664/5411] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:05:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:05:52.482685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7c3500d5-2eec-453c-8927-9146fe3ce683 req-a11e1604-a409-40fa-99dd-ae2092041d95 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068844 Nov 06 21:05:52.483885 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2748/5412] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:52.492969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f8136b1-8581-4059-860f-807c2703e635 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:52.493856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8f8136b1-8581-4059-860f-807c2703e635 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:52.583889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8f8136b1-8581-4059-860f-807c2703e635 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:52.593300 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f8136b1-8581-4059-860f-807c2703e635 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1216 microversion: 2.1 time: 0.103234 Nov 06 21:05:52.593883 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2665/5413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:52 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:53.322019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:53.323056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:53.333951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.335504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.336979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.337898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.430192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:53.430709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:53.439780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.440399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.441317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.441850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.543360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:53.554536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f538500-ecd5-4bf3-b1f2-586473f275ce tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1267 microversion: 2.1 time: 0.127334 Nov 06 21:05:53.555840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2666/5414] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:53 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:53.607733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:53.610079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:53.610701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:53.619142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.619754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee916345-24b0-4f0f-9941-7760a21f1fa1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.304631 Nov 06 21:05:53.620077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.620912 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2749/5415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:53 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:53.621736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:53.622602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:53.729733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:53.748058 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a27354ff-537f-4f5a-ae35-d8b32c9e671b tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1268 microversion: 2.1 time: 0.141576 Nov 06 21:05:53.762117 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2667/5416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:53 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:54.572045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:54.576500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:54.588204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:54.590806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:54.592754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:54.593219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:54.636892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:54.638956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:54.647739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:54.652331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:54.653526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:54.655713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:55.217804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:55.223773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:55.228144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1af5c014-906e-41c8-8caf-415ec322ab3d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.594830 Nov 06 21:05:55.229930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2668/5417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:54 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:55.232197 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b57caf73-948b-4428-bf0d-2288434e710b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.663756 Nov 06 21:05:55.238048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2558fd44-22d8-4e84-9e24-bd6df3968e8e req-1e5261b8-97a0-415c-98e1-301ce90b7725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd5bc7c-71dd-4d19-b5d5-93cf8a247607", "tag": "0037773b-b08f-4097-ba1e-95dd0e264335"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:55.240120 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:55.240120 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:55.244455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2750/5418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:54 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:55.250782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:55.251306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:55.254047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2558fd44-22d8-4e84-9e24-bd6df3968e8e req-1e5261b8-97a0-415c-98e1-301ce90b7725 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:55.255088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2558fd44-22d8-4e84-9e24-bd6df3968e8e req-1e5261b8-97a0-415c-98e1-301ce90b7725 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:55.264985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:55.266030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:55.267057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:55.267683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:55.272642 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2558fd44-22d8-4e84-9e24-bd6df3968e8e req-1e5261b8-97a0-415c-98e1-301ce90b7725 service nova] Creating event network-changed:0037773b-b08f-4097-ba1e-95dd0e264335 for instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 on nch2-master-1 Nov 06 21:05:55.279001 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2558fd44-22d8-4e84-9e24-bd6df3968e8e req-1e5261b8-97a0-415c-98e1-301ce90b7725 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047051 Nov 06 21:05:55.280724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2669/5419] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:55.488189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:55.496429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1be4257-49c1-43d2-bd8a-d2812b80df56 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.250666 Nov 06 21:05:55.497686 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2751/5420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:55 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:55.660652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-74b4b510-6a08-4231-8d77-e025c1340205 req-623ee72b-0c43-4bdd-a2ea-ef616040ed3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7fa355-21c7-4872-921a-e69f45f9a56d", "tag": "2417b151-bead-4f2a-b636-595224e0704b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:55.662791 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:55.662791 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:05:55.670829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-74b4b510-6a08-4231-8d77-e025c1340205 req-623ee72b-0c43-4bdd-a2ea-ef616040ed3f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:55.671543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-74b4b510-6a08-4231-8d77-e025c1340205 req-623ee72b-0c43-4bdd-a2ea-ef616040ed3f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:55.683245 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-74b4b510-6a08-4231-8d77-e025c1340205 req-623ee72b-0c43-4bdd-a2ea-ef616040ed3f service nova] Creating event network-changed:2417b151-bead-4f2a-b636-595224e0704b for instance 5b7fa355-21c7-4872-921a-e69f45f9a56d on nch2-master-1 Nov 06 21:05:55.689175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-74b4b510-6a08-4231-8d77-e025c1340205 req-623ee72b-0c43-4bdd-a2ea-ef616040ed3f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034036 Nov 06 21:05:55.690395 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2670/5421] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:05:56.244886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:56.245497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:56.252903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:56.253891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:56.261663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.262402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.263419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.264750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.264893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.265356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.269266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.269573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.626538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:56.638530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3705c90e-62f9-4869-901e-250378d38aa5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.387497 Nov 06 21:05:56.641833 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2671/5422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:56 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:56.649197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:56.650018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:56.656775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.657267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.661153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:56.667936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:56.669692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:56.670934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-726124e8-8090-4647-b3dc-1d9dce8f8e04 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.429152 Nov 06 21:05:56.671943 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2752/5423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:56 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:56.954667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:56.962729 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e09a6c8-a939-4128-a483-58963def559d tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.319494 Nov 06 21:05:56.963307 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2672/5424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:56 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:57.656802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:57.657520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:57.664640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:57.665447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:57.666418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:57.667199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:57.688149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:57.688841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:57.699590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:57.700264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:57.701237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:57.702354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:58.095557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:58.100498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:58.103360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2712b3ae-7008-4315-931e-486bb8966e09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.419676 Nov 06 21:05:58.104436 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2673/5425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:57 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:58.108511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-100d3402-0087-4a80-978c-60693e54d964 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.455961 Nov 06 21:05:58.111003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:58.111673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:58.118364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:58.119210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:58.120187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:58.120901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:58.121287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2753/5426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:57 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:58.211435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1b9992e1-1d35-427a-86d2-b038d7eaf8d4 req-1d164bc9-ec3a-4722-9813-bd64e4a07d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c608206-049f-45dd-ad2c-c73bd68927eb", "name": "network-vif-plugged", "status": "completed", "tag": "6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:05:58.213277 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:05:58.213277 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:05:58.224802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b9992e1-1d35-427a-86d2-b038d7eaf8d4 req-1d164bc9-ec3a-4722-9813-bd64e4a07d8d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:58.226266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1b9992e1-1d35-427a-86d2-b038d7eaf8d4 req-1d164bc9-ec3a-4722-9813-bd64e4a07d8d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:58.250756 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1b9992e1-1d35-427a-86d2-b038d7eaf8d4 req-1d164bc9-ec3a-4722-9813-bd64e4a07d8d service nova] Creating event network-vif-plugged:6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8 for instance 5c608206-049f-45dd-ad2c-c73bd68927eb on nch2-master-1 Nov 06 21:05:58.260014 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1b9992e1-1d35-427a-86d2-b038d7eaf8d4 req-1d164bc9-ec3a-4722-9813-bd64e4a07d8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052510 Nov 06 21:05:58.261328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2754/5427] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:05:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:05:58.343909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:58.352928 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a27d149f-f3bd-4117-92af-231fb1ece43c tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.246624 Nov 06 21:05:58.353806 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2674/5428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:58 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:59.120891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:59.121591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:59.127847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.128428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:59.128873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.129153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:59.129248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.129633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.135640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.136097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.136921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.137354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.335725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:59.339998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:59.343937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-154d9e57-df61-47bc-9f1f-3047029918f7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1294 microversion: 2.1 time: 0.227803 Nov 06 21:05:59.344738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2755/5429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:59 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:05:59.349922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d8bf1d7-1f74-4050-8f1a-120708f6ecd1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.225218 Nov 06 21:05:59.350498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2675/5430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:59 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:05:59.370032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:05:59.370637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:05:59.376502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.376954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.377742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:05:59.378161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:05:59.512880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:05:59.523125 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5dee265-7b5a-4e50-b0bb-88c307ebae2e tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.156580 Nov 06 21:05:59.523923 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2756/5431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:05:59 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:00.361973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:00.361973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:00.367317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:00.367992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:00.368362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.368824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.369615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.370239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.375958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.376439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.377414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.378028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.587768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:00.591624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:00.600867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c6beb52-3811-46a0-90af-4a4f5eb8f2c9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.237443 Nov 06 21:06:00.601793 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2757/5432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:00 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:00.603473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-67b48d47-c0fc-47c9-bfea-587471856016 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1485 microversion: 2.1 time: 0.246156 Nov 06 21:06:00.616816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6af7edc3-03c3-490c-9a8d-2726cdf88ccd req-0c3f4215-1650-4e8e-8557-e6470dd97d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd5bc7c-71dd-4d19-b5d5-93cf8a247607", "name": "network-vif-plugged", "status": "completed", "tag": "0037773b-b08f-4097-ba1e-95dd0e264335"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:00.616816 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:00.616816 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:00.618996 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2676/5433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:00 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1485 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:00.623238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6af7edc3-03c3-490c-9a8d-2726cdf88ccd req-0c3f4215-1650-4e8e-8557-e6470dd97d30 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.623871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6af7edc3-03c3-490c-9a8d-2726cdf88ccd req-0c3f4215-1650-4e8e-8557-e6470dd97d30 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.625090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:00.625879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:00.634862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.635893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.637375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.638169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.644699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6af7edc3-03c3-490c-9a8d-2726cdf88ccd req-0c3f4215-1650-4e8e-8557-e6470dd97d30 service nova] Creating event network-vif-plugged:0037773b-b08f-4097-ba1e-95dd0e264335 for instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 on nch2-master-1 Nov 06 21:06:00.650937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6af7edc3-03c3-490c-9a8d-2726cdf88ccd req-0c3f4215-1650-4e8e-8557-e6470dd97d30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047886 Nov 06 21:06:00.651848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2758/5434] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:00.657622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:00.658337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:00.680982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.681816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.683121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:00.686001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:00.872735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:00.881034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1527f61-8a7b-4ab3-868d-6b31fe8a5142 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227921 Nov 06 21:06:00.881631 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2759/5435] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:06:00 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:00.885958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8d5ad8b-ae11-4e98-a0e6-9186c5aab6f9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.265643 Nov 06 21:06:00.886921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2677/5436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:00 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:01.619181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:01.619798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:01.625884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:01.626556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:01.627536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:01.627982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:01.904008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:01.906178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:01.913059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:01.920448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:01.921702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:01.923362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:01.924598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:01.927413 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e66ebff-de23-430d-bfd7-36b0470be835 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1309 microversion: 2.1 time: 0.312773 Nov 06 21:06:01.928134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2760/5437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:01 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:02.282003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:02.284128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:02.285402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:02.293972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.294442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:02.294840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c417963-4c1d-4aa4-91a2-647615e0d567 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.395492 Nov 06 21:06:02.295346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.295809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:02.300813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2678/5438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:01 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:02.320930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5aadb5c5-3445-4f82-a06d-d66aa4e6bd11 req-9bf6b75e-600d-461c-9dc0-7a050e85e7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c608206-049f-45dd-ad2c-c73bd68927eb", "tag": "6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:02.323657 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:02.323657 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:02.337610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5aadb5c5-3445-4f82-a06d-d66aa4e6bd11 req-9bf6b75e-600d-461c-9dc0-7a050e85e7ad service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.338324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5aadb5c5-3445-4f82-a06d-d66aa4e6bd11 req-9bf6b75e-600d-461c-9dc0-7a050e85e7ad service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:02.353769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5aadb5c5-3445-4f82-a06d-d66aa4e6bd11 req-9bf6b75e-600d-461c-9dc0-7a050e85e7ad service nova] Creating event network-changed:6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8 for instance 5c608206-049f-45dd-ad2c-c73bd68927eb on nch2-master-1 Nov 06 21:06:02.363107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5aadb5c5-3445-4f82-a06d-d66aa4e6bd11 req-9bf6b75e-600d-461c-9dc0-7a050e85e7ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060291 Nov 06 21:06:02.365045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2679/5439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:02.377192 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9eb40e61-c0f3-40bd-8fa4-c1128bff7ca3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.109754 Nov 06 21:06:02.381648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2761/5440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:02 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:06:02.671206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-dda4c95d-544d-4cdc-b34d-a5b2640650e5 req-a36ef2a0-ded8-4e73-8a04-677d926210e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7fa355-21c7-4872-921a-e69f45f9a56d", "name": "network-vif-plugged", "status": "completed", "tag": "2417b151-bead-4f2a-b636-595224e0704b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:02.674058 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:02.674058 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:02.682115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-dda4c95d-544d-4cdc-b34d-a5b2640650e5 req-a36ef2a0-ded8-4e73-8a04-677d926210e6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.682680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-dda4c95d-544d-4cdc-b34d-a5b2640650e5 req-a36ef2a0-ded8-4e73-8a04-677d926210e6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:02.694638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-dda4c95d-544d-4cdc-b34d-a5b2640650e5 req-a36ef2a0-ded8-4e73-8a04-677d926210e6 service nova] Creating event network-vif-plugged:2417b151-bead-4f2a-b636-595224e0704b for instance 5b7fa355-21c7-4872-921a-e69f45f9a56d on nch2-master-1 Nov 06 21:06:02.700032 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-dda4c95d-544d-4cdc-b34d-a5b2640650e5 req-a36ef2a0-ded8-4e73-8a04-677d926210e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034981 Nov 06 21:06:02.703945 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2680/5441] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:02.948145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:02.949006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:02.958087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.958531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:02.959631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:02.960073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.134038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:03.143949 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f949c4b4-96f3-4501-87db-f5b554d26913 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1489 microversion: 2.1 time: 0.199794 Nov 06 21:06:03.145082 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2762/5442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:02 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1489 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:03.175203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:03.176552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.185581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.186057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.186910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.187349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.269678 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator IPAddress() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Nov 06 21:06:03.269678 ncdv-master-1 devstack@n-api.service[134828]: result = query.session.execute(update_stmt) Nov 06 21:06:03.288248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4d3bcaf-118d-4d57-98c8-ed5022c15c7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "PUT /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1084 microversion: 2.1 time: 0.124515 Nov 06 21:06:03.289117 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2681/5443] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:06:03 2021] PUT /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1084 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:03.304576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:03.307724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.316722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:03.317691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.321361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.321820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.322748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.323056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.331098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.332647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.333922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.334724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.551795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:03.558832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:03.561877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4af8a067-5e2b-4c77-bff5-21f6bdb27131 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1510 microversion: 2.1 time: 0.261652 Nov 06 21:06:03.564447 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2763/5444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:03 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:03.569935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:03.570895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.578819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.579298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.580088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.580554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.584594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f28fb9e4-924b-4547-af36-8ad42dae39fd tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1316 microversion: 2.1 time: 0.273472 Nov 06 21:06:03.593937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2682/5445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:03 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:03.598821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:03.599383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.606481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.606944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.607793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.608534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.660938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b94edd2-0d7f-4a03-8307-f928c71a2229 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.094813 Nov 06 21:06:03.665061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2764/5446] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:03 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:03.763070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:03.773045 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6e051e0-0937-4f70-8ebd-adafb5185fd9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1510 microversion: 2.1 time: 0.177963 Nov 06 21:06:03.773830 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2683/5447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:03 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:03.797737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:03.798700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.805839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.806619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.807435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.807866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.838828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:03.911356 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eee79b43-2a18-443a-9079-6259eec01e97 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 204 len: 0 microversion: 2.1 time: 0.124516 Nov 06 21:06:03.911953 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2765/5448] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:03 2021] DELETE /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:06:03.920689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:03.921310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:03.927253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.927712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:03.928543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:03.928990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.061238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:04.068475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5637725-d99d-4c9a-9c79-c5bc3e3641e9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1516 microversion: 2.1 time: 0.152158 Nov 06 21:06:04.069044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2684/5449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:03 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:04.599440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:04.600149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:04.609004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.609573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.610489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.610924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.675531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:04.676571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:04.688024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.688824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.690742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.691547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.752851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d816e1e6-9eb8-45e6-96e5-a9a12d72b939 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.083321 Nov 06 21:06:04.753709 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2685/5450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:04 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:04.763022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:04.772221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce226b86-60b6-4af7-8895-4c4c7dbb8ce9 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1502 microversion: 2.1 time: 0.176895 Nov 06 21:06:04.772846 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2766/5451] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:04 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:04.789843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:04.790441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:04.801292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.801763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.802562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.803013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.869069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89d8d4b5-37d5-417c-a32e-3ee7d3f57f11 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.083071 Nov 06 21:06:04.869753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2686/5452] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Nov 6 21:06:04 2021] DELETE /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d/os-server-password => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:06:04.878848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:04.879604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:04.885436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.885894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.886691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.887133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.911768 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3161ba8f-b750-40da-a88d-4ecd99a7a80a tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.036726 Nov 06 21:06:04.912378 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2767/5453] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Nov 6 21:06:04 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d/os-server-password => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:04.922261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:04.922772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:04.929416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.929863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.930654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:04.931114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:04.958978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:05.035333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d38c29c-9b12-4303-aaa9-bef555bdb728 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 204 len: 0 microversion: 2.1 time: 0.116423 Nov 06 21:06:05.036101 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2687/5454] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:04 2021] DELETE /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:06:05.044006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:05.044695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:05.050931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.051393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.052191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.052669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.086583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:05.087430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:05.093625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.094082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.094865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.095298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.255708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:05.263368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0fe19bd1-41db-46e5-9897-f7c5a4b64012 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1508 microversion: 2.1 time: 0.223385 Nov 06 21:06:05.264613 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2768/5455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:05 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:05.322536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:05.331055 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d3ffd60-ccca-4211-8e6c-7fa8e818f2bf tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1516 microversion: 2.1 time: 0.248897 Nov 06 21:06:05.331731 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2688/5456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:05 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:05.767482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:05.772942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:05.781664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.782510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.784551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:05.785661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:05.880800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4853d7fa-e8fd-4f84-b671-eae6f16e698c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.119758 Nov 06 21:06:05.883338 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2769/5457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:05 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:06.281494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:06.282777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:06.293925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.295223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.297834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.299827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.350076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:06.351148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:06.367562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.369376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.372209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.372898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.517628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:06.526109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-552359fe-3587-4ed0-a6ad-7cd8323a26f2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 200 len: 1474 microversion: 2.1 time: 0.180517 Nov 06 21:06:06.527957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2770/5458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:06 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 1474 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:06.534941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c1ebc202-7983-4a0b-b6dc-5ce162035640 req-2d6c0f96-3bce-4c51-9d0d-3bc4731c5678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd5bc7c-71dd-4d19-b5d5-93cf8a247607", "name": "network-vif-deleted", "tag": "0037773b-b08f-4097-ba1e-95dd0e264335"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:06.536728 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:06.536728 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:06.545942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c1ebc202-7983-4a0b-b6dc-5ce162035640 req-2d6c0f96-3bce-4c51-9d0d-3bc4731c5678 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.546852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c1ebc202-7983-4a0b-b6dc-5ce162035640 req-2d6c0f96-3bce-4c51-9d0d-3bc4731c5678 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.561614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c1ebc202-7983-4a0b-b6dc-5ce162035640 req-2d6c0f96-3bce-4c51-9d0d-3bc4731c5678 service nova] Creating event network-vif-deleted:0037773b-b08f-4097-ba1e-95dd0e264335 for instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 on nch2-master-1 Nov 06 21:06:06.566983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c1ebc202-7983-4a0b-b6dc-5ce162035640 req-2d6c0f96-3bce-4c51-9d0d-3bc4731c5678 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037639 Nov 06 21:06:06.567646 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2771/5459] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:06.894326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:06.896271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:06.910570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.911031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.911835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:06.912276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:06.952287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b26ad84c89e84478bc05aebf56168b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf03418aeba4a469e09111804ee7a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:06.967743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f838a22a-d0b1-4fdd-85d4-1dd3ecbbb6a4 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 200 len: 1508 microversion: 2.1 time: 0.690022 Nov 06 21:06:06.969997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2689/5460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:06 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 1508 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:06.983468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-baad5524-fc4d-40af-9a59-eaa24b20241b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.095119 Nov 06 21:06:06.985153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2772/5461] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:06 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:06:07.546756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:07.547360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:07.554072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:07.554523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:07.555301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:07.555735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:07.570002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. Nov 06 21:06:07.570603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:07.571423 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-512152bf-3346-4acb-9620-ce8853cc815f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 404 len: 111 microversion: 2.1 time: 0.028343 Nov 06 21:06:07.571958 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2690/5462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:07 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:07.667418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-508491007", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0397278-359e-4b6d-bb4f-e56cf166bbfb"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:07.726436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] validate_networks() for [('c0397278-359e-4b6d-bb4f-e56cf166bbfb', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:06:07.991491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:07.993646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] [instance: 5b7fa355-21c7-4872-921a-e69f45f9a56d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:08.012385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.013253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.014186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.014704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.034928 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] HTTP exception thrown: Instance 5b7fa355-21c7-4872-921a-e69f45f9a56d could not be found. Nov 06 21:06:08.035951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] Returning 404 to user: Instance 5b7fa355-21c7-4872-921a-e69f45f9a56d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:08.037100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74e32f8e-7d38-44c7-9ced-08064e78fd24 tempest-ServerPasswordTestJSON-1323027827 tempest-ServerPasswordTestJSON-1323027827-project] 10.222.0.13 "GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d" status: 404 len: 111 microversion: 2.1 time: 0.052527 Nov 06 21:06:08.040474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2691/5463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:07 2021] GET /compute/v2.1/servers/5b7fa355-21c7-4872-921a-e69f45f9a56d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:06:08.064572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:08.065713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:08.078023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.080440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.081327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.084771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.141054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d263debe-4c9b-4f59-94f4-46429589a792 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.086036 Nov 06 21:06:08.142184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2692/5464] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:08 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:08.202448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:08.203075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:08.203552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:08.204287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:08.205206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:08.219785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.220746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.221791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.222447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.242978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:08.249835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Getting quotas for user 247e9ac02acd44c3b1186567c91bbfa9 and project 6eda1afc00c24f888ad31c7bade0503e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:06:08.262784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:06:08.266224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:06:08.317724 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-375c13f6-1736-46ab-aba6-51301c3a178c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654309 Nov 06 21:06:08.318526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2773/5465] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:06:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:06:08.329378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a409a423-8bb8-465d-a72f-6c3a447b65f7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:08.330064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a409a423-8bb8-465d-a72f-6c3a447b65f7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:08.434273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a409a423-8bb8-465d-a72f-6c3a447b65f7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:08.442799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a409a423-8bb8-465d-a72f-6c3a447b65f7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1208 microversion: 2.1 time: 0.117272 Nov 06 21:06:08.444027 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2693/5466] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:08 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1208 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:08.583645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-531fa2ae-7206-45ec-9b56-b95d1d51b4e5 req-a9d927d4-b7cc-4485-a427-67cadba11ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7fa355-21c7-4872-921a-e69f45f9a56d", "name": "network-vif-deleted", "tag": "2417b151-bead-4f2a-b636-595224e0704b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:08.585649 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:08.585649 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:08.594512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-531fa2ae-7206-45ec-9b56-b95d1d51b4e5 req-a9d927d4-b7cc-4485-a427-67cadba11ef0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:08.594973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-531fa2ae-7206-45ec-9b56-b95d1d51b4e5 req-a9d927d4-b7cc-4485-a427-67cadba11ef0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:08.606576 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-531fa2ae-7206-45ec-9b56-b95d1d51b4e5 req-a9d927d4-b7cc-4485-a427-67cadba11ef0 service nova] Creating event network-vif-deleted:2417b151-bead-4f2a-b636-595224e0704b for instance 5b7fa355-21c7-4872-921a-e69f45f9a56d on nch2-master-1 Nov 06 21:06:08.611924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-531fa2ae-7206-45ec-9b56-b95d1d51b4e5 req-a9d927d4-b7cc-4485-a427-67cadba11ef0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031774 Nov 06 21:06:08.616524 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2774/5467] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:09.151695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:09.152652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:09.159007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:09.159460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:09.160243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:09.160711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:09.198967 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85807700-f125-41f5-9bf7-be8405e536f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.051063 Nov 06 21:06:09.199633 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2694/5468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:09 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:09.462711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:09.463524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:09.472863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:09.473227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:09.474078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:09.483110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:09.592623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:09.601651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a1ec0f5-66ef-4f07-962a-0d70bbfbdbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1278 microversion: 2.1 time: 0.144542 Nov 06 21:06:09.602238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2775/5469] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:09 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:10.212364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:10.213329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:10.214837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1302756259", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": "none"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:10.226759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.228478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.231594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.233067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.287460 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05e09e99-995b-4621-b824-2b978df817b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.081166 Nov 06 21:06:10.291681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2776/5470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:10 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:10.297086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:10.297656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:10.298222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:10.299297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:10.299785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:10.310078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.311056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.311906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.312647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.331154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Getting quotas for project ce63ab4cf0914a21af1079b2532238a8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:10.336359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Getting quotas for user ea332a0c12024bcd933af8e1ba928a8a and project ce63ab4cf0914a21af1079b2532238a8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:06:10.349378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:06:10.351909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:06:10.397052 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-023c31a9-3f6b-44c0-b082-9ef580c7a075 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.380616 Nov 06 21:06:10.403320 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2695/5471] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 21:06:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 21:06:10.409559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:10.410249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:10.475811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:10.491833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:10.493999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:10.495329 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4caa017-045e-4c02-abde-8d783caea29d tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 200 len: 1278 microversion: 2.47 time: 0.090448 Nov 06 21:06:10.496008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2777/5472] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:10 2021] GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:10.563275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1846295665", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": "none"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:10.621067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:10.621777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:10.636940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.637212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:10.637595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:10.638298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.639003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:10.639632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.639816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:10.640484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.641015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:10.663256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.711436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.711436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:10.711436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:10.711436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Getting quotas for project ce63ab4cf0914a21af1079b2532238a8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:10.711436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Getting quotas for user ea332a0c12024bcd933af8e1ba928a8a and project ce63ab4cf0914a21af1079b2532238a8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:06:10.726814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:06:10.729360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:06:10.806602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ada325b6-fb9e-4716-934e-d96186e42466 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.249000 Nov 06 21:06:10.808350 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2696/5473] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 21:06:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 21:06:10.827687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6f93bfc-6c79-4a91-82b7-a2f7010db48b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:10.829590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6f93bfc-6c79-4a91-82b7-a2f7010db48b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:10.932157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6f93bfc-6c79-4a91-82b7-a2f7010db48b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "PUT /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 992 microversion: 2.47 time: 0.116265 Nov 06 21:06:10.933138 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2697/5474] 10.222.0.13 () {62 vars in 1296 bytes} [Sat Nov 6 21:06:10 2021] PUT /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 992 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:10.951180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:10.952032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:10.955346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:10.965271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c81aac7a-14e1-42cf-ac6d-c1fbdfe9a9fa tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.348354 Nov 06 21:06:10.967089 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2778/5475] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:10 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:11.041092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:11.052540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:11.054277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:11.055811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e16df103-3d00-45a6-abaf-fdf8740bffc0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1278 microversion: 2.47 time: 0.109249 Nov 06 21:06:11.056414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2698/5476] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:10 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:11.246603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-76dce228-39e4-4949-a1dc-37574442e77b req-0d938789-c074-4d09-bca5-a2a6a4ce470c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da3b3c4-23b9-4025-9148-2b3df46d60bd", "tag": "46e3a37b-fdae-4de1-b4fa-b19d171d2efe"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:11.255954 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:11.255954 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:11.284164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-76dce228-39e4-4949-a1dc-37574442e77b req-0d938789-c074-4d09-bca5-a2a6a4ce470c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:11.284961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-76dce228-39e4-4949-a1dc-37574442e77b req-0d938789-c074-4d09-bca5-a2a6a4ce470c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:11.299110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:11.300620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:11.307212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:11.307669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:11.308484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:11.309165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:11.315911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-76dce228-39e4-4949-a1dc-37574442e77b req-0d938789-c074-4d09-bca5-a2a6a4ce470c service nova] Creating event network-changed:46e3a37b-fdae-4de1-b4fa-b19d171d2efe for instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd on nch2-master-1 Nov 06 21:06:11.321081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-76dce228-39e4-4949-a1dc-37574442e77b req-0d938789-c074-4d09-bca5-a2a6a4ce470c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097383 Nov 06 21:06:11.322239 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2779/5477] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:11.374561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b545ace0-1733-45dd-81c2-f707efd95086 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.079193 Nov 06 21:06:11.378486 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2699/5478] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:11 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:06:11.986167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:11.986963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:11.994058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:11.994522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:11.995484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:11.995932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:12.077163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:12.077888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:12.086101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:12.086737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:12.087596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:12.088062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:12.149786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:12.157872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9deb2780-5f64-4292-8e96-3b7e6a6bf0d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.176800 Nov 06 21:06:12.158463 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2780/5479] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:11 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:12.165225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:12.173679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:12.175424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:12.176579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5b92691-f3b9-4b3e-bc0d-d80b1af87e43 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1330 microversion: 2.47 time: 0.104671 Nov 06 21:06:12.177131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2700/5480] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:12 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:12.385318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:12.386421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:12.394124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:12.394640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:12.395460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:12.395903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:12.481181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af8dd4b7-ff99-44a4-9cdd-768733b20962 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.099224 Nov 06 21:06:12.485739 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2781/5481] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:12 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:06:13.176796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:13.177441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:13.184147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.184706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.185535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.185973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.198354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:13.199653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:13.207420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.208034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.208827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.209268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.306014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:13.316076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:13.317643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:13.318810 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-911c5f2e-42b0-4c8c-bd0e-ebffb9583909 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1336 microversion: 2.47 time: 0.126013 Nov 06 21:06:13.319393 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2782/5482] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:13 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1336 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:13.386239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:13.394217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-497cc8fc-d9dd-4c8a-a505-514e4aa111ab tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.222337 Nov 06 21:06:13.394723 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2701/5483] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:13 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:13.492616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:13.493541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:13.500281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.500835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.501562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:13.502003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:13.543567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c29c44a-e50d-4a90-88f6-3d628e77f6e4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.054369 Nov 06 21:06:13.546818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2783/5484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:13 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:06:14.338269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:14.338880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:14.345549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.346010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.346801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.347245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.415356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:14.415488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:14.416173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:14.423971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.424217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:14.425766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:14.426361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.426896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da9164c5-3a43-4e97-9bb4-f73e684a70cd tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1336 microversion: 2.47 time: 0.092408 Nov 06 21:06:14.427201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.427456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2702/5485] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:14 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:14.427655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.553855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:14.554842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:14.561276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.561745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.561844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:14.562551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:14.562983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:14.569605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78190234-e129-41a3-885e-6a435786cee3 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.162247 Nov 06 21:06:14.570175 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2784/5486] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:14 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:14.606128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03b5e418-f384-42c1-87c3-e3051e5a0e74 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 14 microversion: 2.1 time: 0.055840 Nov 06 21:06:14.606760 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2703/5487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:14 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:06:15.446515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:15.447267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:15.455641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.456086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.456899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.457336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.528273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:15.536962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:15.538113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:15.539252 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd4417fb-5a53-4693-a7ce-1a8fbf9a8d17 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1336 microversion: 2.47 time: 0.096867 Nov 06 21:06:15.539810 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2785/5488] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:15 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:15.588332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:15.589150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:15.597386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.598033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.599138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.599643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.617228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:15.618177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:15.624862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.625312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.626100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:15.626535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:15.686716 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d30164f2-899d-4095-9c1f-3eaab53fcde3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 8208 microversion: 2.1 time: 0.073252 Nov 06 21:06:15.687443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2786/5489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:15 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 8208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:15.775777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:15.783185 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0a28aea-de34-4e33-b660-c6f363a30ca8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.199594 Nov 06 21:06:15.783879 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2704/5490] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:15 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:16.558326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:16.559780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:16.568308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.569076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.571114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.572005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.664794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:16.674277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:16.675833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:16.677048 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dbcf91fa-f02f-4c0c-b4cf-044ff2a08df2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1336 microversion: 2.47 time: 0.122886 Nov 06 21:06:16.677614 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2787/5491] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:16 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:16.698203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:16.699187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:16.708344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.708809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.709603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.710048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.759877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9849b167-ab84-4a70-921f-088a61d2a8ee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.065441 Nov 06 21:06:16.760534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2705/5492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:16 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:16.803153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:16.803989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:16.811483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.812416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.813692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:16.814507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:16.958964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:16.967099 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f17fb993-9acc-4382-93fa-511dbec6af7e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.169862 Nov 06 21:06:16.968244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2788/5493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:16 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:17.695480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:17.696176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:17.703172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.703792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.704508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.704946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.771227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:17.771847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:17.772277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:17.780048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.780528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.781372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.781751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.781851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:17.783491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:17.784683 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ae57386-3f2a-49c4-86be-8e084e94b475 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1357 microversion: 2.47 time: 0.093229 Nov 06 21:06:17.785254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2706/5494] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:17 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1357 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:17.807997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:17.810502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:17.816564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.816957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.817736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:17.818167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:17.835531 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cdd5e0c3-6a9b-413f-bc36-67ac82fea3c3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.068237 Nov 06 21:06:17.836462 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2789/5495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:17 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:17.902009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:17.902522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:17.903180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:17.903729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:17.905159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:17.986931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:17.987820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:17.991714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:18.000198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.000965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.002032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.003172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.003596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.004462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.005558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.006412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.040640 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92160226-a408-4183-bb6c-f98894b0a229 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "POST /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd/action" status: 202 len: 1079 microversion: 2.47 time: 0.236459 Nov 06 21:06:18.043036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2707/5496] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:06:17 2021] POST /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd/action => generated 1079 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 06 21:06:18.065649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:18.066480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:18.074381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.074842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.075812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.076638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.203886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:18.215960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:18.221942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:18.226771 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff83f5da-dd99-46a4-89ca-e31d5415a30a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.167090 Nov 06 21:06:18.227917 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2708/5497] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:18 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:18.235879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ea055e45-7b45-4dd9-aa25-0964cde56ee6 req-4252e4b4-f774-473b-8fe7-33c632597b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da3b3c4-23b9-4025-9148-2b3df46d60bd", "name": "network-vif-plugged", "status": "completed", "tag": "46e3a37b-fdae-4de1-b4fa-b19d171d2efe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:18.237511 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:18.237511 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:18.250910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ea055e45-7b45-4dd9-aa25-0964cde56ee6 req-4252e4b4-f774-473b-8fe7-33c632597b9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.253115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ea055e45-7b45-4dd9-aa25-0964cde56ee6 req-4252e4b4-f774-473b-8fe7-33c632597b9d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.274594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ea055e45-7b45-4dd9-aa25-0964cde56ee6 req-4252e4b4-f774-473b-8fe7-33c632597b9d service nova] Creating event network-vif-plugged:46e3a37b-fdae-4de1-b4fa-b19d171d2efe for instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd on nch2-master-1 Nov 06 21:06:18.280176 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ea055e45-7b45-4dd9-aa25-0964cde56ee6 req-4252e4b4-f774-473b-8fe7-33c632597b9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050976 Nov 06 21:06:18.280852 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2709/5498] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:18.296359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:18.304104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f782fbbf-8cff-4db8-82c6-fdfa0ab8d2b0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.322976 Nov 06 21:06:18.305146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2790/5499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:17 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:18.848252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:18.849254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:18.855393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.855846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.856647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:18.857584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:18.898049 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f05d95d9-7a72-4c5b-9bbc-d644f5719a03 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.054443 Nov 06 21:06:18.898657 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2710/5500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:18 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:19.245442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:19.246062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:19.254298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.254755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.255549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.255988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.320739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:19.322987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:19.324894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:19.328786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:19.330320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:19.331516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab2177cc-51ca-461e-b5c0-7fea1a5c8a80 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.089930 Nov 06 21:06:19.334307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.334879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.335797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.336714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.343554 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2791/5501] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:19 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:19.485356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:19.492671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f52f3c09-5931-41f9-8dba-f23b7135f480 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1308 microversion: 2.1 time: 0.174631 Nov 06 21:06:19.493234 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2711/5502] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:19 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:19.660365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1424719774", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:19.708102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:06:19.910194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:19.911265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:19.918970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.919487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.920281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:19.921005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:19.967852 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c42d50c-5aae-4ae0-91ad-3b2459d1066e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.061301 Nov 06 21:06:19.970622 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2712/5503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:19 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:19.990387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:19.991011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:19.991522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:19.992119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:19.992739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:20.002966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.003451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.004339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.004822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.023331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Getting quotas for project 851c2b80f5494964acaa57e656390e5e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:20.029095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Getting quotas for user ec5fd2a8ee26496aadb9e422dc995fe6 and project 851c2b80f5494964acaa57e656390e5e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:06:20.042800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:06:20.045221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:06:20.091005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8920cba-2473-4c79-bd2b-956f163ea5ac tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434268 Nov 06 21:06:20.091700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2792/5504] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:06:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:06:20.102047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4246cbb-573a-4294-88c9-98cdf3da2d0e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:20.102992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4246cbb-573a-4294-88c9-98cdf3da2d0e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.159750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4246cbb-573a-4294-88c9-98cdf3da2d0e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.166238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4246cbb-573a-4294-88c9-98cdf3da2d0e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1214 microversion: 2.1 time: 0.068353 Nov 06 21:06:20.167184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2713/5505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:20 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:20.351190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:20.351811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.359347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.359878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.360791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.361238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.433117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.441699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.443365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.444600 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97891491-ab23-42bc-bb6a-acdf48837957 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.097247 Nov 06 21:06:20.445177 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2793/5506] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:20 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:20.509976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:20.510617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.517347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.517802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.518584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.519022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.697010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.705117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4778327-ea12-474e-97a2-4ab0066b01da tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1488 microversion: 2.1 time: 0.198977 Nov 06 21:06:20.705830 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2714/5507] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:20 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:20.721942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-517601420"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:20.723183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.729188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.729721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.730519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.730957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.799159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5fb57ea-f561-4568-9494-b535b743518b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "PUT /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1073 microversion: 2.1 time: 0.080906 Nov 06 21:06:20.800215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2794/5508] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:06:20 2021] PUT /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1073 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:20.814115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:20.814975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.821416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.821856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.822651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.823090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.954197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:20.961603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48617342-dca0-4048-b712-6a3f06b9444e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1499 microversion: 2.1 time: 0.151165 Nov 06 21:06:20.962168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2715/5509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:20 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1499 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:20.977985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:20.978701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.978932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:20.980472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:20.985950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.986408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.988440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.989291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.989416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.989603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:20.990291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:20.990985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.140524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.148056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-faabfaa8-a5c8-4915-8dd9-073841940c6b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1499 microversion: 2.1 time: 0.173884 Nov 06 21:06:21.148679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2795/5510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:20 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1499 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:21.163056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54002ac9-08fc-47fb-bee3-a5df1a1aebb4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.187890 Nov 06 21:06:21.163844 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2716/5511] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:20 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:21.164060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87d99a15-16f5-4d01-ab45-9ec53f91cd70 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:21.170483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d99a15-16f5-4d01-ab45-9ec53f91cd70 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.170940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87d99a15-16f5-4d01-ab45-9ec53f91cd70 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.183461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:21.184165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:21.191123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.191578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.192396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.192834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.193171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87d99a15-16f5-4d01-ab45-9ec53f91cd70 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:06:21.234776 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87d99a15-16f5-4d01-ab45-9ec53f91cd70 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "POST /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd/action" status: 202 len: 0 microversion: 2.1 time: 0.074023 Nov 06 21:06:21.235309 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2796/5512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:21 2021] POST /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:06:21.244208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:21.244959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:21.251808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.252258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.253120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.253547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.258591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.268097 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0bbeed1a-4e82-4a19-abb5-50f2ef1735ff tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1266 microversion: 2.1 time: 0.088488 Nov 06 21:06:21.269058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2717/5513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:21 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:21.390422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.397819 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-766c7eb8-37eb-4dcf-9f7b-53dd5e8ae032 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.158343 Nov 06 21:06:21.398388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2797/5514] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:21 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:21.462983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:21.463606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:21.471309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.471896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.472726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:21.473170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:21.546011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.554678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.556187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:21.557399 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac6abecb-ee79-4dc1-852a-085978b142a5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.098334 Nov 06 21:06:21.558149 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2718/5515] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:21 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:22.173976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:22.174889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:22.181264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.181717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.182497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.182931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.221907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f7b7eec-8665-419d-82b0-cb9754d857fb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 16353 microversion: 2.1 time: 0.051488 Nov 06 21:06:22.223332 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2798/5516] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:22 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 16353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:22.285658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:22.286375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:22.293636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.294096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.295489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.295934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.421320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:22.422126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:22.431891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.434411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.435355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.436010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.439810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:22.449352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2805a48-d0b3-4a36-a038-c9349d2052d2 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.167350 Nov 06 21:06:22.450586 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2719/5517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:22 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:22.577259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:22.578036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:22.585004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.585727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.586699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:22.587334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:22.631882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:22.642176 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e14aeea9-9ea6-4cbf-ab01-8a3cbff6a5fb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.229228 Nov 06 21:06:22.648490 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2799/5518] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:22 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:22.672076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:22.680791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:22.682285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:22.684131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-912e0857-b3a1-4276-b739-c0cc80c35058 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.110772 Nov 06 21:06:22.685456 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2720/5519] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:22 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:23.146539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5ed63460-408e-436e-81ca-df501604382a req-783d0a44-af87-44b0-82e9-e334070b8ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d88d69-b75b-4b9a-aa09-fff4350dc38e", "tag": "3471221c-f2e2-4aa9-8203-a9e22ba0c090"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:23.149724 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:23.149724 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:23.158106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5ed63460-408e-436e-81ca-df501604382a req-783d0a44-af87-44b0-82e9-e334070b8ecf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.158638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5ed63460-408e-436e-81ca-df501604382a req-783d0a44-af87-44b0-82e9-e334070b8ecf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.176640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5ed63460-408e-436e-81ca-df501604382a req-783d0a44-af87-44b0-82e9-e334070b8ecf service nova] Creating event network-changed:3471221c-f2e2-4aa9-8203-a9e22ba0c090 for instance 85d88d69-b75b-4b9a-aa09-fff4350dc38e on nch2-master-1 Nov 06 21:06:23.181581 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5ed63460-408e-436e-81ca-df501604382a req-783d0a44-af87-44b0-82e9-e334070b8ecf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039636 Nov 06 21:06:23.182509 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2800/5520] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:06:23.233965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:23.234929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:23.241092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.241561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.243002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.243451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.303164 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1878c01-c5b1-4a0f-aa8e-17cf7b6a6efb tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.072958 Nov 06 21:06:23.306948 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2721/5521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:23 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:23.467645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:23.468486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:23.474474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.474924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.475702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.476132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.606505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:23.615755 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c341f24-f1ff-4647-9a57-d027a197c1fa tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.152542 Nov 06 21:06:23.616339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2801/5522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:23 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:23.659755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:23.660528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:23.667743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.668129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.669025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.669957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.703314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:23.703937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:23.722307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.722770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.723604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:23.724033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:23.824532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:23.833554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:23.835474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:23.837104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8855527d-e157-4aca-ae27-489702cb9d48 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.137776 Nov 06 21:06:23.838185 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2802/5523] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:23 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:23.846626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:23.854745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98f7c4f8-b22d-4a7d-9b28-69656ef72795 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.199001 Nov 06 21:06:23.855503 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2722/5524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:23 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:24.315346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:24.316282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:24.323466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.323981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.324824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.325255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.373955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e21a3a82-3e51-4787-a173-95e88379df11 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.062536 Nov 06 21:06:24.374766 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2803/5525] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:24 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:24.637810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:24.639019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:24.645868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.646319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.647103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.647538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.776472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:24.783866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8362a912-c5de-48f3-936c-8cb82a6ab431 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.149706 Nov 06 21:06:24.784460 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2723/5526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:24 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:24.856387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:24.857682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:24.864699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.865159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.865952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.866426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.873138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:24.873760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:24.879851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.880329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.881130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:24.881573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:24.939494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:24.947422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:24.948968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:24.950150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba2ae7d9-d1a2-4da7-80f1-a669d87869a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.098037 Nov 06 21:06:24.950780 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2804/5527] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:24 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:25.027588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:25.034920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0b99ede2-0ad8-46a9-aa1c-fb34b580d301 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.165970 Nov 06 21:06:25.035483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2724/5528] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:24 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:25.385854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:25.386958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:25.394900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.395453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:25.396545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.397110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:25.451193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e949eabd-29ab-4847-9289-702c5ec94c09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.068949 Nov 06 21:06:25.454913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2805/5529] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:25 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:25.801562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:25.802089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:25.809773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.810269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:25.811070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.811506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:25.952932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:25.960410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edb22bef-f378-4773-bee4-f0e557e24bed tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.162713 Nov 06 21:06:25.960981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2725/5530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:25 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:25.969781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:25.970490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:25.977551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.978010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:25.978795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:25.979234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.044145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:26.052580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:26.052718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:26.053123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:26.054065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:26.055243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2adcbb97-ccde-4fab-8ee9-0d3dfdfa9008 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.090259 Nov 06 21:06:26.055806 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2806/5531] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:25 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:26.059369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.060481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.061463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.062005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.194465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:26.202336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c910a1e0-cd48-422b-8df0-cb2dfa9e6359 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.153956 Nov 06 21:06:26.202905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2726/5532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:26 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:26.462789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:26.463791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:26.474538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.474987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.475770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.476203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.518122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e430845-f095-4851-a744-9badfb3ec243 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.059103 Nov 06 21:06:26.518802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2807/5533] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:26 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:26.976984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:26.977597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:26.985640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.986243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:26.986899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:26.987333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.074844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:27.075572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:27.082539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.082987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.083774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.084206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.124590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:27.132970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c62740d6-8256-481d-8fde-9164d704bf01 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.159684 Nov 06 21:06:27.133550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2727/5534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:26 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:27.152720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:27.161925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:27.163455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:27.165388 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2b7b707-e525-480b-8830-6c097adc8ea9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.093900 Nov 06 21:06:27.166027 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2808/5535] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:27 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:27.219553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:27.220126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:27.226029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.226486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.227265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.227705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.366010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:27.373574 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-543ecb00-e701-47c1-ac1c-07b3eda2aaf4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.158462 Nov 06 21:06:27.374442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2728/5536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:27 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:27.529803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:27.530745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:27.537869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.538322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.539164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:27.539641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:27.582836 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c28c557-dcd2-45c9-960a-f224f965ca21 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.056916 Nov 06 21:06:27.583470 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2809/5537] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:27 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:28.150655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:28.151392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:28.164750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.165282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.166151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.166592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.186089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:28.186787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:28.194087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.194882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.195866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.196488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.292873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:28.304082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:28.306090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:28.307503 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2bc4527-ff14-4283-8eb6-25d620cb1eb6 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.125850 Nov 06 21:06:28.308271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2810/5538] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:28 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:28.361690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:28.369994 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a774345-9186-40fb-983d-0c1a54bfe78e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.222948 Nov 06 21:06:28.371548 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2729/5539] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:28 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:28.390930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:28.391696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:28.398397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.398859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.399655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.400103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.552176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:28.560602 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae111869-32b0-4b92-9ebe-64684c386eeb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.173360 Nov 06 21:06:28.561295 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2811/5540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:28 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:28.595823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:28.596841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:28.603226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.603679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.604639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:28.605226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:28.649128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c392828-8fef-4fc1-909c-5abf545c5690 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.058365 Nov 06 21:06:28.650038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2730/5541] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:28 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:29.326090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:29.326715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:29.338962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.339489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.340580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.341026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.389276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:29.390039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:29.398205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.399174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.400618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.401166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.414357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:29.437114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:29.440277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:29.441840 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5155926a-25e2-4009-801f-1d08ea16433c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.119460 Nov 06 21:06:29.442943 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2812/5542] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:29 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:29.576866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:29.577749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:29.578560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:29.585987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.586443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.587731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.587907 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c061de70-7f49-4a03-a67e-881a5c107888 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.203745 Nov 06 21:06:29.588246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.589237 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2731/5543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:29 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:29.663480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:29.664774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:29.672259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.672792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.674272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:29.674686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:29.729924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c7eaad7-0522-4d1f-b0fa-58b70dd0e5b5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.070532 Nov 06 21:06:29.730584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2732/5544] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:29 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:29.733328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:29.742547 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a64e6c73-affb-41ed-b177-d5b785abfa4a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.168614 Nov 06 21:06:29.743459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2813/5545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:29 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:30.103039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5a7a220a-167a-463b-bf03-c1f7a2d2d8dd req-ed109795-9cdd-437d-b845-a74036154dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d88d69-b75b-4b9a-aa09-fff4350dc38e", "name": "network-vif-plugged", "status": "completed", "tag": "3471221c-f2e2-4aa9-8203-a9e22ba0c090"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:30.105004 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:30.105004 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:30.113344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5a7a220a-167a-463b-bf03-c1f7a2d2d8dd req-ed109795-9cdd-437d-b845-a74036154dae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.113987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5a7a220a-167a-463b-bf03-c1f7a2d2d8dd req-ed109795-9cdd-437d-b845-a74036154dae service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.128724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5a7a220a-167a-463b-bf03-c1f7a2d2d8dd req-ed109795-9cdd-437d-b845-a74036154dae service nova] Creating event network-vif-plugged:3471221c-f2e2-4aa9-8203-a9e22ba0c090 for instance 85d88d69-b75b-4b9a-aa09-fff4350dc38e on nch2-master-1 Nov 06 21:06:30.134383 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5a7a220a-167a-463b-bf03-c1f7a2d2d8dd req-ed109795-9cdd-437d-b845-a74036154dae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Nov 06 21:06:30.135444 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2733/5546] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:30.460462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:30.461108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:30.467676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.468136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.469662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.470621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.537281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:30.546219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:30.547987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:30.550193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f4f60c9-1db3-4269-be39-3e7106df6ca9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.093533 Nov 06 21:06:30.560322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2814/5547] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:30 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:30.608048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:30.608786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:30.616179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.616763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.617718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.618398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.741288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:30.742606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:30.766150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.768253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.769292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.769873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.804523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:30.812677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0899f33d-9440-4f85-8e38-340caa110cd7 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.210009 Nov 06 21:06:30.820925 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2734/5548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:30 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:30.826628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:30.827264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:30.834235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c8d9915-6b17-4917-8798-0b7fa82a1dbf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.096626 Nov 06 21:06:30.838351 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2815/5549] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:30 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:30.839953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.840469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:30.841359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:30.841818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.008553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:31.021244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6321f899-1ab8-4f81-b530-d994cd298221 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.198061 Nov 06 21:06:31.024782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2735/5550] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:30 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:31.571202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:31.572087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:31.579834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.580545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.581405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.581810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.666192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:31.676769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:31.679087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:31.680457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa6ac1dc-b636-4b10-8783-b08f336e1df0 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.114047 Nov 06 21:06:31.692511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2816/5551] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:31 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:31.830525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:31.831126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:31.839549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.840057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.841031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.841601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.845821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:31.846755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:31.853769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.854544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.855570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:31.856216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:31.912343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d72c0deb-9a92-4e0d-a3bb-2d3afd09d836 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.069765 Nov 06 21:06:31.913921 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2817/5552] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:31 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:32.033380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:32.043340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:32.044111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:32.044218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90bd2f56-95de-4a4f-b51b-10fef5107072 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1314 microversion: 2.1 time: 0.218053 Nov 06 21:06:32.044970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2736/5553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:31 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:32.059385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.059909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.060992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.061912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.250323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:32.258813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a914a21b-6b9a-48bb-aeea-ec795c9a603f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.222929 Nov 06 21:06:32.271373 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2818/5554] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:32 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:32.361644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2131529527", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "10aa7df9-ef25-4001-9ab7-89fee07e9767"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:32.419953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] validate_networks() for [('10aa7df9-ef25-4001-9ab7-89fee07e9767', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:06:32.700989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:32.702470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:32.712441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.712441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.713397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.713832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.798734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:32.806912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:32.808461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:32.809887 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e57171d3-d49c-4e4e-bc9f-9488c84d7fc1 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.113406 Nov 06 21:06:32.810435 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2819/5555] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:32 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:32.850446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:32.850923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:32.851341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:32.851763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:32.852257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:32.864392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.864969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.865804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.866249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.885114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Getting quotas for project cf82afb0b851411fa5ebbb7a77e087f3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:32.891092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Getting quotas for user d3c2cde31b11407793be22fcefdb72a2 and project cf82afb0b851411fa5ebbb7a77e087f3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:06:32.905120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:06:32.907682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:06:32.924794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:32.926693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:32.934088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.934640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.935564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:32.936159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:32.959495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ddc71ed-a730-4e28-9bd6-28133165dc95 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746208 Nov 06 21:06:32.960137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2737/5556] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:06:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:06:32.970435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ccdd8824-ce1a-4593-95e5-49a0676ea929 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:32.971058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ccdd8824-ce1a-4593-95e5-49a0676ea929 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:32.994772 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c025484b-581e-490b-b261-2af99d60a260 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.072863 Nov 06 21:06:32.995011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2820/5557] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:32 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:33.032565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ccdd8824-ce1a-4593-95e5-49a0676ea929 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.040392 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ccdd8824-ce1a-4593-95e5-49a0676ea929 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1214 microversion: 2.1 time: 0.074088 Nov 06 21:06:33.040975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2738/5558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:32 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:33.063225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:33.064493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:33.071844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.072323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.073182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.073821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.232704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.242495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27987562-b116-42c7-8d4b-4d40dd7b8455 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1464 microversion: 2.1 time: 0.183223 Nov 06 21:06:33.243482 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2821/5559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:33 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:33.261778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1e216d8-3a6b-4fcb-a9c0-a136b001e711", "device": "/dev/sdb"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:33.263670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:33.271585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.272045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.277639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.278259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.280495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:33.281410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:33.291283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.292154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.293134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.293896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.577643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.585475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-015756c0-efb6-4f83-a38a-4d7342462dcb tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.310138 Nov 06 21:06:33.586045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2822/5560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:33 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:33.679872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b90e796-c36a-4f8f-952a-ffeb999bad10 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "POST /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422199 Nov 06 21:06:33.680598 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2739/5561] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:06:33 2021] POST /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:33.829899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:33.830511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:33.836852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.837307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.838093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:33.838797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:33.905827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.914456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.916002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:33.917500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6846f115-312d-465a-84c2-cb5b76ef2183 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.091911 Nov 06 21:06:33.918059 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2823/5562] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:33 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:34.007442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:34.008538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:34.014684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.015139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.015917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.016376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.057324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:34.058072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:34.074048 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-716cc6e2-8ac8-4eeb-9762-9dc0f1fc7c3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.071039 Nov 06 21:06:34.077506 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2740/5563] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:34 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:34.081051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.081516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.082323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.082767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.170243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:34.179496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-30cefdde-47f0-4056-9904-8ae55efadff2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1266 microversion: 2.1 time: 0.125939 Nov 06 21:06:34.181052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2824/5564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:34 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:34.603607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:34.604611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:34.612332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.612903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.613800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.614431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.750469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:34.759342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d033389-a1f1-41b4-802b-3c87f230910f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.160058 Nov 06 21:06:34.760668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2741/5565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:34 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:34.937724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:34.938443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:34.946040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.946502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:34.947309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:34.947751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.014205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:35.021837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:35.023387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:35.024616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-800cad65-79b5-4985-99d4-d5261426007e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.090761 Nov 06 21:06:35.025341 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2825/5566] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:34 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:35.086035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:35.086965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:35.095582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.096039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.096859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.097303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.146591 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2bd8e118-2efa-495b-8956-048b2a93608f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.064058 Nov 06 21:06:35.147835 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2742/5567] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:35 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:35.197873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:35.198824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:35.206103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.206558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.207465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.207943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.568461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-29f18b16-8d14-40bb-94d0-7985b79902bf req-9dac9e1b-9efd-4360-b04d-b780a3931848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0", "tag": "e84fd4a8-a08d-4b66-882b-9f627be244d1"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:35.570726 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:35.570726 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:35.584747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29f18b16-8d14-40bb-94d0-7985b79902bf req-9dac9e1b-9efd-4360-b04d-b780a3931848 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.585340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29f18b16-8d14-40bb-94d0-7985b79902bf req-9dac9e1b-9efd-4360-b04d-b780a3931848 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.603120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-29f18b16-8d14-40bb-94d0-7985b79902bf req-9dac9e1b-9efd-4360-b04d-b780a3931848 service nova] Creating event network-changed:e84fd4a8-a08d-4b66-882b-9f627be244d1 for instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 on nch2-master-1 Nov 06 21:06:35.607956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-29f18b16-8d14-40bb-94d0-7985b79902bf req-9dac9e1b-9efd-4360-b04d-b780a3931848 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044867 Nov 06 21:06:35.608669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2743/5568] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:35.615309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:35.622626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb3bd1c4-b527-4138-837c-ad2dac5c1418 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.428567 Nov 06 21:06:35.623190 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2826/5569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:35 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:35.777842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:35.778613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:35.785351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.785811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.786668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:35.787120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:35.927423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:35.935037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6db68483-1ae0-45b7-8032-842ddc0eebd8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.161595 Nov 06 21:06:35.935610 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2744/5570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:35 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:36.044619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:36.045218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:36.051635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.052086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.052895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.053333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.115539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:36.123439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:36.124978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:36.126158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4680752-122f-499e-bfd4-541488887106 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.086409 Nov 06 21:06:36.126747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2827/5571] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:36 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:36.158790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:36.159706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:36.166472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.167066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.167851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.168946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.211074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1f48323-fd2e-471d-b831-7c4d993c48c5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.056468 Nov 06 21:06:36.211710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2745/5572] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:36 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:36.639879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:36.640561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:36.647529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.647986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.648810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.649254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.779307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:36.786647 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d2bdd83-ef85-446a-9c97-c7101fa1037e tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.150460 Nov 06 21:06:36.787219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2828/5573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:36 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:36.952039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:36.952944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:36.961342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.961952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:36.963041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:36.963579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.117130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:37.124913 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1be94014-0ee4-4104-9841-e7124b2822b9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.176862 Nov 06 21:06:37.125688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2746/5574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:36 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:37.149374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:37.150047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:37.160173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.160679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.164969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.165431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.223258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:37.224193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:37.231284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.231722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.232942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.233487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.238258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:37.249213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:37.251216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:37.253036 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64f1ac57-36a8-4e40-80e0-1e88022a806e tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.108151 Nov 06 21:06:37.254133 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2829/5575] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:37 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:37.288280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87c9e8e9-27d6-4469-9323-32954a0df4ae tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.069235 Nov 06 21:06:37.289112 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2747/5576] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:37 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:37.802876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:37.803674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:37.811262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.811713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.812560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:37.813061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:37.965033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:37.974323 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb8787e9-b7a6-4ffb-ae81-44a9485901dd tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.175135 Nov 06 21:06:37.974905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2830/5577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:37 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:38.144466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:38.145363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:38.154823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.155405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.156205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.156693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.273324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:38.274627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:38.280565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.281051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.281896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.282301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.293885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:38.302987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de626e09-bc08-44f2-8f7e-b4306a30fe09 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.163789 Nov 06 21:06:38.303767 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2748/5578] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:38 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:38.308268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:38.309393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:38.316010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.316579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.317537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:38.317977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:38.357687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:38.368909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:38.369561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53505867-25da-40fa-a137-9f0417d4e9b9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.064399 Nov 06 21:06:38.370213 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2749/5579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:38 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:38.370442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:38.371805 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4518023d-9c66-4fdd-95e0-dea81569ad57 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.102205 Nov 06 21:06:38.372655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2831/5580] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:38 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:38.992265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:38.992920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.000200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.000716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.001512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.002006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.151451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:39.161218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85ddb14f-57fa-452f-af5c-4844e51cf9f2 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.173286 Nov 06 21:06:39.161965 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2750/5581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:38 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:39.319940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:39.320589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.328257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.328751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.330044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.330485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.381417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:39.382381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.390307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.390777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.392120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.392915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.438024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cd599ff-5eeb-4be4-9339-2f19a0f04a09 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.060326 Nov 06 21:06:39.439961 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2751/5582] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:39 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:39.446224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:39.446927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.453896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.454970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.455884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.456219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.512166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:39.521129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2f4baa1-b8f1-4706-a171-84437d83234d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.204746 Nov 06 21:06:39.521862 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2832/5583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:39 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:39.537995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:39.547203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:39.548925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:39.550083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56019ae4-45b9-44cf-b62c-065ba56e7d6b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.108795 Nov 06 21:06:39.550646 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2752/5584] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:39 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:39.781676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:39.782656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.788726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.789207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.790064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.790505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.823584 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcc2c52b-02ef-4dca-b566-d40064c42a9f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045759 Nov 06 21:06:39.824167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2833/5585] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Nov 6 21:06:39 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:39.882537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:39.883034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:39.889431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.889906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.890671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:39.891106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:39.917372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:40.016498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bedf4aa2-46a9-4921-80c2-b9b34409921c tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 204 len: 0 microversion: 2.20 time: 0.136580 Nov 06 21:06:40.017195 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2753/5586] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 21:06:39 2021] DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:06:40.026604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:40.027224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:40.034345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.035095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.036471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.037078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.183299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:40.184507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:40.192385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.193750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.203335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.206185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.207301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.219221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.220840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.227561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a47ee3f-4655-42d0-98e1-1acbc12ccbd9 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.205148 Nov 06 21:06:40.233659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2834/5587] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:40 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:40.396700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.404455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-845cad35-009d-4132-9be2-2bae896d2edf tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.228606 Nov 06 21:06:40.405038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2754/5588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:40 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:40.451070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:40.452138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:40.459781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.460368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.461247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.461751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.512443 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0f1f174-a269-48e0-92f8-91b02797bdde tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.064874 Nov 06 21:06:40.513097 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2835/5589] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:40 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:40.545191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:40.545802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:40.552279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.552895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.553873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.554367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.570274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:40.571149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:40.579856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.580413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.581966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:40.582447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:40.662916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.675992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.677650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.679204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-195955fa-0fb6-4e38-9180-ceccf246de33 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.114021 Nov 06 21:06:40.680055 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2836/5590] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:40 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:40.738317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:40.747713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c83af67c-4ee2-4c10-9e9e-6810cc0592a2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.206308 Nov 06 21:06:40.759968 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2755/5591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:40 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:41.253188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:41.253814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.260814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.261277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.262111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.262552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.339360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:41.339862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.347236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.347637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.348644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.349109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.412637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.421954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.424347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.425739 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcae31a6-98ed-475a-807d-da8b5125643f tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.177101 Nov 06 21:06:41.426389 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2837/5592] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:41 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:41.430993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:41.431681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.439250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.439861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.441026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.441369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.446536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lazy-loading 'services' on Instance uuid 85d88d69-b75b-4b9a-aa09-fff4350dc38e {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:06:41.519439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e/os-volume_attachments/a1e216d8-3a6b-4fcb-a9c0-a136b001e711" status: 202 len: 0 microversion: 2.1 time: 0.184228 Nov 06 21:06:41.524006 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2756/5593] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:06:41 2021] DELETE /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e/os-volume_attachments/a1e216d8-3a6b-4fcb-a9c0-a136b001e711 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:06:41.529538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:41.531577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.538422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.538938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.539763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.540422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.593788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.600446 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-540e5b61-9bab-44cc-9f58-e3667b834f00 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.074761 Nov 06 21:06:41.601214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2757/5594] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:41 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:41.601329 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-367c3505-0f83-4e98-8583-65e2d1444a42 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.173748 Nov 06 21:06:41.601867 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2838/5595] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:41 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:41.699402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:41.700873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.708283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.708773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.709570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.710013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.764780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:41.765432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:41.772614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.773506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.773957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:41.774405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:41.776049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.785436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.786929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.788269 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fcc1b26b-de73-4aa7-9730-4ed543d332a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.092821 Nov 06 21:06:41.788950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2758/5596] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:41 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:06:41.911062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:41.919217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c30ff10-b5c1-4e64-8e01-29e4503e3eff tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.158705 Nov 06 21:06:41.919783 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2839/5597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:41 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:42.144009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-eac8117f-6a42-4080-bfa4-8dca91117d8a req-f89a19a5-2d81-48d8-acaa-a0b84d8f40fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0", "name": "network-vif-plugged", "status": "completed", "tag": "e84fd4a8-a08d-4b66-882b-9f627be244d1"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:42.145548 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:42.145548 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:42.153624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-eac8117f-6a42-4080-bfa4-8dca91117d8a req-f89a19a5-2d81-48d8-acaa-a0b84d8f40fb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.155367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-eac8117f-6a42-4080-bfa4-8dca91117d8a req-f89a19a5-2d81-48d8-acaa-a0b84d8f40fb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.168889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eac8117f-6a42-4080-bfa4-8dca91117d8a req-f89a19a5-2d81-48d8-acaa-a0b84d8f40fb service nova] Creating event network-vif-plugged:e84fd4a8-a08d-4b66-882b-9f627be244d1 for instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 on nch2-master-1 Nov 06 21:06:42.174806 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-eac8117f-6a42-4080-bfa4-8dca91117d8a req-f89a19a5-2d81-48d8-acaa-a0b84d8f40fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034828 Nov 06 21:06:42.175921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2759/5598] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:42.446521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:42.447670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:42.455213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.456560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.457401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.458058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.609359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.612145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:42.613963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:42.622904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.623304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.623464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.624147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.624610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.627071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.629156 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d32fef1b-d667-4ebf-98b7-502807640194 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1720 microversion: 2.20 time: 0.186948 Nov 06 21:06:42.629819 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2840/5599] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:42 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:42.634738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:42.635341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:42.642674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.643200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.644094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.644627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.728614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e2fe59a-6af9-4790-9a6b-f73de4aa2618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.120705 Nov 06 21:06:42.729934 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2760/5600] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:42 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:42.800480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.808039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:42.812996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:42.826839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.827310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.828152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.828761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.832951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40134dd1-91b3-46e9-a145-11a580d3ddbb tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.191474 Nov 06 21:06:42.834261 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2841/5601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:42 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:42.916069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.929290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.931067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:42.932696 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2fa489ef-7d9e-487d-85b9-f06a3e915b1c tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.128994 Nov 06 21:06:42.933606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2761/5602] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:42 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:42.946306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:42.947407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:42.957352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.957957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:42.958971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:42.959427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.117963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:43.125494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f95bfa15-e8c7-4559-820a-dd7e39097448 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.186023 Nov 06 21:06:43.136544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2842/5603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:42 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:43.534850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-27436c40-39e5-4cd5-a227-0a0585d0f379 req-2b667695-8c83-45c5-9a20-d5f660a59b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa56ba73-ff91-44bb-9129-a967bbaad7d0", "name": "network-vif-deleted", "tag": "0f2b5c6f-8395-407a-ad5a-d822b72153bc"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:43.537019 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:43.537019 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:43.546207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-27436c40-39e5-4cd5-a227-0a0585d0f379 req-2b667695-8c83-45c5-9a20-d5f660a59b38 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.546967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-27436c40-39e5-4cd5-a227-0a0585d0f379 req-2b667695-8c83-45c5-9a20-d5f660a59b38 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.560744 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-27436c40-39e5-4cd5-a227-0a0585d0f379 req-2b667695-8c83-45c5-9a20-d5f660a59b38 service nova] Creating event network-vif-deleted:0f2b5c6f-8395-407a-ad5a-d822b72153bc for instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 on nch2-master-1 Nov 06 21:06:43.566456 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-27436c40-39e5-4cd5-a227-0a0585d0f379 req-2b667695-8c83-45c5-9a20-d5f660a59b38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035270 Nov 06 21:06:43.567240 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2762/5604] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:43.648505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:43.649193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:43.658631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.659128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.660585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.661428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.725503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:43.726161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:43.728114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.728865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.729433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lazy-loading 'fault' on Instance uuid fa56ba73-ff91-44bb-9129-a967bbaad7d0 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:06:43.733230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.733894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.737334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.738165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.786494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:43.795934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:43.810163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:43.811847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f17807a206f49a1a165fe77aec4468c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0abfd854dfe46acaeedf288c6674c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:43.817331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1187b17f-eb71-4946-98c4-d85686fcfaac tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 200 len: 1370 microversion: 2.20 time: 0.173311 Nov 06 21:06:43.829967 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2843/5605] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:43 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:43.836796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:43.838404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:43.846127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.846592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.847628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.848249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.886912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc6d48c8-f0e5-453e-ad7a-eff3bf7786ab tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 204 len: 0 microversion: 2.1 time: 0.165940 Nov 06 21:06:43.890945 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2763/5606] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:43 2021] DELETE /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:06:43.896542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:43.897550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:43.905630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.906201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.907631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.908189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.928998 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-529ac0f1-9f35-4489-8068-eceaff2ab79d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.096762 Nov 06 21:06:43.929574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2844/5607] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:43 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:43.935040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:43.935980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:43.943496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.943951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:43.945002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:43.945592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.160670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.165638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.168883 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-658afad8-144b-4d8e-913e-5b0c904ad33a tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1314 microversion: 2.1 time: 0.276438 Nov 06 21:06:44.169555 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2764/5608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:43 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:44.174870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:44.175499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:44.180486 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f42674fe-c0b2-44f6-8439-1c52f057ba60 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1470 microversion: 2.1 time: 0.249135 Nov 06 21:06:44.181458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2845/5609] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:43 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:44.188075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:44.189061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:44.190099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.190634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.191506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.192279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.196005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.196660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.197618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.199158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.283039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.292320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.302750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.305062 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-676701b3-8a85-4e40-9dd6-80b0affcf99b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.134501 Nov 06 21:06:44.306718 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2765/5610] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:44 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:44.411751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:44.421347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2969b64-12a1-415e-990f-71571412374e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.238598 Nov 06 21:06:44.422128 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2846/5611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:44 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:44.836763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:44.837511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:44.848083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.848717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.849681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.850218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.867105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. Nov 06 21:06:44.867912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:44.868873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76fbc1ef-da7d-486d-9901-7c1c8f801295 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 404 len: 111 microversion: 2.20 time: 0.037262 Nov 06 21:06:44.872968 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2766/5612] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:44 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:06:44.878266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5961b75-85ec-4b58-96ee-fb0c3886cd44 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '.version_select at 0x7f6715adbd30>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:44.897184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5961b75-85ec-4b58-96ee-fb0c3886cd44 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853574294" status: 204 len: 0 microversion: 2.20 time: 0.022520 Nov 06 21:06:44.897802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2847/5613] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Nov 6 21:06:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853574294 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:06:44.944834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:44.945809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:44.953145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.953610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:44.955452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:44.955960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.005679 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0d4a9d8-e866-4dfd-9c6f-5873fc403094 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.065515 Nov 06 21:06:45.009803 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2767/5614] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:44 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:45.185922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:45.186526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:45.194197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.194653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.195524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.195885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.200084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:45.201137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:45.211603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.212128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.213046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.213538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.430602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.432562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.441570 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6593ace0-b63a-4749-95e2-f01dd64b5bf5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1497 microversion: 2.1 time: 0.259315 Nov 06 21:06:45.443022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad0d6937-4912-4463-aabb-5d71db55403e tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1470 microversion: 2.1 time: 0.248456 Nov 06 21:06:45.443770 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2768/5615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:45 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1470 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:45.454099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2848/5616] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:45 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:45.460140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:45.460973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:45.461161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:45.461713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:45.471277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.471547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.471919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.472386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.472493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.473102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.473455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:45.473904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:45.591628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.609831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.612654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.613999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de663485-5ff8-4e98-b41f-45b8655790e8 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1366 microversion: 2.47 time: 0.157549 Nov 06 21:06:45.625551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2769/5617] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:45 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:45.729275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:45.744200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7589ee65-39c6-4254-a729-b5f793643da7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.287726 Nov 06 21:06:45.745006 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2849/5618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:45 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:46.019396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:46.020527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.027502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.028134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.029007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.029623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.084287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-376f1d19-fc30-4bd8-a2cd-ae2b272adb96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.069994 Nov 06 21:06:46.088480 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2770/5619] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:46 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:46.462580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:46.463848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.470742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.471207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.472018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.472509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.623067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:46.632875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90b4b9e0-b31a-4005-9034-015ba3a2ace3 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1470 microversion: 2.1 time: 0.173846 Nov 06 21:06:46.633720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2850/5620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:46 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:46.634901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:46.636005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.649402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.651701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.652652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.653328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.723539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:46.731487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:46.733040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:46.734202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b95c77af-c7b0-492d-959b-0c6e1b9eafe5 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1372 microversion: 2.47 time: 0.104621 Nov 06 21:06:46.734758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2771/5621] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:46 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:46.766894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:46.767507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.773859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.774314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.775141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.775602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.927440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:46.928021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.935502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.936081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.937016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.937580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.961032 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. Nov 06 21:06:46.961641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:46.962496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26b59672-b56d-4755-987c-fef57314b733 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 404 len: 111 microversion: 2.1 time: 0.040851 Nov 06 21:06:46.963246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2772/5622] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:46 2021] DELETE /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:46.974897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:46.975734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: fa56ba73-ff91-44bb-9129-a967bbaad7d0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:46.988034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.993057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:46.998905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:46.999892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.022761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:47.023260 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. Nov 06 21:06:47.024525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance fa56ba73-ff91-44bb-9129-a967bbaad7d0 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:47.025564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6ad7cc3-d0f6-4d6a-b3f3-7dc04627e188 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0" status: 404 len: 111 microversion: 2.1 time: 0.056092 Nov 06 21:06:47.026720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2773/5623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:46 2021] GET /compute/v2.1/servers/fa56ba73-ff91-44bb-9129-a967bbaad7d0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:47.037847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f893c82-4885-4618-bb6a-3aee2845bbef tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.274488 Nov 06 21:06:47.039648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2851/5624] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:46 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:47.100859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:47.102243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:47.119914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.120442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.132234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.132234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.194644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8df57b19-497f-4267-ab85-6f5cfb93ed28 req-61b823e2-d84f-4058-a344-c15742a542c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d88d69-b75b-4b9a-aa09-fff4350dc38e", "name": "network-vif-deleted", "tag": "3471221c-f2e2-4aa9-8203-a9e22ba0c090"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:47.196966 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:47.196966 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:47.209590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8df57b19-497f-4267-ab85-6f5cfb93ed28 req-61b823e2-d84f-4058-a344-c15742a542c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.209906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8df57b19-497f-4267-ab85-6f5cfb93ed28 req-61b823e2-d84f-4058-a344-c15742a542c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.222101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1fbddaa-a84d-46b6-a282-3885f46b0ef9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.128832 Nov 06 21:06:47.228855 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2774/5625] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:47 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:47.242358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8df57b19-497f-4267-ab85-6f5cfb93ed28 req-61b823e2-d84f-4058-a344-c15742a542c3 service nova] Creating event network-vif-deleted:3471221c-f2e2-4aa9-8203-a9e22ba0c090 for instance 85d88d69-b75b-4b9a-aa09-fff4350dc38e on nch2-master-1 Nov 06 21:06:47.248034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8df57b19-497f-4267-ab85-6f5cfb93ed28 req-61b823e2-d84f-4058-a344-c15742a542c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057047 Nov 06 21:06:47.249702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2852/5626] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:47.651105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:47.651815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:47.658694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.659390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.660352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.660776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.694001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.694460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.694929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lazy-loading 'fault' on Instance uuid 85d88d69-b75b-4b9a-aa09-fff4350dc38e {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:06:47.739447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5fd2a8ee26496aadb9e422dc995fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c2b80f5494964acaa57e656390e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:47.745600 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b855053-0887-465e-8fb6-8e59edb96b93 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 200 len: 1304 microversion: 2.1 time: 0.098895 Nov 06 21:06:47.746213 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2775/5627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:47 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:47.759297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:47.760099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:47.772890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.773587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.774566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:47.775407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:47.853536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:47.865696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:47.867527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:47.869276 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0e94573-30cf-4df4-9c4f-3ac3c8f4a56a tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1372 microversion: 2.47 time: 0.117286 Nov 06 21:06:47.870370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2853/5628] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:47 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:48.018594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.019179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.027481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.028851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.029962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.030475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.060496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.062449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.062582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:48.073507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.074322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.075503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.076696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.172232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c492cb8-5698-4db3-b10a-d283d699e8f0 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 204 len: 0 microversion: 2.1 time: 0.157588 Nov 06 21:06:48.173829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2776/5629] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:48 2021] DELETE /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:06:48.184552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.185951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.196432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.197402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.198382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.199222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.258295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:48.268370 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-efe00296-4a19-46b2-912b-c4146aa19047 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.212238 Nov 06 21:06:48.269500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2854/5630] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:48 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:48.284244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:48.285723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.292677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.293454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.294345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.294860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.350067 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f71178dd-f4fd-4be3-90b8-ab01222481f8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.070010 Nov 06 21:06:48.351114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2855/5631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:48 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:48.358448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.359777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.367685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.369054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.369995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.370561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.393824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. Nov 06 21:06:48.395602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:48.396640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbc301ba-5933-4ef6-91ff-cac48a12b6c5 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 404 len: 111 microversion: 2.1 time: 0.043959 Nov 06 21:06:48.397413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:48.397568 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2856/5632] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:48 2021] DELETE /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:48.405871 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a3d0890-9760-414c-9992-078a5c988d50 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1503 microversion: 2.1 time: 0.226759 Nov 06 21:06:48.406116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.406862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] [instance: e9e2a717-8f31-430c-b427-215e5fa49de6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.413876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.414944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.415792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.416272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.425805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2777/5633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:48 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:48.435265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] HTTP exception thrown: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. Nov 06 21:06:48.435901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] Returning 404 to user: Instance e9e2a717-8f31-430c-b427-215e5fa49de6 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:48.437123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b99f2918-5547-444f-949d-2d107910eb98 tempest-AttachVolumeShelveTestJSON-860784193 tempest-AttachVolumeShelveTestJSON-860784193-project] 10.222.0.13 "GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6" status: 404 len: 111 microversion: 2.1 time: 0.035482 Nov 06 21:06:48.437690 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2857/5634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:48 2021] GET /compute/v2.1/servers/e9e2a717-8f31-430c-b427-215e5fa49de6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:06:48.764558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.765305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] [instance: 85d88d69-b75b-4b9a-aa09-fff4350dc38e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.773386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.773969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.775006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.775532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.794003 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] HTTP exception thrown: Instance 85d88d69-b75b-4b9a-aa09-fff4350dc38e could not be found. Nov 06 21:06:48.795578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] Returning 404 to user: Instance 85d88d69-b75b-4b9a-aa09-fff4350dc38e could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:48.796548 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04514bef-b33e-47ef-9a1b-d6341ffff106 tempest-VolumesBackupsTest-994108957 tempest-VolumesBackupsTest-994108957-project] 10.222.0.13 "GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e" status: 404 len: 111 microversion: 2.1 time: 0.036775 Nov 06 21:06:48.798131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2778/5635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:48 2021] GET /compute/v2.1/servers/85d88d69-b75b-4b9a-aa09-fff4350dc38e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:48.889581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:48.890356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:48.900611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.901300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:48.902272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:48.902866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.032477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:49.045863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:49.050692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:49.052214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70b44737-d6f2-4f33-97d3-4de0eacc74b9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1372 microversion: 2.47 time: 0.166643 Nov 06 21:06:49.053335 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2858/5636] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:48 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:49.286558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:49.287798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:49.295740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.296198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.297129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.298358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.366015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:49.367959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:49.376225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.377764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.378754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.379273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.427973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1392fcea-dd2d-449a-b559-cf87c20aabf4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.069300 Nov 06 21:06:49.439794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2859/5637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:49 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:49.446222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:49.447294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:49.457187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.457881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.459012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:49.459299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:49.587782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:49.600819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-056e1362-c5c6-4988-8083-448f61cba888 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.318313 Nov 06 21:06:49.611215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2779/5638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:49 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:49.723791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:49.738706 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5a6960a-38c0-417f-bf7a-e9d9fb2f21f5 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1503 microversion: 2.1 time: 0.297013 Nov 06 21:06:49.740870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2860/5639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:49 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:50.074906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:50.075931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:50.095345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.096147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.097194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.099108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.263548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:50.284051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:50.285846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:50.287535 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a31a718-a22b-4991-b057-24e72894a978 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1372 microversion: 2.47 time: 0.216432 Nov 06 21:06:50.293045 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2780/5640] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:50 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:50.442682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:50.445101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:50.473324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.474322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.476060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.476694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.533291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7484e5f-bb59-4ea8-8efc-a253327c5cc5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.096884 Nov 06 21:06:50.535047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2861/5641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:50 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:50.620404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:50.621179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:50.636732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.641205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.644778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.653518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.758873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:50.759852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:50.792059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.792640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:50.796180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:50.796905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.071403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.088186 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3a0ab19-b25c-4c1e-bb07-b951adc1f97d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.472851 Nov 06 21:06:51.089421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2781/5642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:50 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:51.175152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.183352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ce55b66-bdcc-4d3c-9e53-da0115a49c93 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1503 microversion: 2.1 time: 0.429949 Nov 06 21:06:51.183938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2862/5643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:50 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:51.314624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:51.315751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:51.355263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.360203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.361907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.362372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.545913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:51.546782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:51.560510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.562843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.567889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.568473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.643726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.653158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.656496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-118c07d8-db38-4f1b-8af2-37336c87fb8f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.114783 Nov 06 21:06:51.658441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.663375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2863/5644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:51 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:51.665189 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a604fbea-7032-4d3f-a9c4-2a2a1f38e767 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1357 microversion: 2.47 time: 0.357346 Nov 06 21:06:51.665927 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2782/5645] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:06:51 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:51.687102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:51.697821 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:51.697821 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:06:51.698957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:51.700814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Searching by: {'deleted': False, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:06:51.714081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.714787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.717633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.718493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.917793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b99550e6-e44e-4e6c-bab8-f6cb48554c9f req-aa8d6e46-b50f-4864-86af-c2248de52f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0", "name": "network-vif-deleted", "tag": "e84fd4a8-a08d-4b66-882b-9f627be244d1"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:51.919570 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:06:51.919570 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:06:51.951635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b99550e6-e44e-4e6c-bab8-f6cb48554c9f req-aa8d6e46-b50f-4864-86af-c2248de52f0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:51.952096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b99550e6-e44e-4e6c-bab8-f6cb48554c9f req-aa8d6e46-b50f-4864-86af-c2248de52f0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:51.999325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:06:52.003362 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b99550e6-e44e-4e6c-bab8-f6cb48554c9f req-aa8d6e46-b50f-4864-86af-c2248de52f0a service nova] Creating event network-vif-deleted:e84fd4a8-a08d-4b66-882b-9f627be244d1 for instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 on nch2-master-1 Nov 06 21:06:52.023801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b99550e6-e44e-4e6c-bab8-f6cb48554c9f req-aa8d6e46-b50f-4864-86af-c2248de52f0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109931 Nov 06 21:06:52.030827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2783/5646] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:06:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:06:52.107547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:52.109065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:52.127516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.128064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.128932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.129383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.197821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:52.207202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.207649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.220261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:52.221819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:52.392813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e73bfda-811a-4ef6-9157-85d796ce32a4 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.710101 Nov 06 21:06:52.393443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2864/5647] 10.222.0.13 () {60 vars in 1186 bytes} [Sat Nov 6 21:06:51 2021] GET /compute/v2.1/servers/detail => generated 2707 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:06:52.398309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:52.399370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:52.414726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.417270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.421276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.423759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.520984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.521434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.523547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lazy-loading 'fault' on Instance uuid c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:06:52.682976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c2cde31b11407793be22fcefdb72a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf82afb0b851411fa5ebbb7a77e087f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:52.691119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0eabd908-c587-4c29-a221-239c7e31e309 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 200 len: 1304 microversion: 2.1 time: 0.296611 Nov 06 21:06:52.692045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2865/5648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:52 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:52.697409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:52.698167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:52.705436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.706096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.707149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.707835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.735941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:52.834285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-185020ff-3d34-462a-93c3-9d85e61373f9 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 204 len: 0 microversion: 2.1 time: 0.140524 Nov 06 21:06:52.835406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2866/5649] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:52 2021] DELETE /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:06:52.851939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:52.858119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:52.866342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.867037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.869309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.870784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.909204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:52.920233 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-586520f8-4f75-40be-af2f-c598f12bbd1a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.816679 Nov 06 21:06:52.929621 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2784/5650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:52 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:52.934511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:52.935131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:52.942422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a653ef4-97f8-47ef-a6f2-1411f57f2c91 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.105155 Nov 06 21:06:52.946834 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2867/5651] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:52 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:52.951597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.951597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:52.951597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:52.951597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.078689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:53.102231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00f9046f-f23a-4487-8801-47ee3b1296c2 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1297 microversion: 2.1 time: 0.171200 Nov 06 21:06:53.103249 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2785/5652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:52 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1297 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:53.711084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:53.712126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] [instance: c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:53.724898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.725353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.726167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.726635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.744232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] HTTP exception thrown: Instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 could not be found. Nov 06 21:06:53.744965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] Returning 404 to user: Instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:53.745848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b094117e-ed55-4f28-9330-40f6cdf8e312 tempest-VolumesActionsTest-961164403 tempest-VolumesActionsTest-961164403-project] 10.222.0.13 "GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0" status: 404 len: 111 microversion: 2.1 time: 0.041224 Nov 06 21:06:53.746603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2868/5653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:53 2021] GET /compute/v2.1/servers/c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:53.940893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:53.941624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:53.956238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:53.957519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:53.958011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.958709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.960091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.961829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.972319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.972509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:53.974335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:53.975981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:54.065575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc8c3699-092e-466a-bbbd-6c5d3e1c2b5b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.113461 Nov 06 21:06:54.069142 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2869/5654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:53 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:54.119567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:54.121843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:54.135538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:54.138576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:54.147791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:54.148607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:54.319603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:54.336939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f7a1400-2818-4ab0-bfdf-23417fa74ffa tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 200 len: 1297 microversion: 2.1 time: 0.218359 Nov 06 21:06:54.337787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2870/5655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:54 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 1297 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:54.584384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:54.616117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14ed5c5e-ea2b-4093-bd45-d1990dab00c5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.678526 Nov 06 21:06:54.628956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2786/5656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:53 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:55.079721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:55.098612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:55.129567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.130110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.135942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.136722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.259405 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f61509ff-3d33-47bf-8a4a-dc63f9ebaeb6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 24525 microversion: 2.1 time: 0.183448 Nov 06 21:06:55.275110 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2871/5657] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:55 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 24525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:55.366880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:55.367552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: d6409d66-0c39-43e6-85c8-225d86e5d5bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:55.378976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.385070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.386007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.386453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.435371 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] HTTP exception thrown: Instance d6409d66-0c39-43e6-85c8-225d86e5d5bd could not be found. Nov 06 21:06:55.441077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Returning 404 to user: Instance d6409d66-0c39-43e6-85c8-225d86e5d5bd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:55.441946 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-371ceb25-1732-4a08-9a0e-a6808c5a963b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd" status: 404 len: 111 microversion: 2.1 time: 0.087452 Nov 06 21:06:55.444654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2787/5658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:55 2021] GET /compute/v2.1/servers/d6409d66-0c39-43e6-85c8-225d86e5d5bd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:55.457753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:55.458579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:55.475552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.476255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.478639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.479235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.555698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:06:55.634643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:55.635247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:55.647464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.647590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.648629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.650938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.773671 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9e84874-14f6-4549-b48f-6ba9bdc14d36 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 204 len: 0 microversion: 2.1 time: 0.323976 Nov 06 21:06:55.779409 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2872/5659] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:06:55 2021] DELETE /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:06:55.790664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:55.792847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:55.812110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.814209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:55.816426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:55.817069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:56.021091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:56.044072 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dde74727-45ee-4900-9583-d0b646d32a6f tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 200 len: 1297 microversion: 2.1 time: 0.262981 Nov 06 21:06:56.047260 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2873/5660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:55 2021] GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 1297 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:56.230998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:56.242580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2c4d4d2-e680-4bc9-9378-bcfb389e90d9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.611580 Nov 06 21:06:56.257706 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2788/5661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:55 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:56.286908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:56.287826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:56.303305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:56.304616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:56.307091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:56.307804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:56.410812 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aaca3f5-e685-470c-a574-9a452860de9b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.128671 Nov 06 21:06:56.413298 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2874/5662] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:56 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:57.069755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:57.071346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:57.091677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.093662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.097414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.097414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.264016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:57.265153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:57.283262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:57.294773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e71ff87-f089-40d1-8f99-aac68b3d0174 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 200 len: 1297 microversion: 2.1 time: 0.235024 Nov 06 21:06:57.295367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2789/5663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:57 2021] GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 1297 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:57.307640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.308172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.309158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.309843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.425788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:57.426753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:57.449838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.450306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.459294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:57.459961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:57.578163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c8a087d-11d0-437c-8705-93229b3af345 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.158043 Nov 06 21:06:57.582484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2790/5664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:57 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:06:57.941876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:57.950487 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85f84e6f-d859-45eb-940d-9040fc0b84c1 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.690814 Nov 06 21:06:57.954093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2875/5665] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:57 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:06:58.317092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:58.319878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:58.351613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:58.352224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:58.357054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:58.357498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:58.419513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:58.420703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:58.421202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lazy-loading 'fault' on Instance uuid 1e7fd587-208c-4767-861b-fdb930387e96 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:06:58.593988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:58.595000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:58.603012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:58.603486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:58.604540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:58.605164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:58.668674 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c417d707-8b88-4948-9e50-90fd75aad3b7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.078123 Nov 06 21:06:58.669426 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2876/5666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:58 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:58.777696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea332a0c12024bcd933af8e1ba928a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce63ab4cf0914a21af1079b2532238a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:58.785690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-081cc93d-8f79-43c5-abde-418f89e49392 tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 200 len: 1302 microversion: 2.1 time: 0.477073 Nov 06 21:06:58.795241 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2791/5667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:58 2021] GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 1302 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:58.832504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d0b88a7-4b7f-4fdb-b41a-0c5f8aa30e6a tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Action: 'create', calling method: .version_select at 0x7f671ad73670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-262888933", "metadata": {"Type": "work"}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:58.834791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d0b88a7-4b7f-4fdb-b41a-0c5f8aa30e6a tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:58.835640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d0b88a7-4b7f-4fdb-b41a-0c5f8aa30e6a tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151531 Nov 06 21:06:58.836219 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2877/5668] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Nov 6 21:06:58 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:06:58.855364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47dc0a5f-1647-492f-b53d-2239cd7e1f69 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Action: 'create', calling method: .version_select at 0x7f6714be4160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1162737474", "metadata": {"Type": "work"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:58.859021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47dc0a5f-1647-492f-b53d-2239cd7e1f69 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:58.908922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47dc0a5f-1647-492f-b53d-2239cd7e1f69 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017891 Nov 06 21:06:58.912753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2792/5669] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Nov 6 21:06:58 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:06:58.930559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3155ef99-a98d-4ef5-b218-a12de630dac9 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Action: 'create', calling method: .version_select at 0x7f671ad55550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-626427307", "metadata": {"Type": "work"}}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:58.932953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3155ef99-a98d-4ef5-b218-a12de630dac9 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:58.935076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3155ef99-a98d-4ef5-b218-a12de630dac9 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012373 Nov 06 21:06:58.935954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2878/5670] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Nov 6 21:06:58 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:06:58.946102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f68f595-4620-4ec8-b534-db0483e18b4d tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Calling method '.version_select at 0x7f6715541160>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:58.985732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:58.987818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:59.007128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.007790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.008132 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9f68f595-4620-4ec8-b534-db0483e18b4d tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] HTTP exception thrown: Volume tempest-invalid-1689160490 could not be found. Nov 06 21:06:59.008936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.009505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f68f595-4620-4ec8-b534-db0483e18b4d tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 404 to user: Volume tempest-invalid-1689160490 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:59.010200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.010648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f68f595-4620-4ec8-b534-db0483e18b4d tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1689160490" status: 404 len: 99 microversion: 2.1 time: 0.068639 Nov 06 21:06:59.012526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2793/5671] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Nov 6 21:06:58 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1689160490 => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 21:06:59.028091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53ac0005-fe5a-4cb5-a86d-4a5510800ece tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009595 Nov 06 21:06:59.029203 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2794/5672] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Nov 6 21:06:59 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 06 21:06:59.050374 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4aff7a53-67dd-4c37-b436-7a99cd31ae0e tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012266 Nov 06 21:06:59.052208 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2795/5673] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:06:59 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 06 21:06:59.067262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-597e68ce-25ef-4961-ad32-03c58a4d78bc tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Calling method '.version_select at 0x7f6714be4ee0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:59.107271 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-597e68ce-25ef-4961-ad32-03c58a4d78bc tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] HTTP exception thrown: Volume 2c865f3d-53a3-4e74-b230-b15908b81002 could not be found. Nov 06 21:06:59.108180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-597e68ce-25ef-4961-ad32-03c58a4d78bc tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 404 to user: Volume 2c865f3d-53a3-4e74-b230-b15908b81002 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:59.110713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-597e68ce-25ef-4961-ad32-03c58a4d78bc tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/2c865f3d-53a3-4e74-b230-b15908b81002" status: 404 len: 109 microversion: 2.1 time: 0.051763 Nov 06 21:06:59.111820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2796/5674] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:06:59 2021] DELETE /compute/v2.1/os-volumes/2c865f3d-53a3-4e74-b230-b15908b81002 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:59.122321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1146844507", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "26ebcefd-d4b1-4fd8-a62b-28d254b6db14"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1071119647", "security_groups": []}, "os:scheduler_hints": {"different_host": ["91687b9e-e2f0-4d54-b588-03aedc5067a4"]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:59.191475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] validate_networks() for [('26ebcefd-d4b1-4fd8-a62b-28d254b6db14', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:06:59.360655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:06:59.369892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f09b4b1-7764-4258-a438-157e80e884a5 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.396748 Nov 06 21:06:59.371016 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2879/5675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:58 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:06:59.375708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d222e28d-833d-4d36-83d2-06728665d039 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Calling method '.version_select at 0x7f671ac06040>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:59.409520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d222e28d-833d-4d36-83d2-06728665d039 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] HTTP exception thrown: Volume 889ca4bc-982f-46b3-85cd-796e97cba7a2 could not be found. Nov 06 21:06:59.410136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d222e28d-833d-4d36-83d2-06728665d039 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] Returning 404 to user: Volume 889ca4bc-982f-46b3-85cd-796e97cba7a2 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:59.413027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d222e28d-833d-4d36-83d2-06728665d039 tempest-VolumesNegativeTest-1369836507 tempest-VolumesNegativeTest-1369836507-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/889ca4bc-982f-46b3-85cd-796e97cba7a2" status: 404 len: 109 microversion: 2.1 time: 0.040842 Nov 06 21:06:59.413637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2880/5676] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Nov 6 21:06:59 2021] GET /compute/v2.1/os-volumes/889ca4bc-982f-46b3-85cd-796e97cba7a2 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:06:59.683984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:06:59.685419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:59.710652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.711442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.713642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.715387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.773467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8f0b8aa-e00e-4efe-b306-48a4c274080c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.095088 Nov 06 21:06:59.775354 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2881/5677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:06:59 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:06:59.806377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:06:59.807125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] [instance: 1e7fd587-208c-4767-861b-fdb930387e96] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:06:59.815365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.816048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.816951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.817771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.841618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] HTTP exception thrown: Instance 1e7fd587-208c-4767-861b-fdb930387e96 could not be found. Nov 06 21:06:59.842735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] Returning 404 to user: Instance 1e7fd587-208c-4767-861b-fdb930387e96 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:06:59.844350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-474c1803-7362-4f06-b5b9-f64245bf3c1b tempest-ServerShowV247Test-567287009 tempest-ServerShowV247Test-567287009-project] 10.222.0.13 "GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96" status: 404 len: 111 microversion: 2.1 time: 0.042779 Nov 06 21:06:59.845322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2882/5678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:06:59 2021] GET /compute/v2.1/servers/1e7fd587-208c-4767-861b-fdb930387e96 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:06:59.918935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:06:59.919509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:06:59.920262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:06:59.921030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:06:59.921621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:06:59.950993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.952992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.955241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:06:59.955730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:06:59.984948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for project f2513646a2fc417d9b601006a57d5693. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:06:59.993816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Getting quotas for user dac5721604a146aa9c840c2aa546805a and project f2513646a2fc417d9b601006a57d5693. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:00.040666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:07:00.044115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:07:00.105935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf9d45a3-3444-4cf9-9b66-594b4a1820df tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.991272 Nov 06 21:07:00.106689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2797/5679] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:06:59 2021] POST /compute/v2.1/servers => generated 361 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:07:00.121915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7850d810-75d0-4899-ab34-fd8dfeaf077b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:00.122106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7850d810-75d0-4899-ab34-fd8dfeaf077b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:00.233772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7850d810-75d0-4899-ab34-fd8dfeaf077b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:00.247751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7850d810-75d0-4899-ab34-fd8dfeaf077b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1242 microversion: 2.1 time: 0.130176 Nov 06 21:07:00.251835 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2883/5680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:00 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:00.389724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:00.390551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:00.403484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:00.418423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:00.429841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:00.433161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:00.744972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:00.772681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4e33ef4-4fe6-4a1c-b97a-054e1fa1b28c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.386392 Nov 06 21:07:00.787781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:00.789195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:00.794423 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2798/5681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:00 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:00.823891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:00.824445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:00.826036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:00.829607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:00.926791 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bef78b7-b877-4705-83f8-e76787aaed6d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.144165 Nov 06 21:07:00.927511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2884/5682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:00 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:01.268190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:01.268799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:01.279776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.280231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:01.283878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.286020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:01.450888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:01.461503 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-176eb012-814e-4d62-8750-a26a7b2f8767 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1246 microversion: 2.1 time: 0.197260 Nov 06 21:07:01.463663 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2799/5683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:01 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1246 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:01.799336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:01.800984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:01.809312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.810030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:01.811161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.811806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:01.945983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:01.947085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:01.961250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.964445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:01.966781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:01.967786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:02.044586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ddbf82f1-2b10-4656-8981-6ca38a2c96df tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.108895 Nov 06 21:07:02.046565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2800/5684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:01 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:02.315285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:02.326768 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a00e87c-08eb-49b0-b82c-3d504cc3a32b tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1509 microversion: 2.1 time: 0.533646 Nov 06 21:07:02.327845 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2885/5685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:01 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:02.488160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:02.489885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:02.503715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:02.504518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:02.505662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:02.511929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:02.688520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:02.701318 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2741a9bf-c7b9-4f98-b718-d2dbd79f1f4b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.221415 Nov 06 21:07:02.702313 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2801/5686] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:02 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:03.063649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:03.078812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:03.099925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.100481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:03.106758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.108680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:03.211533 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee76c9a9-8fae-4ad6-90b2-4bc39035c495 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.153288 Nov 06 21:07:03.226869 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2886/5687] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:03 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:03.351688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:03.353492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:03.362766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.363232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:03.364322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.364984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:03.724880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:03.740656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:03.775993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.778235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:03.779316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:03.787789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.007237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:04.024661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4a26c67-9c2e-46d1-9193-4f35534a4cd0 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1486 microversion: 2.1 time: 0.682188 Nov 06 21:07:04.027019 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2802/5688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:03 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1486 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:04.044058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1803104952"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:04.045941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:04.058585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.058978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.059789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.060324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.217399 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7864b8e5-f1f3-4c86-9fc0-b96c5021f4d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "PUT /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1060 microversion: 2.1 time: 0.177350 Nov 06 21:07:04.222496 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2803/5689] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:07:04 2021] PUT /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1060 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:04.237080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:04.243428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:04.246882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:04.255900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04b6fec3-a265-4ecf-bb2c-cc73a0b2c47c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.540174 Nov 06 21:07:04.258066 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2887/5690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:03 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:04.271486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:04.278774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:04.278899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.278899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.279511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.289450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.295415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.296631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.299399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.300642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.463548 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-948dd1c4-0946-41b4-a960-374e1b224267 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.221078 Nov 06 21:07:04.464337 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2804/5691] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:04 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:04.761808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:04.777311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a7e6c30-159f-4138-8a04-3c6e1aace36f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1487 microversion: 2.1 time: 0.517988 Nov 06 21:07:04.777910 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2888/5692] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:04 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1487 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:04.796142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:04.796945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:04.814749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.815202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:04.820537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:04.821209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.276964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:05.278283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:05.286788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.287551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.288696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.289360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.511884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:05.524872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eedd41fb-ee81-4e3b-bc8e-56e566f8c87d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1487 microversion: 2.1 time: 0.733124 Nov 06 21:07:05.525532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2805/5693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:04 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1487 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:05.541090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:05.542597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:05.550537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:05.550847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.551507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.552483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.553472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.564847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c451b89e-e707-4233-80e8-9b1c9c0a528d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.289775 Nov 06 21:07:05.567266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2889/5694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:05 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:05.590151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:05.592199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:05.600757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.611089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.612066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.615996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.643038 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7e5b465-8ac6-4323-a8f7-ef0bca6be746 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.114614 Nov 06 21:07:05.644238 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2806/5695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:05 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:05.721640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:07:05.936535 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4be1fab-071f-4c42-9e3c-51042f364c8f tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 204 len: 0 microversion: 2.1 time: 0.365316 Nov 06 21:07:05.938127 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2890/5696] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:05 2021] DELETE /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:07:05.948268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:05.949006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:05.967948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.969549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:05.972745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:05.973369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.437172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:06.446872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d80c4a6d-aa81-4291-b22a-76b18885fce9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1493 microversion: 2.1 time: 0.503107 Nov 06 21:07:06.447591 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2807/5697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:05 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1493 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:06.456564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c885af54-74b8-446b-8dc6-bb57ca22c27e req-f694e7f2-526f-4351-bd53-64cd49f2a67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c469f5-45df-4fe7-9a08-fb76cf7ab67f", "tag": "a3ce13be-6d35-4362-a233-b10dc053ec0c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:06.459711 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:06.459711 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:06.477956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c885af54-74b8-446b-8dc6-bb57ca22c27e req-f694e7f2-526f-4351-bd53-64cd49f2a67e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:06.478639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c885af54-74b8-446b-8dc6-bb57ca22c27e req-f694e7f2-526f-4351-bd53-64cd49f2a67e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.497861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c885af54-74b8-446b-8dc6-bb57ca22c27e req-f694e7f2-526f-4351-bd53-64cd49f2a67e service nova] Creating event network-changed:a3ce13be-6d35-4362-a233-b10dc053ec0c for instance 07c469f5-45df-4fe7-9a08-fb76cf7ab67f on nch1-master-1 Nov 06 21:07:06.507079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c885af54-74b8-446b-8dc6-bb57ca22c27e req-f694e7f2-526f-4351-bd53-64cd49f2a67e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057654 Nov 06 21:07:06.508084 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2808/5698] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:06.585704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:06.587362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:06.595928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:06.596439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.597251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:06.597947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.614914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1671371431", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:06.702535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] validate_networks() for [('c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:07:06.834079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:06.843394 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c40ed2c-b0bb-4d6e-8fff-289004ee7c4c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.262412 Nov 06 21:07:06.853496 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2809/5699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:06 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:06.860321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:06.861519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:06.869176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:06.869897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.870913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:06.871611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:06.922675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0ce8fd4-1373-401f-944e-7c9b637a72f1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.065486 Nov 06 21:07:06.924550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2810/5700] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:06 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:07.396873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:07:07.397413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:07:07.398008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:07:07.398530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:07:07.399200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:07:07.418256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.419012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:07.423783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.424442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:07.468034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:07.470374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:07.494534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Getting quotas for project 930a318a21a4455c8d2c6eb794459b51. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:07.505301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.508169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Getting quotas for user 4ef3f8eee14643889cf3f3ccf5858c71 and project 930a318a21a4455c8d2c6eb794459b51. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:07.511217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:07.518545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.520184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:07.538427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:07:07.548402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:07:07.627808 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e183ccd-8b19-4a80-830e-a4e9a679c589 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483224 Nov 06 21:07:07.630343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2891/5701] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:07:07.641107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5598860-699b-47b4-a5ce-c68f072ee533 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:07.644191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5598860-699b-47b4-a5ce-c68f072ee533 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:07.883392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5598860-699b-47b4-a5ce-c68f072ee533 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:07.894141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5598860-699b-47b4-a5ce-c68f072ee533 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1217 microversion: 2.1 time: 0.256390 Nov 06 21:07:07.896047 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2892/5702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:07.919726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:07.921491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:07.938488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.939676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:07.942214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:07.942678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:08.267575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:08.272981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:08.281754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b793601-f5df-428a-a78b-9147942054e7 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.378847 Nov 06 21:07:08.286451 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2893/5703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:07 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:08.300275 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ec40e7f-0b87-42a1-8fa2-7d464105e40a tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 200 len: 1493 microversion: 2.1 time: 0.835594 Nov 06 21:07:08.303708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:08.303842 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2811/5704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:07 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 1493 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:08.316184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:08.323472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4a003e4b-4f03-40d3-b8b3-e6474395c0e9 req-5fc7f907-07af-4861-9757-cf2395340cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da3b3c4-23b9-4025-9148-2b3df46d60bd", "name": "network-vif-deleted", "tag": "46e3a37b-fdae-4de1-b4fa-b19d171d2efe"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:08.327355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:08.328105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:08.329524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:08.330097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:08.332360 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:08.332360 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:08.357761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a003e4b-4f03-40d3-b8b3-e6474395c0e9 req-5fc7f907-07af-4861-9757-cf2395340cc7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:08.360111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4a003e4b-4f03-40d3-b8b3-e6474395c0e9 req-5fc7f907-07af-4861-9757-cf2395340cc7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:08.394962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24774cb0-8e70-4431-b445-c92ae0829597 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.105687 Nov 06 21:07:08.396858 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2894/5705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:08 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:08.402134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4a003e4b-4f03-40d3-b8b3-e6474395c0e9 req-5fc7f907-07af-4861-9757-cf2395340cc7 service nova] Creating event network-vif-deleted:46e3a37b-fdae-4de1-b4fa-b19d171d2efe for instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd on nch2-master-1 Nov 06 21:07:08.414188 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4a003e4b-4f03-40d3-b8b3-e6474395c0e9 req-5fc7f907-07af-4861-9757-cf2395340cc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108203 Nov 06 21:07:08.415591 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2812/5706] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:08.914820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:08.916483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:08.925856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:08.926475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:08.927343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:08.928244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.042298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:09.052446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ddbac3ae-9ac1-4cdc-9230-8288e11a5356 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1269 microversion: 2.1 time: 0.142228 Nov 06 21:07:09.053722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2895/5707] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:08 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:09.310073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.310925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.323869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.324688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.325840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.325955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.327650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.328669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.341349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.342279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.344200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.344834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.386146 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. Nov 06 21:07:09.386774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.394065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e32a8cf-088a-493a-8873-91be8615b9b4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 404 len: 111 microversion: 2.1 time: 0.071018 Nov 06 21:07:09.394909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2896/5708] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.418613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.420348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.435872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.436359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.438498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.439961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.506139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:09.507958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. Nov 06 21:07:09.509220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.512787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-748208ba-d42e-4ed9-8238-f5c40814ea14 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 404 len: 111 microversion: 2.1 time: 0.097964 Nov 06 21:07:09.513922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2897/5709] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:09 2021] DELETE /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.522717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:09.523912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.530268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5271a459-fd5e-41c6-8653-3c127b655b62 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.230087 Nov 06 21:07:09.531383 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2813/5710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:09.532622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.533224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.544006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.544843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.558914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.560246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 0da3b3c4-23b9-4025-9148-2b3df46d60bd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.574357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.575131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.580123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.580945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.613435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. Nov 06 21:07:09.614889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 0da3b3c4-23b9-4025-9148-2b3df46d60bd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.615981 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-428208b2-2ead-42bc-9c79-a0eb5edc17e8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd" status: 404 len: 111 microversion: 2.1 time: 0.082574 Nov 06 21:07:09.619275 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2814/5711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/0da3b3c4-23b9-4025-9148-2b3df46d60bd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.627902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.633026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.640381 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cae4c90b-de98-45d5-9896-1b517753ad8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.123392 Nov 06 21:07:09.642257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2898/5712] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:09 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:09.645546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.645546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.645967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.646073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.676983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. Nov 06 21:07:09.677647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.678875 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74af77c7-37ab-44cf-9481-3d9251e35916 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 404 len: 111 microversion: 2.1 time: 0.054830 Nov 06 21:07:09.679213 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2815/5713] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:09 2021] DELETE /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:07:09.692841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.696970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.714727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.716664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.719627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.720131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.764967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. Nov 06 21:07:09.768841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.770969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-436c46c5-6339-4cc9-90ac-5bd7c83dbcc9 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607" status: 404 len: 111 microversion: 2.1 time: 0.084447 Nov 06 21:07:09.771655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2899/5714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/7bd5bc7c-71dd-4d19-b5d5-93cf8a247607 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.779934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.780720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.793408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.793867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.794834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.795415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.814323 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. Nov 06 21:07:09.815147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.816195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13a8e131-175f-4f97-9f83-ff11f36722b7 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 404 len: 111 microversion: 2.1 time: 0.039963 Nov 06 21:07:09.817252 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2816/5715] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:09 2021] DELETE /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.825701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.826357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 6123f97a-1c1d-4334-b05e-edb8cd2172de] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.840795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.841294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.843991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.845052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.870427 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. Nov 06 21:07:09.871485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 6123f97a-1c1d-4334-b05e-edb8cd2172de could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.872490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8132188-76f6-44d9-8a5f-a61abdeba09d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de" status: 404 len: 111 microversion: 2.1 time: 0.051365 Nov 06 21:07:09.873379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2900/5716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/6123f97a-1c1d-4334-b05e-edb8cd2172de => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.889188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.889355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.901896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.903011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.903807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.904339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.936111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. Nov 06 21:07:09.936887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.938679 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ff01f06-b441-410d-bb8e-6c97a11f7e36 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 404 len: 111 microversion: 2.1 time: 0.057764 Nov 06 21:07:09.939978 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2817/5717] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:09 2021] DELETE /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:09.949360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:09.950620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: bcc2b920-2680-4f38-acce-5220d6dcc981] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:09.965165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.968666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.969852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:09.971265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:09.990887 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. Nov 06 21:07:09.992868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance bcc2b920-2680-4f38-acce-5220d6dcc981 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:09.994187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b451570a-a70e-4781-be98-9736dc6cffb4 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981" status: 404 len: 111 microversion: 2.1 time: 0.049753 Nov 06 21:07:09.995388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2901/5718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:09 2021] GET /compute/v2.1/servers/bcc2b920-2680-4f38-acce-5220d6dcc981 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.006881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.007426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.018059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.018523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.019332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.020337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.057147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. Nov 06 21:07:10.058043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.059144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ea5a02d-ccd1-4a1e-8fe2-07a694a2650e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 404 len: 111 microversion: 2.1 time: 0.059207 Nov 06 21:07:10.063291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2818/5719] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:09 2021] DELETE /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.071052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.072114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.087861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.089481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.090026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.091785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: aca1947e-e0cb-4178-9921-7758f415d600] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.092747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.096531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.122317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.126784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.135275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.137868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.180179 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. Nov 06 21:07:10.182338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance aca1947e-e0cb-4178-9921-7758f415d600 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.187959 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c11dcc3c-c62a-4d88-8646-3ff676d33fc8 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600" status: 404 len: 111 microversion: 2.1 time: 0.112448 Nov 06 21:07:10.189146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2819/5720] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:10 2021] GET /compute/v2.1/servers/aca1947e-e0cb-4178-9921-7758f415d600 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.216979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.217659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.231928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.232534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.233234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.233684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.265039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. Nov 06 21:07:10.265717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.269850 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac008336-a456-499d-8bf8-919674ae376c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 404 len: 111 microversion: 2.1 time: 0.076488 Nov 06 21:07:10.272186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2820/5721] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:10 2021] DELETE /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:07:10.283779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.284876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: ad43190b-c3fb-42dc-914d-50260df910d5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.295081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.296550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.298831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.299649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.336533 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. Nov 06 21:07:10.337837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance ad43190b-c3fb-42dc-914d-50260df910d5 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.338853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-979dc648-ae66-4b83-a829-c919ee4fea67 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5" status: 404 len: 111 microversion: 2.1 time: 0.061860 Nov 06 21:07:10.340575 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2821/5722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:10 2021] GET /compute/v2.1/servers/ad43190b-c3fb-42dc-914d-50260df910d5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.362504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ebc97a4-8298-4a67-9b7a-b839b787919c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.362504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ebc97a4-8298-4a67-9b7a-b839b787919c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.382454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-0ebc97a4-8298-4a67-9b7a-b839b787919c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. Nov 06 21:07:10.384236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ebc97a4-8298-4a67-9b7a-b839b787919c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.385353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ebc97a4-8298-4a67-9b7a-b839b787919c tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad" status: 404 len: 111 microversion: 2.1 time: 0.038457 Nov 06 21:07:10.387894 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2822/5723] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:10 2021] DELETE /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.399348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25159451-730e-4eab-8bba-543a7da2d721 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.406840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25159451-730e-4eab-8bba-543a7da2d721 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: 8509bf14-3fc3-4278-bfe8-128a6e21f8ad] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.440228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-25159451-730e-4eab-8bba-543a7da2d721 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. Nov 06 21:07:10.452130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25159451-730e-4eab-8bba-543a7da2d721 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance 8509bf14-3fc3-4278-bfe8-128a6e21f8ad could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:10.456448 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25159451-730e-4eab-8bba-543a7da2d721 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad" status: 404 len: 111 microversion: 2.1 time: 0.065065 Nov 06 21:07:10.460320 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2823/5724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:10 2021] GET /compute/v2.1/servers/8509bf14-3fc3-4278-bfe8-128a6e21f8ad => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:10.476258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.477161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.501529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.502083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.505640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.507776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.605836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:07:10.819158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-887ddbc8-fe00-48a0-a89f-194157ebd73d tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 204 len: 0 microversion: 2.1 time: 0.354578 Nov 06 21:07:10.821291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2824/5725] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:10 2021] DELETE /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:07:10.835295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:10.838036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:10.853545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.854367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:10.859638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:10.860274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:11.255944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:11.276841 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-965799b1-b33e-47f6-8f4a-85d646c160c1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1275 microversion: 2.1 time: 1.209275 Nov 06 21:07:11.280395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2902/5726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:10 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1275 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:11.298446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:11.320374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:11.351404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:11.368463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:11.370744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:11.371207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:11.434079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:11.453349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-146ce837-c448-499e-b30d-d6b4e8caacc1 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.628071 Nov 06 21:07:11.454364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2825/5727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:10 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:11.464278 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bdf921f1-b51b-461a-9149-4599c7caf50f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.182006 Nov 06 21:07:11.465856 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2903/5728] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:11 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:11.466603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:11.467255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:11.478570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:11.478730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:11.479718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:11.480345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:11.720214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:11.728053 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cec45297-d4c2-4cf5-802a-5bbb87766bfc tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1479 microversion: 2.1 time: 0.271860 Nov 06 21:07:11.730357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2826/5729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:11 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1479 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:12.183564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-65921ca4-c5f8-4fe2-bf95-6a6549f8bed4 req-e92b44c0-3003-4d25-9e2d-8c84f76f0b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:12.189892 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:12.189892 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:12.212487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-65921ca4-c5f8-4fe2-bf95-6a6549f8bed4 req-e92b44c0-3003-4d25-9e2d-8c84f76f0b52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.212988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-65921ca4-c5f8-4fe2-bf95-6a6549f8bed4 req-e92b44c0-3003-4d25-9e2d-8c84f76f0b52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.237727 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-65921ca4-c5f8-4fe2-bf95-6a6549f8bed4 req-e92b44c0-3003-4d25-9e2d-8c84f76f0b52 service nova] Creating event network-changed:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:07:12.244458 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-65921ca4-c5f8-4fe2-bf95-6a6549f8bed4 req-e92b44c0-3003-4d25-9e2d-8c84f76f0b52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066549 Nov 06 21:07:12.245061 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2904/5730] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:12.297171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:12.298917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:12.317767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.319824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.339615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.340287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.474864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:12.476792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:12.496141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.499313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.502053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.505300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.894136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:12.908913 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6aae73d0-5ee7-4f32-9d62-20c055ef415d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.613789 Nov 06 21:07:12.909573 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2827/5731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:12 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:12.940683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:12.941698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:12.943505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:12.959773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.960233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.975845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-379df348-4c43-402d-8773-eebb86e54f5d tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.508657 Nov 06 21:07:12.980507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2905/5732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:12 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:12.986209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:12.986755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e0da96fe-c66c-4727-a5c2-bdef5328422c req-47e8d21d-fcfe-4ddd-894b-05152ed8a98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c469f5-45df-4fe7-9a08-fb76cf7ab67f", "name": "network-vif-plugged", "status": "completed", "tag": "a3ce13be-6d35-4362-a233-b10dc053ec0c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:12.987442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:12.993728 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:12.993728 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:13.019876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e0da96fe-c66c-4727-a5c2-bdef5328422c req-47e8d21d-fcfe-4ddd-894b-05152ed8a98b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.021220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e0da96fe-c66c-4727-a5c2-bdef5328422c req-47e8d21d-fcfe-4ddd-894b-05152ed8a98b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:13.068164 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e0da96fe-c66c-4727-a5c2-bdef5328422c req-47e8d21d-fcfe-4ddd-894b-05152ed8a98b service nova] Creating event network-vif-plugged:a3ce13be-6d35-4362-a233-b10dc053ec0c for instance 07c469f5-45df-4fe7-9a08-fb76cf7ab67f on nch1-master-1 Nov 06 21:07:13.096053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e0da96fe-c66c-4727-a5c2-bdef5328422c req-47e8d21d-fcfe-4ddd-894b-05152ed8a98b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113141 Nov 06 21:07:13.097420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2906/5733] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:13.100004 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc708494-09af-4140-9553-4b9a39c50bee tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.171011 Nov 06 21:07:13.107554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:13.108580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:13.109684 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2828/5734] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:12 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:13.121686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.122336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:13.123518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.124117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:13.427373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247e9ac02acd44c3b1186567c91bbfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eda1afc00c24f888ad31c7bade0503e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:13.437248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92a42115-ad96-493c-a3ea-d67da7e703d2 tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 200 len: 1479 microversion: 2.1 time: 0.338242 Nov 06 21:07:13.442476 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2907/5735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:13 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 1479 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:13.663975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3e11918a-e589-45a9-b535-98056983fe63 req-0d5c6990-b79f-443e-b8da-85334835da97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e556d555-ac33-446d-a5c6-2bc4d404e921", "name": "network-vif-deleted", "tag": "bbe58d3f-538b-46e3-b044-460af86c1b11"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:13.665761 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:13.665761 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:13.674624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e11918a-e589-45a9-b535-98056983fe63 req-0d5c6990-b79f-443e-b8da-85334835da97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.675255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e11918a-e589-45a9-b535-98056983fe63 req-0d5c6990-b79f-443e-b8da-85334835da97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:13.687788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3e11918a-e589-45a9-b535-98056983fe63 req-0d5c6990-b79f-443e-b8da-85334835da97 service nova] Creating event network-vif-deleted:bbe58d3f-538b-46e3-b044-460af86c1b11 for instance e556d555-ac33-446d-a5c6-2bc4d404e921 on nch2-master-1 Nov 06 21:07:13.692857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3e11918a-e589-45a9-b535-98056983fe63 req-0d5c6990-b79f-443e-b8da-85334835da97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033071 Nov 06 21:07:13.694497 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2829/5736] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:13.938025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:13.939715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:13.950419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.951065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:13.952491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:13.953643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.016784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:14.020261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:14.029197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.029915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.030974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.031701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.285725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:14.292131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:14.301951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a07fbe04-1e67-4d12-a68d-d4522f1b0a3b tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1300 microversion: 2.1 time: 0.304663 Nov 06 21:07:14.304491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2830/5737] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:13 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1300 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:14.308860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:14.311135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:14.311343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8771ed75-99fa-4dcb-a50f-aa350d8d36b7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.388130 Nov 06 21:07:14.313183 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2908/5738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:13 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:14.318697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.319371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.320823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.321990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.391070 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94dac7c6-82b4-4ee9-9215-fca74e9a859c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.086691 Nov 06 21:07:14.392913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2831/5739] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:14 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:14.460986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:14.461874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] [instance: e556d555-ac33-446d-a5c6-2bc4d404e921] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:14.481917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.484675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.485833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:14.486523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:14.519219 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] HTTP exception thrown: Instance e556d555-ac33-446d-a5c6-2bc4d404e921 could not be found. Nov 06 21:07:14.520544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] Returning 404 to user: Instance e556d555-ac33-446d-a5c6-2bc4d404e921 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:14.522284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5337a100-cc74-4178-915e-9546d0ad8c6e tempest-ServersTestJSON-309509686 tempest-ServersTestJSON-309509686-project] 10.222.0.13 "GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921" status: 404 len: 111 microversion: 2.1 time: 0.065344 Nov 06 21:07:14.523448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2909/5740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:14 2021] GET /compute/v2.1/servers/e556d555-ac33-446d-a5c6-2bc4d404e921 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:15.342189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:15.342897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:15.343837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:15.345422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:15.379232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.380980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.388863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.389829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.391367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.391491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.393330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.393749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.715638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:15.729440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21d95e79-dbdd-4bd9-ac0e-66222efa921f tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1473 microversion: 2.1 time: 0.413200 Nov 06 21:07:15.742306 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2832/5741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:15 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:15.766946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:15.768411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:15.775360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.776035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.777098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.777726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.848314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:15.863300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e69df51-dab5-407c-907d-14ee49c403e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.533433 Nov 06 21:07:15.865312 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2910/5742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:15 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:15.871370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d998af3e-17d7-4f47-a8d2-939877427cb0 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.118604 Nov 06 21:07:15.872311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:15.872449 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2833/5743] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:15 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:15.873208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:15.898545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.898545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:15.898545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:15.898545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.042102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:16.053333 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b73b9d9-f4fa-4076-8a1d-7cde3a5054ed tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1473 microversion: 2.1 time: 0.185957 Nov 06 21:07:16.053935 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2911/5744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:15 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:16.072090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:16.073498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:16.083444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.083902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.085874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.085874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.214525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5340d900-245d-4eab-8775-d5c0dd484b5f tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1624 microversion: 2.1 time: 0.146239 Nov 06 21:07:16.225293 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2834/5745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:16 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1624 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:16.245552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:16.246200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:16.256459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.257559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.261445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.263749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.462253 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ee3ceb9-f829-4b80-b890-a6ea2f8432d7 tempest-TestSecurityGroupsBasicOps-195828091 tempest-TestSecurityGroupsBasicOps-195828091-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1910 microversion: 2.1 time: 0.223830 Nov 06 21:07:16.472985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2912/5746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:16 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1910 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:16.585737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:16.586311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:16.596723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.597297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.614219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.616083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.663424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:07:16.829928 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9181377-adc0-499f-8814-6cecc2d59e76 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 204 len: 0 microversion: 2.1 time: 0.245831 Nov 06 21:07:16.830687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2835/5747] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:16 2021] DELETE /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:07:16.840164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:16.841141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:16.849709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.850066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.851075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.851517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.886568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:16.893475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:16.899994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.903264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:16.904349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:16.909412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:17.026143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:17.040581 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1948b7b3-c77d-404c-af02-f229bcf4c58a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1479 microversion: 2.1 time: 0.203142 Nov 06 21:07:17.041975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2913/5748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:16 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1479 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:17.053579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:17.056019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:17.070566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:17.071570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:17.073908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:17.075419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:17.157730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df2a667f-d25f-4944-add5-b8ff63e14255 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.111878 Nov 06 21:07:17.158695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2914/5749] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:17 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:17.212483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:17.220619 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45dc1ff9-2ca7-43d4-99cf-86bdd02fc0f4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.340860 Nov 06 21:07:17.221509 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2836/5750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:18.064947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:18.084575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:18.100180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.101239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.102064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.102503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.172130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:18.173075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:18.184043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.184734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.185967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.186415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.234620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21703985-9eda-4b3e-841a-8b1d48776c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.068390 Nov 06 21:07:18.239274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2837/5751] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:18 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:18.249103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:18.250544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:18.264826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.267113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.270389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.271253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.386395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:18.394901 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9da2b18f-5ffd-42fc-9e95-4c7ae5219f92 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1479 microversion: 2.1 time: 0.336828 Nov 06 21:07:18.399384 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2915/5752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:18 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1479 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:18.563925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f1b00917-ef3c-4ab4-9b21-d33d0e5d6f11 req-b6eccab1-0f51-4216-b21d-0b84a00ae843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "name": "network-vif-plugged", "status": "completed", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:18.565617 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:18.565617 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:18.590829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f1b00917-ef3c-4ab4-9b21-d33d0e5d6f11 req-b6eccab1-0f51-4216-b21d-0b84a00ae843 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:18.591475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f1b00917-ef3c-4ab4-9b21-d33d0e5d6f11 req-b6eccab1-0f51-4216-b21d-0b84a00ae843 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:18.612904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f1b00917-ef3c-4ab4-9b21-d33d0e5d6f11 req-b6eccab1-0f51-4216-b21d-0b84a00ae843 service nova] Creating event network-vif-plugged:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:07:18.634470 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f1b00917-ef3c-4ab4-9b21-d33d0e5d6f11 req-b6eccab1-0f51-4216-b21d-0b84a00ae843 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074318 Nov 06 21:07:18.635807 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2916/5753] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:18.772914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:18.785285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c5218f4-ac29-49fc-be4c-b58b1b859f87 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.542855 Nov 06 21:07:18.792384 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2838/5754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:19.250302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:19.251397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:19.267071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.267849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.268692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.270519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.334219 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3ac2d61f-0118-464a-a1a7-100bf1e52d3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.090446 Nov 06 21:07:19.334884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2917/5755] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:19 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:19.414049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:19.414651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:19.432427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.433144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.434042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.434481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.617669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:19.627545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0feaf791-5433-4514-82cd-51c776787002 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 200 len: 1479 microversion: 2.1 time: 0.217135 Nov 06 21:07:19.632703 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2839/5756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:19 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 1479 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:19.667263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-70a04422-630c-477c-89a4-79c30ada9a37 req-422a47c6-b90c-4c53-a083-8f8576de9d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c469f5-45df-4fe7-9a08-fb76cf7ab67f", "name": "network-vif-deleted", "tag": "a3ce13be-6d35-4362-a233-b10dc053ec0c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:19.671386 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:19.671386 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:19.691981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-70a04422-630c-477c-89a4-79c30ada9a37 req-422a47c6-b90c-4c53-a083-8f8576de9d8f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.696841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-70a04422-630c-477c-89a4-79c30ada9a37 req-422a47c6-b90c-4c53-a083-8f8576de9d8f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.742053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-70a04422-630c-477c-89a4-79c30ada9a37 req-422a47c6-b90c-4c53-a083-8f8576de9d8f service nova] Creating event network-vif-deleted:a3ce13be-6d35-4362-a233-b10dc053ec0c for instance 07c469f5-45df-4fe7-9a08-fb76cf7ab67f on nch1-master-1 Nov 06 21:07:19.754462 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-70a04422-630c-477c-89a4-79c30ada9a37 req-422a47c6-b90c-4c53-a083-8f8576de9d8f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100094 Nov 06 21:07:19.764654 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2918/5757] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:19.816464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:19.817297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:19.826578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.830019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:19.830992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:19.832309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:20.170878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:20.181097 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2296e589-29a6-4478-b822-d7a08c605b00 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1317 microversion: 2.1 time: 0.374070 Nov 06 21:07:20.185645 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2840/5758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:20.357460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:20.360505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:20.373066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:20.377004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:20.379399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:20.380032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:20.442071 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a32aeb5-5d18-450e-853a-005de050722c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.092795 Nov 06 21:07:20.442980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2919/5759] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:20 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:20.650126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:20.650768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 07c469f5-45df-4fe7-9a08-fb76cf7ab67f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:20.661922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:20.662906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:20.664533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:20.665366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:20.682963 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] HTTP exception thrown: Instance 07c469f5-45df-4fe7-9a08-fb76cf7ab67f could not be found. Nov 06 21:07:20.683855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Returning 404 to user: Instance 07c469f5-45df-4fe7-9a08-fb76cf7ab67f could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:20.684943 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c18f041-2676-4ca7-b9ec-8fdfc41068ba tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f" status: 404 len: 111 microversion: 2.1 time: 0.039109 Nov 06 21:07:20.686608 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2841/5760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:20 2021] GET /compute/v2.1/servers/07c469f5-45df-4fe7-9a08-fb76cf7ab67f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:21.201178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:21.202159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:21.217051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:21.217659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:21.222557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:21.223155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:21.457208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:21.458155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:21.469207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:21.469664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:21.470460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:21.470897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:21.490507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:21.500758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c918d4df-f547-4ad5-90ab-fdee08e3bd6d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.305375 Nov 06 21:07:21.509689 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2920/5761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:21 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:21.593527 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6d2eb0b-4963-4abb-b96f-6252018d583a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.141882 Nov 06 21:07:21.594187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2842/5762] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:21 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:21.721878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-974183721", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:21.833870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] validate_networks() for [('c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:07:22.612042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:22.613513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:22.634907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:22.635617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:22.638000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:22.639181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:22.743224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5d86ea2-7d86-4ebf-acbe-7e737267c27a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.141585 Nov 06 21:07:22.745667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2843/5763] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:22 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:23.146486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:07:23.147763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:07:23.148496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:07:23.149350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:07:23.149919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:07:23.166005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:23.166964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:23.169146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:23.169843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:23.214852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Getting quotas for project 930a318a21a4455c8d2c6eb794459b51. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:23.227606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Getting quotas for user 4ef3f8eee14643889cf3f3ccf5858c71 and project 930a318a21a4455c8d2c6eb794459b51. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:23.256139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:07:23.262415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:07:23.380003 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2da86a1-2d02-4eaf-bd9b-e25b57c795fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659616 Nov 06 21:07:23.386275 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2921/5764] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:07:23.396355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f4c7a68-85b3-4f4d-94ed-6c900e906d52 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:23.397174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f4c7a68-85b3-4f4d-94ed-6c900e906d52 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:23.534282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3f4c7a68-85b3-4f4d-94ed-6c900e906d52 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:23.542039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f4c7a68-85b3-4f4d-94ed-6c900e906d52 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1216 microversion: 2.1 time: 0.149464 Nov 06 21:07:23.545105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2844/5765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:23 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:23.761268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:23.763571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:23.797378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:23.798424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:23.804806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:23.810117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:23.923807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97813f33-54c4-4a95-bdf1-7f2954c01777 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.167439 Nov 06 21:07:23.926500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2922/5766] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:23 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:24.562358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:24.563353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:24.585257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:24.585727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:24.604182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:24.605531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:24.778228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:24.786678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5a00aa4-97de-4b9f-af6b-857bb9064e78 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1212 microversion: 2.1 time: 0.228916 Nov 06 21:07:24.789870 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2845/5767] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:24 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1212 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:24.937823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:24.938835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:24.947205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:24.947709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:24.948617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:24.949172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:25.034347 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5dea93ae-0147-49cb-a475-687002c4933d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.101050 Nov 06 21:07:25.042875 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2923/5768] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:24 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:25.813840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:25.815190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:25.834625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:25.835152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:25.837310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:25.840693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:26.048789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:26.050349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:26.068971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:26.069665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:26.082466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:26.083240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:26.126307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:26.149028 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4dc7b98-2c13-4647-b51c-4fbf664e6692 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1274 microversion: 2.1 time: 0.343756 Nov 06 21:07:26.151231 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2846/5769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:25 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1274 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:26.220264 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2e5fd5e-7bc0-4ecd-aa4d-ac3cd26773a7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.176445 Nov 06 21:07:26.220945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2924/5770] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:26 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:26.652034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: .version_select at 0x7f671adceca0>, body: {"keypair": {"name": "tempest-keypair-1470063633"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:26.702863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:26.710853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:27.037437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:27.043549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:27.062752 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19a09b57-857e-4747-a8d5-a9e0e2adfe64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.909760 Nov 06 21:07:27.064144 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2847/5771] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:07:26 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:27.168318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:27.169654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:27.196404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:27.196877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:27.201001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:27.201575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:27.233621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:27.235941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:27.250879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:27.251505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:27.253424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:27.256282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:27.326081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6d16321-126f-4d05-87c4-79bbbb8779ba tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.097330 Nov 06 21:07:27.332177 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2848/5772] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:27 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:27.679965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:27.694894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-369a9120-f323-493d-8909-7c19e380e593 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.530435 Nov 06 21:07:27.696958 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2925/5773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:27 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:28.339691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:28.341355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:28.362635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:28.363341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:28.364604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:28.365059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:28.423029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66dcb1fe-232e-4c9d-9db6-71d726536d3f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.088003 Nov 06 21:07:28.424344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2849/5774] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:28 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:28.712934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:28.713725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:28.739110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:28.744579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:28.745716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:28.746394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:29.437350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:29.439097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:29.449256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:29.453549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:29.456079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:29.478449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:29.582046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7a430d09-d3bd-4258-bf78-81b872741825 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.149526 Nov 06 21:07:29.586348 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2850/5775] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:29 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:29.740132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9b06290b-c9fe-4e58-b596-b1cd34fe699c req-e0b9a00a-df70-4c53-b2d4-055d552c02af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87760ef5-370e-4d4e-b5c7-9322d089e9ac", "tag": "a26b735f-b3a5-4a7a-a025-d9364e42a0a4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:29.745020 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:29.745020 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:29.760902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9b06290b-c9fe-4e58-b596-b1cd34fe699c req-e0b9a00a-df70-4c53-b2d4-055d552c02af service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:29.762266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9b06290b-c9fe-4e58-b596-b1cd34fe699c req-e0b9a00a-df70-4c53-b2d4-055d552c02af service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:29.784910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9b06290b-c9fe-4e58-b596-b1cd34fe699c req-e0b9a00a-df70-4c53-b2d4-055d552c02af service nova] Creating event network-changed:a26b735f-b3a5-4a7a-a025-d9364e42a0a4 for instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac on nch1-master-1 Nov 06 21:07:29.793081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9b06290b-c9fe-4e58-b596-b1cd34fe699c req-e0b9a00a-df70-4c53-b2d4-055d552c02af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060707 Nov 06 21:07:29.794253 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2851/5776] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:29.846016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:29.899519 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31728ca8-5a4c-4a95-86f2-217ef839f995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 1.189983 Nov 06 21:07:29.902299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2926/5777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:28 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:30.238364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1736599558", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "868d34b9-2a4b-44dd-9b37-b695b577f3c0"}], "security_groups": [{"name": "tempest-securitygroup--1621249649"}], "key_name": "tempest-keypair-1470063633", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:30.581003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] validate_networks() for [('868d34b9-2a4b-44dd-9b37-b695b577f3c0', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:07:30.593812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:30.603513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:30.614648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:30.616280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:30.617590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:30.618105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:30.672684 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2799c09b-ff35-407e-b384-4cf03e6a50d8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.082482 Nov 06 21:07:30.675043 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2927/5778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:30 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:30.923623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:30.924946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:30.948875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:30.949481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:30.950445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:30.950979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:31.698226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:31.710735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8208fdb7-5d8e-4816-9abc-dce919729c1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.791775 Nov 06 21:07:31.714675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2928/5779] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:30 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:31.723563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:31.727120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:31.741764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:31.742224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:31.743027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:31.751530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:31.814115 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eaee82d1-7a4f-4344-a278-39c89aaf691f tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.097779 Nov 06 21:07:31.814785 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2929/5780] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:31 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:32.334659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:07:32.335795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:07:32.336508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:07:32.337105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:07:32.337592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:07:32.355874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.356918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.357752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.363599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.405424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:32.414629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:32.458616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:07:32.483909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:07:32.592463 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a64f1f3c-5d88-40c3-bb76-4bc048fea086 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.358805 Nov 06 21:07:32.595418 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2852/5781] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:07:32.607180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-542597aa-49f7-4e3c-ab7f-d12989b711bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:32.611330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-542597aa-49f7-4e3c-ab7f-d12989b711bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:32.737712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:32.738919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:32.773307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.778993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.781749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.785789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.790949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-542597aa-49f7-4e3c-ab7f-d12989b711bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:32.801449 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-542597aa-49f7-4e3c-ab7f-d12989b711bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1238 microversion: 2.1 time: 0.197508 Nov 06 21:07:32.804013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2930/5782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:32 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1238 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:32.821992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:32.822537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:32.845741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.848332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.849471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:32.851774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:32.957149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:07:33.144968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-475dae37-3577-4356-9b30-5f0020f16e96 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "DELETE /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 204 len: 0 microversion: 2.1 time: 0.326191 Nov 06 21:07:33.146112 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2931/5783] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:32 2021] DELETE /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:07:33.161947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:33.163047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:33.172598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.173055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.174876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.175536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.225337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:33.238410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84d1c885-218d-4ec7-b4e1-7e4505dad04b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.509661 Nov 06 21:07:33.241442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2853/5784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:32 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:33.257443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1c169fc1-6e25-4eb6-93fc-35eb0fd32347 req-84f9b453-bd03-465d-a110-f6f6417ea4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91687b9e-e2f0-4d54-b588-03aedc5067a4", "tag": "a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:33.261650 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:33.261650 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:33.266745 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5abe19a9-a77c-4904-9c4b-973d8388116d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.118464 Nov 06 21:07:33.273459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2932/5785] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:33 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:33.277716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1c169fc1-6e25-4eb6-93fc-35eb0fd32347 req-84f9b453-bd03-465d-a110-f6f6417ea4d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.278538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1c169fc1-6e25-4eb6-93fc-35eb0fd32347 req-84f9b453-bd03-465d-a110-f6f6417ea4d7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.305198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:33.305932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:33.320956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.322447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1c169fc1-6e25-4eb6-93fc-35eb0fd32347 req-84f9b453-bd03-465d-a110-f6f6417ea4d7 service nova] Creating event network-changed:a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a for instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 on nch2-master-1 Nov 06 21:07:33.329635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.331649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.334382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.336002 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1c169fc1-6e25-4eb6-93fc-35eb0fd32347 req-84f9b453-bd03-465d-a110-f6f6417ea4d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092011 Nov 06 21:07:33.340679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2854/5786] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:33.691155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:33.705145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82806d3c-44b3-4e21-b334-053f165f251c tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1765 microversion: 2.1 time: 0.423686 Nov 06 21:07:33.705779 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2933/5787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:33 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1765 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:33.821946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:33.822660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:33.831398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.831809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.846515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:33.846990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:33.964434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:33.973003 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b3130ad-da9c-4b3d-9ec0-54ee7b76d78a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1234 microversion: 2.1 time: 0.156463 Nov 06 21:07:33.974477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2855/5788] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:33 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:34.257083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:34.257744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:34.269899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.271533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.272713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.273364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.285846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:34.287923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:34.305913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.306406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.309480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.311588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.421252 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a34766c1-c2b6-455d-a0ae-d3c309b91d1c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.138755 Nov 06 21:07:34.427797 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2856/5789] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:34 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:34.728962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:34.729944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:34.760467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:34.771790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.771968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-425b0789-b4af-4f9d-9c7b-6a93119245ec tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.517335 Nov 06 21:07:34.773678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.778754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:34.781710 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2934/5790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:34 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:34.784203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:34.991666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:34.992602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:35.008700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.015607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.018633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.021348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.288152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:35.308426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c7092e9-0943-4c8b-8829-148390b0e7f7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1296 microversion: 2.1 time: 0.319390 Nov 06 21:07:35.322681 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2935/5791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:34 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1296 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:35.433820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:35.435243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:35.442799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.443680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.444707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.445355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.506193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47dee4b0-270e-4edb-a3a3-96fd812eecad tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.075912 Nov 06 21:07:35.506830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5721604a146aa9c840c2aa546805a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2513646a2fc417d9b601006a57d5693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:35.508887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2936/5792] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:35 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:35.520760 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df9ab90c-6f5d-4b6c-a625-e809ab2599ff tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 200 len: 1646 microversion: 2.1 time: 0.797069 Nov 06 21:07:35.530360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2857/5793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:34 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 1646 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:35.790465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:35.792139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:35.806861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.808097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.809660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.810380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.889658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-30ac752c-31c0-40ee-9716-1a460a1118b6 req-1b62f5c0-6e3a-4a5d-8575-0d2fcf3f0470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91687b9e-e2f0-4d54-b588-03aedc5067a4", "name": "network-vif-deleted", "tag": "a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:35.891785 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:35.891785 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:35.904021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-30ac752c-31c0-40ee-9716-1a460a1118b6 req-1b62f5c0-6e3a-4a5d-8575-0d2fcf3f0470 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:35.904503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-30ac752c-31c0-40ee-9716-1a460a1118b6 req-1b62f5c0-6e3a-4a5d-8575-0d2fcf3f0470 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:35.924196 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-30ac752c-31c0-40ee-9716-1a460a1118b6 req-1b62f5c0-6e3a-4a5d-8575-0d2fcf3f0470 service nova] Creating event network-vif-deleted:a52f0ff0-c5ac-4c95-aa5a-7ebd79094e2a for instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 on nch2-master-1 Nov 06 21:07:35.929116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-30ac752c-31c0-40ee-9716-1a460a1118b6 req-1b62f5c0-6e3a-4a5d-8575-0d2fcf3f0470 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044093 Nov 06 21:07:35.930139 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2858/5794] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:07:36.116605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:36.133647 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-327ef278-ef50-4f0f-b0ee-9ea075be89b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.347713 Nov 06 21:07:36.134172 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2937/5795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:35 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:36.327116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:36.329857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:36.340981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.341688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.342808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.343403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.519122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:36.524871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:36.534526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.536326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.537327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.541461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.640412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df3a9af9-a353-4e44-b25a-468937cf071b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.124115 Nov 06 21:07:36.646014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2938/5796] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:36 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:36.653750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:36.656184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] [instance: 91687b9e-e2f0-4d54-b588-03aedc5067a4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:36.670123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.671697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.673197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:36.675529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:36.711564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] HTTP exception thrown: Instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 could not be found. Nov 06 21:07:36.712183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Returning 404 to user: Instance 91687b9e-e2f0-4d54-b588-03aedc5067a4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:36.713076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91488287-17db-41b1-b657-b98ae733c08a tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4" status: 404 len: 111 microversion: 2.1 time: 0.064200 Nov 06 21:07:36.713633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2939/5797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:36 2021] GET /compute/v2.1/servers/91687b9e-e2f0-4d54-b588-03aedc5067a4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:36.978430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3b5192e0-c4bf-4b56-b9d6-7075e119922c req-e6a0a309-6e75-48a7-b518-a7e17b076484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87760ef5-370e-4d4e-b5c7-9322d089e9ac", "name": "network-vif-plugged", "status": "completed", "tag": "a26b735f-b3a5-4a7a-a025-d9364e42a0a4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:36.980153 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:36.980153 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:37.005935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3b5192e0-c4bf-4b56-b9d6-7075e119922c req-e6a0a309-6e75-48a7-b518-a7e17b076484 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:37.006475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3b5192e0-c4bf-4b56-b9d6-7075e119922c req-e6a0a309-6e75-48a7-b518-a7e17b076484 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:37.032596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3b5192e0-c4bf-4b56-b9d6-7075e119922c req-e6a0a309-6e75-48a7-b518-a7e17b076484 service nova] Creating event network-vif-plugged:a26b735f-b3a5-4a7a-a025-d9364e42a0a4 for instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac on nch1-master-1 Nov 06 21:07:37.051265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3b5192e0-c4bf-4b56-b9d6-7075e119922c req-e6a0a309-6e75-48a7-b518-a7e17b076484 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078045 Nov 06 21:07:37.051945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2940/5798] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:07:37.153490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:37.154497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:37.168232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:37.171219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:37.172149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:37.176111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:37.255956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:37.264168 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85270bfd-fd6f-4cd6-addf-9971d5c6090e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.941353 Nov 06 21:07:37.269428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2859/5799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:36 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:37.556660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:37.586377 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd575d3f-d5c0-4d43-838f-5ba2f3b40c63 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.434735 Nov 06 21:07:37.587012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2941/5800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:37 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:37.656677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:37.657620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:37.667096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:37.667816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:37.668828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:37.669452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:37.726063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-363397f3-c618-45f2-82ac-eaf6e514b335 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.074636 Nov 06 21:07:37.730009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2860/5801] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:37 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:38.286640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:38.287474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:38.303340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.303817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.316847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.317339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.622607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2337c08f-3e22-4037-8acb-bcc7ea37eeb0 req-597df25c-ea0b-49e7-83ea-25b5342a9eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8565783d-e8fd-4786-9848-138d58914019", "tag": "9373871f-a511-4c47-9d92-654088c8202d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:38.625389 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:38.625389 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:38.637663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2337c08f-3e22-4037-8acb-bcc7ea37eeb0 req-597df25c-ea0b-49e7-83ea-25b5342a9eb7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.638164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2337c08f-3e22-4037-8acb-bcc7ea37eeb0 req-597df25c-ea0b-49e7-83ea-25b5342a9eb7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.675849 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2337c08f-3e22-4037-8acb-bcc7ea37eeb0 req-597df25c-ea0b-49e7-83ea-25b5342a9eb7 service nova] Creating event network-changed:9373871f-a511-4c47-9d92-654088c8202d for instance 8565783d-e8fd-4786-9848-138d58914019 on nch1-master-1 Nov 06 21:07:38.698095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2337c08f-3e22-4037-8acb-bcc7ea37eeb0 req-597df25c-ea0b-49e7-83ea-25b5342a9eb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.456243 Nov 06 21:07:38.699308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2942/5802] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:38.708546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:38.710457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:38.741708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.742177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.743078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.743559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.880400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:38.895877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28fb5bc7-d130-48fc-a83c-7e866d6f1fc5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.613996 Nov 06 21:07:38.917884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2861/5803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:38 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:38.925310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:38.927759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:38.934308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.935333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:38.936738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:38.937339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:39.019059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8623ce41-e029-4379-8d16-44fc764a3faf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.102974 Nov 06 21:07:39.023477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2862/5804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:38 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:39.193995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:39.203740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69ee421a-9baa-478d-a26e-94d344563c14 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1316 microversion: 2.1 time: 0.501149 Nov 06 21:07:39.206562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2943/5805] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:38 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:39.928199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:39.930141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:39.943748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:39.947041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:39.950026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:39.951491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.041028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:40.044409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:40.073990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.078008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.079015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.080964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.192096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-133c3f99-0b81-4f93-9d60-cd1e942c6fe4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.160094 Nov 06 21:07:40.194655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2944/5806] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:40 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:40.222918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:40.224008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:40.232082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:40.233558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.234008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.243537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de130917-d55a-4846-a66c-bf54c99ae9ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.320574 Nov 06 21:07:40.244136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2863/5807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:39 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:40.245022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.245605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.463450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:40.478627 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1a3500c-67f3-4c1e-b0ab-9598ba151af0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1503 microversion: 2.1 time: 0.261284 Nov 06 21:07:40.479891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2945/5808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:40 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:40.497241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:40.497976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:40.508372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.508873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.509853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.510485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.558294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:07:40.739497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c274b07d-db3c-4a52-b388-0838d6b4978d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 204 len: 0 microversion: 2.1 time: 0.243803 Nov 06 21:07:40.740035 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2864/5809] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:07:40 2021] DELETE /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:07:40.748343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:40.749837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:40.760188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.760770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:40.761481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:40.763368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:41.128081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:41.136079 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fef10820-e433-4aa1-b0db-dd3266c5b92a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1509 microversion: 2.1 time: 0.391888 Nov 06 21:07:41.138941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2946/5810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:40 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:41.206109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:41.207049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:41.216696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:41.220911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:41.222828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:41.223290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:41.261685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:41.262598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:41.276874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:41.277355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:41.278169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:41.278604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:41.293907 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07567318-eaf4-42ae-8fa6-56129ada37cd tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.091655 Nov 06 21:07:41.298311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2865/5811] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:41 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:41.704230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:41.721563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ec6038d-34a9-4193-abae-c81637bb3575 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.463367 Nov 06 21:07:41.727042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2947/5812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:41 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:42.155885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:42.160388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:42.181201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.182530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:42.183425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.183874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:42.323962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:42.325053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:42.363569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.364376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:42.367101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.370514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:42.460051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c4541af-64dc-4e1a-82af-e5de37b36dea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.155205 Nov 06 21:07:42.466923 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2948/5813] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:42 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:42.711026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:42.724514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20274ec9-d339-41ea-8f4a-aecd0a5f1491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1509 microversion: 2.1 time: 0.573028 Nov 06 21:07:42.727952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2866/5814] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:42 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:42.745149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:42.746553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:42.771007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.771830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:42.773134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:42.774714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.156760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab1c9ac3-e15d-4840-88e9-a7670e9adf77 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] Calling method '.version_select at 0x7f6714c14d30>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:43.212768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab1c9ac3-e15d-4840-88e9-a7670e9adf77 tempest-TestSecurityGroupsBasicOps-707919793 tempest-TestSecurityGroupsBasicOps-707919793-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1071119647" status: 202 len: 0 microversion: 2.1 time: 0.061968 Nov 06 21:07:43.213792 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2867/5815] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Nov 6 21:07:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1071119647 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:07:43.474987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:43.476141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:43.483463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:43.490871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:43.490871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.491547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:43.492086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.498632 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ed932fbf-0c4a-4566-bb9a-f64ca431da77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.758016 Nov 06 21:07:43.499240 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2949/5816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:42 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:43.620056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01847262-9357-4dce-9eb8-3d9bc0289af3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.149085 Nov 06 21:07:43.624713 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2868/5817] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:43 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:43.742664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:43.743315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:43.755850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:43.756634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.757602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:43.758196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.781860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9f27e993-5fd7-44b4-995b-2937704e67b3 req-75b6336d-3eab-4da7-82da-e6fadfa82e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87760ef5-370e-4d4e-b5c7-9322d089e9ac", "name": "network-vif-deleted", "tag": "a26b735f-b3a5-4a7a-a025-d9364e42a0a4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:43.783977 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:43.783977 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:07:43.802048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9f27e993-5fd7-44b4-995b-2937704e67b3 req-75b6336d-3eab-4da7-82da-e6fadfa82e0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:43.803778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9f27e993-5fd7-44b4-995b-2937704e67b3 req-75b6336d-3eab-4da7-82da-e6fadfa82e0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:43.819056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9f27e993-5fd7-44b4-995b-2937704e67b3 req-75b6336d-3eab-4da7-82da-e6fadfa82e0a service nova] Creating event network-vif-deleted:a26b735f-b3a5-4a7a-a025-d9364e42a0a4 for instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac on nch1-master-1 Nov 06 21:07:43.838648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9f27e993-5fd7-44b4-995b-2937704e67b3 req-75b6336d-3eab-4da7-82da-e6fadfa82e0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061159 Nov 06 21:07:43.840387 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2869/5818] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:07:43.893995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:43.904015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7959ef17-5103-4901-930f-61f7a3cb6e4e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 200 len: 1467 microversion: 2.1 time: 0.164941 Nov 06 21:07:43.904960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2950/5819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:43 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 1467 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:44.516505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:44.517588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:44.525510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.537348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.538214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.538669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.638046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:44.639505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:44.659029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.663752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.665657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.667873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.772353 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-394afb51-a739-490f-90f3-fae9120ac0a3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.140881 Nov 06 21:07:44.774912 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2951/5820] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:44 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:44.911892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:44.937389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-894718ed-bf1f-44e4-b191-a2c5d3755ec2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.424224 Nov 06 21:07:44.939840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2870/5821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:44 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:44.954398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:44.958502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:44.975159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.976014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.977443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:44.978096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:44.998844 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. Nov 06 21:07:45.000969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:45.003158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b58799cf-7196-4a04-b17a-223c451d0c93 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 404 len: 111 microversion: 2.1 time: 0.060845 Nov 06 21:07:45.009133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2871/5822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:44 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:07:45.020158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:45.021901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:45.031764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.032830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.034466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.035519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.278899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:45.292067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-65cc6f26-f945-4216-96bc-91fb64074d1d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.279463 Nov 06 21:07:45.294984 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2872/5823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:45 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:45.314189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3e83c166-6390-4578-8816-56bbfc6477d2 req-30c87a01-6f21-44e0-b06c-fea8db0d1923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8565783d-e8fd-4786-9848-138d58914019", "name": "network-vif-plugged", "status": "completed", "tag": "9373871f-a511-4c47-9d92-654088c8202d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:45.319495 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:45.319495 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:45.343985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3e83c166-6390-4578-8816-56bbfc6477d2 req-30c87a01-6f21-44e0-b06c-fea8db0d1923 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.345206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3e83c166-6390-4578-8816-56bbfc6477d2 req-30c87a01-6f21-44e0-b06c-fea8db0d1923 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.359014 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3e83c166-6390-4578-8816-56bbfc6477d2 req-30c87a01-6f21-44e0-b06c-fea8db0d1923 service nova] Creating event network-vif-plugged:9373871f-a511-4c47-9d92-654088c8202d for instance 8565783d-e8fd-4786-9848-138d58914019 on nch1-master-1 Nov 06 21:07:45.367646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3e83c166-6390-4578-8816-56bbfc6477d2 req-30c87a01-6f21-44e0-b06c-fea8db0d1923 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463490 Nov 06 21:07:45.373739 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2952/5824] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:45.484731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-319d65b5-6da9-4d5a-a6c0-b305a78251a0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:45.485930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-319d65b5-6da9-4d5a-a6c0-b305a78251a0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:45.486725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-319d65b5-6da9-4d5a-a6c0-b305a78251a0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006572 Nov 06 21:07:45.487242 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2873/5825] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:45 2021] POST /compute/v2.1/servers => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:45.497573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:45.498809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:45.506515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.507562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.508860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.509306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.710078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:45.717750 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3735b870-57e4-4e5a-9b10-6d7c7d19e2d6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.224480 Nov 06 21:07:45.730394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2953/5826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:45 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:45.734911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:45.735520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:45.744070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.744931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.745916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.746495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.789606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:45.790682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:45.797955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.798404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.799995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.800478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.845060 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8aa4dea0-dfa6-4449-ac8f-3667d55f70ea tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.059093 Nov 06 21:07:45.846585 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2954/5827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:45 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:45.922282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:45.932701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-677f6da4-63db-4871-b470-8b1f5dc1e113 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.201263 Nov 06 21:07:45.933220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2874/5828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:45 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:45.956155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:45.956901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:45.966842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.967585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:45.970826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:45.972753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:46.224076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:46.238332 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b49c26a9-5e80-4b29-9a6f-2bd212e2c930 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1364 microversion: 2.1 time: 0.286992 Nov 06 21:07:46.239841 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2955/5829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:45 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:46.859207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:46.867576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:46.878067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:46.878522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:46.882427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:46.883957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:46.929078 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1db52396-4116-45d9-b63e-4f76a09e907c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.075368 Nov 06 21:07:46.932246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2875/5830] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:46 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:47.261885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:47.263174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:47.273625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.274641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.275718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.276400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.444158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:47.454655 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f14f1bac-cb2f-4c8b-99ae-eae373b0b0cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1550 microversion: 2.1 time: 0.202834 Nov 06 21:07:47.455576 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2956/5831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:47 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1550 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:47.472607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:47.473365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:47.482449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.483600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.484604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.485229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.612451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0f55605-edb5-4662-ad7e-48d3207a848a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143963 Nov 06 21:07:47.613377 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2876/5832] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:07:47 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:47.850220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a829793-0fdb-47ba-936f-9bef6bd28667 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-159050051", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5b264d32-7085-4e51-90c3-0767a5710a13", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:47.943814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-4a829793-0fdb-47ba-936f-9bef6bd28667 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Block Device 5b264d32-7085-4e51-90c3-0767a5710a13 is not bootable. Nov 06 21:07:47.944429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a829793-0fdb-47ba-936f-9bef6bd28667 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Block Device 5b264d32-7085-4e51-90c3-0767a5710a13 is not bootable. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:47.947239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a829793-0fdb-47ba-936f-9bef6bd28667 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.100735 Nov 06 21:07:47.949672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2957/5833] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:47 2021] POST /compute/v2.1/servers => generated 110 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:47.950164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:47.951819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:47.960466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:47.962778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:47.968150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.971891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.972975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.973415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.977470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.978335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:47.979653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:47.983328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:48.049441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8db2edf7-cb81-4f7e-ac83-ee5e8f4c1c8c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.110089 Nov 06 21:07:48.050911 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2877/5834] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:47 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:48.442018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:48.452026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1cf1d9a0-a36a-4088-a92c-1b8bdd13c7ab tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.496388 Nov 06 21:07:48.453431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2958/5835] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:47 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:48.474377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:48.475133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:48.484102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:48.484844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:48.485864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:48.487081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.016634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:49.028258 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5cefb22-cd52-4479-afa3-ea0d6986c0bc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.557705 Nov 06 21:07:49.042093 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2878/5836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:48 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:49.062337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:49.063358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:49.073856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:49.074652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.079267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:49.080081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.161479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5b2123d-7fff-412e-8ecf-2d3928b2a2ed tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.103904 Nov 06 21:07:49.165570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2959/5837] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:49 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:49.611940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:49.612944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:49.615407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9f4cfc2e-8bfb-4daa-8b0e-04514594a278 req-c7521733-bf4c-46b8-ae87-9a6ba7ddb787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8565783d-e8fd-4786-9848-138d58914019", "tag": "9373871f-a511-4c47-9d92-654088c8202d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:49.618395 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:07:49.618395 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:07:49.622977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:49.623479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.625398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:49.625764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.636434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f4cfc2e-8bfb-4daa-8b0e-04514594a278 req-c7521733-bf4c-46b8-ae87-9a6ba7ddb787 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:49.637160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f4cfc2e-8bfb-4daa-8b0e-04514594a278 req-c7521733-bf4c-46b8-ae87-9a6ba7ddb787 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:49.657409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9f4cfc2e-8bfb-4daa-8b0e-04514594a278 req-c7521733-bf4c-46b8-ae87-9a6ba7ddb787 service nova] Creating event network-changed:9373871f-a511-4c47-9d92-654088c8202d for instance 8565783d-e8fd-4786-9848-138d58914019 on nch1-master-1 Nov 06 21:07:49.662493 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9f4cfc2e-8bfb-4daa-8b0e-04514594a278 req-c7521733-bf4c-46b8-ae87-9a6ba7ddb787 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050967 Nov 06 21:07:49.663662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2960/5838] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:07:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:07:49.677606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1645e71a-da6d-4c43-984d-85d23ae253be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.070109 Nov 06 21:07:49.681171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2879/5839] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:49 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:50.175797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:50.176848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:50.191812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:50.192286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:50.193211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:50.193691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:50.287179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66e4504e-cf71-4d8c-a08f-ff1ba96d2540 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.116920 Nov 06 21:07:50.294271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2961/5840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:50 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:50.693141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:50.695739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:50.710169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:50.712255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:50.714068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:50.715443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:50.765274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4c07791-3bde-49a6-8c28-6e45d7d82988 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.078610 Nov 06 21:07:50.766310 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2880/5841] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:50 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:07:51.306471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:51.307603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:51.337514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.337983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:51.338832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.339284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:51.427447 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c050f98c-9808-431e-839c-59c3fb046361 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.125336 Nov 06 21:07:51.447276 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2962/5842] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:51 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:51.785076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:51.790692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:51.813402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.814860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:51.816612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.817661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:51.897598 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e410fa5a-7df0-4316-9feb-fcb7919733a7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.121995 Nov 06 21:07:51.898375 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2881/5843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:51 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:51.954388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32c0cf58-6c5f-4398-9a4c-05f32cba213c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1061125246", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "destination_type": "local"}, {"source_type": "volume", "uuid": "7a5871d3-6398-4a4d-9e14-9b406460f719", "destination_type": "invalid"}], "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:51.956508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32c0cf58-6c5f-4398-9a4c-05f32cba213c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:51.957551 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32c0cf58-6c5f-4398-9a4c-05f32cba213c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.007816 Nov 06 21:07:51.958307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2963/5844] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:51 2021] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:51.967518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:51.968593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:51.979242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.984577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:51.986271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:51.987497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.456242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:52.459119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:52.474868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.477366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.481000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.482183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.567055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19ca1af6-b484-4f73-a236-c2d5aaeab4b4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.113800 Nov 06 21:07:52.572131 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2964/5845] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:52 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:52.694053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:52.702474 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c12fec03-be1a-48b4-8c54-77b7073f0f7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.739292 Nov 06 21:07:52.705574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2882/5846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:51 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:52.724724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:52.725691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:52.740668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.741131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.741939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.742379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.908068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:52.909163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:52.923695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.924226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:52.939289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:52.939967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:53.014484 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41a6eb09-44e5-49ff-b483-e38335c17459 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.109400 Nov 06 21:07:53.015952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2883/5847] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:52 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:07:53.596053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:53.600713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:53.659691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:53.660496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:53.669769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:53.672033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:53.765215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20929415-e986-4bf3-a6cc-5307cac2bcff tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.179257 Nov 06 21:07:53.772662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2884/5848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:53 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:53.798233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:53.806539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4941e430-f247-4e94-8ead-eee69aadb6c2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 1.086577 Nov 06 21:07:53.829266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2965/5849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:52 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:54.035163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:54.036386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:54.057537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.058163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.062682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.063245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.109412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bae11504-847b-4c17-ab04-146a9cfdd18d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.086154 Nov 06 21:07:54.112683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2885/5850] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:54 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:54.196942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7dc223f-57f6-4b2b-8fae-02b044098a0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1819272578", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:54.198789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7dc223f-57f6-4b2b-8fae-02b044098a0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:54.199747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7dc223f-57f6-4b2b-8fae-02b044098a0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.007102 Nov 06 21:07:54.200698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2966/5851] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:54 2021] POST /compute/v2.1/servers => generated 624 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:54.209636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:54.210704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:54.224008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.226150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.227349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.228248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.636964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:54.649559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d207cd50-b0ac-49ad-91ed-6bb3b63d9656 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.444068 Nov 06 21:07:54.650369 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2886/5852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:54 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:54.669400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:54.670982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:54.683688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.686691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.688554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.690573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.779871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:54.781556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:54.790272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.791570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.793123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:54.794537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:54.870827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9dca680-58a1-4cba-a90b-050e6c3a8015 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.092587 Nov 06 21:07:54.873585 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2887/5853] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:54 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:55.007405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:55.017667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02deb442-db64-4e87-8b82-05210c826995 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.353996 Nov 06 21:07:55.018592 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2967/5854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:54 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:55.124182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:55.134507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:55.154889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.155775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.156997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.157620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.203935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2d457d69-6a41-4434-ba81-a0d8b9d425f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.086143 Nov 06 21:07:55.205033 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2888/5855] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:55 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:55.279905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d99dd159-a66c-46fd-9c40-a38b72dd3d7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:55.284843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d99dd159-a66c-46fd-9c40-a38b72dd3d7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:55.287641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d99dd159-a66c-46fd-9c40-a38b72dd3d7c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012087 Nov 06 21:07:55.288225 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2968/5856] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:55 2021] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:55.298186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:55.307099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:55.315460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.316276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.317550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.318135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.570053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:55.578328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d0b9732-67a6-4962-a7ff-2b170506c7eb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.285008 Nov 06 21:07:55.578930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2889/5857] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:55 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:55.601670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:55.602613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:55.610834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.611274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.612331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.612796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.866410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:55.883416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:55.887806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:55.891498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7ee2f6a-77e5-4f7a-a0a4-5579118df643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.293259 Nov 06 21:07:55.893677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2969/5858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:55 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:55.907006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.907524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:55.908474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:55.908800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.033270 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05496d9c-ec6d-41f8-a84c-80ef0d2911d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.153314 Nov 06 21:07:56.039624 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2890/5859] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:55 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:07:56.137541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ac5571f-1d09-4dec-b1c1-24adb3d6ddf9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267802668", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": -1, "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:56.173681 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7ac5571f-1d09-4dec-b1c1-24adb3d6ddf9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Flavor -1 could not be found. Nov 06 21:07:56.174821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ac5571f-1d09-4dec-b1c1-24adb3d6ddf9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:56.176250 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ac5571f-1d09-4dec-b1c1-24adb3d6ddf9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.042680 Nov 06 21:07:56.180149 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2970/5860] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:56 2021] POST /compute/v2.1/servers => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 06 21:07:56.187000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:56.188214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:56.196409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.197100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.198060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.199055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.214878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:56.216357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:56.231402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.232149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.235313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.242175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.318603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99164ed5-d4c1-4279-bc7f-04bfee6ab73a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.107373 Nov 06 21:07:56.321959 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2971/5861] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:56 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:07:56.500092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:56.508733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0016c624-395b-4bb4-9e2b-6440f2598d10 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.326676 Nov 06 21:07:56.510171 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2891/5862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:56 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:56.530106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:56.531605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:56.539603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.540403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.541362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:56.542215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:56.768938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:56.780572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79259551-45ec-4f12-957c-6036a2ce37e2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.253936 Nov 06 21:07:56.796931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2972/5863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:56 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:57.056877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:57.057829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:57.061156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bced7add-52ad-4587-85ef-b9e4db5af4bb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-102584087", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:57.063897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bced7add-52ad-4587-85ef-b9e4db5af4bb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:57.064761 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bced7add-52ad-4587-85ef-b9e4db5af4bb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.014675 Nov 06 21:07:57.065335 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2973/5864] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:57 2021] POST /compute/v2.1/servers => generated 145 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:57.078894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:57.085641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.089702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.090786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.093819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.096463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:57.112157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.113408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.114760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.115536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.173128 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4984c6ce-f8cd-42cb-988d-0a2257a8c69e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.129886 Nov 06 21:07:57.175848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2892/5865] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:57 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:57.333875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:57.336169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:57.363010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.363010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.364252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.365375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.427095 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e463a782-a2b4-4ad1-bf56-4ac13bacde19 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.099586 Nov 06 21:07:57.430843 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2893/5866] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:57 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:57.454321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:57.464653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6e249db-60ac-47d1-a7c7-5f89474b6693 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.390285 Nov 06 21:07:57.465886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2974/5867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:57 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:57.486571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:57.489678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:57.505830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.507855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.508756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:57.509348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:57.556937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-298632983", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:57.665245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] validate_networks() for None {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:07:58.006588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:58.022347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ea81ff6-fefb-48c4-940d-e43545c1e19c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.537601 Nov 06 21:07:58.023727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2894/5868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:57 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:58.184953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:58.186090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:58.198390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.200758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.202946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.205934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.231437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:07:58.231862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:07:58.232928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:07:58.233510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:07:58.233924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:07:58.253118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.253519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.260330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.263408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.278382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53b135db-8317-4440-9d2b-95c04c073a81 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.097590 Nov 06 21:07:58.283111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2895/5869] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:58 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:58.294270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13d5888a-e045-4b17-8c37-8ddc8c22a9e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-371863440", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:58.300749 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-13d5888a-e045-4b17-8c37-8ddc8c22a9e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 06 21:07:58.302070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13d5888a-e045-4b17-8c37-8ddc8c22a9e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:58.307509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13d5888a-e045-4b17-8c37-8ddc8c22a9e8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022817 Nov 06 21:07:58.309482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2896/5870] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:58 2021] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:07:58.325340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Getting quotas for project 0b512f3f002d4176808c9ea78c759467. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:07:58.331853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Getting quotas for user 48334679063d40429b42fddf3d7f03ba and project 0b512f3f002d4176808c9ea78c759467. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:07:58.346137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:58.349115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:58.364745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:07:58.366860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.367393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:07:58.368677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.370963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.371644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.476884 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46bbce70-79b5-468f-a1db-5a1a7b7f97e4 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924064 Nov 06 21:07:58.484273 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2975/5871] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:07:58.489427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:58.490791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:58.498612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.499313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.500353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.501417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.568416 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dca55c83-40fe-4058-8004-c2d53e59ebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 14 microversion: 2.1 time: 0.082370 Nov 06 21:07:58.570057 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2976/5872] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:58 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:07:58.575476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-548bb57c-f148-4314-bd30-5c6321340d32 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:58.577182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-548bb57c-f148-4314-bd30-5c6321340d32 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:58.681442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-548bb57c-f148-4314-bd30-5c6321340d32 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:58.699765 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-548bb57c-f148-4314-bd30-5c6321340d32 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1214 microversion: 2.1 time: 0.127946 Nov 06 21:07:58.700809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:58.703400 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2977/5873] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:58 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:58.724895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f569fd93-81cb-4cfa-8881-c6a34425faed tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.392196 Nov 06 21:07:58.724895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2897/5874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:58 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:58.740911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:58.742035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:58.751278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.751996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:58.753629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:58.754267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.160382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:59.171111 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f3dab2f-6d35-4f33-847f-b45a635308b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.443065 Nov 06 21:07:59.174242 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2898/5875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:58 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:07:59.291175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:59.293062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:59.301089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.301538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.302333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.302761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.369518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f610978e-4ee1-4790-b323-0de454cc8fef tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1286209387", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "key_name": "tempest-key-1753277722", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:59.426308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75f4c3ff-094f-4fee-ad44-1882f9d8b9d9 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.138510 Nov 06 21:07:59.433062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2978/5876] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:59 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:07:59.477258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-f610978e-4ee1-4790-b323-0de454cc8fef tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] validate_networks() for [('c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:07:59.582105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:07:59.583164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:59.595755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.597388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.599383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.603066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.667956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-28559cc5-3981-4870-b5dd-119cbf2a29ef tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 8207 microversion: 2.1 time: 0.090272 Nov 06 21:07:59.672315 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2979/5877] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:07:59 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 8207 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:07:59.722695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:59.730344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:59.741485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.743076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.744153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.744866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.800443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f610978e-4ee1-4790-b323-0de454cc8fef tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Invalid key_name provided. Nov 06 21:07:59.801202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f610978e-4ee1-4790-b323-0de454cc8fef tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid key_name provided. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:07:59.802151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f610978e-4ee1-4790-b323-0de454cc8fef tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.437106 Nov 06 21:07:59.802846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2899/5878] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:07:59 2021] POST /compute/v2.1/servers => generated 70 bytes in 439 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 06 21:07:59.811929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:07:59.812698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:07:59.824440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.825209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.826330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:07:59.827022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:07:59.845638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:07:59.856406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edbc99a4-dd4b-477c-aaaf-130507d09ba6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1266 microversion: 2.1 time: 0.137870 Nov 06 21:07:59.858070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2980/5879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:59 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:00.047735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:00.059702 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-deff4fb1-56b9-4ecb-8436-b20697e3ed3d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.251409 Nov 06 21:08:00.061195 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2900/5880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:07:59 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:00.077977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:00.078710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:00.093628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.094611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.095434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.095881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.354318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:00.371081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a04809f5-7575-4b9b-b8e2-76c92ad17764 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.297236 Nov 06 21:08:00.372599 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2981/5881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:00 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:00.439426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:00.440609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:00.450085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.453560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.454893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.455660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.539785 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18b37c46-375b-4c09-9435-08d48b631b7d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.104337 Nov 06 21:08:00.541379 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2901/5882] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:00 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:00.666312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c97cdde7-8b14-4e40-bf7e-a7da379c6b97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8781958", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:00.679712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:00.681110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:00.689690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.690493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.692313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.693299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.776539 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f340c91-b33a-4d2a-9dcb-e3b358e4ba9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 16401 microversion: 2.1 time: 0.100971 Nov 06 21:08:00.777510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2902/5883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:00 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 16401 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:00.808037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.security_group_api [None req-c97cdde7-8b14-4e40-bf7e-a7da379c6b97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Neutron security group does_not_exist not found {{(pid=134827) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 06 21:08:00.809520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c97cdde7-8b14-4e40-bf7e-a7da379c6b97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 06 21:08:00.810746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c97cdde7-8b14-4e40-bf7e-a7da379c6b97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:00.812346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c97cdde7-8b14-4e40-bf7e-a7da379c6b97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.150213 Nov 06 21:08:00.813708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2982/5884] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:00 2021] POST /compute/v2.1/servers => generated 106 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:08:00.826905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:00.827614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:00.842158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.842651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.843512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.843959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.875388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:00.876468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:00.887161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.887632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.892704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:00.893190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:00.999541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:01.012005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1688b27e-d074-4d09-9f4a-1e5fd02bafc3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1272 microversion: 2.1 time: 0.141090 Nov 06 21:08:01.016992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2983/5885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:00 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:01.131836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:01.145086 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df13b504-4b8f-400b-bc59-7ef2a8360a5d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.323359 Nov 06 21:08:01.147181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2903/5886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:00 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:01.172455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:01.173078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.179900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.180614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.182000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.182529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.385282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:01.400482 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11213564-ace1-4ed5-ae25-47cffbed1425 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.241225 Nov 06 21:08:01.414509 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2984/5887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:01 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:01.419273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7e6bcf8-7240-480c-9e77-bfbecc2a098a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:01.419811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7e6bcf8-7240-480c-9e77-bfbecc2a098a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: dc5ed02c-3c93-4c4b-b0ba-778e594ddd8d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.439437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f7e6bcf8-7240-480c-9e77-bfbecc2a098a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance dc5ed02c-3c93-4c4b-b0ba-778e594ddd8d could not be found. Nov 06 21:08:01.440004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7e6bcf8-7240-480c-9e77-bfbecc2a098a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance dc5ed02c-3c93-4c4b-b0ba-778e594ddd8d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:01.440870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7e6bcf8-7240-480c-9e77-bfbecc2a098a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc5ed02c-3c93-4c4b-b0ba-778e594ddd8d" status: 404 len: 111 microversion: 2.1 time: 0.026803 Nov 06 21:08:01.444352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2904/5888] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:08:01 2021] DELETE /compute/v2.1/servers/dc5ed02c-3c93-4c4b-b0ba-778e594ddd8d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:08:01.449471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:01.450097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.457843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.458324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.459114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.459559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.552640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:01.554892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.572431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.573710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.574794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.575559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.680021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:01.681732 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7735affd-8197-465c-aba1-3403655790d4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.128093 Nov 06 21:08:01.686255 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2905/5889] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:01 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:01.695666 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-695ded6c-b9ec-47b4-8dd3-327cd0cfa643 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.249808 Nov 06 21:08:01.709361 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2985/5890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:01 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:01.719784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:01.719784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.730480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.730939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.739091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.740135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.788789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:01.789764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:01.798283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.809270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.810767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:01.811232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:01.967673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b04f70c-f0cb-4c05-b059-2ac67b37b403 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 16401 microversion: 2.1 time: 0.180699 Nov 06 21:08:01.969317 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2986/5891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:01 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 16401 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:02.033244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.034642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.050000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:02.051545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.052968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.054679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.055307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.061991 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80234187-0f20-4c68-9d41-b8bb7f17b795 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.347858 Nov 06 21:08:02.062604 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2906/5892] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:01 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:02.081765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d6546f9-6da7-4d08-a234-d18ec1093491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.084579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d6546f9-6da7-4d08-a234-d18ec1093491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Failed to fetch instance by id 9223372036854775808 {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 21:08:02.090427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7d6546f9-6da7-4d08-a234-d18ec1093491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 06 21:08:02.091081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d6546f9-6da7-4d08-a234-d18ec1093491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:02.092550 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d6546f9-6da7-4d08-a234-d18ec1093491 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017381 Nov 06 21:08:02.096232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2907/5893] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Nov 6 21:08:02 2021] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:08:02.101426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.105891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.132708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.133093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.133938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.134380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.578972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:02.591615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-257dcae7-16d3-43d4-a16a-f2c16f4c1a11 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.564117 Nov 06 21:08:02.595752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2987/5894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:02 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:02.627020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:02.636692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37d43c9c-b476-4e5a-b78a-9936e5ed2cb3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.538425 Nov 06 21:08:02.637811 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2908/5895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:02 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:02.657519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.658408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.671393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.672052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.673192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.673707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.702619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:02.702619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.707280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.707549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.709225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.710795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.792892 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-459bd8af-b8c8-43d7-805a-1bbce2cf2091 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.102071 Nov 06 21:08:02.797845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2909/5896] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:02 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:02.921073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:02.929498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-091419a4-c6a5-484a-8b01-a6a672ffa23d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.278039 Nov 06 21:08:02.929941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2988/5897] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:02 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:02.946080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de59f5e4-2b40-4ccc-bbf9-e24d7cabbcb1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.946568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de59f5e4-2b40-4ccc-bbf9-e24d7cabbcb1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Failed to fetch instance by id -1 {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 21:08:02.947075 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-de59f5e4-2b40-4ccc-bbf9-e24d7cabbcb1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance -1 could not be found. Nov 06 21:08:02.947977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de59f5e4-2b40-4ccc-bbf9-e24d7cabbcb1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance -1 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:02.949276 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de59f5e4-2b40-4ccc-bbf9-e24d7cabbcb1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.007325 Nov 06 21:08:02.949971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2910/5898] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:08:02 2021] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:08:02.958973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:02.959826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.972958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.979319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:02.980468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:02.981127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:02.985275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:02.988897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.016870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.017482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.018474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.018970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.116211 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b2f59bf-8fb2-4bca-9e1a-36344dbe8aa9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 16401 microversion: 2.1 time: 0.140202 Nov 06 21:08:03.117105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2911/5899] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:02 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 16401 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:03.226744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:03.235183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77fce872-7a35-451c-8c9f-cf71438b7071 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.280572 Nov 06 21:08:03.236961 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2989/5900] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:02 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:03.254527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:03.255221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:03.269032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.269493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.270301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.271076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.495843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:03.504702 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fba8b57-008d-458a-a842-5a3856cb0dd1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.253612 Nov 06 21:08:03.518623 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2912/5901] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:03 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:03.524281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-256517a7-25c1-4f66-9636-d1945ead9055 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:03.524824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-256517a7-25c1-4f66-9636-d1945ead9055 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 44debe8a-1233-43c5-9fa2-def12289258d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:03.537599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-256517a7-25c1-4f66-9636-d1945ead9055 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 44debe8a-1233-43c5-9fa2-def12289258d could not be found. Nov 06 21:08:03.544031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-256517a7-25c1-4f66-9636-d1945ead9055 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 44debe8a-1233-43c5-9fa2-def12289258d could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:03.545083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-256517a7-25c1-4f66-9636-d1945ead9055 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/44debe8a-1233-43c5-9fa2-def12289258d/action" status: 404 len: 111 microversion: 2.1 time: 0.024963 Nov 06 21:08:03.545683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2990/5902] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:03 2021] POST /compute/v2.1/servers/44debe8a-1233-43c5-9fa2-def12289258d/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:03.563073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:03.563691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:03.572011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.573320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.574630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.575219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:03.948034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:03.969605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6182659e-b681-439e-be4a-25b88ec22282 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.416473 Nov 06 21:08:03.984676 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2991/5903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:03 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:03.989978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:03.990419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:03.998620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:03.999129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.000189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.000893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.027199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c047e49d-83e3-429f-be04-516ccb9877f5 req-b2ffcf00-b36c-4473-9838-c0cb76d1279b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4b38f1-3d16-45a3-a0c2-913238ee5bcd", "tag": "cf841088-3420-4a58-88f6-ca910cf72b21"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:04.030474 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:04.030474 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:08:04.047299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c047e49d-83e3-429f-be04-516ccb9877f5 req-b2ffcf00-b36c-4473-9838-c0cb76d1279b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.048005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c047e49d-83e3-429f-be04-516ccb9877f5 req-b2ffcf00-b36c-4473-9838-c0cb76d1279b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.072821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c047e49d-83e3-429f-be04-516ccb9877f5 req-b2ffcf00-b36c-4473-9838-c0cb76d1279b service nova] Creating event network-changed:cf841088-3420-4a58-88f6-ca910cf72b21 for instance 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd on nch2-master-1 Nov 06 21:08:04.082450 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c047e49d-83e3-429f-be04-516ccb9877f5 req-b2ffcf00-b36c-4473-9838-c0cb76d1279b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.550879 Nov 06 21:08:04.083588 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2913/5904] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:04.091771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:04.093620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.102511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.103303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.117347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.118644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.213315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70403642-40db-46c8-aa2f-b06ec6da9439 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.127695 Nov 06 21:08:04.214949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2914/5905] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:04 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:04.227713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:04.229121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.257591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.258057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.259313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.260160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.525022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:04.537079 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d522bb9-1ae0-4797-a7ff-39564dae49f2 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.551242 Nov 06 21:08:04.538215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2992/5906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:03 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:04.553413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:04.556995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.568104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.571626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.572880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.573860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.585735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:04.594724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c406acb-56bb-45be-ab52-154159ea799d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.378279 Nov 06 21:08:04.595296 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2915/5907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:04 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:04.620132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88b5525c-e1db-439f-a05a-975ed83b393c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:04.624242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88b5525c-e1db-439f-a05a-975ed83b393c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 523db5f9-2a5f-41e3-a0d2-d3dc85a94d0e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.628407 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0238842-e95e-40c5-97cd-5dea4663dadc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 16401 microversion: 2.1 time: 0.088019 Nov 06 21:08:04.629265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2993/5908] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:04 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 16401 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:04.641834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-88b5525c-e1db-439f-a05a-975ed83b393c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 523db5f9-2a5f-41e3-a0d2-d3dc85a94d0e could not be found. Nov 06 21:08:04.642768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88b5525c-e1db-439f-a05a-975ed83b393c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 523db5f9-2a5f-41e3-a0d2-d3dc85a94d0e could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:04.643945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88b5525c-e1db-439f-a05a-975ed83b393c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/523db5f9-2a5f-41e3-a0d2-d3dc85a94d0e/action" status: 404 len: 111 microversion: 2.1 time: 0.028222 Nov 06 21:08:04.645310 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2916/5909] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:04 2021] POST /compute/v2.1/servers/523db5f9-2a5f-41e3-a0d2-d3dc85a94d0e/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:04.654920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:04.655698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.663547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.664149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.664986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.665425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.945834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:04.956327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d872fdca-3db7-4452-9041-1aa6a4373bb8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.306707 Nov 06 21:08:04.957587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2994/5910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:04 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:04.974497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:04.975297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:04.984252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.984788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:04.985590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:04.986029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.225775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:05.226939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.254795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.256629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.260136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.261298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.335708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2975532-58f4-4baa-9250-05b06f770e07 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.113519 Nov 06 21:08:05.341089 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2995/5911] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:05 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:05.452835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:05.467529 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33f30cfc-febb-4262-a659-2ba51959c87f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.496558 Nov 06 21:08:05.468500 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2917/5912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:04 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:05.492378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84ec5544-f61f-4c95-9830-1fc935101f85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:05.493292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84ec5544-f61f-4c95-9830-1fc935101f85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 449feba0-3cab-493d-8581-24f815aaf3e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.508558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-84ec5544-f61f-4c95-9830-1fc935101f85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 449feba0-3cab-493d-8581-24f815aaf3e1 could not be found. Nov 06 21:08:05.509325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84ec5544-f61f-4c95-9830-1fc935101f85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 449feba0-3cab-493d-8581-24f815aaf3e1 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:05.510265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84ec5544-f61f-4c95-9830-1fc935101f85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/449feba0-3cab-493d-8581-24f815aaf3e1" status: 404 len: 111 microversion: 2.1 time: 0.024291 Nov 06 21:08:05.515673 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2996/5913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:05 2021] GET /compute/v2.1/servers/449feba0-3cab-493d-8581-24f815aaf3e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:05.531904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:05.532559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.543385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.543836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.544702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.545140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.556697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:05.557655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.571885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.572663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.574025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.584239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.790685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:05.798356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-868970f8-0bb1-493b-9508-5bef0ffe4940 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.277876 Nov 06 21:08:05.799503 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2918/5914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:05 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:05.808286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:05.817729 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcf5091f-df22-469b-8176-fc1da0a17c7c tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.266139 Nov 06 21:08:05.818164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:05.818728 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2997/5915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:05 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:05.819486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.823158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:05.823758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:05.826368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.826968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.827889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.828559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.830787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.831308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.832089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:05.833990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:05.918519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4cd6fe9d-db9d-4a80-8bdf-5cc021395ed3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.117538 Nov 06 21:08:05.920688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2919/5916] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:05 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:06.133370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:06.144134 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8018a256-06d5-4d94-b8ac-f5e8d123ce51 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.324256 Nov 06 21:08:06.160384 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2998/5917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:05 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:06.254970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9b4aba2-df45-4dab-95ee-92bba107e399 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1255206259", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:06.256903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9b4aba2-df45-4dab-95ee-92bba107e399 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:06.257806 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9b4aba2-df45-4dab-95ee-92bba107e399 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006817 Nov 06 21:08:06.258539 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2920/5918] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:06 2021] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:08:06.266840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:06.267445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:06.273595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.274199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.275143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.275571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.348920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:06.350771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:06.363341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.364015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.365484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.366038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.413183 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-53413daa-947c-4b4c-9fa3-1d72fdf52226 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.069660 Nov 06 21:08:06.414979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2921/5919] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:06 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:06.431250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:06.438645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c525ac4c-751f-43a3-bb98-8b061d0eda11 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.175997 Nov 06 21:08:06.439599 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 2999/5920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:06 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:06.456031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:06.456762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:06.463756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.464211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.465191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.465640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.639451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:06.652264 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7fdfa49-f0e1-4c03-adc2-7bf3e7213267 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.199971 Nov 06 21:08:06.665081 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2922/5921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:06 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:06.773690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea17f5c8-a70b-4461-9e97-23e437c93c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-392289395", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:06.774857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea17f5c8-a70b-4461-9e97-23e437c93c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:06.775650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea17f5c8-a70b-4461-9e97-23e437c93c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006425 Nov 06 21:08:06.776200 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3000/5922] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:06 2021] POST /compute/v2.1/servers => generated 133 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 21:08:06.784950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:06.785558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:06.792407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.792858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.793644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.794079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.836009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:06.836847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:06.846256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.846711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:06.848366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:06.850224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.022810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.045846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ad930e9-0de3-4f7b-85dd-477a5b49ccca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.264837 Nov 06 21:08:07.052674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2923/5923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:06 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:07.055595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.062576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:07.068284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5118dacf-ab06-4904-a17e-c9be942360d6 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.236846 Nov 06 21:08:07.070548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.080552 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3001/5924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:06 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:07.081095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.081829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.082856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.083510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.083832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:07.084484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.092661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.093323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.094316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.095045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.130961 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7438357-9e91-4e44-a00d-4ee5d0da5f24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.076596 Nov 06 21:08:07.135219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2924/5925] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:07 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:07.248260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.258205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d00922bf-b855-434a-96c2-d8d2434d2531 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.179422 Nov 06 21:08:07.258806 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3002/5926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:07.277540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27456dfe-9023-4961-9db2-483f9f6a2519 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:07.278167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27456dfe-9023-4961-9db2-483f9f6a2519 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: bec458e9-2250-454f-a8a2-28c554f9245d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.284686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-27456dfe-9023-4961-9db2-483f9f6a2519 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance bec458e9-2250-454f-a8a2-28c554f9245d could not be found. Nov 06 21:08:07.285516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27456dfe-9023-4961-9db2-483f9f6a2519 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance bec458e9-2250-454f-a8a2-28c554f9245d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:07.286704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27456dfe-9023-4961-9db2-483f9f6a2519 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/bec458e9-2250-454f-a8a2-28c554f9245d/action" status: 404 len: 111 microversion: 2.1 time: 0.013939 Nov 06 21:08:07.287548 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2925/5927] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:07 2021] POST /compute/v2.1/servers/bec458e9-2250-454f-a8a2-28c554f9245d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:07.296309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:07.296753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.303172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.303629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.304678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.305124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.426480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:07.427945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.439079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.441175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.442466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.443540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.464735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.472494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b65240e3-0f39-47fe-ab3c-95d70768c3a2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.180455 Nov 06 21:08:07.473231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3003/5928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:07.489679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:07.493598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.501114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.501499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.502282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.502883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.503486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-afc6d551-8236-4f57-9c61-44299dee820d tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.081172 Nov 06 21:08:07.504859 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2926/5929] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:07 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:07.645719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.656692 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b957f065-ac2b-4a25-af94-879cd452527a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.170572 Nov 06 21:08:07.657898 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3004/5930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:07.675710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:07.676465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.684595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.686827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.699034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.699034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.769338 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f66a82b9-3dec-4041-93cd-002c4f8df385 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.098565 Nov 06 21:08:07.770532 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2927/5931] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:07 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:08:07.782428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:07.784950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:07.792478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.792934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.794058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:07.795202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:07.956385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:07.969863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d36b3dc-f495-4828-ace0-2b6b237d357e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1509 microversion: 2.1 time: 0.194606 Nov 06 21:08:07.970560 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3005/5932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:08.090280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:08.092110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:08.099356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.099897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.100950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.101490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.142293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:08.143299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:08.151769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.152242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.153038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.153572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.204509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc266632-6232-4ae2-aa89-dddffb820333 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.066249 Nov 06 21:08:08.205585 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3006/5933] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:08 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:08.516038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:08.517169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:08.524916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.525439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.526421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.527013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:08.576475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f34593dd-343c-4ea9-9411-af19ea01c739 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.064337 Nov 06 21:08:08.581168 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3007/5934] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:08 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:08.587105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:08.596181 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2978880-3bf7-4740-96e6-7878a71c12c3 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.510915 Nov 06 21:08:08.597444 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2928/5935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:08 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:08.988172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:08.989084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:08.997932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:08.998943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.000236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.000734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.145205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:09.152997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de71e80f-f4fe-4943-905f-bf6ac9b08baa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1489 microversion: 2.1 time: 0.169605 Nov 06 21:08:09.153591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3008/5936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:08 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1489 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:09.169979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:09.170512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.177548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.178004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.178795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.179241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.202889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'pause' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state paused Nov 06 21:08:09.203525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'pause' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state paused {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:09.204396 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79a8f7b0-a8f4-4d0e-98de-e41201d723ca tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 143 microversion: 2.1 time: 0.038933 Nov 06 21:08:09.205137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2929/5937] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:09 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 143 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:08:09.213125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:09.213656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.216019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:09.217049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.220392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.221097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.222787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.223454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.225269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.225729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.226569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.227239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.283107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0de6f78-7d55-49f5-a015-3f8bacaba6a1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.070999 Nov 06 21:08:09.285417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2930/5938] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:09 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:09.306141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-689d60ea-753a-44db-b6cc-5ac48556be8a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.096122 Nov 06 21:08:09.310631 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3009/5939] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:09 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:08:09.332506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:09.333715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.347488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.347945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.348768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.369382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.592286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:09.593456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.593579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:09.601930 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af124cb1-d9b9-4814-8774-b50087988b85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1496 microversion: 2.1 time: 0.288615 Nov 06 21:08:09.602498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2931/5940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:09 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1496 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:09.616996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:09.617360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.617838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.617956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:09.618656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.619089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.624951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.625652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.626550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:09.627096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:09.676438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-481985f6-d788-4714-8bb5-e395abe138b8 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.090604 Nov 06 21:08:09.677562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3010/5941] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:09 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:09.802871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:09.811232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e0737c7-d25c-4b43-9c3e-4c9efba77482 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.201052 Nov 06 21:08:09.816257 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2932/5942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:09 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:10.295820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:10.296894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:10.304339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.304801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.305591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.306076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.353899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc0de507-3ef0-4538-bbaa-2b6e695d3e64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.062179 Nov 06 21:08:10.354563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3011/5943] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:10 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:10.618791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:10.619302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:10.627889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.628390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.629180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.629643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.689177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:10.690765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:10.699317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.699941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.700993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.701573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.745424 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f7dfd96-4dae-46dc-ada4-c63ac54a3f3e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.060568 Nov 06 21:08:10.746292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3012/5944] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:10 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:10.754257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2feb57da-dac1-4910-a31d-0d889cd60244 req-5e59075f-cfa9-412a-aacb-d4c9ffcbc7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4b38f1-3d16-45a3-a0c2-913238ee5bcd", "name": "network-vif-plugged", "status": "completed", "tag": "cf841088-3420-4a58-88f6-ca910cf72b21"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:10.756071 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:10.756071 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:10.764143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2feb57da-dac1-4910-a31d-0d889cd60244 req-5e59075f-cfa9-412a-aacb-d4c9ffcbc7bd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.764833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2feb57da-dac1-4910-a31d-0d889cd60244 req-5e59075f-cfa9-412a-aacb-d4c9ffcbc7bd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.778084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2feb57da-dac1-4910-a31d-0d889cd60244 req-5e59075f-cfa9-412a-aacb-d4c9ffcbc7bd service nova] Creating event network-vif-plugged:cf841088-3420-4a58-88f6-ca910cf72b21 for instance 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd on nch2-master-1 Nov 06 21:08:10.783237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2feb57da-dac1-4910-a31d-0d889cd60244 req-5e59075f-cfa9-412a-aacb-d4c9ffcbc7bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034526 Nov 06 21:08:10.784041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3013/5945] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:10.804083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:10.827378 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5827a06-9a1c-4aa8-9a04-8633f8ae33b1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1496 microversion: 2.1 time: 0.212272 Nov 06 21:08:10.828160 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2933/5946] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:10 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:10.837686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:10.837686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:10.838237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.838691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.839478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:10.839913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:10.991615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:10.999171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1f5de92-8c8a-4f6e-838f-22614bd9d6ae tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.173144 Nov 06 21:08:10.999804 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3014/5947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:10 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:11.365233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:11.366222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:11.372608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.373139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.373994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.374518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.414714 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c07eb20-6c5f-405f-b313-8484dba68b86 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.052811 Nov 06 21:08:11.415229 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2934/5948] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:11 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:11.760770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:11.762365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:11.772025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.772531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.773418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.773936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.815861 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aee4866f-ff81-487e-9cdc-bd4ef1dc60d6 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.061177 Nov 06 21:08:11.817254 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3015/5949] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:11 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:11.845579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:11.846427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:11.854838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.855301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.856100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:11.856642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:11.993133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:12.001289 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-840c78a7-7e47-423d-bdc2-5993c5c4cd0c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1496 microversion: 2.1 time: 0.160815 Nov 06 21:08:12.002092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2935/5950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:11 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:12.017656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:12.018690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:12.027011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.027662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.028557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.029126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.163917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:12.172670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1e8bfa4-1183-4314-b085-3d0d17b59ed9 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1314 microversion: 2.1 time: 0.159665 Nov 06 21:08:12.173244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3016/5951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:12 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:12.426462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:12.427492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:12.433991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.434534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.435415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.435920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.475138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3dca13c-2696-4055-9315-d6b531f9c48a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.052427 Nov 06 21:08:12.478962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2936/5952] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:12 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:12.827161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:12.828075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:12.835324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.835769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.836568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:12.837005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:12.876783 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08006938-3e69-4561-8432-7d40fd030fc7 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.053499 Nov 06 21:08:12.878435 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3017/5953] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:12 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:13.019425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:13.020189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.028144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.029209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.030006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.030444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.180341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:13.190417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:13.191127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.198259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.198624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f908c6b-7b3f-4146-a6b1-5bc6d4844d97 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1496 microversion: 2.1 time: 0.183115 Nov 06 21:08:13.199180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.209567 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2937/5954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:13 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1496 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:13.210042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.210042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.340034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:13.347311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b186ba6-23c9-4bab-8c1b-d3661af7aa04 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1464 microversion: 2.1 time: 0.160934 Nov 06 21:08:13.347999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3018/5955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:13 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:13.385494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:13.386012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.392612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.393062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.393835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.394560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.420143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:08:13.490328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:13.491678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.499696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.500498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.501714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.502508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.502808 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ea353e3-f68c-4a9b-9343-b827c9e7aaea tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 204 len: 0 microversion: 2.1 time: 0.120446 Nov 06 21:08:13.503494 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2938/5956] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:08:13 2021] DELETE /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:08:13.516673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:13.517382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.523238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.523698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.524512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.524954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.549642 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47d3f5e3-7313-4512-a1d7-805015cb67bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.066821 Nov 06 21:08:13.553464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3019/5957] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:13 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:13.662091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:13.670438 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d17a475-8bdd-452a-a46c-651f7b042022 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1470 microversion: 2.1 time: 0.162364 Nov 06 21:08:13.671109 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2939/5958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:13 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:13.889090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:13.890086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:13.897285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.897735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.898507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:13.898935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:13.941662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d4aa66f-58db-4df3-8098-d4bc014d8618 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.056466 Nov 06 21:08:13.942308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3020/5959] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:13 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:14.216910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:14.217638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:14.224230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.224726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.225504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.225940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.359975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:14.367782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24861639-cd86-40a5-ac13-420f9225df40 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1496 microversion: 2.1 time: 0.154988 Nov 06 21:08:14.368359 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2940/5960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:14 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:14.561399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:14.562406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:14.569742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.570443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.571233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.571837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.634044 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ed5f50e-c838-4ac9-87a0-aa167b6eccac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.076644 Nov 06 21:08:14.634952 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3021/5961] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:14 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:14.687154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:14.687799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:14.693703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.694168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.694951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.695394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.832116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:14.839896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6759225-8bf4-45e2-a59e-3ceff1ff45c8 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1470 microversion: 2.1 time: 0.156856 Nov 06 21:08:14.840516 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2941/5962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:14 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:14.954383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:14.955393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:14.963022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.963478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:14.964326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:14.964751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.004875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e5cf305-0908-4431-ab9a-9c9bafc784f3 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.054794 Nov 06 21:08:15.006035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3022/5963] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:14 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:15.385168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:15.386956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.395403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.396186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.397609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.398341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.474344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-623fdf54-221b-49d4-aaa0-ae2ea5aab3ff req-05e9d85d-d660-40ad-a1a7-48e083952ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4b38f1-3d16-45a3-a0c2-913238ee5bcd", "name": "network-vif-deleted", "tag": "cf841088-3420-4a58-88f6-ca910cf72b21"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:15.476325 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:15.476325 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:15.488783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-623fdf54-221b-49d4-aaa0-ae2ea5aab3ff req-05e9d85d-d660-40ad-a1a7-48e083952ceb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.494413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-623fdf54-221b-49d4-aaa0-ae2ea5aab3ff req-05e9d85d-d660-40ad-a1a7-48e083952ceb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.511621 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-623fdf54-221b-49d4-aaa0-ae2ea5aab3ff req-05e9d85d-d660-40ad-a1a7-48e083952ceb service nova] Creating event network-vif-deleted:cf841088-3420-4a58-88f6-ca910cf72b21 for instance 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd on nch2-master-1 Nov 06 21:08:15.517656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-623fdf54-221b-49d4-aaa0-ae2ea5aab3ff req-05e9d85d-d660-40ad-a1a7-48e083952ceb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048201 Nov 06 21:08:15.518594 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3023/5964] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:15.605664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:15.615882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-852351e1-9b37-465d-bdcb-087ee274a9c4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.234134 Nov 06 21:08:15.616710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2942/5965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:15 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:15.636770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:15.637895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.650356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.651199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.652237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:15.654719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.655727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.656175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.666239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.667154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.673209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.674302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.730883 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50d8fb65-026f-4664-a342-8fd10e4c518e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.087316 Nov 06 21:08:15.735869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2943/5966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:15 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:15.830026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:15.837612 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9ebf260-0e8a-407b-b093-77b58c2e591e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.206521 Nov 06 21:08:15.844503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3024/5967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:15 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:15.855012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:15.856322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.859399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:15.859664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.866516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.867290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.868101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.868563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.892313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.892771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.893577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.894016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.908071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.908784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.909467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lazy-loading 'fault' on Instance uuid 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:08:15.922414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. Nov 06 21:08:15.923316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:15.924349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5eea5dc-3932-4f32-b7b0-6c9e4fbcf81c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac/action" status: 404 len: 111 microversion: 2.1 time: 0.074020 Nov 06 21:08:15.925259 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2944/5968] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:15 2021] POST /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:15.934160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:15.935114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:15.942693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.943707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.945377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:15.946342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:15.986854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48334679063d40429b42fddf3d7f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b512f3f002d4176808c9ea78c759467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:15.996225 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb131167-6e5d-44e9-adf3-6033a5b67833 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 200 len: 1304 microversion: 2.1 time: 0.142956 Nov 06 21:08:15.996839 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3025/5969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:15 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:16.018940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:16.020103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.027163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.027941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.029716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.030359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.078363 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2885f211-e9b3-458f-93ec-655aa37e5ea5 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.064602 Nov 06 21:08:16.079274 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3026/5970] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:16 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:16.139196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:16.146489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07f06497-2179-4312-96ee-324a8af1e36c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.217142 Nov 06 21:08:16.147042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2945/5971] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:15 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:16.164019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:16.164773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.172092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.172558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.173362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.173797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.312479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:16.319736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6b1318f-4da9-470c-afd6-216eab011e85 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.159709 Nov 06 21:08:16.320321 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3027/5972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:16.337880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c88e7cc0-3c19-42ed-a996-dd66f2eba1f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:16.338860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c88e7cc0-3c19-42ed-a996-dd66f2eba1f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: a71d4bc6-cfe4-4aa0-8906-38f155b07a49] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.345319 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c88e7cc0-3c19-42ed-a996-dd66f2eba1f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance a71d4bc6-cfe4-4aa0-8906-38f155b07a49 could not be found. Nov 06 21:08:16.345986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c88e7cc0-3c19-42ed-a996-dd66f2eba1f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance a71d4bc6-cfe4-4aa0-8906-38f155b07a49 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:16.346860 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c88e7cc0-3c19-42ed-a996-dd66f2eba1f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/a71d4bc6-cfe4-4aa0-8906-38f155b07a49/action" status: 404 len: 111 microversion: 2.1 time: 0.013313 Nov 06 21:08:16.347475 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2946/5973] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:16 2021] POST /compute/v2.1/servers/a71d4bc6-cfe4-4aa0-8906-38f155b07a49/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:08:16.355364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:16.356006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.362025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.362489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.363265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.363706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.504095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:16.511586 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c3b7541-b920-464d-ad4c-0db9bd246346 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.159883 Nov 06 21:08:16.512158 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3028/5974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:16.529174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:16.529783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.536767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.537220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.538000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.538441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.671982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:16.680120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d01b7d60-ac91-4277-afc7-40b7e68a0f38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.153864 Nov 06 21:08:16.680120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2947/5975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:16.696157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:16.697590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.703776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.704231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.705056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.705496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.718456 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. Nov 06 21:08:16.719042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:16.719860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8288e9a-7d3c-4e55-82af-d96792a2b185 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac/action" status: 404 len: 111 microversion: 2.1 time: 0.027459 Nov 06 21:08:16.720648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3029/5976] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:16 2021] POST /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:16.728658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:16.729271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.735456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.735906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.736706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.737140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.746274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:16.747785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.753830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.754374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.755065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.755569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.799181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14b52882-14c8-4775-8d3a-776608e1381a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.056350 Nov 06 21:08:16.799917 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3030/5977] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:16 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:16.891091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:16.898800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c04821d-e1d2-42a2-aa0e-b87b5b9b26f5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.173982 Nov 06 21:08:16.899533 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2948/5978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:16.917068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:16.917774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:16.925384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.925848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:16.926644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:16.927085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.013829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:17.014449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] [instance: 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.022590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.023501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.024595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.025241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.040040 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] HTTP exception thrown: Instance 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd could not be found. Nov 06 21:08:17.040782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] Returning 404 to user: Instance 6c4b38f1-3d16-45a3-a0c2-913238ee5bcd could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:17.041958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90b42171-0db2-4be4-a691-164707acb3f1 tempest-VolumesNegativeTest-1453129096 tempest-VolumesNegativeTest-1453129096-project] 10.222.0.13 "GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd" status: 404 len: 111 microversion: 2.1 time: 0.031881 Nov 06 21:08:17.042601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2949/5979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:17 2021] GET /compute/v2.1/servers/6c4b38f1-3d16-45a3-a0c2-913238ee5bcd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:08:17.068446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:17.077400 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-296c4381-0bbd-42d5-827f-7ecc09c199ce tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.164657 Nov 06 21:08:17.078353 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3031/5980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:17.089474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:17.090506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.096602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7051033-7f92-4b42-a79d-e84d7c918aea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:17.098044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7051033-7f92-4b42-a79d-e84d7c918aea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 00be07e3-f20e-4896-a3e6-8f90b16a73dd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.104155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.104857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e7051033-7f92-4b42-a79d-e84d7c918aea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 00be07e3-f20e-4896-a3e6-8f90b16a73dd could not be found. Nov 06 21:08:17.105055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.105464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7051033-7f92-4b42-a79d-e84d7c918aea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 00be07e3-f20e-4896-a3e6-8f90b16a73dd could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:17.106316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.107042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7051033-7f92-4b42-a79d-e84d7c918aea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/00be07e3-f20e-4896-a3e6-8f90b16a73dd/action" status: 404 len: 111 microversion: 2.1 time: 0.013910 Nov 06 21:08:17.107753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.111388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3032/5981] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:17 2021] POST /compute/v2.1/servers/00be07e3-f20e-4896-a3e6-8f90b16a73dd/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:17.116796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:17.117409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.125431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.125896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.126702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.127579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.153228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2952a376-f524-4ea8-9e50-61620d94b50a tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.067200 Nov 06 21:08:17.158745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2950/5982] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:17 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:17.280097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:17.289351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1241cbad-e359-42e3-a4ce-423de898f863 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.176808 Nov 06 21:08:17.292616 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3033/5983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:17 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:17.309088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:17.309875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.316992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.317454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.318249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.318699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.463296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:17.472382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66ba79b3-8c20-4ee4-9b2c-ff4c39f73d6c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.167201 Nov 06 21:08:17.484133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2951/5984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:17 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:17.489209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c98aaa1-6c90-4ce1-95c8-b1bb79056b5c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:17.489819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c98aaa1-6c90-4ce1-95c8-b1bb79056b5c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 726df7e4-36e7-45aa-ba7f-20a6d1782ca8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.496715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-1c98aaa1-6c90-4ce1-95c8-b1bb79056b5c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 726df7e4-36e7-45aa-ba7f-20a6d1782ca8 could not be found. Nov 06 21:08:17.497610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c98aaa1-6c90-4ce1-95c8-b1bb79056b5c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 726df7e4-36e7-45aa-ba7f-20a6d1782ca8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:17.498646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c98aaa1-6c90-4ce1-95c8-b1bb79056b5c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/726df7e4-36e7-45aa-ba7f-20a6d1782ca8/action" status: 404 len: 111 microversion: 2.1 time: 0.013388 Nov 06 21:08:17.499395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3034/5985] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:17 2021] POST /compute/v2.1/servers/726df7e4-36e7-45aa-ba7f-20a6d1782ca8/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:17.507586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:17.508211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.514840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.515300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.516669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.517935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.691885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:17.701929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30106570-6d0d-4b22-a496-23538f4a6ef1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.198140 Nov 06 21:08:17.702816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2952/5986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:17 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:17.723891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:17.724764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.734022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.734612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.735792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.736409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.816668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:17.817859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.826442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.827101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.827923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.828382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.891822 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4dc4af90-9250-4a2c-b3d7-b47938097472 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.083887 Nov 06 21:08:17.897060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2953/5987] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:17 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:17.940548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:17.950839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f48f9cc-ca25-4edb-8c4b-402d0ac9bb67 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.231448 Nov 06 21:08:17.951458 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3035/5988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:17 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:17.968179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:17.968748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:17.976530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.977019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:17.978178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:17.978888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.010835 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'restore' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active Nov 06 21:08:18.011489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'restore' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:18.012682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7df60246-e050-4f63-b8cf-f7af3543ad28 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 145 microversion: 2.1 time: 0.048902 Nov 06 21:08:18.014201 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2954/5989] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:17 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 145 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:08:18.022624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:18.023329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.030802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.031269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.032064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.032878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.166210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:18.167676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.175259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.176126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.177091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.177679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.229959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:18.233654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9018775-2b30-430c-8f92-cc7ca792ec99 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.071145 Nov 06 21:08:18.234432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2955/5990] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:18 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:18.238556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2dad4131-a87d-46e5-bbd6-f76fce778bf8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.219654 Nov 06 21:08:18.239466 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3036/5991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:18.258296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:18.258730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.267404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.267951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.268773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.269181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.439503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:18.448953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2cc0bfed-96a3-4a3c-9020-5303230c2a46 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.195454 Nov 06 21:08:18.449752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2956/5992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:18.467781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c77eaca4-9f0a-4993-8d83-d27e7a067802 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:18.468627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c77eaca4-9f0a-4993-8d83-d27e7a067802 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: ea1293e5-3236-47ae-920d-9220b60773e3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.474620 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c77eaca4-9f0a-4993-8d83-d27e7a067802 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance ea1293e5-3236-47ae-920d-9220b60773e3 could not be found. Nov 06 21:08:18.475286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c77eaca4-9f0a-4993-8d83-d27e7a067802 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance ea1293e5-3236-47ae-920d-9220b60773e3 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:18.476405 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c77eaca4-9f0a-4993-8d83-d27e7a067802 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/ea1293e5-3236-47ae-920d-9220b60773e3/action" status: 404 len: 111 microversion: 2.1 time: 0.013081 Nov 06 21:08:18.477098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3037/5993] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:18 2021] POST /compute/v2.1/servers/ea1293e5-3236-47ae-920d-9220b60773e3/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:18.485930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:18.486590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.494154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.494643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.495451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.495917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.680420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:18.690552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c88f56df-6ad1-45cc-9891-73de2c831b8f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.208473 Nov 06 21:08:18.701437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2957/5994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:18.714630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:18.715505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.724022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.724759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.725817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.726450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.891504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:18.900914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f13ad4df-2941-4fca-a8b3-336ab97c8590 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.191109 Nov 06 21:08:18.901510 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3038/5995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:18.908198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:18.909244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.915654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.916188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.922579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:18.923536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.924070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.927138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.934338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.949743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.950622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:18.951287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:18.978941 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'resume' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active Nov 06 21:08:18.979564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'resume' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:18.980575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d798718-31d9-48e4-a63b-11eabe818f72 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 144 microversion: 2.1 time: 0.062477 Nov 06 21:08:18.982257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3039/5996] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:18 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 144 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 06 21:08:18.992420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:18.993547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:18.993676 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d2b7d7a-fe0d-4b86-a053-f379a183bfad tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.088790 Nov 06 21:08:18.998033 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2958/5997] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:18 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:19.001233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.001732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.002813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.003518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.190255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:19.201078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a66543b-c13a-4bcc-9f6b-578fcf5930ae tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.213406 Nov 06 21:08:19.202605 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3040/5998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:19.222648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:19.224133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.232712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.233616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.234721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.235418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.246509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:19.247474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.255159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.256015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.257098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.257771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.326379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-125dc8db-15f5-47df-b981-6bfd3b8db4b1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.083704 Nov 06 21:08:19.327477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3041/5999] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:19 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:19.402996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:19.411653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c188407-6faf-4c80-bde6-b515819dd739 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.193877 Nov 06 21:08:19.412215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2959/6000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:19.546525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b4b4fec-ede8-4115-9709-807b790c56ac tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c30ed2f9-ff90-4ea6-91a5-88a8e8f623d3"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:19.547988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b4b4fec-ede8-4115-9709-807b790c56ac tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:19.548825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b4b4fec-ede8-4115-9709-807b790c56ac tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.006485 Nov 06 21:08:19.549348 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3042/6001] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:19 2021] POST /compute/v2.1/servers => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:08:19.557583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:19.558206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.565489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.565952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.566746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.567188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.713924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:19.722738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91b6400c-264d-4b76-bdaa-44970dceb743 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.168638 Nov 06 21:08:19.725415 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2960/6002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:19.749225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:19.750280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.759774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.760373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.761130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.761569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.920269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:19.928565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fa54efe-5d87-492c-a0fc-dab94a6070e3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.189354 Nov 06 21:08:19.929447 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3043/6003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:19.949936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c028837-344d-4d2c-8c3c-224570d7d592 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:19.951092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c028837-344d-4d2c-8c3c-224570d7d592 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 14405ba4-3990-4a0f-a64d-0e6cf81ff10b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.957033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-3c028837-344d-4d2c-8c3c-224570d7d592 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 14405ba4-3990-4a0f-a64d-0e6cf81ff10b could not be found. Nov 06 21:08:19.957720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c028837-344d-4d2c-8c3c-224570d7d592 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 14405ba4-3990-4a0f-a64d-0e6cf81ff10b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:19.958552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c028837-344d-4d2c-8c3c-224570d7d592 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/14405ba4-3990-4a0f-a64d-0e6cf81ff10b/action" status: 404 len: 111 microversion: 2.1 time: 0.012644 Nov 06 21:08:19.959118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2961/6004] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:19 2021] POST /compute/v2.1/servers/14405ba4-3990-4a0f-a64d-0e6cf81ff10b/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:19.969641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:19.970635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:19.977434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.978120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:19.979021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:19.979587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.006897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:20.008047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:20.025758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.026406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.027294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.030159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.086644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7dfbef4b-a19b-49da-bdb4-c985af811131 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.079459 Nov 06 21:08:20.089928 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2962/6005] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:20 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:20.146659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:20.154460 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e60bd64-532d-4b0f-b74c-c0c34e30412e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.188927 Nov 06 21:08:20.155708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3044/6006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:20.174121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:20.175066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:20.184109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.185330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.186486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.187160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.340497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:20.342433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:20.354617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.356162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.358451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.359258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.382156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:20.394753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57dfa0f2-7b9f-477d-85dd-2bfe895aba38 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.225361 Nov 06 21:08:20.395886 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2963/6007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:20 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:20.413690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:20.414231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:20.414588 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bed379ac-e7c8-45b4-8a6e-e8f9ecca8c6e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.079109 Nov 06 21:08:20.415436 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3045/6008] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:20 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:20.421746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.422249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.423415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.423864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.450452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lazy-loading 'flavor' on Instance uuid 40215c7e-b779-4d6b-adfd-20dd72cdb1cd {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:08:20.746872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ea75229-ee79-46f8-bc5e-68f341c25971 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.336616 Nov 06 21:08:20.747754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2964/6009] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:20 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:08:20.762366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:20.763147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:20.776734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.777490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.779105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:20.779996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:20.956940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:20.966785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60a408a4-c1ed-41c3-a03e-6d203603a837 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.214373 Nov 06 21:08:20.967572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3046/6010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:20 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:21.098772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:21.099907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:21.106844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.107528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:21.108964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.109487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:21.149908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fdcfe80-0346-4148-8090-aa0f575ffc56 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.054927 Nov 06 21:08:21.150569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2965/6011] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:21 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:21.427935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:21.428991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:21.437289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.437741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:21.438535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.438993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:21.484239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f5dc523-3f0e-47fa-98fa-54a8ffe414f4 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.060714 Nov 06 21:08:21.485540 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3047/6012] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:21 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:21.985459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:21.986202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:21.994397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.995145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:21.996176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:21.996638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:22.163953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:22.165039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:22.173456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:22.174206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:22.175132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:22.175737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:22.225392 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8139e29-fa92-475e-a5d7-5eb568a41718 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.065848 Nov 06 21:08:22.226201 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3048/6013] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:22 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:22.229464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:22.241159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f25f2208-7afe-49de-8ee6-8fc68f5ace41 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.258367 Nov 06 21:08:22.241159 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2966/6014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:21 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:22.500065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:22.501447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:22.512531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:22.512531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:22.512531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:22.512531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:22.557014 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29236f4e-d675-4917-b823-90f94370f9c1 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 32591 microversion: 2.1 time: 0.064279 Nov 06 21:08:22.557820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3049/6015] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:22 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 32591 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:23.238978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:23.239964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:23.248872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.249931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.251052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.251592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.259196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:23.260314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:23.273213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.273755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.282262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.282730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.338595 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51dd79df-3db1-47dc-b296-09c2ca72cf59 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.103717 Nov 06 21:08:23.343428 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2967/6016] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:23 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:23.488799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:23.497464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b04a85e3-82f7-43f2-a7aa-9ec6342c2b22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.242707 Nov 06 21:08:23.498262 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3050/6017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:23 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:23.570278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:23.571787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:23.579593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.580120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.580980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.581422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.639100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fdcb53a-227f-4bdc-8a10-05c0f5a5945b tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action" status: 200 len: 40746 microversion: 2.1 time: 0.072986 Nov 06 21:08:23.639905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2968/6018] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:23 2021] POST /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb/action => generated 40746 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:23.649794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:23.650509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:23.656964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.657610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.658406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:23.658844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:23.847660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:23.857326 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f7912ea-6609-4021-b1c8-26c496c37cb2 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1604 microversion: 2.1 time: 0.211056 Nov 06 21:08:23.857915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3051/6019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:23 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:23.922512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: .version_select at 0x7f67153703a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1407222739"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:23.942727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:23.948393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:24.064904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:24.072134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:24.088086 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d186b661-1f5f-4a96-96c2-5acbc6452d8f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.415153 Nov 06 21:08:24.088722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2969/6020] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:08:23 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:24.360421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:24.362502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:24.373222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.373443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.374350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.374819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.422195 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca014e54-395b-4452-ba8b-43f9c3a79b73 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.074908 Nov 06 21:08:24.422854 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3052/6021] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:24 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:24.518338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:24.519217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:24.530108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.530619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.531928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.532515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.716330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:24.726455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05b00818-a401-4102-ab7d-b2afd2b1bd6b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.214347 Nov 06 21:08:24.727483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2970/6022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:24 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:24.833035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:24.837109 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:24.837109 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:24.838120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:24.838966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Searching by: {'deleted': False, 'project_id': '23c3196631494be38ca11b2167bbc4bb'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:08:24.845973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.846431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.847382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.847822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.881477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:08:24.911586 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61a490ec-866b-4555-bc96-ef9dce7da081 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.082855 Nov 06 21:08:24.912582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3053/6023] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:08:24 2021] GET /compute/v2.1/servers => generated 344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:24.924619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:24.929854 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:24.929854 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:08:24.931723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:24.933014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Searching by: {'deleted': False, 'project_id': '23c3196631494be38ca11b2167bbc4bb'} {{(pid=134828) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:08:24.938931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.939392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.940253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:24.940667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:24.971815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.multi_cell_list [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:08:25.014349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:25.021045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.021753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.195380 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f75f19d7-2e96-4369-8cce-6126750ac52c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.274363 Nov 06 21:08:25.195960 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2971/6024] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:08:24 2021] GET /compute/v2.1/servers/detail => generated 1607 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:25.213036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89d24332-f1dd-4cf8-af5e-46c6e80c343c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:25.224198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89d24332-f1dd-4cf8-af5e-46c6e80c343c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014579 Nov 06 21:08:25.225118 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3054/6025] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:08:25 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:25.433868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:25.435047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:25.441465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.441948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.442774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.443411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.489317 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e18f7d4-de51-4fac-8479-7c5aec834b93 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.059464 Nov 06 21:08:25.493411 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2972/6026] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:25 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:25.576028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:25.576914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:25.589211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.589629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.591056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.593177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.638938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:08:25.724565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 204 len: 0 microversion: 2.1 time: 0.152457 Nov 06 21:08:25.725459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3055/6027] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:08:25 2021] DELETE /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:08:25.733539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:25.734821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:25.743261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.744099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.745063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.745655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.749667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:25.750454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:25.757286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.757819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.758871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:25.759526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:25.992705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:26.002300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cfeea856-f8ed-4bd0-9a1c-dda6e607691f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.260905 Nov 06 21:08:26.003257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3056/6028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:25 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:26.013895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:26.023205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-140063f0-2d45-4e1e-b99f-0f7db6c9a92c tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1610 microversion: 2.1 time: 0.293557 Nov 06 21:08:26.023781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2973/6029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:25 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1610 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:26.502318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:26.503405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:26.510041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:26.510591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:26.511446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:26.512102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:26.554317 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5874863e-2077-4068-bab9-a51986b06049 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.055306 Nov 06 21:08:26.555892 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3057/6030] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:26 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:27.020955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:27.021600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:27.031579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.032467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.033529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.039484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.041299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:27.042258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:27.053343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.054040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.063320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.063979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.293755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:27.302414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66d61cf8-c0b1-4555-a147-2a225b713d3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.285665 Nov 06 21:08:27.306603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2974/6031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:27 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:27.334723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:27.343232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-518a91e6-2ec2-47eb-8471-5f14b50c835e tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1610 microversion: 2.1 time: 0.305801 Nov 06 21:08:27.344215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3058/6032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:27 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1610 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:27.565920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:27.567138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:27.577568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.578315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.579308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:27.579969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:27.630222 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f41592fc-f931-4cc0-8191-5e739485aaed tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.067737 Nov 06 21:08:27.630876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2975/6033] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:27 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:28.323129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:28.323740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:28.337054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.342283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.343438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.344078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.361743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:28.362455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:28.383092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.383719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.386862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.387801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.551889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:28.559630 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ada3a9a1-377f-4380-8a3e-e4d926dc91cf tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1542 microversion: 2.1 time: 0.201852 Nov 06 21:08:28.560338 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2976/6034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:28 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1542 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:28.648779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:28.649704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:28.657194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.662087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.663204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.664984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.772210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6a915bf-0554-44c3-a14b-3a6c9e12ba98 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.131073 Nov 06 21:08:28.774217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2977/6035] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:28 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:08:28.817616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:28.830587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-423e88bb-bd83-4ce4-8847-aa4c594ef582 req-17b8cd84-bf61-4cb9-be70-de2adaa3f9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c608206-049f-45dd-ad2c-c73bd68927eb", "name": "network-vif-deleted", "tag": "6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:28.832664 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:28.832664 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:08:28.833990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bf597d0-f0f5-4dae-81f6-68734cfe5f81 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.512277 Nov 06 21:08:28.834815 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3059/6036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:28 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:28.861849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-423e88bb-bd83-4ce4-8847-aa4c594ef582 req-17b8cd84-bf61-4cb9-be70-de2adaa3f9d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:28.862597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-423e88bb-bd83-4ce4-8847-aa4c594ef582 req-17b8cd84-bf61-4cb9-be70-de2adaa3f9d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:28.885121 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-423e88bb-bd83-4ce4-8847-aa4c594ef582 req-17b8cd84-bf61-4cb9-be70-de2adaa3f9d6 service nova] Creating event network-vif-deleted:6f9a0e8b-dd2b-4d0a-a8a9-dabf4f84f7e8 for instance 5c608206-049f-45dd-ad2c-c73bd68927eb on nch2-master-1 Nov 06 21:08:28.891811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-423e88bb-bd83-4ce4-8847-aa4c594ef582 req-17b8cd84-bf61-4cb9-be70-de2adaa3f9d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075340 Nov 06 21:08:28.892772 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2978/6037] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:29.577079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:29.578569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:29.590926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.591354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.592163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.595769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.654338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.654944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.655515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lazy-loading 'fault' on Instance uuid 5c608206-049f-45dd-ad2c-c73bd68927eb {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:08:29.758467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51fe86b5589475da23e549e5e4128aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c3196631494be38ca11b2167bbc4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:29.777600 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-985c01ce-130a-4034-826c-b2ecc887ec82 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 200 len: 1212 microversion: 2.1 time: 0.198918 Nov 06 21:08:29.781173 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3060/6038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:29 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 1212 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:29.795736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:29.797302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:29.809914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.810435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.813611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.814406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.855699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:29.858434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:29.895663 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8dcdb37-9bd1-4d8c-b8d1-c35a43f36af2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.112192 Nov 06 21:08:29.898759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2979/6039] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:29 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:29.917724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.918329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:29.921631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:29.926183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:30.380807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:30.399682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0813ad1f-f7cf-479f-8eba-7b09a0d6da0e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.550394 Nov 06 21:08:30.400484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3061/6040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:29 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:30.802814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:30.804457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] [instance: 5c608206-049f-45dd-ad2c-c73bd68927eb] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:30.815824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:30.816835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:30.819343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:30.820041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:30.852978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] HTTP exception thrown: Instance 5c608206-049f-45dd-ad2c-c73bd68927eb could not be found. Nov 06 21:08:30.853960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Returning 404 to user: Instance 5c608206-049f-45dd-ad2c-c73bd68927eb could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:08:30.855089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8e632c9-e2d0-4f74-a688-9e86d8b95197 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb" status: 404 len: 111 microversion: 2.1 time: 0.060631 Nov 06 21:08:30.856831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2980/6041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:30 2021] GET /compute/v2.1/servers/5c608206-049f-45dd-ad2c-c73bd68927eb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:08:30.864415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-909a40a9-1105-48b0-a61b-b0e48951fd96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] Calling method '.version_select at 0x7f671402daf0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:30.899401 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-909a40a9-1105-48b0-a61b-b0e48951fd96 tempest-ServersTestBootFromVolume-1142499360 tempest-ServersTestBootFromVolume-1142499360-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124541079" status: 202 len: 0 microversion: 2.1 time: 0.038547 Nov 06 21:08:30.904511 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3062/6042] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:08:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124541079 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:08:30.914148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:30.915167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:30.926315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:30.931218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:30.932151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:30.932633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:30.983624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e2767c2-3df3-4e85-823d-cbe75a2760ce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.077377 Nov 06 21:08:30.986044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2981/6043] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:30 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:31.417624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:31.418264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:31.426367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:31.433000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:31.435986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:31.438607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:31.959105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:31.967921 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1dc96610-a00f-462e-b3f9-b4b9b529861a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.554468 Nov 06 21:08:31.979928 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3063/6044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:31 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:31.997962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:31.998988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:32.022060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:32.022529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:32.029993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:32.030633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:32.129641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c1cec5a-4010-4214-8252-3ee6832997f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.135568 Nov 06 21:08:32.137134 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2982/6045] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:31 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:32.460761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-288973601", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "365f443f-951f-4715-808f-274013e10fb3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1407222739", "security_groups": [{"name": "tempest-secgroup-smoke-7235011"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:32.686219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] validate_networks() for [('365f443f-951f-4715-808f-274013e10fb3', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:08:32.989604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:32.990331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:33.004465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.005158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.014472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.015364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.329580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:33.338407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd8f9807-6ce1-4d0f-8dfd-fc6e2c86dc49 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1531 microversion: 2.1 time: 0.353279 Nov 06 21:08:33.339349 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2983/6046] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:32 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1531 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:33.344866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:33.346109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:33.355653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.356390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.361483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.362617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.415023 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74fadcfc-11f4-4177-847f-62e597917663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.072826 Nov 06 21:08:33.417502 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2984/6047] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:33 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:33.487554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:08:33.488118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:08:33.488689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:08:33.489166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:08:33.489653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:08:33.500758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.501566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.502701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:33.503151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:33.524403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:33.530365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:33.543624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:08:33.546352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:08:33.605598 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcefb316-55c1-4613-acfe-6de672950f7e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.153580 Nov 06 21:08:33.607135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3064/6048] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:32 2021] POST /compute/v2.1/servers => generated 403 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:08:33.617511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e52d403b-6b83-4052-b663-ab55b39991a3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:33.618648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e52d403b-6b83-4052-b663-ab55b39991a3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:33.707726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e52d403b-6b83-4052-b663-ab55b39991a3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:33.715303 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e52d403b-6b83-4052-b663-ab55b39991a3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1266 microversion: 2.1 time: 0.101810 Nov 06 21:08:33.716487 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2985/6049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:33 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:34.358190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:34.359182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:34.366264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.366714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.367570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.367941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.427251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:34.429988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:34.442430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.443225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.444094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.444626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.531722 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cba48dc7-a0f6-452e-a3df-3117c2b55eea tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.108132 Nov 06 21:08:34.536417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2986/6050] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:34 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:34.643368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:34.654736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7e9d823-c311-4b5a-b81b-2bb5e5b1263e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1531 microversion: 2.1 time: 0.301584 Nov 06 21:08:34.656004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3065/6051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:34 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1531 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:34.735048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:34.735877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:34.771143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.772911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.776237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:34.780275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:34.982901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:34.999922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-803a1624-87d6-4778-b91c-b5d1e32fa33f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1318 microversion: 2.1 time: 0.265999 Nov 06 21:08:35.005214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2987/6052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:34 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:35.547682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:35.548879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:35.559748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:35.560205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:35.564105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:35.565110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:35.638596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e9ac014-72dd-4750-946b-2f4b41315e94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.094734 Nov 06 21:08:35.645345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3066/6053] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:35 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:35.676034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:35.677294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:35.690010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:35.692113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:35.693242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:35.694411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:36.019959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:36.020925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:36.031932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:36.042181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:36.043771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:36.044233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:36.089600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:36.100065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e47b23b2-173d-499d-a601-49a633b1531f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1531 microversion: 2.1 time: 0.431475 Nov 06 21:08:36.101252 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2988/6054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:35 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1531 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:36.170444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:36.178523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd5c6f50-063a-4e18-8f18-bf4b87e9700d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1324 microversion: 2.1 time: 0.162745 Nov 06 21:08:36.179117 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3067/6055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:36 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:36.658512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:36.659877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:36.676096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:36.676925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:36.677407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:36.677845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:36.779112 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f0a749d-0a85-4fd8-9a5e-9e4dca63991e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.127927 Nov 06 21:08:36.784352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2989/6056] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:36 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:37.118855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:37.120018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:37.132217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:37.132748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:37.133562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:37.134002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:37.199965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:37.200740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:37.209292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:37.209757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:37.210565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:37.212912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:38.367515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:38.375702 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9bc6d5e-b2a9-4a70-84b1-0272df346c43 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1531 microversion: 2.1 time: 1.261088 Nov 06 21:08:38.391496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:38.399787 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ee9f7f0-5182-41fb-82f3-845f733bd417 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 1.205632 Nov 06 21:08:38.400780 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3068/6057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:37 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1531 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:38.407309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2990/6058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:37 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:38.411339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:38.414334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:38.429722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:38.447595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:38.449056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:38.450449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:38.533976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5686d3f0-a3a4-4673-9c6f-2237f69df5b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.131650 Nov 06 21:08:38.538551 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3069/6059] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:38 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:39.320013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5a6914ce-3925-4dd6-8d23-fa705c15ab0c req-137c3e6c-8361-4355-be5a-f46621c3771f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:39.329951 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:39.329951 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:08:39.351685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5a6914ce-3925-4dd6-8d23-fa705c15ab0c req-137c3e6c-8361-4355-be5a-f46621c3771f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:39.354785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5a6914ce-3925-4dd6-8d23-fa705c15ab0c req-137c3e6c-8361-4355-be5a-f46621c3771f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:39.379012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5a6914ce-3925-4dd6-8d23-fa705c15ab0c req-137c3e6c-8361-4355-be5a-f46621c3771f service nova] Creating event network-changed:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch2-master-1 Nov 06 21:08:39.392127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5a6914ce-3925-4dd6-8d23-fa705c15ab0c req-137c3e6c-8361-4355-be5a-f46621c3771f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084357 Nov 06 21:08:39.400270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:39.403477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:39.412837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:39.413295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:39.414096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:39.414532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:39.417433 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2991/6060] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:39.429922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:39.437242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:39.449663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:39.450123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:39.450930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:39.451370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:40.633105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:40.642891 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe1d20c2-8bcd-48a8-a224-9b3cda1d808e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 1.221259 Nov 06 21:08:40.647817 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2992/6061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:39 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:40.655418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:40.656736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:40.663711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:40.665117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:40.667328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:40.668743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:40.752748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:40.766091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e8cdad0-665b-4da3-871e-673409f51f3e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 1.369680 Nov 06 21:08:40.769007 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3070/6062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:39 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:40.772324 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e2c17e26-a013-4640-8000-0f19e11f7836 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.120962 Nov 06 21:08:40.773666 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2993/6063] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:40 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:40.790564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d50197cd-ca04-4e32-9948-61f52759fbbf req-b615803c-ce2a-4b29-b8f5-b2e2ac10b27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "name": "network-vif-plugged", "status": "completed", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:40.793551 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:40.793551 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:40.805738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d50197cd-ca04-4e32-9948-61f52759fbbf req-b615803c-ce2a-4b29-b8f5-b2e2ac10b27b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:40.809566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d50197cd-ca04-4e32-9948-61f52759fbbf req-b615803c-ce2a-4b29-b8f5-b2e2ac10b27b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:40.872165 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d50197cd-ca04-4e32-9948-61f52759fbbf req-b615803c-ce2a-4b29-b8f5-b2e2ac10b27b service nova] Creating event network-vif-plugged:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:08:40.899299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d50197cd-ca04-4e32-9948-61f52759fbbf req-b615803c-ce2a-4b29-b8f5-b2e2ac10b27b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127450 Nov 06 21:08:40.899941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3071/6064] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:41.665585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:41.667203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:41.678430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:41.684421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:41.685794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:41.686459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:41.798549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:41.804468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:41.829377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:41.837512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:41.839792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:41.844438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:41.969529 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebc57874-b3e4-4ade-94e1-7cd2a0f78ae0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.187513 Nov 06 21:08:41.970568 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3072/6065] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:41 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:41.984830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:41.985942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:42.005487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:42.007623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:42.009594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:42.013008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:42.036116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:42.045151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-056abbe1-7f78-4fc8-8228-58cd3eb4596f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.383846 Nov 06 21:08:42.052572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2994/6066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:41 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:42.337420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:42.346475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4f3b72a-897b-4c8f-bcc9-c969dc6c8455 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.374366 Nov 06 21:08:42.347146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3073/6067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:41 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:42.981023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:42.982588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:42.992256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:42.992928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:42.993878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:42.994467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:43.042490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98186ac6-9a8e-4e5b-abcc-8c6a380c16db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.063229 Nov 06 21:08:43.044134 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2995/6068] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:42 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:43.069466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:43.070160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:43.080068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:43.080560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:43.081715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:43.082158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:43.330064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:43.348237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81b6324d-d5e4-4e7c-b4d5-6c1f9e9c281c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.282080 Nov 06 21:08:43.352538 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3074/6069] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:43 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:43.368885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:43.370442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:43.379258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:43.380256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:43.380525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:43.380971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:43.611601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:43.620154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-427aa7ea-4c9a-4a8c-b8e5-e680643f8ece tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.257686 Nov 06 21:08:43.625040 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2996/6070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:43 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.093117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:44.102634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-135182f3-b64e-4c90-9dac-24af7802e551 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.051038 Nov 06 21:08:44.103813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3075/6071] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:44 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:44.366300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:44.367078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:44.381156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.382716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:44.384924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.385407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:44.645072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:44.646042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:44.657250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.660859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:44.663787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:44.666038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:45.014277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:45.033718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e17668c-4cd7-4217-a086-a36cf3bb5763 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.670875 Nov 06 21:08:45.050902 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2997/6072] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:44 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:45.085716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:45.097907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd15d4aa-4624-4462-b182-23e8ddd7dbb2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.457114 Nov 06 21:08:45.099744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3076/6073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:44 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:45.115994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:45.121776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:45.130044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:45.130654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:45.132257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:45.132731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:45.203094 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c206722b-fd03-4163-9b9c-9f5e71512b51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.091325 Nov 06 21:08:45.204645 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2998/6074] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:45 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:46.059704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:46.060337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:46.071456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.072212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.073232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.074492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.142158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:46.143613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:46.171675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.172043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.178595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.179229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.599351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:46.611121 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e31edbeb-02ed-47bf-b7da-5b2b02e5419a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.554994 Nov 06 21:08:46.618265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:46.624552 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3077/6075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:46 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:46.628650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3e8e269-76f2-4a3f-9ba7-c447a6c997d8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.493917 Nov 06 21:08:46.629220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 2999/6076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:46 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:46.630203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:46.631850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:46.638721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.639608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.641036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:46.642233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:46.719782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08688b72-1c7d-4e77-a8d0-8a61ecf3c083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.089923 Nov 06 21:08:46.721212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3078/6077] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:46 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:47.632379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:47.632977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:47.646348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:47.647613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:47.648263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:47.650118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:47.650947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:47.651396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:47.660282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:47.660699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:47.661542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:47.661988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:48.108006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:48.116950 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01d8f9ac-f5d7-4770-92fb-10b62f527f30 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.489780 Nov 06 21:08:48.120203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:48.126367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3000/6078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:47 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:48.139676 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ede24185-04e2-485b-8470-5afae6c269cb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.497232 Nov 06 21:08:48.145050 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3079/6079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:47 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:48.147472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:48.154490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:48.165392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:48.168605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:48.174198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:48.174681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:48.281989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe2de6f0-c110-4aca-b8a0-7fc8759c10f1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 24572 microversion: 2.1 time: 0.148807 Nov 06 21:08:48.283407 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3001/6080] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:48 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 24572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:49.145313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:49.147102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:49.165263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:49.166882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:49.183933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.187277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.190855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.191943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.192826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.193444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.194445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.201148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.757347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:49.765027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:49.767649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5d205d4-e2cd-40a4-adaa-06f637059517 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.607391 Nov 06 21:08:49.774336 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca386a1d-bb10-4888-b26d-b10a9081e6af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.634462 Nov 06 21:08:49.774908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3080/6081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:49 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:49.779807 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3002/6082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:49 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:49.786803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:49.788446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:49.795942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-61bcebca-7641-4d03-8d0e-6e11fe3d8db6 req-3bbd165c-0ed9-44e6-bdee-f12f14c7710d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "name": "network-vif-plugged", "status": "completed", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:49.797502 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:49.797502 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:49.804444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.804902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.805689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.806123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.847896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61bcebca-7641-4d03-8d0e-6e11fe3d8db6 req-3bbd165c-0ed9-44e6-bdee-f12f14c7710d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:49.860428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61bcebca-7641-4d03-8d0e-6e11fe3d8db6 req-3bbd165c-0ed9-44e6-bdee-f12f14c7710d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:49.877084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70c8884e-4c79-4497-8fb8-db200e55403b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.095298 Nov 06 21:08:49.881840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3003/6083] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:49 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:49.894481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-61bcebca-7641-4d03-8d0e-6e11fe3d8db6 req-3bbd165c-0ed9-44e6-bdee-f12f14c7710d service nova] Creating event network-vif-plugged:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch2-master-1 Nov 06 21:08:49.904593 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-61bcebca-7641-4d03-8d0e-6e11fe3d8db6 req-3bbd165c-0ed9-44e6-bdee-f12f14c7710d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123096 Nov 06 21:08:49.906495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3081/6084] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:50.787238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:50.791126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:50.797329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:50.798643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:50.809373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:50.811149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:50.813073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:50.813945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:50.814327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:50.814621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:50.815152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:50.815954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:51.182005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:51.190536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb8f6196-f74f-4e9f-baa5-75a562334c8c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1389 microversion: 2.1 time: 0.402728 Nov 06 21:08:51.193423 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3082/6085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:50 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1389 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:51.206194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:51.211538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:51.226386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:51.227033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:51.227933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:51.228589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:51.288098 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-498f8588-1f9c-4841-baf2-1dddd34804c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.091325 Nov 06 21:08:51.292963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3083/6086] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:51 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:51.302238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:51.319949 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-626b77af-3275-492f-81a8-0719dd70d93f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.533027 Nov 06 21:08:51.324719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3004/6087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:50 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:51.557393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'create', calling method: .version_select at 0x7f671403cee0>, body: {"keypair": {"name": "tempest-keypair-1181306452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:51.581032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for project 2f47922bfda043499f1554d9db0bc00c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:51.596022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for user 93a1f3d37b604a3b8c2bcc68d4b2cccb and project 2f47922bfda043499f1554d9db0bc00c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:52.185456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for project 2f47922bfda043499f1554d9db0bc00c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:52.201288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for user 93a1f3d37b604a3b8c2bcc68d4b2cccb and project 2f47922bfda043499f1554d9db0bc00c. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:52.210353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:52.210974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:52.227857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.228332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.229142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.229581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.233159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ed8ede9-eb41-4329-92ef-c9c91d5523d2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.942134 Nov 06 21:08:52.235423 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3084/6088] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:08:51 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:52.302042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:52.303825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:52.311435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.311966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.312964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.313471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.380878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5710b6c-a628-4d5a-9394-d46a6c917f0a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.083044 Nov 06 21:08:52.381946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3085/6089] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:52 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:52.388867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:52.389758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:52.400319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.401255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.402333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.402961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.548846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:52.563862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca01bffa-523c-41a7-9b88-0f5d229411cf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1561 microversion: 2.1 time: 0.357382 Nov 06 21:08:52.565216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3005/6090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:52 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1561 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:52.580029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:52.580672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:52.603458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.604670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.607906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:52.610209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:52.758799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:52.766967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb561a1e-d760-4888-b829-ea0024ca47d0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.383550 Nov 06 21:08:52.770651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3086/6091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:52 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:52.914463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:52.926293 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6cb6dfbd-6204-4484-b92a-4781e183ae3e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1561 microversion: 2.1 time: 0.349958 Nov 06 21:08:52.933975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3006/6092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:52 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1561 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:08:53.393119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:53.394276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:53.409026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:53.409967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:53.412935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:53.414276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:53.505650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a62d454-c0ba-4260-ada6-23dc76872663 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.116478 Nov 06 21:08:53.508483 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3087/6093] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:53 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:53.786060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:53.786724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:53.803333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:53.804045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:53.805560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:53.808743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:54.519899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:54.532427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:54.566158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:54.572768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:54.573037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:54.575968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:54.579006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:54.589542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9e63bd2-42db-4a3b-aa80-e38b293f2e79 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.806328 Nov 06 21:08:54.591421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3007/6094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:53 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:54.668714 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60740295-5c7f-4888-9554-767820d0ff42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.153629 Nov 06 21:08:54.669769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3088/6095] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:54 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:55.513083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1432669936", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fcfa1f11-e91c-4db8-b14a-85f52d95550f"}], "security_groups": [{"name": "tempest-securitygroup--607835261"}], "key_name": "tempest-keypair-1181306452", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:55.607133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:55.608565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:55.642481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:55.646398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:55.647458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:55.648086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:55.736930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] validate_networks() for [('fcfa1f11-e91c-4db8-b14a-85f52d95550f', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:08:56.291294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:56.300244 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc28c406-9a9a-4721-8c73-54ce6d984b1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.697050 Nov 06 21:08:56.303725 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3089/6096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:55 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:56.309913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:56.316122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:56.333208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.335182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.337674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.338032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.425572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee9f24e7-6349-4d7b-9f25-631874ca1e88 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.119434 Nov 06 21:08:56.431271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3090/6097] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:56 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:56.442271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:56.444831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:56.459122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.459581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.460437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.462914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.894985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for project 2f47922bfda043499f1554d9db0bc00c. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:56.928990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for user 93a1f3d37b604a3b8c2bcc68d4b2cccb and project 2f47922bfda043499f1554d9db0bc00c. Resources: dict_keys(['metadata_items']) {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:56.948508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:56.952127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:08:56.953184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:08:56.953885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:08:56.954601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:08:56.959748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:08:56.963291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebd19821-45a1-4e14-884b-3708a10b1faf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1561 microversion: 2.1 time: 0.524726 Nov 06 21:08:56.975575 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3091/6098] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:56 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1561 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:56.975804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.975804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.975804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:56.975804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:56.992344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c0996b99-2504-4c83-8ce6-5e29ea7e90f7 req-07828532-7215-4f90-b456-77df9ae13e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:56.994145 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:56.994145 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:57.014212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c0996b99-2504-4c83-8ce6-5e29ea7e90f7 req-07828532-7215-4f90-b456-77df9ae13e98 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.014707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c0996b99-2504-4c83-8ce6-5e29ea7e90f7 req-07828532-7215-4f90-b456-77df9ae13e98 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.015498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for project 2f47922bfda043499f1554d9db0bc00c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:08:57.028233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Getting quotas for user 93a1f3d37b604a3b8c2bcc68d4b2cccb and project 2f47922bfda043499f1554d9db0bc00c. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:08:57.047186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c0996b99-2504-4c83-8ce6-5e29ea7e90f7 req-07828532-7215-4f90-b456-77df9ae13e98 service nova] Creating event network-changed:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch2-master-1 Nov 06 21:08:57.054844 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c0996b99-2504-4c83-8ce6-5e29ea7e90f7 req-07828532-7215-4f90-b456-77df9ae13e98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088520 Nov 06 21:08:57.056071 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3092/6099] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:57.084590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:08:57.091145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:08:57.235221 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1bd8a78-9842-4524-be44-8fcdea0805c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.727071 Nov 06 21:08:57.238006 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3008/6100] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:08:55 2021] POST /compute/v2.1/servers => generated 408 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:08:57.251027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75e4eb76-a8c8-4386-8ba3-a2d9746a95d8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:57.257930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75e4eb76-a8c8-4386-8ba3-a2d9746a95d8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:57.384482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Calling method '.version_select at 0x7f67150665e0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:57.385529 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:08:57.385529 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:08:57.387626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.388088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.416287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.417525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.442084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75e4eb76-a8c8-4386-8ba3-a2d9746a95d8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:57.442338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.443724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.454824 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a31b895f-6c7c-467f-b774-70648f7b6b59 tempest-PortsAdminExtendedAttrsTestJSON-359085165 tempest-PortsAdminExtendedAttrsTestJSON-359085165-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.397166 Nov 06 21:08:57.455593 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3093/6101] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:08:57 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:08:57.465769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:57.468605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:57.475175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75e4eb76-a8c8-4386-8ba3-a2d9746a95d8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1278 microversion: 2.1 time: 0.207648 Nov 06 21:08:57.477214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3009/6102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:57 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:57.486666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.486666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.486666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.486666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.499656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:57.501939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:57.533814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.535865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.538107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:57.539639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:57.614150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e1f00e5-1ff1-4f13-a5a4-c5fdd03b4d26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.131889 Nov 06 21:08:57.615473 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3010/6103] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:57 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:58.006662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:58.031354 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d489e54c-8d97-445c-baad-16c855015894 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.574782 Nov 06 21:08:58.031958 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3094/6104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:57 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:58.493591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:58.494624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:58.509749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:58.517408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:58.519256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:58.520014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:58.626382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:58.627715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:58.638353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:58.638908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:58.640344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:58.643854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:58.645293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:58.647299 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85741bad-231a-4137-b760-0182545ed863 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1330 microversion: 2.1 time: 0.157517 Nov 06 21:08:58.648448 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3011/6105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:58 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:58.772229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fe08c8e-dcc6-4115-9f42-cf8e244bc361 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.149594 Nov 06 21:08:58.773138 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3095/6106] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:58 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:08:59.049167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:59.050066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:59.056526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.056991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.057788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.058232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.538844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:59.546876 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-33c68d1a-4a11-4444-b82b-e41556d1fce1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1526 microversion: 2.1 time: 0.501256 Nov 06 21:08:59.547931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3012/6107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:59 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1526 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:59.665849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:08:59.667559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:59.688357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.689016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.690500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.691237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.784239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:08:59.785417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:08:59.786397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:08:59.792992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.793636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.794423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:08:59.794985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91d7fe3b-efbf-4404-8b16-26f829d738b6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1336 microversion: 2.1 time: 0.133475 Nov 06 21:08:59.795133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:08:59.796554 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3096/6108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:08:59 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:08:59.847012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df1158a6-ed42-4a87-8a8f-04400f41e077 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.066597 Nov 06 21:08:59.848037 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3013/6109] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:08:59 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:00.563652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:00.564184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:00.572131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:00.572763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:00.573571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:00.574015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:00.812355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:00.813146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:00.821034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:00.821497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:00.822294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:00.822738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:01.019788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:01.032076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fa2ab68-e752-4d8f-a7c1-a133b040bf9c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1508 microversion: 2.1 time: 0.472587 Nov 06 21:09:01.042902 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3097/6110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:00 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:01.042902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:01.042902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:01.049714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:01.050172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:01.051583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:01.052307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:01.105643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a44c1eb3-8b35-453c-ab1a-492147d680be tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069721 Nov 06 21:09:01.106352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3098/6111] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:01 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:01.176144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:01.184758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db70af55-1f11-48a5-a037-ec3113e15cbf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.376141 Nov 06 21:09:01.185083 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3014/6112] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:00 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:01.527089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6b340549-67bf-4420-b7e6-724c0d5fc674 req-0dc88682-6b4b-4fe1-ad1d-6eb0db2a0d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c47cf6b-e137-45f8-b4d2-bf6aef3ef779", "tag": "dbb2910c-cfb7-477f-8b50-e894e660bcdb"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:01.531704 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:01.531704 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:09:01.553771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6b340549-67bf-4420-b7e6-724c0d5fc674 req-0dc88682-6b4b-4fe1-ad1d-6eb0db2a0d12 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:01.554212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6b340549-67bf-4420-b7e6-724c0d5fc674 req-0dc88682-6b4b-4fe1-ad1d-6eb0db2a0d12 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:01.570626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6b340549-67bf-4420-b7e6-724c0d5fc674 req-0dc88682-6b4b-4fe1-ad1d-6eb0db2a0d12 service nova] Creating event network-changed:dbb2910c-cfb7-477f-8b50-e894e660bcdb for instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 on nch1-master-1 Nov 06 21:09:01.577064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6b340549-67bf-4420-b7e6-724c0d5fc674 req-0dc88682-6b4b-4fe1-ad1d-6eb0db2a0d12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056953 Nov 06 21:09:01.578234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3099/6113] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:02.051652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:02.053267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:02.062176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.062633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.063536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.064491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.118471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:02.119472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:02.126489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.127159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.127958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.128421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.172974 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8fa87e6e-bda2-43f3-a2e7-1f12b5d8908f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058476 Nov 06 21:09:02.174291 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3100/6114] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:02 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:02.202146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:02.203129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:02.210417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.210880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.211684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.212125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.382539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:02.390765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d847e7e-da86-465b-b003-b6f1f7548d22 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1508 microversion: 2.1 time: 0.343823 Nov 06 21:09:02.391426 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3015/6115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:02 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:02.477732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:02.485869 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f791c2de-e459-4f2e-87eb-6d93f7d9a878 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.288055 Nov 06 21:09:02.492741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3101/6116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:02 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:02.910235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d0d5226f-9f32-44a5-be03-060ab0080058 req-ead75f67-0b6d-4a8a-be5b-c787cc56fd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "name": "network-vif-unplugged", "status": "completed", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:02.912897 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:02.912897 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:09:02.921904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d0d5226f-9f32-44a5-be03-060ab0080058 req-ead75f67-0b6d-4a8a-be5b-c787cc56fd16 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:02.922385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d0d5226f-9f32-44a5-be03-060ab0080058 req-ead75f67-0b6d-4a8a-be5b-c787cc56fd16 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:02.940245 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d0d5226f-9f32-44a5-be03-060ab0080058 req-ead75f67-0b6d-4a8a-be5b-c787cc56fd16 service nova] Creating event network-vif-unplugged:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:09:02.949454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d0d5226f-9f32-44a5-be03-060ab0080058 req-ead75f67-0b6d-4a8a-be5b-c787cc56fd16 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041932 Nov 06 21:09:02.951810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3016/6117] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:03.185339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:03.186387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.194483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.195078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.196006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.196654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.244237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c17c11f8-b273-4ab8-be38-242a55dc2ae6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.062975 Nov 06 21:09:03.248844 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3102/6118] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:03 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:03.409373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:03.410175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.416837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.417928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.418738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.419186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.503231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:03.503946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.511113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.511646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.513552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.513991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.638410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:03.647177 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f9caf1a4-8c20-4464-a938-adab6cd9a808 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1451 microversion: 2.1 time: 0.242164 Nov 06 21:09:03.647841 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3017/6119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:03 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:03.663390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:03.664015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.670899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.671370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.672358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.672971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.706460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:03.735728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84f40f6d-3539-446d-8226-674d3294eb10 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.233514 Nov 06 21:09:03.745179 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3103/6120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:03 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:03.818608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:03.827018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b2ca61e2-18f0-4edd-b31c-69b9b051eaee tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1451 microversion: 2.1 time: 0.167128 Nov 06 21:09:03.827669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3018/6121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:03 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:03.869615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:03.870183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.876779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.877466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.878418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.878844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.909890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lazy-loading 'flavor' on Instance uuid 40215c7e-b779-4d6b-adfd-20dd72cdb1cd {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:09:03.922740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'shelve' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state shelved_offloaded Nov 06 21:09:03.923345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'shelve' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state shelved_offloaded {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:03.924186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78e866e6-a474-4955-9b9c-ad3c050c24de tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 155 microversion: 2.1 time: 0.058345 Nov 06 21:09:03.924786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3104/6122] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:03 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 155 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:09:03.933201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:03.933840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:03.940073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.940561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:03.941348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:03.941779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.033657 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d20d01b4-8f80-4ed4-b765-b9d1b4ecb2f2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.104412 Nov 06 21:09:04.037654 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3019/6123] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:03 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:09:04.042894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:04.043526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:04.050141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.050802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.051926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.052099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.224708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:04.232888 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-698907c4-6d2a-40f2-a5ba-45d6fc359c2f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1459 microversion: 2.1 time: 0.194038 Nov 06 21:09:04.233455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3105/6124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:04 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1459 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:04.256262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:04.257314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:04.264094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.264588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.265413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.266177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.309502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0ea8b22-3226-4e3a-9654-23cd47cdb83a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.056705 Nov 06 21:09:04.311051 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3020/6125] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:04 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:04.752953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:04.753736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:04.760318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.760836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.761702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:04.762416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:04.913491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:04.922074 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2101a53d-2b90-47d3-bbdd-e6881634a174 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.173494 Nov 06 21:09:04.922731 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3106/6126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:04 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:05.250932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:05.251645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:05.259724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.260283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:05.261759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.262277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:05.323707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:05.325483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:05.331607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.332277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:05.333231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.333817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:05.386486 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5458ff6c-980b-4f2e-a95b-47edb7163045 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.067856 Nov 06 21:09:05.390407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3107/6127] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:05 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:05.529358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:05.538192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3336002-dfd0-4d3e-87af-ff16f102f6d9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.291715 Nov 06 21:09:05.538769 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3021/6128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:05 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:05.943443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:05.944488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:05.953027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.954172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:05.954536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:05.955221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:06.106699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:06.114864 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d46de5a1-ed83-4231-9fd5-fbdb73442029 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.178963 Nov 06 21:09:06.115900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3108/6129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:05 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:06.397725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:06.400685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:06.417763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:06.423700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:06.424937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:06.426722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:06.510179 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc01303c-5801-41b9-8229-21e15a143a46 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.115870 Nov 06 21:09:06.511434 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3022/6130] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:06 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:06.578113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:06.580736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:06.589606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:06.590060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:06.590857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:06.591292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:06.790468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:06.804043 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f390cc5-6da9-429f-88dd-92680fd27aaa tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.248526 Nov 06 21:09:06.804747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3109/6131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:06 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:07.133659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:07.134391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:07.148144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-89c78ba5-baac-491e-84e0-6a22d63801af req-553e8bcf-bbdb-41ce-b033-a0d8fcf115a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c47cf6b-e137-45f8-b4d2-bf6aef3ef779", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2910c-cfb7-477f-8b50-e894e660bcdb"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:07.150775 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:07.150775 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:09:07.158263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.160271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.163709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-89c78ba5-baac-491e-84e0-6a22d63801af req-553e8bcf-bbdb-41ce-b033-a0d8fcf115a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.164417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.165096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.168135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-89c78ba5-baac-491e-84e0-6a22d63801af req-553e8bcf-bbdb-41ce-b033-a0d8fcf115a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.198848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-89c78ba5-baac-491e-84e0-6a22d63801af req-553e8bcf-bbdb-41ce-b033-a0d8fcf115a5 service nova] Creating event network-vif-plugged:dbb2910c-cfb7-477f-8b50-e894e660bcdb for instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 on nch1-master-1 Nov 06 21:09:07.208095 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-89c78ba5-baac-491e-84e0-6a22d63801af req-553e8bcf-bbdb-41ce-b033-a0d8fcf115a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063413 Nov 06 21:09:07.212086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3110/6132] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:07.509386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:07.522593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:07.522779 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95757ff4-e41e-4b82-acc9-eab12ad25fe5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.394353 Nov 06 21:09:07.523792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:07.533662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3023/6133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:07 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:07.534040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.534498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.535320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.535762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.753963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33adafe7-ab0b-404e-9027-e70431c3aa6d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.235005 Nov 06 21:09:07.755834 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3111/6134] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:07 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:07.825926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:07.827385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:07.836139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.837002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:07.838169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:07.838817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:08.078806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:08.101314 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3e835b6-0877-4030-b17d-883c0484d541 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.283638 Nov 06 21:09:08.107101 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3024/6135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:07 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:08.540545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:08.552847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:08.565551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:08.568420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:08.569267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:08.569715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:08.773756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:08.778093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:08.785268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:08.785987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:08.787115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:08.788110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:08.858963 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f40ba80-f8c4-48ac-8e15-b776c85a5d7c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.094646 Nov 06 21:09:08.860622 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3025/6136] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:08 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:09.048196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:09.063291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03f740f3-14c1-4086-bd4f-107269fb89bb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1403 microversion: 2.1 time: 0.524784 Nov 06 21:09:09.066135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3112/6137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:08 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1403 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:09.119376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:09.120705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:09.144637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:09.145623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:09.147226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:09.147830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:09.545687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:09.553955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdc0190a-f04a-4187-b74b-803a1431e7a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.438603 Nov 06 21:09:09.554547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3026/6138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:09 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:09.877458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:09.878714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:09.888653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:09.889408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:09.890396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:09.890999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:09.946986 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27b9708b-5a5e-4b5c-ad8d-116df0b5975f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.076666 Nov 06 21:09:09.949805 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3113/6139] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:09 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:10.091069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:10.091846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:10.099568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.100916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.101267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.101887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.435460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:10.449643 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1af0bb4-d4ee-4c98-bbe9-c993d767cf61 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1591 microversion: 2.1 time: 0.370074 Nov 06 21:09:10.463595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3027/6140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:10 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1591 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:10.468219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:10.468936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:10.498466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.498927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.500011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.500670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.572693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:10.573924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:10.582821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.585091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.586138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.586759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.690475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e35b9852-5dea-475c-b666-f9dae7f70b4c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227730 Nov 06 21:09:10.696717 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3114/6141] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:09:10 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:09:10.966810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:10.967661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:10.982716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.989903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:10.990792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:10.991234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:11.050364 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89e1f35a-c76a-4dc1-adfc-255801ccd7a3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.088223 Nov 06 21:09:11.054438 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3115/6142] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:10 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:11.463082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:11.477119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2b94efde-9ce4-46a9-86e9-483fbe2c5d1c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.908683 Nov 06 21:09:11.484904 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3028/6143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:10 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:12.063595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:12.064535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:12.071689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.072137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.072956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.073394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.118818 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b178258-9d8f-476b-a8fc-e613fb83c5f6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.059371 Nov 06 21:09:12.120754 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3116/6144] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:12 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:12.496746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:12.498410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:12.508016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.509196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.510210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.511508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.845534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:12.855355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a98a423b-fe44-4f36-bf9d-b95bba16713f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.363562 Nov 06 21:09:12.865060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3029/6145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:12 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:12.922006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:12.939588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-44f9e619-9265-4280-acac-393e574af6ba req-bb48cdf3-2f8a-492c-8226-68fb8ff05b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c47cf6b-e137-45f8-b4d2-bf6aef3ef779", "tag": "dbb2910c-cfb7-477f-8b50-e894e660bcdb"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:12.941744 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:12.941744 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:09:12.943387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:12.954538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.956058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.957430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.958097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.959915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44f9e619-9265-4280-acac-393e574af6ba req-bb48cdf3-2f8a-492c-8226-68fb8ff05b55 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:12.960714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-44f9e619-9265-4280-acac-393e574af6ba req-bb48cdf3-2f8a-492c-8226-68fb8ff05b55 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:12.975190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-44f9e619-9265-4280-acac-393e574af6ba req-bb48cdf3-2f8a-492c-8226-68fb8ff05b55 service nova] Creating event network-changed:dbb2910c-cfb7-477f-8b50-e894e660bcdb for instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 on nch1-master-1 Nov 06 21:09:12.982556 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-44f9e619-9265-4280-acac-393e574af6ba req-bb48cdf3-2f8a-492c-8226-68fb8ff05b55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065720 Nov 06 21:09:12.986395 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3030/6146] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:13.033839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0e01a07-7f63-48dc-915c-cb8d34ae0731 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.112816 Nov 06 21:09:13.037849 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3117/6147] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:12 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:13.133789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:13.135433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:13.150596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:13.156218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:13.157324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:13.157930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:13.212463 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58e1cfa4-4ebc-4e94-919b-26bb2c410ca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.083536 Nov 06 21:09:13.217968 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3031/6148] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:13 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:13.874787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:13.876840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:13.889188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:13.890200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:13.891457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:13.892139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:14.049464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:14.050515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:14.063107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:14.063568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:14.064391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:14.064843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:14.102665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:14.115561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9761446-4511-4594-9f97-89aba6b5c8c3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.245806 Nov 06 21:09:14.117649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3118/6149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:13 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:14.150514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91940772-bf50-4d3f-9a7f-be3e9c85af9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.105548 Nov 06 21:09:14.154414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3032/6150] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:14 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:09:14.225750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:14.226949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:14.234341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:14.235101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:14.236085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:14.236550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:14.297001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a63a5ae9-d4ba-4e11-b35d-77210bd86786 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.074490 Nov 06 21:09:14.299192 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3119/6151] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:14 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:15.137145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:15.139702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:15.150332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.150843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.152512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.152974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.163701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:15.165476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:15.172686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.173253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.174134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.174674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.226183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec029daf-ea1b-490f-b577-d69307ff80ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.067006 Nov 06 21:09:15.232731 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3120/6152] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:15 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 06 21:09:15.311779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:15.314905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:15.326458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.328599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.329511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:15.329981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:15.362788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:15.372311 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa507fdb-e263-4805-aef2-64cecf18be27 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.241191 Nov 06 21:09:15.384443 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3033/6153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:15 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:15.435494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-765b1d56-c6ed-4759-8ffd-885f3ee4754b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.128284 Nov 06 21:09:15.436672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3121/6154] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:15 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:16.246163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:16.248048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:16.259040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.261437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.262535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.266693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.326296 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46414c78-41c1-40e6-881e-45e7d6112a60 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.084233 Nov 06 21:09:16.333200 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3034/6155] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:16 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:16.407361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:16.408227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:16.415810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.417541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.418702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.419354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.447350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:16.449126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:16.466442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.467192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.468025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:16.468509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:16.527062 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d348425e-270b-4abd-a38c-eb78f343e713 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.083376 Nov 06 21:09:16.528495 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3035/6156] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:16 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:16.606120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:16.617075 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e158596-2a7f-4db1-a729-885ae3c6e9e1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.213741 Nov 06 21:09:16.620325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3122/6157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:16 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:17.340548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:17.341553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:17.349022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.349476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.350248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.350683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.387226 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7af5388a-7fbd-4d7d-b106-7209ab82eec9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.051340 Nov 06 21:09:17.387831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3036/6158] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:17 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:17.538977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:17.539926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:17.546963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.547419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.548199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.548676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.587759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c86a4523-91b3-43a2-9dc2-f279b9043c32 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.052382 Nov 06 21:09:17.589013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3123/6159] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:17 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:17.635239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:17.636657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:17.643592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.644048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.644857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:17.645292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:17.785985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:17.793615 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-862795f9-3751-4cb1-8555-1e22d1487618 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.162428 Nov 06 21:09:17.794183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3037/6160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:17 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:18.398697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:18.399802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:18.407201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.407650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.408456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.408888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.448442 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4d5f118c-e42e-41a9-a524-fb61c8625362 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.053580 Nov 06 21:09:18.449107 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3124/6161] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:18 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:18.599798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:18.600900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:18.611330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.611988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.613082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.613589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.659520 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-105f2e7b-b4f5-405c-a474-4d756692554c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.063553 Nov 06 21:09:18.660378 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3038/6162] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:18 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:18.811654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:18.813462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:18.820656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.821473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.822361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:18.823538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:18.971078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:18.979338 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-71ed6c0a-705d-416b-8d3e-f2da08f56171 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.171831 Nov 06 21:09:18.979922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3125/6163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:18 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:19.460585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:19.461914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:19.472961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:19.473568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:19.474482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:19.478449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:19.550768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e69d754a-97df-418b-944b-ad9afd9b8894 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.095064 Nov 06 21:09:19.553754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3039/6164] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:19 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:19.672206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:19.673909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:19.683144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:19.683610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:19.684456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:19.684896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:19.738126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f296524b-2c11-4bd6-a7bb-f89743facf6e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.067977 Nov 06 21:09:19.738126 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3126/6165] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:19 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:19.997785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:19.998486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:20.006672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.007128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.008191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.008902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.160528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:20.168946 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c51b43b4-de91-4880-9221-7486b468c057 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.176062 Nov 06 21:09:20.170145 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3040/6166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:19 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:20.562530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:20.564115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:20.571377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.572555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.573556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.573995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.617816 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36147e42-31e8-4eef-8316-cadee197d6a3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 14 microversion: 2.1 time: 0.060080 Nov 06 21:09:20.618794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3127/6167] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:20 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:09:20.749659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:20.750854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:20.758106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.758573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.759429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:20.759872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:20.814091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecfc9cc5-f115-493a-9134-f2fde13c4238 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069748 Nov 06 21:09:20.815354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3041/6168] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:20 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:21.188938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:21.189911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:21.198804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.199533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.200669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.201278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.367102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:21.375843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8166f68e-604b-4adf-a852-4ca41ae36388 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.192225 Nov 06 21:09:21.376527 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3128/6169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:21 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:21.630333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:21.631705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:21.641453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.642315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.643286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.644021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.702075 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-634ba179-fc9e-4c1a-927f-571ef6c96e38 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 8207 microversion: 2.1 time: 0.075942 Nov 06 21:09:21.703931 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3042/6170] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:21 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 8207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:21.877627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:21.879411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:21.890946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.891405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.892245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:21.892717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:21.937049 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b44a0135-d11c-47cc-ba0b-f553271acc53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.086848 Nov 06 21:09:21.937941 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3129/6171] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:21 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:22.396536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:22.398408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:22.432454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.433418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:22.434950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.439113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:22.679485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:22.695718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-330b4e90-e9de-4518-a296-3ab7d7c421b4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.306134 Nov 06 21:09:22.698835 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3043/6172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:22 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:22.715288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:22.716252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:22.723989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.724463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:22.725474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.726067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:22.779980 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a302cb0-78be-447e-b9bc-6416d2b09954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 16397 microversion: 2.1 time: 0.069327 Nov 06 21:09:22.780908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3130/6173] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:22 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 16397 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:22.949903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:22.950829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:22.958537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.959744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:22.960803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:22.961318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:23.015651 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de7e382d-518c-40c8-b2fd-2249589af457 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069969 Nov 06 21:09:23.017144 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3044/6174] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:22 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:23.716162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:23.717058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:23.725021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:23.725485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:23.726363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:23.726876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:23.792735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:23.793738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:23.803623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:23.804077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:23.804912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:23.805349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:23.856960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b1b4a51-bd34-4bfe-af69-fbaf4572d4c1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 16397 microversion: 2.1 time: 0.069033 Nov 06 21:09:23.858310 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3045/6175] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:23 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 16397 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:23.892403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:23.902447 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dddbb90d-c6b7-4584-aa64-776ffd1c2c55 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.191009 Nov 06 21:09:23.904098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3131/6176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:23 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:24.029095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:24.030247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:24.037823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.038556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:24.039589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.040499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:24.082041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49e62ead-c48b-48fb-ab08-8a7804209ac3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058405 Nov 06 21:09:24.082687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3046/6177] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:24 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:24.870107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:24.871892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:24.881465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.881924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:24.882722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.883291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:24.920119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:24.920949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:24.928579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.928962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4bc384d3-6ab8-457a-9df5-5138cca30b8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 16397 microversion: 2.1 time: 0.062966 Nov 06 21:09:24.929472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:24.933402 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3132/6178] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:24 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 16397 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:24.934096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:24.934751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:25.095176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:25.096224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:25.106070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:25.106533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:25.107357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:25.107941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:25.159894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47959c84-44cd-460e-b2ee-9b05532d83fc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069253 Nov 06 21:09:25.160934 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3133/6179] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:25 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:25.198636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:25.210646 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-582235a3-6290-4eee-a1d6-5895ce5a7ecd tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.295261 Nov 06 21:09:25.211484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3047/6180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:24 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:25.942287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:25.943800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:25.951792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:25.952997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:25.954358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:25.954868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:25.999734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f881edd6-3b80-4b2e-be87-a8db85822b69 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 16397 microversion: 2.1 time: 0.061772 Nov 06 21:09:26.003265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3134/6181] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:25 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 16397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:26.173321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:26.174618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:26.182494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:26.183107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:26.184725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:26.185276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:26.228216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af3ff4b5-50ca-4310-a052-7ddc7aa510e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058638 Nov 06 21:09:26.229705 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3048/6182] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:26 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:26.233517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:26.237651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:26.248180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:26.248958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:26.249951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:26.250572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:26.458711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:26.467609 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb00d9b2-19b0-49e0-8038-e18008ec291d tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.242276 Nov 06 21:09:26.476363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3135/6183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:26 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:27.012556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:27.013816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:27.021031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.021781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.022744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.023339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.079414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb753215-63a9-4418-83cc-7c9eb1170c75 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.071635 Nov 06 21:09:27.081332 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3049/6184] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:27 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:27.158783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0232fe30-841e-4114-a6b7-6b33e96ddb73 req-f8360fb6-9c0c-4e75-a918-2d04024284a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "name": "network-vif-plugged", "status": "completed", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:27.160559 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:27.160559 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:09:27.171515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0232fe30-841e-4114-a6b7-6b33e96ddb73 req-f8360fb6-9c0c-4e75-a918-2d04024284a3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.174488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0232fe30-841e-4114-a6b7-6b33e96ddb73 req-f8360fb6-9c0c-4e75-a918-2d04024284a3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.188096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0232fe30-841e-4114-a6b7-6b33e96ddb73 req-f8360fb6-9c0c-4e75-a918-2d04024284a3 service nova] Creating event network-vif-plugged:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:09:27.193185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0232fe30-841e-4114-a6b7-6b33e96ddb73 req-f8360fb6-9c0c-4e75-a918-2d04024284a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038508 Nov 06 21:09:27.195159 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3136/6185] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:27.242134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:27.244024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:27.258458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.259794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.260695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.261197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.316026 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-291117c6-7332-4745-9998-dc91d6360fb9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.078358 Nov 06 21:09:27.323311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3050/6186] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:27 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:27.486442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:27.487497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:27.495143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.495879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.496931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:27.497586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:27.744010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:27.758141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-192796dc-877e-44d9-a49f-1b58cd308483 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.275774 Nov 06 21:09:27.759013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3137/6187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:27 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:28.094365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:28.095775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:28.103394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.105072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:28.105960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.106578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:28.149060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c7943777-79c3-4f12-82d4-d665af0a2cbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.059311 Nov 06 21:09:28.149802 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3051/6188] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:28 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:28.329750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:28.330608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:28.337907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.338443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:28.339493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.339934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:28.388121 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73e31b98-f114-4fc7-91d0-ce449443fea7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.062037 Nov 06 21:09:28.392879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3138/6189] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:28 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:28.776056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:28.776830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:28.787994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.792043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:28.793129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:28.793589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:29.045155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:29.059958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d914dbca-71d7-446f-9873-ab8186ae3dc5 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1517 microversion: 2.1 time: 0.287922 Nov 06 21:09:29.060951 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3052/6190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:28 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:29.163249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:29.167443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:29.176076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:29.176780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:29.177999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:29.179185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:29.246319 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-127c9bea-119c-47a4-a8ec-933b85cf1b12 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.088596 Nov 06 21:09:29.247741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3139/6191] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:29 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:29.400091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:29.401868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:29.408826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:29.409720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:29.410987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:29.411601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:29.459036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66a08432-c6c6-4c9a-a453-52ba2543e379 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.062788 Nov 06 21:09:29.460441 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3053/6192] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:29 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:30.078656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:30.080162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.089347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.089919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.090832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.091397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.258651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:30.260106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:30.262978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.268033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a02688a0-75ef-4492-aef9-23a03d77ab1e tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.193788 Nov 06 21:09:30.271230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.271911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.272965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.273412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.280457 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3140/6193] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:30 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:30.285613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:30.286834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.295281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.295803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.296703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.297202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.317483 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c486f011-9f2b-4597-8cd0-94db3bc162e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.062883 Nov 06 21:09:30.318123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3054/6194] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:30 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:30.455131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:30.464284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29ce32d7-e40e-4ef9-a495-a3672be2b059 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.182195 Nov 06 21:09:30.465129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3141/6195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:30 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:30.472953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:30.474379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.482864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.483536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.484662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.485521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.499893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:30.500966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.508853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.509560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.511189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.511831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.537865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1710fcd8-9b45-4411-86a4-91cb01a3653f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069005 Nov 06 21:09:30.538579 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3055/6196] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:30 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:30.746414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:30.753675 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04e673cb-8e03-4d38-b95a-443e1a191636 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.257432 Nov 06 21:09:30.754241 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3142/6197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:30 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:30.770573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-439212e8-7c5b-49f9-a113-16e6d9b3cf0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:30.777390 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-439212e8-7c5b-49f9-a113-16e6d9b3cf0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance c10e92f7-4109-48cc-a3ab-6bd94c6e77b7 has no mapping to a cell. Nov 06 21:09:30.777983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-439212e8-7c5b-49f9-a113-16e6d9b3cf0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance c10e92f7-4109-48cc-a3ab-6bd94c6e77b7 has no mapping to a cell. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:30.778807 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-439212e8-7c5b-49f9-a113-16e6d9b3cf0b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/c10e92f7-4109-48cc-a3ab-6bd94c6e77b7/action" status: 404 len: 117 microversion: 2.1 time: 0.012398 Nov 06 21:09:30.779358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3056/6198] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:30 2021] POST /compute/v2.1/servers/c10e92f7-4109-48cc-a3ab-6bd94c6e77b7/action => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:30.787169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:30.787813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.794164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.794613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.795397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.795840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.939867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:30.949628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92e1e4a2-3402-4024-a803-a986ffc6e2fe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.165686 Nov 06 21:09:30.950564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3143/6199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:30 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:30.967858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:30.968632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:30.975696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.976150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:30.976995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:30.977436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.117737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:31.126795 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7077f11b-662b-4bdc-888a-1387a1081dc2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.162499 Nov 06 21:09:31.127378 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3057/6200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:30 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:31.143373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa537841-7d6c-4fbf-a85f-974ade9cd97b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:31.143932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa537841-7d6c-4fbf-a85f-974ade9cd97b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 45ae356c-0ab8-40ba-9f79-71e33c822d83] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.150145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-aa537841-7d6c-4fbf-a85f-974ade9cd97b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 45ae356c-0ab8-40ba-9f79-71e33c822d83 could not be found. Nov 06 21:09:31.150780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa537841-7d6c-4fbf-a85f-974ade9cd97b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 45ae356c-0ab8-40ba-9f79-71e33c822d83 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:31.151785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa537841-7d6c-4fbf-a85f-974ade9cd97b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/45ae356c-0ab8-40ba-9f79-71e33c822d83/action" status: 404 len: 111 microversion: 2.1 time: 0.012198 Nov 06 21:09:31.152368 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3144/6201] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:31 2021] POST /compute/v2.1/servers/45ae356c-0ab8-40ba-9f79-71e33c822d83/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:31.160181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:31.161039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.167194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.167653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.168469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.169083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.318608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:31.327211 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85e50fb6-016e-4b0f-8e47-91c5544b3789 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.170635 Nov 06 21:09:31.327777 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3058/6202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:31 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:31.337663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:31.338980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.347106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.347531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:31.348152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.348499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.349379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.350715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.354066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.354834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.355636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.356083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.393221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e9144b6-49c0-4839-adfb-f5ea3116a368 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.067873 Nov 06 21:09:31.394383 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3145/6203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:31 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:31.497093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:31.505458 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c9c68b0-2d39-4e3d-8436-5fcccdeb5492 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.161592 Nov 06 21:09:31.517324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3059/6204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:31 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:31.523067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:31.523809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.540232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.541708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.542600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.543136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.546055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:31.547188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.557536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.559012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.560126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.561561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.570346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lazy-loading 'flavor' on Instance uuid 40215c7e-b779-4d6b-adfd-20dd72cdb1cd {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:09:31.622662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd9fb08b-60b1-4699-bd66-5ae34f6ecbbb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action" status: 200 len: 24543 microversion: 2.1 time: 0.083834 Nov 06 21:09:31.625071 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3060/6205] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:31 2021] POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action => generated 24543 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:31.631729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:31.634298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.645957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.646506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.647594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.648674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.682349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5afae6c7-c850-4676-b167-dbf67b5b1dbb tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.162722 Nov 06 21:09:31.686916 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3146/6206] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:31 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:09:31.692523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:31.693526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:31.696746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c15af6d-6712-415d-be8b-37414118aa5b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069062 Nov 06 21:09:31.699380 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3061/6207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:31 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:31.705179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.705958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.706963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:31.707465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:31.929748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:31.937710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6967ad95-0950-44fe-9383-5f52ea9e3fa4 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1512 microversion: 2.1 time: 0.249305 Nov 06 21:09:31.938312 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3147/6208] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:31 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:32.406882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:32.408139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:32.421975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.422656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:32.423447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.425234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:32.466730 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-afcb9be6-c216-4d41-b44d-504c1c6d4deb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.064372 Nov 06 21:09:32.467356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3062/6209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:32 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:32.709109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:32.710075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:32.717412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.717871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:32.718682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.719125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:32.760514 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7ddbdf3-b5ad-44a6-a486-75e0051bb0df tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.054270 Nov 06 21:09:32.762073 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3148/6210] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:32 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:32.956799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:32.957651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:32.964318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.965063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:32.966073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:32.966518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.214271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:33.221814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77c3015c-0364-4937-bbd7-294bda6e82d3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1495 microversion: 2.1 time: 0.269284 Nov 06 21:09:33.222514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3063/6211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:32 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1495 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:33.240162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:33.240820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:33.248323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.248807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.249581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.250020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.278544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lazy-loading 'flavor' on Instance uuid 40215c7e-b779-4d6b-adfd-20dd72cdb1cd {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:09:33.292037 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'suspend' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state suspended Nov 06 21:09:33.292662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'suspend' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state suspended {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:33.293557 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49cf28c8-eeb4-4f25-a3f4-c999a891a7ea tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 148 microversion: 2.1 time: 0.058452 Nov 06 21:09:33.294133 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3149/6212] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:33 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 148 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:09:33.302731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:33.303409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:33.311589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.312124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.313023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.313550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.383723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a22f7d4c-2b31-4d22-be6f-2d32ab3082c6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 202 len: 0 microversion: 2.1 time: 0.084949 Nov 06 21:09:33.387732 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3064/6213] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:33 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:09:33.393925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:33.394091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:33.402809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.403267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.404253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.405420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.479511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:33.480455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:33.486637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.487091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.487888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.488430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.527276 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bed392c2-14b8-4e06-85be-0ef3da9c97c2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.053000 Nov 06 21:09:33.531038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3065/6214] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:33 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:33.698359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:33.707429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58b63436-b79b-4a8f-a8e7-335e2eed0329 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1501 microversion: 2.1 time: 0.318224 Nov 06 21:09:33.715171 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3150/6215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:33 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1501 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:33.774154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:33.775946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:33.783349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.784180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.786630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:33.787245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:33.842295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38f8780c-5de7-4c16-8c05-3f6769bcb2ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.072596 Nov 06 21:09:33.848631 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3066/6216] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:33 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:34.539427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:34.540710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:34.562449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.563645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.565025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.565477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.610399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-425cf503-34ca-4ac5-b593-166cc8dd1006 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.075062 Nov 06 21:09:34.614232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3151/6217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:34 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:34.726554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:34.727259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:34.735853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.736417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.737439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.738070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.856813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:34.858348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:34.866535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.867096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.868581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:34.869803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:34.919149 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-919101f1-cf9f-4299-a0e8-556b39e9c9d6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.067144 Nov 06 21:09:34.920388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3152/6218] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:34 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:34.998285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:35.010847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad7e9abc-92bf-4dea-8731-4e56f30db3e6 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1501 microversion: 2.1 time: 0.288009 Nov 06 21:09:35.012092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3067/6219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:34 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:35.623145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:35.624250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:35.631794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:35.632247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:35.633093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:35.633529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:35.676195 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-820ba310-625c-4688-9934-4f53e3bf8673 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.057489 Nov 06 21:09:35.676879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3153/6220] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:35 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:35.930814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:35.932339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:35.954881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:35.955341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:35.965720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:35.966393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.009218 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99988eb0-6518-4419-8607-856628251cc0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.081637 Nov 06 21:09:36.010183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3068/6221] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:35 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:36.029861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:36.031483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:36.039006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.039640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.040706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.041736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.595206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:36.602639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-909d5596-9bf4-474c-ae55-40cdf60cb0a7 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.576835 Nov 06 21:09:36.603212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3154/6222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:36 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:36.623372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:36.624405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:36.632198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.632615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.633413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.633858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.687016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:36.687951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:36.697369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.698034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.698840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.699278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.738543 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a2703ab-e8ba-4c55-8102-7af06117c5e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.055147 Nov 06 21:09:36.742235 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3155/6223] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:36 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:36.902046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:36.909656 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4b853ac-52ca-4f3b-8b68-df5c0971102c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.291976 Nov 06 21:09:36.910204 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3069/6224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:36 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:36.929143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ed30404-2522-46ea-a9d7-1562ec634033 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:36.929889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ed30404-2522-46ea-a9d7-1562ec634033 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 9ab712e6-99c5-45ac-ab64-4a4e718ea1e7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:36.935775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6ed30404-2522-46ea-a9d7-1562ec634033 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 9ab712e6-99c5-45ac-ab64-4a4e718ea1e7 could not be found. Nov 06 21:09:36.936444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ed30404-2522-46ea-a9d7-1562ec634033 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 9ab712e6-99c5-45ac-ab64-4a4e718ea1e7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:36.937399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ed30404-2522-46ea-a9d7-1562ec634033 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/9ab712e6-99c5-45ac-ab64-4a4e718ea1e7/action" status: 404 len: 111 microversion: 2.1 time: 0.012566 Nov 06 21:09:36.937988 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3156/6225] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:36 2021] POST /compute/v2.1/servers/9ab712e6-99c5-45ac-ab64-4a4e718ea1e7/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:09:36.945810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:36.946424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:36.953552 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.954015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:36.954792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:36.955232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.022127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:37.023410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.031972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.033293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.034092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.034683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.077234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d6335e9-72cc-4edd-897c-ba23577b85c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058846 Nov 06 21:09:37.078723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3157/6226] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:37 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:37.110739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:37.118158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f53d619-db83-4909-9ec1-48b355f18afe tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.175947 Nov 06 21:09:37.118721 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3070/6227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:36 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:37.137064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:37.137765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.144613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.145067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.145855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.146290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.331705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:37.341030 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4a104355-9333-4eae-978c-493cf359133b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.208585 Nov 06 21:09:37.343537 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3158/6228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:37 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:37.360809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:37.361638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.371581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.372324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.373336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.373947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.417034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'unpause' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active Nov 06 21:09:37.417758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'unpause' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:37.418913 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61efea68-5677-4393-86bd-4146cfee41c9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 145 microversion: 2.1 time: 0.063371 Nov 06 21:09:37.420148 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3071/6229] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:37 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 145 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:09:37.427790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:37.428744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.437430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.438191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.439239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.439871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.674432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:37.683389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9498e12-bedc-443d-a1e8-349c2bb800f0 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.259167 Nov 06 21:09:37.684653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3159/6230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:37 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:37.702679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:37.703296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.714453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.714829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.715652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.716087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.750522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:37.751474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.758723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.759387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.760412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:37.761009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:37.835158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-52f99d4f-d8ad-4581-b7c7-3d97a0aa4e8c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.063280 Nov 06 21:09:37.835942 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3160/6231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:37 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:37.941504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:37.949551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a93f5b21-975e-46a1-99bd-51f5f3551e04 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.250319 Nov 06 21:09:37.950559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3072/6232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:37 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:37.971664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf8c81a1-571d-42e2-a0ce-542c7ee3ec3f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:37.972470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf8c81a1-571d-42e2-a0ce-542c7ee3ec3f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: da05fe2c-e254-407f-9e04-e675953a5cc8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:37.980046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-bf8c81a1-571d-42e2-a0ce-542c7ee3ec3f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance da05fe2c-e254-407f-9e04-e675953a5cc8 could not be found. Nov 06 21:09:37.981183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf8c81a1-571d-42e2-a0ce-542c7ee3ec3f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance da05fe2c-e254-407f-9e04-e675953a5cc8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:37.982546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf8c81a1-571d-42e2-a0ce-542c7ee3ec3f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/da05fe2c-e254-407f-9e04-e675953a5cc8/action" status: 404 len: 111 microversion: 2.1 time: 0.015664 Nov 06 21:09:37.984081 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3161/6233] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:37 2021] POST /compute/v2.1/servers/da05fe2c-e254-407f-9e04-e675953a5cc8/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:37.993274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:37.993960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.005027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.005501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.006299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.006741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.089908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:38.092054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.101152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.101853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.103849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.104474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.148166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7cf162fd-e5c9-4da1-8bc7-c4fca7864a2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.062453 Nov 06 21:09:38.149262 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3162/6234] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:38 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:38.232832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:38.240309 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6681a665-a1a4-4473-9ec1-a1660e4a53a3 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.250688 Nov 06 21:09:38.241048 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3073/6235] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:37 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:38.258047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:38.258759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.266403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.266934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.267793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.268334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.440939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:38.449140 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09b872d4-cd6d-4f05-9d38-1048217ad31f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.195183 Nov 06 21:09:38.449714 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3163/6236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:38 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:38.466018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:38.466591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.475845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.476349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.478001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.478454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.501951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Cannot 'unshelve' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active Nov 06 21:09:38.502626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 409 to user: Cannot 'unshelve' instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd while it is in vm_state active {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:38.503393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b484e988-d112-4974-85a7-c46b89d727d2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action" status: 409 len: 146 microversion: 2.1 time: 0.042001 Nov 06 21:09:38.503935 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3074/6237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:38 2021] POST /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd/action => generated 146 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 06 21:09:38.512424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:38.513074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.518939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.519393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.520183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.520741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.661479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:38.669245 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e955995c-e446-4514-882e-123213059b7b tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.161077 Nov 06 21:09:38.669801 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3164/6238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:38 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:38.688094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:38.688782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.694983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.695432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.696218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.696852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.833380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:38.840925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f71cada-014f-4ee8-bac2-768cc8a562f1 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.156501 Nov 06 21:09:38.841978 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3075/6239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:38 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:38.846889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:38.847813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.854759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.855219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.856014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.856493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.856678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18c9bd0c-7812-498c-9277-901ceef30700 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1279492702_updated"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:38.857875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18c9bd0c-7812-498c-9277-901ceef30700 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: ca1c153c-f5ea-45ee-b78a-5d70a28a2ae5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.863423 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-18c9bd0c-7812-498c-9277-901ceef30700 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance ca1c153c-f5ea-45ee-b78a-5d70a28a2ae5 could not be found. Nov 06 21:09:38.864011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18c9bd0c-7812-498c-9277-901ceef30700 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance ca1c153c-f5ea-45ee-b78a-5d70a28a2ae5 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:38.864931 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18c9bd0c-7812-498c-9277-901ceef30700 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "PUT /compute/v2.1/servers/ca1c153c-f5ea-45ee-b78a-5d70a28a2ae5" status: 404 len: 111 microversion: 2.1 time: 0.011882 Nov 06 21:09:38.865645 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3076/6240] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:09:38 2021] PUT /compute/v2.1/servers/ca1c153c-f5ea-45ee-b78a-5d70a28a2ae5 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:38.873756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:38.874365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:38.880878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.881332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.882125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:38.882559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:38.903858 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e84fe6e-b3f2-4bcc-b173-221947b101ef tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.060430 Nov 06 21:09:38.904504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3165/6241] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:38 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:39.026272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:39.033869 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-779a882b-40dc-4720-ab27-ee8ee9a14e60 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.163543 Nov 06 21:09:39.034429 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3077/6242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:38 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:39.052673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:39.053377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.060737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.061194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.061984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.062429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.160717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:39.161635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.168983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.169729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.170958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.171626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.201106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:39.208825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-838d53ea-b7d6-4b00-bdab-0cbd282b77b9 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.160245 Nov 06 21:09:39.219961 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3166/6243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:39 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:39.223936 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41bcd307-6a4c-41e1-a5e5-98c763a47d68 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.066721 Nov 06 21:09:39.228060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3078/6244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:39 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:39.230130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69516788-9cf0-46ec-8af5-0fa06c84af94 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:39.231555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69516788-9cf0-46ec-8af5-0fa06c84af94 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:39.232542 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69516788-9cf0-46ec-8af5-0fa06c84af94 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "PUT /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 400 len: 619 microversion: 2.1 time: 0.006673 Nov 06 21:09:39.236213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3167/6245] 10.222.0.13 () {60 vars in 1256 bytes} [Sat Nov 6 21:09:39 2021] PUT /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:09:39.241655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:39.242712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.249958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.250414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.251197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.251634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.389589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:39.397378 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-497506cf-37ab-4472-9158-cf39c790e450 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.159642 Nov 06 21:09:39.408386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3079/6246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:39 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:39.417384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:39.418181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.425550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.426074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.427132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.427688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.595490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:39.605188 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1c718b8-1390-4f32-8b2c-6da43cf6f634 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.193507 Nov 06 21:09:39.606005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3168/6247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:39 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:39.621816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60301a53-fa30-47eb-9327-65ad4f450f48 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:39.623454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60301a53-fa30-47eb-9327-65ad4f450f48 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:39.624550 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60301a53-fa30-47eb-9327-65ad4f450f48 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "PUT /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 400 len: 108 microversion: 2.1 time: 0.006641 Nov 06 21:09:39.625170 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3080/6248] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:09:39 2021] PUT /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 06 21:09:39.633673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:39.634506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.641480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.642204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.643112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.643815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.915829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:39.919609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:39.924710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:39.925918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.926619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.927651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:39.928322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:39.933813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-667c51a5-f578-4d24-9213-cdb84dbfd9fc tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1504 microversion: 2.1 time: 0.304135 Nov 06 21:09:39.934611 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3169/6249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:39 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:39.973017 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7761391f-6d40-465d-9c36-6e32164b007e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.061363 Nov 06 21:09:39.974179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3081/6250] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:39 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:40.235487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:40.236726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:40.244586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:40.245043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:40.245842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:40.246279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:40.290474 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04df9b8e-48b4-4549-9872-3ad60eed8d7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058598 Nov 06 21:09:40.291848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3170/6251] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:40 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:40.985587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:40.986577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:40.993806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:40.994263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:40.995037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:40.995470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:41.034650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aca4d2f7-9564-4502-97fe-4f0031ac8ab5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.053052 Nov 06 21:09:41.035260 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3082/6252] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:40 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:41.303450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:41.304495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:41.312801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:41.313254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:41.314041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:41.314479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:41.354656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75bdf2fa-2618-4349-897f-6987e6a8fde0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.055296 Nov 06 21:09:41.356137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3171/6253] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:41 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:42.047282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:42.048316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.055760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.056222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.057034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.057475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.097549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75308ac1-72f6-4b60-b19f-16c50d7734d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.054190 Nov 06 21:09:42.099001 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3083/6254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:42 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:42.228605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:42.229260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.236217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.236706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.237488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.237933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.251142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. Nov 06 21:09:42.251721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:42.252666 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a632bf72-c647-4cf7-8b10-8b7cefbe7a24 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 404 len: 111 microversion: 2.1 time: 0.028116 Nov 06 21:09:42.253500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3172/6255] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:09:42 2021] DELETE /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:42.262035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:42.262878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 87760ef5-370e-4d4e-b5c7-9322d089e9ac] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.269826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.270358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.271224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.271733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.285680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. Nov 06 21:09:42.286267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 87760ef5-370e-4d4e-b5c7-9322d089e9ac could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:42.287084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22a95e6a-4da8-497b-a186-ee4077e4a75a tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac" status: 404 len: 111 microversion: 2.1 time: 0.029792 Nov 06 21:09:42.287604 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3084/6256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:42 2021] GET /compute/v2.1/servers/87760ef5-370e-4d4e-b5c7-9322d089e9ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:42.295490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:42.295991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.302259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.302707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.303478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.304015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.328772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:09:42.366299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:42.367426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.375149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.375611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.376618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.377064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.407880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c575f297-500f-45f1-8e1c-dca430e78801 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "DELETE /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 204 len: 0 microversion: 2.1 time: 0.115753 Nov 06 21:09:42.408438 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3173/6257] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:09:42 2021] DELETE /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:09:42.418951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76aae3e7-6b8e-46a7-97e3-0aae6e332565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.056073 Nov 06 21:09:42.419197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:42.420001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:42.423864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3085/6258] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:42 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:42.425984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.426445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.427239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:42.427680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:42.560072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:42.568837 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ea1f741-8820-4886-afb4-390c5bf4b6b2 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.156185 Nov 06 21:09:42.569700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3174/6259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:42 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:09:43.110057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:43.111074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:43.118293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.119313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.120089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.120542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.163238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c51fc35-d30d-4f0f-a030-00a95bdba855 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.057102 Nov 06 21:09:43.167669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3086/6260] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:43 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:43.430958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:43.432736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:43.439884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.440723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.442131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.442818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.488721 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cefc278e-5667-4dc2-bc96-25226ca6eff8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.061175 Nov 06 21:09:43.489363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3175/6261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:43 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:43.590272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:43.590972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:43.598533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.599109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.599783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:43.600504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:43.751583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:43.763241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06f3beb3-a3e2-4f9e-be7d-a8d1d0b9843f tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1510 microversion: 2.1 time: 0.177813 Nov 06 21:09:43.764092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3087/6262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:43 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:44.175767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:44.176864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:44.193319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.193319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.199327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.199987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.266618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d926178f-e3a0-404f-86a8-56d51f15c283 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.093417 Nov 06 21:09:44.267563 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3176/6263] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:44 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:44.502483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:44.504164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:44.511484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.512209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.513201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.513982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.572933 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b460853f-61d0-4292-8922-1ac076391676 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.075063 Nov 06 21:09:44.573603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3088/6264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:44 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:09:44.781827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:44.782822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:44.795536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.796133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.797205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.797875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:44.942155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef3f8eee14643889cf3f3ccf5858c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930a318a21a4455c8d2c6eb794459b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:09:44.958339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e4cc3b9e-c908-40dc-865b-d61da6992fb3 req-0d4a00cc-a43c-465a-8418-f7875afb21f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40215c7e-b779-4d6b-adfd-20dd72cdb1cd", "name": "network-vif-deleted", "tag": "1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:44.960848 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:09:44.960848 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:09:44.974687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19bc35d2-b39b-40c4-a39d-c95904292a4c tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 200 len: 1468 microversion: 2.1 time: 0.190222 Nov 06 21:09:44.987872 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3177/6265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:44 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:09:44.994521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e4cc3b9e-c908-40dc-865b-d61da6992fb3 req-0d4a00cc-a43c-465a-8418-f7875afb21f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:44.994981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e4cc3b9e-c908-40dc-865b-d61da6992fb3 req-0d4a00cc-a43c-465a-8418-f7875afb21f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:45.018171 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e4cc3b9e-c908-40dc-865b-d61da6992fb3 req-0d4a00cc-a43c-465a-8418-f7875afb21f9 service nova] Creating event network-vif-deleted:1b8b5d0d-b9fc-45ab-b4a0-765ddd5037ed for instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd on nch2-master-1 Nov 06 21:09:45.026217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e4cc3b9e-c908-40dc-865b-d61da6992fb3 req-0d4a00cc-a43c-465a-8418-f7875afb21f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073505 Nov 06 21:09:45.027475 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3089/6266] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:09:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:09:45.281629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:45.282573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:45.289247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:45.289701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:45.291074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:45.291951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:45.349294 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63edb019-b1e4-4928-831a-f7c8c7206e44 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.071265 Nov 06 21:09:45.352946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3178/6267] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:45 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:45.590461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:45.591501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:45.599344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:45.600034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:45.601068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:45.601678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:45.653925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b241fc4c-ba58-4247-8103-575cea2fe918 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069950 Nov 06 21:09:45.655572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3090/6268] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:45 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:46.007770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:09:46.010056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] [instance: 40215c7e-b779-4d6b-adfd-20dd72cdb1cd] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:46.020049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.020720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.021746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.022407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.039656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] HTTP exception thrown: Instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd could not be found. Nov 06 21:09:46.040827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] Returning 404 to user: Instance 40215c7e-b779-4d6b-adfd-20dd72cdb1cd could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:09:46.042408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7338c9c-992b-4e68-8243-49db88cdeec8 tempest-ServersNegativeTestJSON-1908266986 tempest-ServersNegativeTestJSON-1908266986-project] 10.222.0.13 "GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd" status: 404 len: 111 microversion: 2.1 time: 0.040674 Nov 06 21:09:46.043130 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3179/6269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:09:45 2021] GET /compute/v2.1/servers/40215c7e-b779-4d6b-adfd-20dd72cdb1cd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:09:46.367910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:46.369096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:46.376460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.376992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.378192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.378843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.461337 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e8cfb56-eb2c-4ec8-ae23-b4db7d30a90a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.102493 Nov 06 21:09:46.462596 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3091/6270] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:46 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:46.667266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:46.668525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:46.677836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.678590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.679650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:46.680741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:46.755595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9e662ed-890e-442e-89b2-bc860c67816f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.092011 Nov 06 21:09:46.758300 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3180/6271] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:46 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:47.473528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:47.475122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:47.483031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:47.483944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:47.484799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:47.485244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:47.528793 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f18e572d-d8f5-4b94-822a-1d811dd3054d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.058495 Nov 06 21:09:47.529458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3092/6272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:47 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:47.770279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:47.771299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:47.783343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:47.784063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:47.785704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:47.786219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:47.855915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9dbc357-fe8d-4fec-b493-ea272522e9cb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.080881 Nov 06 21:09:47.855915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3181/6273] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:47 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:48.542693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:48.543718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:48.554312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:48.554767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:48.555683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:48.557296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:48.604761 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a6a2dca-98a2-42d8-803f-697a74616277 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.067286 Nov 06 21:09:48.608745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3093/6274] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:48 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:48.862562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:48.864343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:48.879846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:48.880205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:48.881102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:48.881575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:48.933847 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1d992fb-fc78-44e0-b99a-31d3ba169510 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.076124 Nov 06 21:09:48.935528 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3182/6275] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:48 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:49.619455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:49.621287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:49.632638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:49.633742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:49.634682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:49.635827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:49.686298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4a42821-310f-4ab8-8a5a-9ffa47e3cfc0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.073484 Nov 06 21:09:49.688523 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3094/6276] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:49 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:49.946842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:49.949629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:49.958153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:49.958619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:49.959544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:49.960150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:50.012726 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d376c5e-94ee-425e-abda-73050625e4a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.070168 Nov 06 21:09:50.014266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3183/6277] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:49 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:50.699878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:50.701060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:50.708748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:50.709296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:50.710207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:50.710765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:50.764957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-628f213e-cd8c-4e6a-9702-b827355d4f68 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.068932 Nov 06 21:09:50.766282 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3095/6278] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:50 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:51.026999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:51.028850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:51.036792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:51.037585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:51.038584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:51.039228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:51.093240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94b4b0ac-79ac-49ac-b3a1-e19e99ac5ca7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.071126 Nov 06 21:09:51.094596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3184/6279] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:51 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:51.776222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:51.780498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:51.789211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:51.789211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:51.790832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:51.790832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:51.833596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a285d42a-de0a-4d4a-bbf8-07efd8ffded1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.060720 Nov 06 21:09:51.837220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3096/6280] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:51 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:52.108274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:52.110054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:52.121286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:52.121667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:52.124310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:52.124968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:52.176680 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad7aa9bb-b4d1-4193-afe5-78b6ab007d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.074787 Nov 06 21:09:52.177486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3185/6281] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:52 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:52.846587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:52.847749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:52.855442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:52.856085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:52.857168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:52.857687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:52.908215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6287565e-b4c3-43bd-9132-3fc033feb624 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.066403 Nov 06 21:09:52.908941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3097/6282] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:52 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:53.189283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:53.190342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:53.198340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:53.198790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:53.199578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:53.200008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:53.239814 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-193cf42e-39ea-4497-9349-9815a533f997 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.054263 Nov 06 21:09:53.243759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3186/6283] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:53 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:53.921741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:53.923699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:53.932798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:53.933505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:53.935640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:53.936634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:53.987901 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7420042-dc4c-4ad0-8cd4-d3e5f0248497 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.071159 Nov 06 21:09:53.989135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3098/6284] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:53 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:54.254651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:54.256636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:54.270173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:54.270884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:54.277279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:54.278126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:54.324311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-daa4f22f-131b-418a-8934-83ba570df2ff tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.074673 Nov 06 21:09:54.326558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3187/6285] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:54 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:55.000639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:55.002484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:55.009538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:55.010041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:55.010845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:55.011524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:55.063452 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f6e6f07-b383-4cb3-96c7-f5221ba2355c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.064833 Nov 06 21:09:55.063452 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3099/6286] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:54 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:55.338755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:55.343131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:55.350920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:55.351444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:55.352328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:55.352824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:55.394301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ca91f94-0428-4176-92fe-14b9215c7bc1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.059923 Nov 06 21:09:55.395299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3188/6287] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:55 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:56.073939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:56.074968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:56.083277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:56.083786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:56.084669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:56.085349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:56.127368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36eadc62-d768-4884-bf6c-8eba441d9109 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.058074 Nov 06 21:09:56.128021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3100/6288] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:56 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:56.406641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:56.408521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:56.417215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:56.417956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:56.418893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:56.419476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:56.475056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57a999f9-9d2c-4cc0-bb45-58452d95d7dd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.071917 Nov 06 21:09:56.476325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3189/6289] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:56 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:57.139926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:57.141739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:57.149696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:57.150963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:57.151822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:57.152350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:57.193105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36cbae38-522a-4f6f-97b3-1d4123d030fb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.057052 Nov 06 21:09:57.193979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3101/6290] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:57 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:57.487424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:57.489780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:57.497262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:57.497899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:57.498837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:57.499425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:57.542143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4311cb4-cdd0-42af-af06-7c2e5ea8c19a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.058298 Nov 06 21:09:57.543666 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3190/6291] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:57 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:58.205909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:58.206930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:58.215887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:58.216377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:58.217184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:58.217625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:58.267484 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9cfe06c-8b8f-4147-8b37-f0e47486bbb1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.065604 Nov 06 21:09:58.272256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3102/6292] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:58 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:58.554879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:58.556200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:58.564502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:58.565299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:58.566599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:58.567234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:58.610958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd1a81a5-f67f-47e3-840a-b94b35d33a9b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.059636 Nov 06 21:09:58.615181 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3191/6293] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:58 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:59.281284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:59.282364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:59.290335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:59.290801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:59.292053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:59.292529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:59.338330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e78762a-bf24-4531-9804-29b8e164a3a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.060863 Nov 06 21:09:59.339202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3103/6294] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:59 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:09:59.624815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:09:59.625886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:09:59.633779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:59.634231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:59.635656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:09:59.636468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:09:59.676129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d70da258-11b8-4905-893e-0eafa274a515 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.055741 Nov 06 21:09:59.677733 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3192/6295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:09:59 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:00.353904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:00.355110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:00.362971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:00.363658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:00.364520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:00.364967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:00.407686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ccf75916-9966-478e-9b78-b41682fe9e71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.060929 Nov 06 21:10:00.412087 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3104/6296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:00 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:00.694716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:00.695912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:00.708775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:00.709277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:00.710325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:00.710913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:00.762926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc6f66e8-046a-46c5-aaec-81002cef4af7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.075184 Nov 06 21:10:00.764232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3193/6297] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:00 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:01.422505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:01.424680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:01.434746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:01.435403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:01.436580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:01.437377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:01.490343 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-383f9c9d-e6bf-4315-a09e-5d07014ae2b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.074121 Nov 06 21:10:01.490996 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3105/6298] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:01 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:01.775733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:01.778624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:01.786985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:01.788037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:01.789264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:01.789947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:01.841417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9f10160-2254-49a3-8a3d-1654e1717636 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.069519 Nov 06 21:10:01.842640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3194/6299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:01 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:02.156967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:02.157678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:02.165038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.165497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.167665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.168344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.502946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:02.504220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:02.511105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.511552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.512574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.513003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.559483 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-adacee1a-139d-462e-b2e0-b338617b50c9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.060506 Nov 06 21:10:02.560333 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3195/6300] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:02 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:02.662270 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ca0f66d-5f84-48af-9c95-1279024ce64c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1831 microversion: 2.1 time: 0.509237 Nov 06 21:10:02.675657 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3106/6301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:02 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1831 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:02.680891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:02.685805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:02.696445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.697504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.698323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.698743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.854181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:02.855461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:02.864162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.865125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.866335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:02.867008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:02.914331 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6d7701c-dfa0-4a91-9c54-fba5200087db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.063694 Nov 06 21:10:02.915173 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3107/6302] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:02 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:02.959438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:02.970577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5e3c445-2f05-43e0-bd4c-870d1c8662ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1680 microversion: 2.1 time: 0.294215 Nov 06 21:10:02.971155 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3196/6303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:02 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1680 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:10:03.116616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:03.117848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:03.127285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.127743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.129076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.129723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.189940 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-769279a4-ffc4-4a6c-943b-296eadc4392a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action" status: 200 len: 32614 microversion: 2.1 time: 0.077685 Nov 06 21:10:03.190668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3108/6304] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:03 2021] POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action => generated 32614 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:03.384031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:03.385279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:03.391938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.392818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.393692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.394202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.434658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '242853ef565f4fc494cafa2ecbc4f9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c7249d344a55a13dbbf7314c345c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:03.435281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] flavor_id is None. Assuming migration. {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 06 21:10:03.435730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:10:03.573162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:03.575057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:03.583480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.584517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.585659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.586204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.637969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a708194-6c97-44df-9209-2714813fcf9e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.070931 Nov 06 21:10:03.640362 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3109/6305] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:03 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:03.779921 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51240ec8-ac82-4aab-9505-c03804767aa3 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action" status: 202 len: 0 microversion: 2.1 time: 0.399801 Nov 06 21:10:03.780669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3197/6306] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:03 2021] POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:10:03.791105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:03.792953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:03.800147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.801001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.803141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.803798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.927211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:03.928536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:03.939481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.939963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.940745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:03.941183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:03.982258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:03.989495 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ed9ec2e-331f-4178-bf4d-2d662a391501 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.066515 Nov 06 21:10:03.990022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-467f64a4-6996-4f71-9f0d-275c41063ec4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1689 microversion: 2.1 time: 0.204026 Nov 06 21:10:03.991290 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3198/6307] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:03 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:03.992370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3110/6308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:03 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:04.651967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:04.653865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:04.668345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:04.669001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:04.671413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:04.672051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:04.725221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3a319db-8636-4223-857f-bdd252938a89 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.078109 Nov 06 21:10:04.726340 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3199/6309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:04 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:05.002420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:05.004052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:05.010333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:05.011120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:05.014637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.015287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.017042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.018422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.027772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.031828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.032816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.034960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.083141 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b90392c5-9b88-40d6-9c31-84c2c3a84bd5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.084189 Nov 06 21:10:05.084620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3111/6310] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:04 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:05.239043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:05.253226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c93374a8-e75c-4b7f-a1a0-f81fb126dc16 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1689 microversion: 2.1 time: 0.241172 Nov 06 21:10:05.253226 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3200/6311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:05 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:05.738475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:05.739496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:05.747826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.748538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.749706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:05.750342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:05.803818 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ea7a769-4a8f-413d-bdd6-f9e8b108dc99 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.068830 Nov 06 21:10:05.808930 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3112/6312] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:05 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:06.095348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:06.096411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:06.104750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.105439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.106451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.107125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.160758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccd73364-5d08-46c3-8ff2-4c2eed381556 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.068373 Nov 06 21:10:06.161465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3201/6313] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:06 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:06.267035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:06.268168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:06.277963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.278485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.279283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.279769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.440524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:06.450961 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3d9cac1-ef2d-47ac-95f4-364e57797ace tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.188648 Nov 06 21:10:06.451642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3113/6314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:06 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:06.819227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:06.820243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:06.828450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.828904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.829701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:06.830100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:06.882190 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd04944c-d85a-4ab4-9062-3bb387fea0ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.068228 Nov 06 21:10:06.882856 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3202/6315] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:06 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:07.173823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:07.174925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:07.184375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.184375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.184375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.184375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.223693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-893ce55f-2740-4c3c-8370-231c7c016856 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.054193 Nov 06 21:10:07.224354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3114/6316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:07 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:07.469166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:07.470921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:07.478909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.479259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.480050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.480520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.641874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:07.651166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3eaaf433-46e3-4443-a3d6-8c3146eb96b4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.185924 Nov 06 21:10:07.651924 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3203/6317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:07 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:07.893937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:07.895976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:07.903550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.904005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.904820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:07.905262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:07.943613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-676dee13-7403-48be-b333-f2671cf5db1d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.053607 Nov 06 21:10:07.944338 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3115/6318] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:07 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:08.235963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:08.236937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:08.243181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.244267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:08.245262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.245692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:08.285260 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32c7f946-ad33-41ac-8846-30e554b6871d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.052813 Nov 06 21:10:08.286014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3204/6319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:08 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:08.671168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:08.672908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:08.682196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.683036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:08.684121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.684727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:08.841493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:08.851136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c02705d1-7acb-4208-9fff-a0aa63ce2f9a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.185914 Nov 06 21:10:08.852235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3116/6320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:08 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:08.961335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:08.961335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:08.979282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.979765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:08.980568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:08.986279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:09.039372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b5a5bf0-30b7-4254-9e8a-2a8a710eb8e2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 24568 microversion: 2.1 time: 0.087818 Nov 06 21:10:09.044018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3205/6321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:08 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 24568 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:09.297436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:09.298498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:09.304880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:09.305403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:09.306305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:09.306807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:09.346618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-130b80d2-ec65-4d36-932b-111a6e1c5963 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.052821 Nov 06 21:10:09.350574 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3117/6322] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:09 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:09.879551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:09.882528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:09.889280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:09.889662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:09.890725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:09.891318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:10.036890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:10.045185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c90b8307-d7b5-4848-a5d3-06d235338550 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.176583 Nov 06 21:10:10.045830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3206/6323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:09 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:10.051369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:10.057445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:10.064880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:10.065380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:10.066390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:10.066938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:10.134774 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68873671-cb10-41c0-8e67-909934ca049f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.087147 Nov 06 21:10:10.135525 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3118/6324] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:10 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:10.359884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:10.361030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:10.368365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:10.369087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:10.370152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:10.370751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:10.435765 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce845c4b-1427-46d2-aae1-a2696c3b9b64 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.079834 Nov 06 21:10:10.436867 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3207/6325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:10 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:11.063332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:11.064074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:11.072144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.072676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.073559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.073919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.148045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:11.149219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:11.164702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.168926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.169881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.173034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.239181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0969bf4b-69a7-4b3d-9d21-ab6bd494db74 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.095746 Nov 06 21:10:11.240448 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3208/6326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:11 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:11.281321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:11.298250 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de22399a-ad16-40de-8141-e6317f6f5545 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.230427 Nov 06 21:10:11.301217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3119/6327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:11 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:11.448578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:11.449601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:11.458038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.458508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.459321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:11.459743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:11.502793 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-474041d2-4220-4042-9f3f-855412b058ac tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.059072 Nov 06 21:10:11.503555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3209/6328] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:11 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:12.251044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:12.252427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:12.271308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.276276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.277411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.278442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.316228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:12.317042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:12.327315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.327995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.328996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.329599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.330029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbc82c9a-93cb-4d9c-b01b-1736c3eefb6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.082594 Nov 06 21:10:12.330740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3120/6329] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:12 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:12.516992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:12.517894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:12.525293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.525981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.526948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:12.527580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:12.542720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:12.552197 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec2fe7c3-af58-40fa-836a-42e46ebeb237 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.239673 Nov 06 21:10:12.553635 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3210/6330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:12 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:10:12.604866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5fb4cc7-9eb0-4ab5-8786-a7740dff7821 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.092066 Nov 06 21:10:12.605601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3121/6331] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:12 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:13.342115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:13.343269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:13.349864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.350309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.351077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.351508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.391545 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8664a7f-7acd-49e3-a26d-f5612d7a072e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.052929 Nov 06 21:10:13.392498 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3211/6332] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:13 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:13.571920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:13.572566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:13.583688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.584144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.584992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.585428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.617831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:13.618881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:13.627623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.627871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.628880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:13.629471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:13.685007 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e187421a-7785-495b-a629-ef67852bcf30 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.071359 Nov 06 21:10:13.686547 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3212/6333] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:13 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:13.755737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:13.768244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c7a8054-3740-42e3-9b2d-195da6d11d1f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.201282 Nov 06 21:10:13.769083 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3122/6334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:13 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:14.404228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:14.405519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:14.418002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.418461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:14.419266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.424619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:14.501995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03c0df36-3c2b-405c-b234-792a99eca500 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.102484 Nov 06 21:10:14.503353 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3213/6335] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:14 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:14.700989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:14.702286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:14.715163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.715627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:14.721364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.722009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:14.786231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:14.786986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:14.794237 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ce4ca0c-7a8f-4ad4-8c8c-b259604c17d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 32651 microversion: 2.1 time: 0.100323 Nov 06 21:10:14.794995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3123/6336] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:14 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 32651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:14.795118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.795501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:14.796519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:14.797107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.045702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:15.053053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5dfb8ab-cbda-4201-94a3-c95c302086c3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.271542 Nov 06 21:10:15.053874 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3214/6337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:14 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:10:15.514535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:15.515660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:15.522855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.523360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.524164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.525149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.568863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07ff375c-7721-4077-aa61-91033d1dd1f7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.058357 Nov 06 21:10:15.572820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3124/6338] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:15 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:15.807056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:15.808113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:15.815206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.815667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.816506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.816942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.872837 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b178337-15f2-41e9-a559-fe10f095f3eb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 200 len: 40799 microversion: 2.1 time: 0.069240 Nov 06 21:10:15.873794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3215/6339] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:15 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 40799 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:15.893370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:15.895759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:15.903807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.904500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.905425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:15.905973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:15.933160 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc804168-b5bc-4a48-995d-0709541c9d66 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/ips" status: 200 len: 145 microversion: 2.1 time: 0.048893 Nov 06 21:10:15.934194 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3125/6340] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:10:15 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:10:16.077369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:16.078287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:16.085441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:16.085891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:16.088009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:16.088473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:16.234177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:16.241952 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48da960a-3d00-4163-acfa-11597aa6a3bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.174225 Nov 06 21:10:16.243703 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3216/6341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:16 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:16.582467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:16.583949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:16.592462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:16.593477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:16.594428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:16.595038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:16.643419 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71ced0e5-2082-4401-9d43-6669c2a36e96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.066105 Nov 06 21:10:16.647470 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3126/6342] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:16 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:17.259857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:17.260490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:17.268179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.268676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:17.269472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.269911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:17.469938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:17.477969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c983dfcb-c29a-4b01-9dfb-bbd2bc5fa68c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1694 microversion: 2.1 time: 0.222184 Nov 06 21:10:17.478649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3217/6343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:17 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:17.655662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:17.656632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:17.664287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.664765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:17.667675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.668121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:17.708455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-732e895f-85af-4f2a-bdaa-4918b228ac71 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.056736 Nov 06 21:10:17.709407 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3127/6344] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:17 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:17.934298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5922c86c-184f-4d10-9008-1de074a050e6"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:17.935402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:17.942549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.943013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:17.943833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:17.944274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.235546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4584df55-a994-4f7c-834b-6a11010988cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305702 Nov 06 21:10:18.236534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3218/6345] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:10:17 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:10:18.495957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:18.497152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:18.506268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:18.507193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.508327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:18.508953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.722802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:18.724251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:18.741041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:18.741496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.742306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:18.743633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.799803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:18.812358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a66761d9-ad83-4605-a735-cc5dc7e0b38f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.094576 Nov 06 21:10:18.816533 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3219/6346] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:18 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:18.816699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-af9880af-8d9a-4421-8cc2-6886b430639d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1693 microversion: 2.1 time: 0.321646 Nov 06 21:10:18.827085 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3128/6347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:18 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1693 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:18.911173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:18.913097 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:10:18.913097 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:10:18.940677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:18.941260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:18.963983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] Creating event network-vif-unplugged:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch1-master-1 Nov 06 21:10:18.970552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] Instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:10:18.989657 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-28c6d1b3-4978-4799-ab5e-00f5e15f22e9 req-8808eb07-d529-4a57-90f0-65fbcc5a3768 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084061 Nov 06 21:10:18.990891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3220/6348] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:10:19.824748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:19.825775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:19.832664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:19.833404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:19.834413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:19.835052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:19.835621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:19.836577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:19.847202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:19.847783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:19.848703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:19.849212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:19.884909 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f09ba49d-2347-42b9-8b42-2ad1e687f788 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.063600 Nov 06 21:10:19.885794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3129/6349] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:19 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:20.507327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:20.524062 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee593cac-1fdf-4eea-8200-2ec98a95c6e4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1693 microversion: 2.1 time: 0.694898 Nov 06 21:10:20.534761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3221/6350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:19 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1693 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:20.897795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:20.898972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:20.907739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:20.908450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:20.910464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:20.911277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:20.957561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09507ae5-d264-4645-97ac-47e78d0589c8 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.063656 Nov 06 21:10:20.958482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3130/6351] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:20 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:21.011607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:21.013122 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:10:21.013122 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:10:21.021967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.022721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:21.035680 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] Creating event network-changed:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch1-master-1 Nov 06 21:10:21.042927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] Instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:10:21.054877 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-377561da-4d88-4a4d-8829-538de108260d req-2640fa37-c86d-49f3-ba9d-c4aa6a517d46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047976 Nov 06 21:10:21.055496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3222/6352] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:10:21.542196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:21.546491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:21.554333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.554798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:21.556115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.556660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:21.609650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f52afbdf-def7-40dc-abb9-9e8992280e3a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:21.616800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52afbdf-def7-40dc-abb9-9e8992280e3a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.617256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f52afbdf-def7-40dc-abb9-9e8992280e3a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:21.642589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f52afbdf-def7-40dc-abb9-9e8992280e3a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:10:21.703609 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f52afbdf-def7-40dc-abb9-9e8992280e3a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 202 len: 0 microversion: 2.1 time: 0.092852 Nov 06 21:10:21.703609 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3223/6353] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:21 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:10:21.711085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:21.712102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:21.720607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.721277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:21.722440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:21.723047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:22.022973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:22.033992 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f396fb5-5975-4395-8eef-b74df00ee1e3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1691 microversion: 2.1 time: 0.495896 Nov 06 21:10:22.034660 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3131/6354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:21 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1691 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:22.039672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:22.042122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:22.053448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:22.054137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:22.055266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:22.056458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:22.103083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1b3f0e5-6754-4ecd-ade0-2edb38bfbbdf tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.066325 Nov 06 21:10:22.104634 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3132/6355] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:22 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:22.164060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:22.173366 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e636932-c841-412d-914f-eddca4827c60 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.467704 Nov 06 21:10:22.174350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3224/6356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:21 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:23.053432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:23.054673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:23.062615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.063396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.064412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.065039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.115164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:23.116166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:23.125318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.125773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.126566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.127003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.169492 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1fc38b56-107b-460c-82da-6db00e472023 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057860 Nov 06 21:10:23.171285 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3225/6357] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:23 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:23.192350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:23.193623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:23.203201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.203834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.204683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:23.205096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:23.340068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:23.351836 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84c646fc-3aee-46c2-8dd5-ef4b436329b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1691 microversion: 2.1 time: 0.302611 Nov 06 21:10:23.378172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3133/6358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:23 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:23.479153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:23.492065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e72fd554-47e0-4c8c-97c3-13843a4cbe79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.303181 Nov 06 21:10:23.495003 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3226/6359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:23 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:24.183177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:24.184390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:24.192062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.192548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.196632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.196632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.236752 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f877a1f-c564-46f9-bd86-704b0e82a40d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057828 Nov 06 21:10:24.237520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3134/6360] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:24 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:24.394813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:24.396766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:24.406035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.406486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.407631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.408064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.514264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:24.515343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:24.522647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.523418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.524486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.525123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.566024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:24.585012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a3b4ae9f-35f6-4362-838f-65b6ad64fd01 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1688 microversion: 2.1 time: 0.193966 Nov 06 21:10:24.596733 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3227/6361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:24 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:24.603445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:24.604194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:24.616599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.617310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.619661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.620567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.693244 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a551d55-b757-466d-84d0-736895b2c4b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action" status: 204 len: 0 microversion: 2.1 time: 0.093141 Nov 06 21:10:24.694187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3228/6362] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:24 2021] POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:10:24.701747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:24.704059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:24.705430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:24.710877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5f4a29b-bd2f-4a23-be1c-6355136aecf0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.200746 Nov 06 21:10:24.711863 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3135/6363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:24 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:24.719461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.720380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:24.721414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:24.721887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:25.086375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:25.095245 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25f510b8-3db9-422f-a6e6-faa4a378e32c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1688 microversion: 2.1 time: 0.395732 Nov 06 21:10:25.095825 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3229/6364] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:24 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1688 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:10:25.249545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:25.251637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:25.261436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:25.262160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:25.263294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:25.263901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:25.312029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37a1d478-9dea-4cc6-8d7e-6e84c04a5485 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.066476 Nov 06 21:10:25.313311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3136/6365] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:25 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:25.731389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:25.732622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:25.740720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:25.741526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:25.742430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:25.743448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:25.904869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:25.914205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2103f540-1857-4929-852f-7796e20bd439 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.187128 Nov 06 21:10:25.915430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3230/6366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:25 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:26.114178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:26.115302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:26.124932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.125509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:26.126604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.127293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:26.323823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:26.324786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:26.339949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.340623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:26.341429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.341901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:26.367990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:26.380288 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4bf240e7-9fe4-4a8a-9208-ea82a24bde54 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1680 microversion: 2.1 time: 0.269348 Nov 06 21:10:26.400398 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3137/6367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:26 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:26.418977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-637d2f00-7ec4-416f-bd2b-74215da244ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.099328 Nov 06 21:10:26.421445 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3231/6368] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:26 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:26.933985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:26.935008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:26.942719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.943469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:26.944584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:26.945185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:27.179213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:27.187906 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8445c7d0-521d-48e2-b66c-cd9acad19c6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.258832 Nov 06 21:10:27.188732 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3138/6369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:26 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:27.435163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:27.437476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:27.449745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:27.450608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:27.451455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:27.452239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:27.476889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6d0f53b0-d842-4ec0-b8e5-ae917f5db80d req-0b5f355f-333a-464c-82bb-fc6c91e5a290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "name": "network-vif-plugged", "status": "completed", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:27.476889 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:10:27.476889 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:10:27.489238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d0f53b0-d842-4ec0-b8e5-ae917f5db80d req-0b5f355f-333a-464c-82bb-fc6c91e5a290 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:27.489857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d0f53b0-d842-4ec0-b8e5-ae917f5db80d req-0b5f355f-333a-464c-82bb-fc6c91e5a290 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:27.503639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51b70827-978f-4aaf-9afe-e262c7315d6a tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.074894 Nov 06 21:10:27.504919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3232/6370] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:27 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:27.518219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6d0f53b0-d842-4ec0-b8e5-ae917f5db80d req-0b5f355f-333a-464c-82bb-fc6c91e5a290 service nova] Creating event network-vif-plugged:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch1-master-1 Nov 06 21:10:27.527351 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6d0f53b0-d842-4ec0-b8e5-ae917f5db80d req-0b5f355f-333a-464c-82bb-fc6c91e5a290 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059784 Nov 06 21:10:27.528283 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3139/6371] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:10:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:10:28.204553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:28.205386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:28.213085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:28.213753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:28.214554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:28.214994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:28.387911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:28.397403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-befb27d3-f13e-4980-adad-0143c7160c4a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.196785 Nov 06 21:10:28.397964 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3233/6372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:28 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:28.515702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:28.516862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:28.524039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:28.524952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:28.525988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:28.526517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:28.569044 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64eec9d3-d01a-49c7-b5a1-988d03d35147 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057348 Nov 06 21:10:28.570135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3140/6373] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:28 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:29.414706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:29.415931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:29.427374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:29.427830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:29.428823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:29.429301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:29.582777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:29.583804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:29.594998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:29.595458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:29.596263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:29.596731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:29.612814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:29.621583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29a44a87-a1a3-4f8f-8e02-76c39d8c14ab tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.210850 Nov 06 21:10:29.623431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3234/6374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:29 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:29.660257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-988cd86d-53e7-4d38-8097-4d110f1a9184 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.081207 Nov 06 21:10:29.661080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3141/6375] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:29 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:30.640661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:30.641915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:30.649722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:30.650287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:30.651154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:30.651659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:30.672966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:30.674166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:30.685078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:30.685544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:30.686342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:30.686781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:30.733808 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4c7438cd-c35c-4d72-be06-f26381dbb87d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.064465 Nov 06 21:10:30.735704 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3142/6376] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:30 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:30.846154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:30.854977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-292fa453-316c-4e10-ae66-7fe2abade54d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.218412 Nov 06 21:10:30.855635 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3235/6377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:30 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:31.746954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:31.747873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:31.754901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:31.755355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:31.756139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:31.756603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:31.803546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5dea9262-4c62-4418-8117-2c09d9df1b2c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.056267 Nov 06 21:10:31.803546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3143/6378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:31 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:31.872084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:31.874629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:31.879614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:31.881097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:31.881889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:31.882327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:32.046397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:32.054924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a86fb827-b214-4d2e-acc7-cbd489754d75 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1724 microversion: 2.1 time: 0.187215 Nov 06 21:10:32.055790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3236/6379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:31 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:32.813536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:32.814772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:32.823012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:32.823620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:32.824540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:32.825081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:32.875882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d65fce4-e9c2-43db-8ff0-c4572316a2eb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.068336 Nov 06 21:10:32.876592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3144/6380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:32 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:33.072989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:33.074176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:33.080764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.081415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.082205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.082913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.230135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:33.238309 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45b48558-e5ba-4aa9-8928-8cba0777a8ba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1701 microversion: 2.1 time: 0.169488 Nov 06 21:10:33.239098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3237/6381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:33 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:33.259412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e95785bd-b43c-4dac-8e29-0bce84b1a083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:33.267342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e95785bd-b43c-4dac-8e29-0bce84b1a083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.267896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e95785bd-b43c-4dac-8e29-0bce84b1a083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.292697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e95785bd-b43c-4dac-8e29-0bce84b1a083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Going to try to start instance {{(pid=134828) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 21:10:33.338272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e95785bd-b43c-4dac-8e29-0bce84b1a083 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 202 len: 0 microversion: 2.1 time: 0.084056 Nov 06 21:10:33.338919 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3145/6382] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:33 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:10:33.349151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:33.349964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:33.357748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.358711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.359756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.360211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.631819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:33.640766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8b20179-a2e8-4482-88f9-401177c0f394 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1710 microversion: 2.1 time: 0.296551 Nov 06 21:10:33.665489 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3238/6383] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:33 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1710 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:33.895061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:33.896286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:33.905319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.906021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.906834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:33.907281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:33.954289 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-329687c5-6531-42e1-8a11-f806ef7d5c5d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.064230 Nov 06 21:10:33.958800 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3146/6384] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:33 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:34.684398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:34.685010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:34.690825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:34.694239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:34.694239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:34.694239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:34.858882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:34.866919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8205842e-f816-4c01-a0a6-92a2ad5bfc00 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1710 microversion: 2.1 time: 0.187654 Nov 06 21:10:34.868333 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3239/6385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:34 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:34.973752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:34.974668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:34.983801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:34.984259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:34.985081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:34.985514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:35.041681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4cfde551-682f-4cc4-818f-6effcd0254ba tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.072257 Nov 06 21:10:35.042695 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3147/6386] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:34 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:35.885739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:35.886346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:35.893015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:35.893467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:35.894249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:35.894678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:36.030070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:36.037985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-960b8f76-aff2-476f-b02c-f43181f0088c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1714 microversion: 2.1 time: 0.156537 Nov 06 21:10:36.038550 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3240/6387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:35 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:36.055264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:36.056319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:36.063655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:36.064111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:36.064939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:36.065379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:36.113526 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50374a49-5415-435d-ae3d-164a5c68c4d5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062905 Nov 06 21:10:36.117388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3148/6388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:36 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:37.125028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:37.126007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:37.147188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:37.147648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:37.148489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:37.149427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:37.206306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3dbafcab-77a1-44cc-8a03-e9c3d44664b7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.085091 Nov 06 21:10:37.211921 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3241/6389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:37 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:38.219464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:38.220894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:38.229360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:38.230079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:38.230862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:38.231332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:38.277715 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73534940-eeec-44b9-9cd0-f77ee79af61f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.063065 Nov 06 21:10:38.278590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3149/6390] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:38 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:39.290877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:39.291859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:39.299178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:39.299657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:39.300780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:39.301227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:39.344427 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46a5e8d4-38c0-403b-8475-614132d6959c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.058510 Nov 06 21:10:39.345071 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3242/6391] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:39 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:40.356710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:40.357713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:40.366987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:40.367485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:40.368279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:40.368823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:40.411942 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cee4b3ba-c3c4-4e69-a559-1ab8bdf1adc4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.058680 Nov 06 21:10:40.415721 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3150/6392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:40 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:41.427033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:41.428826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:41.437596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:41.438279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:41.439075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:41.439507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:41.482053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bce35fa-f056-4260-82c3-4bdd64c51e23 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.058529 Nov 06 21:10:41.482957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3243/6393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:41 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:42.495209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:42.496142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:42.503516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:42.503981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:42.504809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:42.505257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:42.548151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f71abb77-bbde-4ca7-b4a6-de7f41ed79e6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057499 Nov 06 21:10:42.549750 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3151/6394] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:42 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:43.561752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:43.563619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:43.573229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:43.574501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:43.575668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:43.576124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:43.630231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-735140c0-246c-4cc9-aa45-910668bb477d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.073643 Nov 06 21:10:43.634137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3244/6395] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:43 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:44.643428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:44.647101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:44.655801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:44.656266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:44.657085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:44.657699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:44.707712 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c0567ac-fd80-49ec-b85e-9aedb5d8175b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.069208 Nov 06 21:10:44.708673 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3152/6396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:44 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:45.720590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:45.721604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:45.729699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:45.730208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:45.731001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:45.731435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:45.771763 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b306f64c-3290-4a5d-a632-549f6ad772e9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.055029 Nov 06 21:10:45.775739 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3245/6397] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:45 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:46.783827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:46.784864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:46.797271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:46.798027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:46.799194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:46.799647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:46.848522 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01608f43-0a2f-429f-b286-e259723b7a28 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.068474 Nov 06 21:10:46.849187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3153/6398] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:46 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:47.860650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:47.861672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:47.869697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:47.870159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:47.870964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:47.871419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:47.920849 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5875219d-94f4-4929-8c37-ddd393335ad5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.064265 Nov 06 21:10:47.921596 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3246/6399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:47 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:48.933674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:48.934941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:48.942944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:48.943531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:48.944526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:48.945120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:48.991542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbe3d904-e168-4b39-91eb-10744d74e45d tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062469 Nov 06 21:10:48.992980 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3154/6400] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:48 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:50.005655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:50.006741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:50.014950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:50.015504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:50.016399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:50.016936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:50.064649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10764535-2c71-43c8-a5fa-b49a0a9e1acc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062840 Nov 06 21:10:50.065558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3247/6401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:50 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:51.077445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:51.078465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:51.086369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:51.086831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:51.087712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:51.088159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:51.129620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2c8806f-dd5f-452a-92da-9f6217c9f941 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.055794 Nov 06 21:10:51.130169 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3155/6402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:51 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:52.141812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:52.142906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:52.155203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:52.155661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:52.156494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:52.156929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:52.209614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0e4525a-b9b8-4d4b-a8ed-34fe1a055065 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.071884 Nov 06 21:10:52.219412 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3248/6403] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:52 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:53.288086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:53.289751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:53.302952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:53.303427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:53.304884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:53.305437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:53.352212 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0bf9f87-2b8e-477f-a655-2ed4277281d9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.068356 Nov 06 21:10:53.354319 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3156/6404] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:53 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:54.366024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:54.367911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:54.377646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:54.378568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:54.379664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:54.380559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:54.439063 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-453cf518-2b01-4922-af0e-21f26db80f09 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.078796 Nov 06 21:10:54.443124 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3249/6405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:54 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:55.452745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:55.458369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:55.469530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:55.470312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:55.471451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:55.472095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:55.540175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-523fa0c9-f331-44fe-acfd-cf917fa14533 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.092133 Nov 06 21:10:55.541541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3157/6406] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:55 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:56.554003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:56.555042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:56.573768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:56.574230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:56.575043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:56.575490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:56.644493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:56.646452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:56.657998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:56.658649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a277a6c6-e354-457b-8624-123dc10c8ccc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.108597 Nov 06 21:10:56.659086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:56.660080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:56.660757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:56.672761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3250/6407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:56 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:56.734739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a83eaee-f86e-4d5d-a057-ed2df40cb0b8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action" status: 200 len: 24576 microversion: 2.1 time: 0.095259 Nov 06 21:10:56.748988 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3158/6408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:56 2021] POST /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2/action => generated 24576 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:56.994613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2013889024", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "626e6dee-8d5a-490e-b0c2-9e4b3deeaae2"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:57.055642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] validate_networks() for [('626e6dee-8d5a-490e-b0c2-9e4b3deeaae2', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:10:57.569827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:10:57.570395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:10:57.570714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:10:57.571486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:10:57.572235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:10:57.583064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:57.583522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:57.584373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:57.584817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:57.608923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Getting quotas for project f9d79d6bd1d64d35b00654facac911cb. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:10:57.614456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Getting quotas for user 7152903b2ffa43e28d2e556ae0558b20 and project f9d79d6bd1d64d35b00654facac911cb. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:10:57.627421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:10:57.630873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:10:57.671947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:57.674046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:57.682137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:57.682602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:57.683414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:57.683854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:57.697397 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f453f53f-fe34-4a72-ade9-ed4d7da649eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839348 Nov 06 21:10:57.698814 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3251/6409] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:10:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:10:57.709720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf1e1bc6-cc1e-43e5-8dfb-c9ca2533afde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:57.715747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf1e1bc6-cc1e-43e5-8dfb-c9ca2533afde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:57.763936 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-140a15b7-ce7b-42a6-a015-a84ceb7eb3d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.096157 Nov 06 21:10:57.764638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3159/6410] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:57 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:10:57.942762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cf1e1bc6-cc1e-43e5-8dfb-c9ca2533afde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:57.951159 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf1e1bc6-cc1e-43e5-8dfb-c9ca2533afde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1215 microversion: 2.1 time: 0.245811 Nov 06 21:10:57.951947 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3252/6411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:57 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:10:58.780086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:58.782051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:58.792247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:58.793576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:58.794494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:58.795267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:58.850431 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90f77c7e-8807-44f6-8ae1-f6ba481fac96 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.077911 Nov 06 21:10:58.851914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3160/6412] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:58 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:10:58.968687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:10:58.969328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:58.976868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:58.977320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:58.978304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:58.978766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:59.058771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:10:59.066565 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a34d648-303b-4c29-ae5e-933a2040c4cc tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1273 microversion: 2.1 time: 0.101512 Nov 06 21:10:59.067160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3253/6413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:10:58 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:10:59.865052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:10:59.868364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:10:59.878743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:59.879927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:59.881035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:10:59.881921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:10:59.940881 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c1d3a91-5e83-4128-992a-ae5a6a19f796 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.080313 Nov 06 21:10:59.945484 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3161/6414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:10:59 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:00.084587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:00.086226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:00.094037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:00.094797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:00.095850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:00.096674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:00.443188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:00.455514 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b7d4f11-224b-4980-98a3-289468188164 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.375926 Nov 06 21:11:00.456640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3254/6415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:00 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:00.670292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f277913a-90a3-435b-9434-bba6e911d36a req-d3f8e59e-8020-4630-a5e2-02412519b469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87624922-75f3-4162-b674-c7d0f77164a7", "tag": "a32f4399-5934-42ad-8d46-92a6c0555a4f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:00.671941 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:00.671941 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:00.718112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f277913a-90a3-435b-9434-bba6e911d36a req-d3f8e59e-8020-4630-a5e2-02412519b469 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:00.718997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f277913a-90a3-435b-9434-bba6e911d36a req-d3f8e59e-8020-4630-a5e2-02412519b469 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:00.742430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f277913a-90a3-435b-9434-bba6e911d36a req-d3f8e59e-8020-4630-a5e2-02412519b469 service nova] Creating event network-changed:a32f4399-5934-42ad-8d46-92a6c0555a4f for instance 87624922-75f3-4162-b674-c7d0f77164a7 on nch2-master-1 Nov 06 21:11:00.751657 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f277913a-90a3-435b-9434-bba6e911d36a req-d3f8e59e-8020-4630-a5e2-02412519b469 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084543 Nov 06 21:11:00.754181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3162/6416] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:00.955215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:00.956763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:00.965804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:00.967789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:00.969120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:00.969828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:01.041823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f614650c-38d7-43fd-9114-b8a633fbcc49 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.091839 Nov 06 21:11:01.044116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3255/6417] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:00 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:01.475400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:01.476690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:01.488823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:01.489528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:01.490352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:01.490982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:01.735724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:01.749765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b389af9-2a8c-4b65-81ca-c7cd2a91a889 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.280536 Nov 06 21:11:01.755540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3163/6418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:01 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:02.055843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:02.057186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:02.078726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:02.079281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:02.080165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:02.080697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:02.133251 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c1b9bd2-47d0-4ff4-adf7-343f0b994954 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.081591 Nov 06 21:11:02.134697 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3256/6419] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:02 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:02.770569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:02.771124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:02.778599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:02.779053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:02.780044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:02.780540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:03.001373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:03.008815 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1b83f0b8-b8b4-41fc-87b3-a25dd844fef9 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.242404 Nov 06 21:11:03.009761 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3164/6420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:02 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:03.145539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:03.146542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:03.153820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:03.154266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:03.155042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:03.155472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:03.198406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bccf8854-ce14-45d7-a31d-65f64bd2eed1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.054912 Nov 06 21:11:03.198406 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3257/6421] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:03 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:04.025695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:04.026939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:04.033788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:04.034531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:04.035599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:04.036210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:04.208771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:04.209800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:04.217393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:04.217847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:04.218656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:04.219098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:04.261436 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79af71a7-44b6-4a5f-a3f1-d4b0d6d4cfbe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.056464 Nov 06 21:11:04.262299 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3258/6422] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:04 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:11:04.378501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:04.388967 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9b80f56-393e-4dfd-b543-8dab4df59d91 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.367657 Nov 06 21:11:04.398520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3165/6423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:04 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:05.274221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:05.275875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:05.283577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:05.284261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:05.285263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:05.285861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:05.331100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-235ad8be-be7d-4b56-92c4-3328af08e0d6 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.061252 Nov 06 21:11:05.332973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3259/6424] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:05 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:05.405351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:05.408076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:05.417092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:05.418200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:05.419230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:05.420003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:05.586124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:05.594870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-690ff41e-1021-4e89-8923-a14df7a183bd tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.193752 Nov 06 21:11:05.604915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3166/6425] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:05 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:06.343833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:06.345661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:06.353670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:06.354387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:06.355509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:06.356272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:06.409284 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-722eaeb1-2d01-445f-85b1-774022d001e3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.069609 Nov 06 21:11:06.410220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3260/6426] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:06 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:06.613025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:06.613656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:06.626128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:06.626596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:06.627556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:06.627858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:06.805564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:06.813712 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c502e0ff-6b70-442e-8717-46bc47219f34 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.204623 Nov 06 21:11:06.815125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3167/6427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:06 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:07.407140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e3b03202-136f-4c82-abd2-32af8b789a8c req-088c2f9f-d5a6-4254-96bf-c812d2a08a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87624922-75f3-4162-b674-c7d0f77164a7", "name": "network-vif-plugged", "status": "completed", "tag": "a32f4399-5934-42ad-8d46-92a6c0555a4f"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:07.408820 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:07.408820 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:11:07.420518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e3b03202-136f-4c82-abd2-32af8b789a8c req-088c2f9f-d5a6-4254-96bf-c812d2a08a09 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:07.420968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e3b03202-136f-4c82-abd2-32af8b789a8c req-088c2f9f-d5a6-4254-96bf-c812d2a08a09 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:07.424810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:07.426268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:07.432753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:07.433064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e3b03202-136f-4c82-abd2-32af8b789a8c req-088c2f9f-d5a6-4254-96bf-c812d2a08a09 service nova] Creating event network-vif-plugged:a32f4399-5934-42ad-8d46-92a6c0555a4f for instance 87624922-75f3-4162-b674-c7d0f77164a7 on nch2-master-1 Nov 06 21:11:07.433709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:07.434981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:07.435783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:07.438077 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e3b03202-136f-4c82-abd2-32af8b789a8c req-088c2f9f-d5a6-4254-96bf-c812d2a08a09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Nov 06 21:11:07.438690 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3261/6428] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:11:07.496921 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6853c3f0-7a47-44d6-b84d-4bc2d9aa98e0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.076052 Nov 06 21:11:07.500915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3168/6429] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:07 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:07.831357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:07.832087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:07.838775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:07.839269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:07.840053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:07.840702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:07.991649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:08.001789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3ac6f3d-cfbf-469a-a412-2493c1e0bd5c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1315 microversion: 2.1 time: 0.174765 Nov 06 21:11:08.012011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3262/6430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:07 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:08.509721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:08.510753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:08.517956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:08.518412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:08.519253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:08.519691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:08.562693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9eed5d78-aa74-4e11-8786-534852cd8390 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057373 Nov 06 21:11:08.566637 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3169/6431] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:08 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:09.019362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:09.020003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:09.028650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.029214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.030050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.030501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.173771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:09.181564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10e1a74f-d8fc-4b96-a52d-2daeb836fa5b tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1502 microversion: 2.1 time: 0.166028 Nov 06 21:11:09.182138 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3263/6432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:09 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:09.198918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:09.199841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:09.207342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.208387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.209281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.210493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.362256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:09.370693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbe6887b-79bd-4b5e-85cd-3db52cdf5fb6 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1502 microversion: 2.1 time: 0.176841 Nov 06 21:11:09.371442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3170/6433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:09 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:09.387226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:09.387763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:09.394227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.394898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.395699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.396135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.424848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lazy-loading 'flavor' on Instance uuid 87624922-75f3-4162-b674-c7d0f77164a7 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:11:09.501709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e80002fa-3747-41ad-8053-47f23e62d8af tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action" status: 202 len: 0 microversion: 2.1 time: 0.117914 Nov 06 21:11:09.505333 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3264/6434] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:09 2021] POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:09.513153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:09.513809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:09.539100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.540517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.542029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.542412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.578792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:09.579822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:09.587038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.587495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.588322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:09.588938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:09.631009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ec8c70f-fb85-4660-99a0-8c3325d83aed tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057637 Nov 06 21:11:09.632500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3265/6435] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:09 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:09.757594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:09.765283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e933dff-d3a6-4237-9cdb-ad69e6a73e6c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1510 microversion: 2.1 time: 0.258595 Nov 06 21:11:09.765960 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3171/6436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:09 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:10.643975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:10.645030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:10.652702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:10.653387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:10.654180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:10.654620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:10.697560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87009ed9-6a24-4429-b7b2-eecf9c34b3e1 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.057533 Nov 06 21:11:10.698904 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3266/6437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:10 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:10.782274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:10.783024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:10.789833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:10.790293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:10.791084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:10.791770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.006165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:11.017101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10026d35-96d2-4e92-8adb-ea6ae8b3be01 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1493 microversion: 2.1 time: 0.238548 Nov 06 21:11:11.031913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3172/6438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:10 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1493 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:11.035671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:11.036330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:11.071762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.072223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.073128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.073756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.151909 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3aec7481-fcd9-4e71-8e9c-737dfe94dbce tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action" status: 202 len: 0 microversion: 2.1 time: 0.119823 Nov 06 21:11:11.155243 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3267/6439] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:11 2021] POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:11:11.168800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:11.169653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:11.179018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.179836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.181975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.182881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.526712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:11.539347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6a9233e-0e09-4efd-9040-b68a94d68a92 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1499 microversion: 2.1 time: 0.375343 Nov 06 21:11:11.540108 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3173/6440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:11 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1499 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:11.711989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:11.713291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:11.723347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.723920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.724749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:11.725187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:11.778479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99f63d18-b0a6-47b7-a3c3-2689cd4c269f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.071860 Nov 06 21:11:11.780373 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3268/6441] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:11 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:12.557981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:12.558599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:12.567956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:12.568556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:12.569394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:12.569838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:12.792077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:12.793842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:12.801958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:12.802529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:12.803423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:12.803961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:12.809304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:12.819685 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76d9a70b-6186-4255-ba36-6cde8eee4e3c tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1499 microversion: 2.1 time: 0.265595 Nov 06 21:11:12.821327 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3174/6442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:12 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:12.856906 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcc8af46-521c-4267-9805-92bdf305df97 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.069458 Nov 06 21:11:12.857558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3269/6443] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:12 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:11:13.836960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:13.837546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:13.844955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:13.845415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:13.846215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:13.846658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:13.892916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:13.894709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:13.902682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:13.903227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:13.904096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:13.904773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:13.950295 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-943cc736-6817-44cd-afa1-4aab66e675a2 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.079878 Nov 06 21:11:13.954378 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3270/6444] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:13 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:14.110586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:14.118559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f13e8a95-bb23-4a49-b13a-e15aa1f51671 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1502 microversion: 2.1 time: 0.285283 Nov 06 21:11:14.119143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3175/6445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:13 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:14.136767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:14.137640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:14.144982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.145441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:14.148529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.148970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:14.178324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lazy-loading 'flavor' on Instance uuid 87624922-75f3-4162-b674-c7d0f77164a7 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:11:14.261221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1480d895-aff5-4679-aea6-b555adc209d5 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action" status: 202 len: 0 microversion: 2.1 time: 0.129106 Nov 06 21:11:14.262505 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3271/6446] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:14 2021] POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:11:14.279932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:14.280885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:14.286908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.289139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:14.290910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.291808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:14.524050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:14.535038 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fde88ae3-1e21-44dd-9988-2cb256971de4 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1510 microversion: 2.1 time: 0.258710 Nov 06 21:11:14.543131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3176/6447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:14 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:14.962699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:14.963720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:14.972097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.972619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:14.973459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:14.974096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.021721 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcaf6c52-b7c7-40f9-8d18-510e2af087cb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062801 Nov 06 21:11:15.022534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3272/6448] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:14 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:15.552736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:15.553866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:15.561298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.562103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.563066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.563616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.810916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:15.818966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3f9f444-48ba-4751-882c-ae58b31e30eb tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1493 microversion: 2.1 time: 0.270011 Nov 06 21:11:15.819680 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3177/6449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:15 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1493 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:15.836657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:15.837595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:15.845580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.846343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.854447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.854897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.931480 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2044accf-e99f-4103-b4ca-f311f4567cde tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action" status: 202 len: 0 microversion: 2.1 time: 0.098584 Nov 06 21:11:15.932035 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3273/6450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:15 2021] POST /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:15.940030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:15.940655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:15.946741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.947104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:15.947897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:15.948357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:16.033766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:16.035714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:16.044405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:16.045163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:16.046317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:16.046974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:16.092905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-179a0284-3d86-417b-a62e-48871b9c12a9 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062159 Nov 06 21:11:16.094169 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3274/6451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:16 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:16.268048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:16.281775 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56832697-ea30-43dc-a34c-5afa87bbed08 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1499 microversion: 2.1 time: 0.345087 Nov 06 21:11:16.282130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3178/6452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:15 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1499 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:17.105920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:17.107490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:17.116368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:17.117046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:17.118158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:17.119090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:17.163585 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-988265d4-c406-4b26-995c-9ee0278ba5bd tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.061906 Nov 06 21:11:17.167868 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3275/6453] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:17 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:17.299557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:17.300185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:17.307788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:17.308250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:17.309214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:17.309529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:17.444207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:17.451726 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fd894f5-ad4a-48b9-b5e5-58f719b3c294 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1499 microversion: 2.1 time: 0.155941 Nov 06 21:11:17.452309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3179/6454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:17 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:18.175900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:18.176923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:18.184334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.184798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.185562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.186173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.228645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be315960-a94d-4b74-9ee4-cbae138305d3 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.056899 Nov 06 21:11:18.230586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3276/6455] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:18 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:18.468925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:18.469639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:18.477479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.478062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.479137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.479791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.649692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:18.658512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b058c39d-f2c5-4586-946a-08a50a067875 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1502 microversion: 2.1 time: 0.193300 Nov 06 21:11:18.659870 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3180/6456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:18 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:18.676817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:18.677583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:18.686251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.686791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.687763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.688215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.727145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:11:18.815596 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-222f941e-76d4-4fcc-b805-0d06bd950b0e tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 204 len: 0 microversion: 2.1 time: 0.142514 Nov 06 21:11:18.816520 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3277/6457] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:11:18 2021] DELETE /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:11:18.825930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:18.825930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:18.832054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.832773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.834159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:18.834700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:18.979789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:18.996607 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0eabad45-9f53-4950-937c-e6fafce18471 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1508 microversion: 2.1 time: 0.175551 Nov 06 21:11:18.997364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3181/6458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:18 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:19.241609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:19.244314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:19.251428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:19.252265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:19.253458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:19.254142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:19.299215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7428f7a1-f465-456d-b132-3b17aa63463e tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.062101 Nov 06 21:11:19.300237 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3278/6459] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:19 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:19.467855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:19.468517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:19.476311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:19.477644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:19.478482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:19.478932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:19.636461 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59ac2498-6faa-4d9a-850d-e81ab16f1ffc tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1831 microversion: 2.1 time: 0.172601 Nov 06 21:11:19.637130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3182/6460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:19 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1831 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:20.014335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:20.015473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:20.023745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.024589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.025411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.025849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.311528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:20.312872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:20.317940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:20.319764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.320553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.321695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.322479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.327006 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-046c50ed-9690-47c1-b803-70787e2198f7 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1508 microversion: 2.1 time: 0.316700 Nov 06 21:11:20.327590 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3279/6461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:20 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:20.370729 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b949ca7-c1c2-413f-90e1-e438e9e85206 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.063386 Nov 06 21:11:20.372115 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3183/6462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:20 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:11:20.700249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:20.700884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:20.704645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6d8546eb-811e-4c26-88ab-e57c4db8b6f3 req-c5f7b3b2-62ef-41d6-b07b-e0c15fe4aa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:20.706578 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:20.706578 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:20.716329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.716999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.718023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.718630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.722335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d8546eb-811e-4c26-88ab-e57c4db8b6f3 req-c5f7b3b2-62ef-41d6-b07b-e0c15fe4aa15 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.722795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6d8546eb-811e-4c26-88ab-e57c4db8b6f3 req-c5f7b3b2-62ef-41d6-b07b-e0c15fe4aa15 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.748315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6d8546eb-811e-4c26-88ab-e57c4db8b6f3 req-c5f7b3b2-62ef-41d6-b07b-e0c15fe4aa15 service nova] Creating event network-changed:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch1-master-1 Nov 06 21:11:20.762439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6d8546eb-811e-4c26-88ab-e57c4db8b6f3 req-c5f7b3b2-62ef-41d6-b07b-e0c15fe4aa15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061950 Nov 06 21:11:20.763066 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3184/6463] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:11:20.765110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:11:20.890008 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fda80ed-b563-4d2f-b9b3-64a1d3f16998 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 204 len: 0 microversion: 2.1 time: 0.193304 Nov 06 21:11:20.891579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3280/6464] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:11:20 2021] DELETE /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:11:20.900463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:20.901184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:20.908952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.909578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:20.910408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:20.910854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:21.345858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:21.347244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:21.367573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:21.368191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:21.369544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:21.369987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:21.659581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:21.672724 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1bcd4334-1015-4d1a-bb5c-77c885ee51e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1686 microversion: 2.1 time: 0.776837 Nov 06 21:11:21.673627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3185/6465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:20 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1686 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:21.679270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:21.680666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:21.688505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:21.690072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:21.691316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:21.692246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:21.757658 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e0e898a6-c4fa-42a6-a9ae-6ce5c21439ad tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.082571 Nov 06 21:11:21.758895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3186/6466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:21 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:21.970403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152903b2ffa43e28d2e556ae0558b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d79d6bd1d64d35b00654facac911cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:21.979854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08cd0051-3a70-4cd1-999c-f5989e76f8f2 tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 200 len: 1508 microversion: 2.1 time: 0.639731 Nov 06 21:11:21.981947 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3281/6467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:21 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:22.692633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:22.693803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:22.704918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:22.705732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:22.706931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:22.707635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:22.774475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:22.776724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:22.786672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:22.786996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:22.788449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:22.788995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:22.837462 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-305618fb-34bf-4d90-9ffa-d4c2c667d0f5 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.071654 Nov 06 21:11:22.839242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3282/6468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:22 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:11:22.846936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2302f0b0-6a6f-4b4f-946c-a35f2261c9e0 req-48f9c304-b1c6-441c-8702-068fae03da76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87624922-75f3-4162-b674-c7d0f77164a7", "name": "network-vif-deleted", "tag": "a32f4399-5934-42ad-8d46-92a6c0555a4f"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:22.848967 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:22.848967 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:11:22.859644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2302f0b0-6a6f-4b4f-946c-a35f2261c9e0 req-48f9c304-b1c6-441c-8702-068fae03da76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:22.860095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2302f0b0-6a6f-4b4f-946c-a35f2261c9e0 req-48f9c304-b1c6-441c-8702-068fae03da76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:22.879566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2302f0b0-6a6f-4b4f-946c-a35f2261c9e0 req-48f9c304-b1c6-441c-8702-068fae03da76 service nova] Creating event network-vif-deleted:a32f4399-5934-42ad-8d46-92a6c0555a4f for instance 87624922-75f3-4162-b674-c7d0f77164a7 on nch2-master-1 Nov 06 21:11:22.885904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2302f0b0-6a6f-4b4f-946c-a35f2261c9e0 req-48f9c304-b1c6-441c-8702-068fae03da76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046327 Nov 06 21:11:22.886974 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3283/6469] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:22.955058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:22.963322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83e2980b-ce6b-4ccd-8d5b-38e03ce29332 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 200 len: 1567 microversion: 2.1 time: 0.276055 Nov 06 21:11:22.968647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3187/6470] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:22 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:22.998356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:22.999127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] [instance: 87624922-75f3-4162-b674-c7d0f77164a7] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:23.006420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.006955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:23.008011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.008550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:23.316084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] HTTP exception thrown: Instance 87624922-75f3-4162-b674-c7d0f77164a7 could not be found. Nov 06 21:11:23.316084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] Returning 404 to user: Instance 87624922-75f3-4162-b674-c7d0f77164a7 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:11:23.316084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-363eb5ae-4556-4a1a-bb86-4682762e648d tempest-TestServerAdvancedOps-601540318 tempest-TestServerAdvancedOps-601540318-project] 10.222.0.13 "GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7" status: 404 len: 111 microversion: 2.1 time: 0.321295 Nov 06 21:11:23.316084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3284/6471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:22 2021] GET /compute/v2.1/servers/87624922-75f3-4162-b674-c7d0f77164a7 => generated 111 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:11:23.849456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:23.850942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:23.861330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.862313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:23.863347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.863999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:23.919886 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96efd5dc-a8f9-404e-9e8e-6db332403fb0 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.073890 Nov 06 21:11:23.923902 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3188/6472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:23 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:23.981349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:23.982530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 80602dc6-0eb8-4ea7-b115-90f0e169f6f2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:23.990345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.990823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:23.991606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:23.992056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:24.005055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] HTTP exception thrown: Instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 could not be found. Nov 06 21:11:24.005732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Returning 404 to user: Instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:11:24.007286 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e035478e-fc28-46a9-b891-7bd1fe5a4dc3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2" status: 404 len: 111 microversion: 2.1 time: 0.029740 Nov 06 21:11:24.007812 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3285/6473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:23 2021] GET /compute/v2.1/servers/80602dc6-0eb8-4ea7-b115-90f0e169f6f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:11:24.904257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4cf6842f-2048-41e7-9481-b46f0216c8b0 req-24eeb18e-3c8b-47af-9c98-9368a81f3e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80602dc6-0eb8-4ea7-b115-90f0e169f6f2", "name": "network-vif-deleted", "tag": "e54de641-10b2-4742-b876-dbb61f65c926"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:24.906549 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:24.906549 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:24.918322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4cf6842f-2048-41e7-9481-b46f0216c8b0 req-24eeb18e-3c8b-47af-9c98-9368a81f3e75 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:24.919070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4cf6842f-2048-41e7-9481-b46f0216c8b0 req-24eeb18e-3c8b-47af-9c98-9368a81f3e75 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:24.932211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:24.934227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:24.953451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:24.953917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:24.954759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:24.955230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:24.960884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4cf6842f-2048-41e7-9481-b46f0216c8b0 req-24eeb18e-3c8b-47af-9c98-9368a81f3e75 service nova] Creating event network-vif-deleted:e54de641-10b2-4742-b876-dbb61f65c926 for instance 80602dc6-0eb8-4ea7-b115-90f0e169f6f2 on nch1-master-1 Nov 06 21:11:24.965191 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4cf6842f-2048-41e7-9481-b46f0216c8b0 req-24eeb18e-3c8b-47af-9c98-9368a81f3e75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066172 Nov 06 21:11:24.966302 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3189/6474] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:24.998789 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8c330fb-c081-41f7-bb47-6b148cdc73a7 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.070691 Nov 06 21:11:25.003287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3286/6475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:24 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:26.012871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:26.014455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:26.021324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:26.022084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:26.022821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:26.023426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:26.066315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ceab3be3-ce46-461e-9d48-531aff5813de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.058265 Nov 06 21:11:26.067975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3190/6476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:26 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:27.079942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:27.082245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:27.096453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:27.099216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:27.105706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:27.106949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:27.189699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b345774-7815-4fb9-ab0f-260f41e16d26 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.113606 Nov 06 21:11:27.195495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3287/6477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:27 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:28.203142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:28.206289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:28.231288 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:11:28.231440 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:11:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action (ip 10.222.0.13) !!! Nov 06 21:11:28.252846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:28.253469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:28.254531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:28.259749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:28.269335 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:11:28.269533 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:11:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action (ip 10.222.0.13) !!! Nov 06 21:11:28.353862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a9d4bd6-dcc6-47f6-ae69-e1bcc2c02548 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.155318 Nov 06 21:11:28.356465 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3191/6478] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:28 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:28.635166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba2b0a81-0105-4880-a51c-1d398351a744 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '.version_select at 0x7f6707e5dc10>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:28.682341 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba2b0a81-0105-4880-a51c-1d398351a744 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1407222739" status: 202 len: 0 microversion: 2.1 time: 0.050781 Nov 06 21:11:28.683046 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3288/6479] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Nov 6 21:11:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1407222739 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:28.715526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: .version_select at 0x7f671ad855e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1717002790"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:28.759658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:28.768965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:29.007122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:29.014519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:29.035559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4a47d9a-89e9-4614-953c-6ed2782dca6a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.326736 Nov 06 21:11:29.036341 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3192/6480] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:11:28 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:29.390271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:29.393229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:29.409280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:29.409753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:29.410574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:29.411069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:29.464819 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2da04e22-8184-4c94-b605-1b6525231175 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.101188 Nov 06 21:11:29.469900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3289/6481] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:29 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:30.476220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:30.478203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:30.492666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:30.493128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:30.494043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:30.494364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:30.576410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49376afe-437f-40e1-b86b-f22e71ac98de tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.103726 Nov 06 21:11:30.580694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3193/6482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:30 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:31.594998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:31.599764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:31.613893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:31.616193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:31.617269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:31.618186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:31.705306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eab08972-ed18-45f3-8867-e8fbba827f51 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.116191 Nov 06 21:11:31.709814 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3290/6483] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:31 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:32.717391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:32.718409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:32.737220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:32.737680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:32.743326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:32.743793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:32.825203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc92e091-d7d8-4853-a6bc-654dea92bfdb tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.111583 Nov 06 21:11:32.826318 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3194/6484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:32 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:33.839673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:33.842181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:33.861439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:33.862192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:33.863492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:33.864148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:33.941418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97a4527b-6ace-4891-9fcf-12b28c580776 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.108161 Nov 06 21:11:33.947705 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3291/6485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:33 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:34.955541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:34.958165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:34.999106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:35.002339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:35.003509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:35.009887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:35.091278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb803c67-1eaf-43d3-a242-181dc28b5be4 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.140392 Nov 06 21:11:35.091878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3195/6486] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:34 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:36.106258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:36.107947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:36.118707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:36.119430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:36.120920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:36.121643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:36.178579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-534aba1d-c866-476f-9a62-d04cafce3124 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.077365 Nov 06 21:11:36.179909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3292/6487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:36 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:37.193617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:37.195254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:37.211340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:37.213386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:37.214250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:37.215856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:37.285968 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1244dfb-f044-4a4c-b33c-19a5a1c6b973 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.097099 Nov 06 21:11:37.291457 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3196/6488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:37 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:37.980785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-533511313", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "bb2e62fb-e870-4edd-9094-f836bea889e4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1717002790", "security_groups": [{"name": "tempest-secgroup-smoke-506144202"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:38.302090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:38.304218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:38.314729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:38.316393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:38.317405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:38.318074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:38.369550 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5dd82f5-5c4f-4824-8406-85d4df29dc9f tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 32638 microversion: 2.1 time: 0.072658 Nov 06 21:11:38.370966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3197/6489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:38 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:38.437599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] validate_networks() for [('bb2e62fb-e870-4edd-9094-f836bea889e4', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:11:39.088146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:39.089131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:39.102899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.103922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.105330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.106296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.379545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:11:39.381166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:11:39.381891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:11:39.382312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:11:39.382735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:11:39.397063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.400153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.402919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.403382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.449654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lazy-loading 'services' on Instance uuid 8565783d-e8fd-4786-9848-138d58914019 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:11:39.458769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:39.470206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:39.486536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:11:39.491341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:11:39.599548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afc850c5-4770-4d6a-b654-944d6de16ce6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.628454 Nov 06 21:11:39.601478 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3293/6490] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:11:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:11:39.608234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:39.610414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:39.651898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.652807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.652927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments/5922c86c-184f-4d10-9008-1de074a050e6" status: 202 len: 0 microversion: 2.1 time: 0.561993 Nov 06 21:11:39.656652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.657506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.669672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3198/6491] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:11:39 2021] DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments/5922c86c-184f-4d10-9008-1de074a050e6 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:39.680345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07395981-1849-44ae-afa5-694dc2082655 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:39.690192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07395981-1849-44ae-afa5-694dc2082655 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:39.774586 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef49725a-9886-472a-b677-20d157265227 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action" status: 200 len: 40793 microversion: 2.1 time: 0.171468 Nov 06 21:11:39.775969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3294/6492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:39 2021] POST /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779/action => generated 40793 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:11:39.800881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:39.803273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:39.811360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.812265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.813349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:39.814015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:39.844382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07395981-1849-44ae-afa5-694dc2082655 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:39.854677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07395981-1849-44ae-afa5-694dc2082655 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1266 microversion: 2.1 time: 0.182389 Nov 06 21:11:39.864043 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3199/6493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:39 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:40.262954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:40.293142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcd16bc3-d792-4e7a-8321-cbdea3148e2b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1710 microversion: 2.1 time: 0.509228 Nov 06 21:11:40.309295 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3295/6494] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:39 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1710 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:40.884708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:40.885503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:40.898915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:40.913703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:40.915584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e160edb9-0816-4295-a6a6-fc99f80a07cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:40.917299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:40.917761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:40.928946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e160edb9-0816-4295-a6a6-fc99f80a07cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:40.929709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e160edb9-0816-4295-a6a6-fc99f80a07cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:40.985866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e160edb9-0816-4295-a6a6-fc99f80a07cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Going to try to stop instance {{(pid=134827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:11:41.090378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:41.096277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e160edb9-0816-4295-a6a6-fc99f80a07cf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 202 len: 0 microversion: 2.1 time: 0.183941 Nov 06 21:11:41.096277 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3296/6495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:40 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:41.099408 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a0a4ab1-73be-408b-aa43-bfa126868d57 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1262 microversion: 2.1 time: 0.219568 Nov 06 21:11:41.099990 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3200/6496] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:40 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1262 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:41.105999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:41.109623 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:41.109623 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:11:41.112682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:41.116193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:41.117499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:41.118707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Searching by: {'deleted': False, 'project_id': '2f47922bfda043499f1554d9db0bc00c'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:11:41.132787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.147617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.151897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.152780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.157476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.160720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.162136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.163028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.194411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:11:41.267862 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79ed068a-d2b0-46ea-bf51-15167ca9766b tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.168782 Nov 06 21:11:41.271954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3297/6497] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:11:41 2021] GET /compute/v2.1/servers => generated 340 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:11:41.301678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:41.313481 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:41.313481 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:11:41.314658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:41.322198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Searching by: {'deleted': False, 'project_id': '2f47922bfda043499f1554d9db0bc00c'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:11:41.328044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.328788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.329769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.330531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.363608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:11:41.417564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:41.426899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:41.428275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:41.711380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:41.723277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3f91413-e490-45b2-9323-7d90b36be1e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 0.617121 Nov 06 21:11:41.726076 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3201/6498] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:41 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:41.948793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Action: 'create', calling method: .version_select at 0x7f6715453280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-271288739"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:41.992159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:42.007001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for user 4efbaa05ffa1428e91caa26d9b1ebe05 and project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:42.020239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd068317-7b90-44a6-a15d-c5e8d490e281 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.730912 Nov 06 21:11:42.021003 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3298/6499] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:11:41 2021] GET /compute/v2.1/servers/detail => generated 1713 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:42.042938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49bfb87d-5757-4529-9aa5-c5344be5dc80 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:42.056178 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49bfb87d-5757-4529-9aa5-c5344be5dc80 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017960 Nov 06 21:11:42.057388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3299/6500] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Nov 6 21:11:42 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:42.126844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:42.127847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:42.136798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.137616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.138694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.139307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.305748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:42.314803 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d7c22b1-8cdd-40f7-abd1-9af1f888af8e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1324 microversion: 2.1 time: 0.199067 Nov 06 21:11:42.316481 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3300/6501] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:42 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1324 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:42.447594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:42.460707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for user 4efbaa05ffa1428e91caa26d9b1ebe05 and project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:42.494138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e0b70e4-c256-4a26-aded-e5de0c11999b tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.766779 Nov 06 21:11:42.495007 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3202/6502] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:11:41 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:42.526413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:42.527011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:42.537993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.542464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.543451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.543949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.600657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:11:42.741844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:42.742868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:42.754901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.757034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.759146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.759277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.817498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dcbec6a0-afa5-455b-8bcb-2f6b9656f530 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 204 len: 0 microversion: 2.1 time: 0.296738 Nov 06 21:11:42.819083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3301/6503] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:11:42 2021] DELETE /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:11:42.831211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:42.832226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:42.849884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.850346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:42.853641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:42.855850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:43.561865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:43.578636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39b1c34d-04cb-4ea3-9781-cecf9ff494d1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 0.836978 Nov 06 21:11:43.579373 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3203/6504] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:42 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:43.593985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:43.598804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:43.608184 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3db41d40-2c69-4e0b-bb64-d1016fd63396 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1716 microversion: 2.1 time: 0.781324 Nov 06 21:11:43.615812 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3302/6505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:42 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1716 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:43.628116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:43.635030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:43.635658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:43.637004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:43.640831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:43.903481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:43.913328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8327837-5fea-4f13-afcd-ee760bb2e054 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1324 microversion: 2.1 time: 0.322906 Nov 06 21:11:43.918344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3204/6506] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:43 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:44.596254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:44.597018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:44.605226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:44.605910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:44.606345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:44.606797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:44.634346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:44.634944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:44.666826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:44.672894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:44.676139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:44.676811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:45.779163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:45.784478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:45.793129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5134dad5-be53-44f9-9099-97a2b9fcae27 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 1.200663 Nov 06 21:11:45.793699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f05d0158-79a6-48de-bfd3-19cff96c75fc tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1716 microversion: 2.1 time: 1.165568 Nov 06 21:11:45.794641 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3205/6507] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:44 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1716 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:45.799123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:45.799638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3303/6508] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:44 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:45.799763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:45.804543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-684300590", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-271288739", "security_groups": [{"name": "tempest-secgroup-smoke-1147950138"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "346fa48e-d19b-41a3-a405-c0c564390c77"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:45.805924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:45.806392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:45.807199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:45.807646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:46.090168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] validate_networks() for [('346fa48e-d19b-41a3-a405-c0c564390c77', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:11:46.444188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:46.454125 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87151205-97fb-46f6-8c79-95499bd001a2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.658324 Nov 06 21:11:46.454719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3206/6509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:45 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:46.812398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:46.813654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:46.823728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:46.824180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:46.826329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:46.826808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:46.930129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:46.938202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-182b4322-ac25-4ebc-a87c-35b3687dfebe tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1649 microversion: 2.1 time: 0.130760 Nov 06 21:11:46.939110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3207/6510] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:46 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1649 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:46.945052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:46.945672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:46.953562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:46.954029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:46.956077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:46.956564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.700687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:47.714653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for user 4efbaa05ffa1428e91caa26d9b1ebe05 and project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: dict_keys(['metadata_items']) {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:47.749246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:11:47.749678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:11:47.750167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:11:47.750655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:11:47.756034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:11:47.767720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.768619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.769806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.770420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.782006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:47.798885 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e9e28eb-ff7f-4ffb-9131-f3e285a93f7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 0.858375 Nov 06 21:11:47.802199 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3208/6511] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:46 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:47.821560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:11:47.823155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-90bdc14c-ec2d-4523-b9db-283a1113fa0e req-50dc635d-6009-4343-8ef6-db1b4a85ec07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c47cf6b-e137-45f8-b4d2-bf6aef3ef779", "name": "network-vif-deleted", "tag": "dbb2910c-cfb7-477f-8b50-e894e660bcdb"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:47.829098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Getting quotas for user 4efbaa05ffa1428e91caa26d9b1ebe05 and project 7e7bb72df2e54f4aa72356d80aae9d38. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:11:47.845793 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:47.845793 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:47.852620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:11:47.855577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:11:47.875452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-90bdc14c-ec2d-4523-b9db-283a1113fa0e req-50dc635d-6009-4343-8ef6-db1b4a85ec07 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.877301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-90bdc14c-ec2d-4523-b9db-283a1113fa0e req-50dc635d-6009-4343-8ef6-db1b4a85ec07 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.898753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-90bdc14c-ec2d-4523-b9db-283a1113fa0e req-50dc635d-6009-4343-8ef6-db1b4a85ec07 service nova] Creating event network-vif-deleted:dbb2910c-cfb7-477f-8b50-e894e660bcdb for instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 on nch1-master-1 Nov 06 21:11:47.905527 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-90bdc14c-ec2d-4523-b9db-283a1113fa0e req-50dc635d-6009-4343-8ef6-db1b4a85ec07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101802 Nov 06 21:11:47.906826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3209/6512] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:47.916840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:47.918901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:47.925788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.926557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.927638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.928717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.957023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd5c21ae-5092-41a2-8eca-09029023c8fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.154995 Nov 06 21:11:47.961234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3304/6513] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:11:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:11:47.969067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:47.971634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:47.980703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.981678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:47.982650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:47.983250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:48.075984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:48.076636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:48.077260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lazy-loading 'fault' on Instance uuid 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:11:48.248938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a1f3d37b604a3b8c2bcc68d4b2cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f47922bfda043499f1554d9db0bc00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:48.263990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61ccfa5a-5e49-45c5-a9ef-a9ef1be2322c tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 200 len: 1368 microversion: 2.1 time: 0.297024 Nov 06 21:11:48.265153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3305/6514] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:47 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:48.285502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8198f387-61de-473f-99b1-19ea42d96885 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:48.286600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8198f387-61de-473f-99b1-19ea42d96885 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:48.344989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:48.354808 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e4589a0-62bc-4c79-9cb5-bc80dd417a32 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.446297 Nov 06 21:11:48.358212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3210/6515] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:47 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:48.383641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8198f387-61de-473f-99b1-19ea42d96885 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:48.391994 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8198f387-61de-473f-99b1-19ea42d96885 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1301 microversion: 2.1 time: 0.119497 Nov 06 21:11:48.394279 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3306/6516] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:48 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:48.825319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:48.826277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:48.837752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:48.838501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:48.841108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:48.842378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.011837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:49.021664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61411a48-b063-45a6-be38-9432e85cfc54 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 0.206952 Nov 06 21:11:49.022217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3211/6517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:48 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:49.282348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:49.283937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] [instance: 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:49.292397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.292834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.293696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.294136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.310466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] HTTP exception thrown: Instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 could not be found. Nov 06 21:11:49.311392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Returning 404 to user: Instance 6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:11:49.312445 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bf66436-b812-4c36-b3b4-e98e2605f7ab tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779" status: 404 len: 111 microversion: 2.1 time: 0.034106 Nov 06 21:11:49.313548 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3307/6518] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:49 2021] GET /compute/v2.1/servers/6c47cf6b-e137-45f8-b4d2-bf6aef3ef779 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:11:49.321817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3fe8521-e41f-4fc5-9de7-fe1123be8650 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] Calling method '.version_select at 0x7f6715422820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:49.342625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3fe8521-e41f-4fc5-9de7-fe1123be8650 tempest-ServersTestManualDisk-1559396683 tempest-ServersTestManualDisk-1559396683-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181306452" status: 202 len: 0 microversion: 2.1 time: 0.024857 Nov 06 21:11:49.343231 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3212/6519] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:11:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181306452 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:49.379810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:49.380539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:49.393924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.394391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.395210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.396183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.410423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:49.410977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:49.423586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.425739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.427774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.429502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.642290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:49.653580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3472903-e7a3-469b-aee9-6449e765c226 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1361 microversion: 2.1 time: 0.247279 Nov 06 21:11:49.657097 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3213/6520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:49 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:49.805646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:49.819751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-abc7e3ff-ffba-4701-b636-d1252f527d18 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.448289 Nov 06 21:11:49.820427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3308/6521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:49 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:49.925828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-482f17ef-c35b-48d2-806e-e28779768693 req-91fc7dae-6840-4ee1-b566-badd6220ccb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:49.929063 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:49.929063 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:49.947778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-482f17ef-c35b-48d2-806e-e28779768693 req-91fc7dae-6840-4ee1-b566-badd6220ccb9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:49.948628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-482f17ef-c35b-48d2-806e-e28779768693 req-91fc7dae-6840-4ee1-b566-badd6220ccb9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:49.977778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-482f17ef-c35b-48d2-806e-e28779768693 req-91fc7dae-6840-4ee1-b566-badd6220ccb9 service nova] Creating event network-changed:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:11:50.006987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-482f17ef-c35b-48d2-806e-e28779768693 req-91fc7dae-6840-4ee1-b566-badd6220ccb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066233 Nov 06 21:11:50.008794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3214/6522] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:50.045232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:50.046107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:50.054740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.055467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.056853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.059443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.675829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:50.676712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:50.683361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:50.688083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.688766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.691808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.693735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.703248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9741893-bc18-4979-94fd-41a301555d50 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1678 microversion: 2.1 time: 0.664230 Nov 06 21:11:50.704650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3309/6523] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:50 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1678 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:50.836796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:50.838291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:50.847766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.850507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.851366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:50.854215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:50.855100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:50.883491 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-720dbb5a-2d13-45a9-b26c-235a041208a5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1359 microversion: 2.1 time: 0.212755 Nov 06 21:11:50.885390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3215/6524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:50 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:51.203877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:51.215618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1bee810-2002-48e8-af5a-8ef402983261 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.382450 Nov 06 21:11:51.216211 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3310/6525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:50 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:51.722359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:51.723052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:51.735246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:51.737215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:51.745710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:51.746582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:51.900196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:51.901043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:51.913544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:51.914124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:51.916541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:51.919644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:52.049372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:52.061765 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed12e589-ff26-4ce7-86bd-db1ad4751611 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1655 microversion: 2.1 time: 0.341409 Nov 06 21:11:52.062379 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3216/6526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:51 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1655 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:52.088194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92f72498-4fde-4376-92d3-77e7595b2061 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:52.094735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f72498-4fde-4376-92d3-77e7595b2061 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:52.095209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92f72498-4fde-4376-92d3-77e7595b2061 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:52.129624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92f72498-4fde-4376-92d3-77e7595b2061 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Going to try to start instance {{(pid=134828) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 21:11:52.236897 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92f72498-4fde-4376-92d3-77e7595b2061 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action" status: 202 len: 0 microversion: 2.1 time: 0.157622 Nov 06 21:11:52.237527 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3217/6527] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:11:52 2021] POST /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:11:52.276142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:52.276923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:52.304761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:52.305286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:52.308951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:52.310676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:52.705072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:52.716119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4c06f3c-4d0b-47e5-9b76-b00a8688fdd6 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.816597 Nov 06 21:11:52.722232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3311/6528] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:51 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:52.748353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:52.755018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:52.783229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:52.787636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:52.793182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:52.798486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:53.091841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:53.101701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fec61ec-46dd-4498-8524-2da3118c73a1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.859195 Nov 06 21:11:53.103038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3218/6529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:52 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:53.313831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:53.324040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff9d90fd-4989-4249-9e02-5a4f68a352bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1664 microversion: 2.1 time: 0.594888 Nov 06 21:11:53.325112 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3312/6530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:52 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1664 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:53.414504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f1883754-cb9a-408b-b2b7-81da8c441cb2 req-18c1eeec-3728-4ce4-a1b2-0f0011f26c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed037684-51f8-4762-9f7e-04784883f269", "tag": "8a928c32-e301-4df3-9dd3-df2f9da3fdc0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:53.416944 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:53.416944 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:11:53.428325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f1883754-cb9a-408b-b2b7-81da8c441cb2 req-18c1eeec-3728-4ce4-a1b2-0f0011f26c7e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:53.436712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f1883754-cb9a-408b-b2b7-81da8c441cb2 req-18c1eeec-3728-4ce4-a1b2-0f0011f26c7e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:53.466467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f1883754-cb9a-408b-b2b7-81da8c441cb2 req-18c1eeec-3728-4ce4-a1b2-0f0011f26c7e service nova] Creating event network-changed:8a928c32-e301-4df3-9dd3-df2f9da3fdc0 for instance ed037684-51f8-4762-9f7e-04784883f269 on nch1-master-1 Nov 06 21:11:53.477701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f1883754-cb9a-408b-b2b7-81da8c441cb2 req-18c1eeec-3728-4ce4-a1b2-0f0011f26c7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066726 Nov 06 21:11:53.478661 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3219/6531] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:53.738878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:53.740342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:53.746673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:53.747388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:53.748408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:53.749301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:54.127987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:54.129636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:54.153072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:54.153678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:54.157954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:54.159835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:54.401842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:54.413954 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c8cc87d-d270-4c95-b8cc-9393af55f81d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.675702 Nov 06 21:11:54.415842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3313/6532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:53 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:54.420866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:54.422072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:54.429194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:54.430307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:54.431463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:54.432139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:54.669366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:54.677747 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1f863e4-db9f-4f82-8ff5-f87a9b42b268 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.560949 Nov 06 21:11:54.681011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3220/6533] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:54 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:54.850887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:54.859035 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17f6d04a-9040-4398-9772-0cf0b68d6bce tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1664 microversion: 2.1 time: 0.441428 Nov 06 21:11:54.859689 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3314/6534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:54 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1664 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:55.432170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:55.433154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:55.446135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.446832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.447879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.448679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.707039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:55.707566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:55.707692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:55.720398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a725a74-c06d-4973-a504-6f1a53f82253 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.291220 Nov 06 21:11:55.727805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.728341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.729089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.729541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.731808 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3221/6535] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:55 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:55.884100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:55.884782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:55.891240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.892142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.893137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:55.893757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:55.989426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:55.996722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1605234-da88-4d59-bd9c-77bc1085b0af tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.302682 Nov 06 21:11:55.997655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3315/6536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:55 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:56.004992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-87c3ba27-85a5-40ce-bc4c-7ecba0d3ad3c req-3115bf7c-398e-4f3f-adf4-7a94b1b01fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-plugged", "status": "completed", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:11:56.006659 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:11:56.006659 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:11:56.015396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-87c3ba27-85a5-40ce-bc4c-7ecba0d3ad3c req-3115bf7c-398e-4f3f-adf4-7a94b1b01fa6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:56.015940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-87c3ba27-85a5-40ce-bc4c-7ecba0d3ad3c req-3115bf7c-398e-4f3f-adf4-7a94b1b01fa6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:56.029454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-87c3ba27-85a5-40ce-bc4c-7ecba0d3ad3c req-3115bf7c-398e-4f3f-adf4-7a94b1b01fa6 service nova] Creating event network-vif-plugged:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:11:56.034883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-87c3ba27-85a5-40ce-bc4c-7ecba0d3ad3c req-3115bf7c-398e-4f3f-adf4-7a94b1b01fa6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035851 Nov 06 21:11:56.035625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3316/6537] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:11:56.148523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:56.158551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5428ab96-ee15-444f-b791-8390afa82dbf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1668 microversion: 2.1 time: 0.279786 Nov 06 21:11:56.159396 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3222/6538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:55 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:56.739231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:56.740614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:56.746842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:56.747190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:56.747981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:56.748450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:56.911107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:56.922087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c592501-bcd9-4c21-8c92-77cd38e441d8 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.187638 Nov 06 21:11:56.922747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3317/6539] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:56 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:57.014546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:57.015163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:57.021961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:57.022423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:57.023227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:57.023673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:57.167797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:57.175576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8094a049-cd2b-4329-b0f0-f63118fae90e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1391 microversion: 2.1 time: 0.164761 Nov 06 21:11:57.176386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3223/6540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:57 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:57.939722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:57.940511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:57.950015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:57.950568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:57.951449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:57.951992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:58.191871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:58.193066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:58.198080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:58.201261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:58.202223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:58.203035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:58.203877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:58.210740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3175c584-62cb-49cd-ad22-6e3fd95ca837 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.275162 Nov 06 21:11:58.222558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3318/6541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:57 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:58.447526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:58.460418 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f52d9ae-358b-4158-85c5-dc32dc6b4eb2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1564 microversion: 2.1 time: 0.272193 Nov 06 21:11:58.461023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3224/6542] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:58 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:11:58.479310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:58.479540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:58.491660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:58.492132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:58.492983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:58.493431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:58.808201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:58.815614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d59cb0a7-632f-4a98-93fa-a087a736b4e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1564 microversion: 2.1 time: 0.342614 Nov 06 21:11:58.816308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3319/6543] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:58 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1564 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:11:59.228637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:11:59.229924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:11:59.237703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:59.244386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:59.245311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:11:59.245775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:11:59.545201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:11:59.562871 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9ec9ee1-1c14-4989-a60f-f64601a5a360 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.337976 Nov 06 21:11:59.563550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3225/6544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:11:59 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:00.583283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:00.585863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:00.611981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:00.613284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:00.615630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:00.617484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:01.024575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:01.045930 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd01dd75-764c-40b8-82e9-461629882299 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.469537 Nov 06 21:12:01.047451 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3320/6545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:00 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:01.440407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:01.440926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:01.455058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-35329be7-76b4-4f48-b3dd-aee94442b7d4 req-08dde411-11b2-425f-8212-1a2bf058cd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:01.456867 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:01.456867 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:01.476847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:01.477353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:01.478197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:01.478655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:01.479713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-35329be7-76b4-4f48-b3dd-aee94442b7d4 req-08dde411-11b2-425f-8212-1a2bf058cd81 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:01.481301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-35329be7-76b4-4f48-b3dd-aee94442b7d4 req-08dde411-11b2-425f-8212-1a2bf058cd81 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:01.510280 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-35329be7-76b4-4f48-b3dd-aee94442b7d4 req-08dde411-11b2-425f-8212-1a2bf058cd81 service nova] Creating event network-changed:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:12:01.517546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-35329be7-76b4-4f48-b3dd-aee94442b7d4 req-08dde411-11b2-425f-8212-1a2bf058cd81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069042 Nov 06 21:12:01.518828 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3321/6546] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:01.895533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:01.913041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abb72e2a-4196-4fab-89d4-93c4e8639b36 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1564 microversion: 2.1 time: 0.476537 Nov 06 21:12:01.916623 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3226/6547] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:01 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1564 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:02.033831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c497cd98-8c9c-4257-98a1-615ab5d0d091 req-7b4cd6be-b771-4194-972d-352f09d74a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed037684-51f8-4762-9f7e-04784883f269", "name": "network-vif-plugged", "status": "completed", "tag": "8a928c32-e301-4df3-9dd3-df2f9da3fdc0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:02.035489 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:02.035489 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:02.052118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c497cd98-8c9c-4257-98a1-615ab5d0d091 req-7b4cd6be-b771-4194-972d-352f09d74a48 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:02.056392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c497cd98-8c9c-4257-98a1-615ab5d0d091 req-7b4cd6be-b771-4194-972d-352f09d74a48 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:02.066784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:02.067973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:02.079601 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c497cd98-8c9c-4257-98a1-615ab5d0d091 req-7b4cd6be-b771-4194-972d-352f09d74a48 service nova] Creating event network-vif-plugged:8a928c32-e301-4df3-9dd3-df2f9da3fdc0 for instance ed037684-51f8-4762-9f7e-04784883f269 on nch1-master-1 Nov 06 21:12:02.081429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:02.081914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:02.086128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:02.086807 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c497cd98-8c9c-4257-98a1-615ab5d0d091 req-7b4cd6be-b771-4194-972d-352f09d74a48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057661 Nov 06 21:12:02.087591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3322/6548] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:02.088569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:02.654671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:02.663489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bfcff4dc-9e71-4db3-9da7-91540b667c46 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.603265 Nov 06 21:12:02.680891 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3227/6549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:02 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:03.683722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:03.685227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:03.694212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:03.694954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:03.695965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:03.696652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:03.980049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:03.987936 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-838feb62-bb95-47d0-8682-6dab2174d11d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1427 microversion: 2.1 time: 0.310341 Nov 06 21:12:03.988721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3323/6550] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:03 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1427 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:05.007914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:05.009152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:05.017057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.017522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:05.018319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.018941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:05.249433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:05.261924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2293dc6-97a3-48fa-b3c1-c3113bdb0214 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1606 microversion: 2.1 time: 0.258530 Nov 06 21:12:05.278054 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3228/6551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:05 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1606 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:05.280449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:05.281075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:05.289258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.289713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:05.290707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.291583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:05.303366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-226870959", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "59e7fdab-fc57-47f6-baad-e3b794bbdc7a"}, {"uuid": "e707313c-c856-41f1-aa71-8d58303103e0"}, {"uuid": "59e7fdab-fc57-47f6-baad-e3b794bbdc7a"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:05.372643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] validate_networks() for [('59e7fdab-fc57-47f6-baad-e3b794bbdc7a', None, None, None, None, None), ('e707313c-c856-41f1-aa71-8d58303103e0', None, None, None, None, None), ('59e7fdab-fc57-47f6-baad-e3b794bbdc7a', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:12:05.679574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:05.695191 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0b40c52-c845-478e-acde-8c20f4e30c92 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1606 microversion: 2.1 time: 0.419546 Nov 06 21:12:05.695786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3324/6552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:05 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1606 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:05.712633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:05.713249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:05.723016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.724468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:05.725484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:05.726096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:06.352177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:06.366952 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99f93b2a-d740-4ed5-bee6-1e7408155e8d tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1606 microversion: 2.1 time: 0.658116 Nov 06 21:12:06.368212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3325/6553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:05 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1606 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:07.354710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:12:07.357024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:12:07.358530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:12:07.358813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:12:07.359304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:12:07.371813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:07.372468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:07.374139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:07.374814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:07.396645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Getting quotas for project 91115e7524fc466e90e6ff1734a2f3d9. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:12:07.403360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Getting quotas for user 0a773d18f637474aac479d84de088eaa and project 91115e7524fc466e90e6ff1734a2f3d9. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:12:07.421437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:12:07.424440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:12:07.500406 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc151f6f-560f-4d94-960d-8af34aba550b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.200245 Nov 06 21:12:07.502036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3229/6554] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:12:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:12:07.514652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1169b2e9-569c-42de-a417-6e0ca8a729a1 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:07.515891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1169b2e9-569c-42de-a417-6e0ca8a729a1 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:07.670976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1169b2e9-569c-42de-a417-6e0ca8a729a1 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:07.684114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1169b2e9-569c-42de-a417-6e0ca8a729a1 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1212 microversion: 2.1 time: 0.173453 Nov 06 21:12:07.685374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3326/6555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:07 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1212 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:08.708260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:08.709119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:08.716989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:08.717456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:08.720469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:08.721142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:08.834745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:08.853274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57334a3d-837d-4c82-8961-5d8a1c07994c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1264 microversion: 2.1 time: 0.152324 Nov 06 21:12:08.854678 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3230/6556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:08 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:09.557392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ccaa4638-4fc8-4f2e-a90a-e115af021917 req-45ac19f9-36c6-4136-bc33-4817e4cd8947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed037684-51f8-4762-9f7e-04784883f269", "tag": "8a928c32-e301-4df3-9dd3-df2f9da3fdc0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:09.559370 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:09.559370 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:09.570037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ccaa4638-4fc8-4f2e-a90a-e115af021917 req-45ac19f9-36c6-4136-bc33-4817e4cd8947 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:09.570763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ccaa4638-4fc8-4f2e-a90a-e115af021917 req-45ac19f9-36c6-4136-bc33-4817e4cd8947 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:09.591973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ccaa4638-4fc8-4f2e-a90a-e115af021917 req-45ac19f9-36c6-4136-bc33-4817e4cd8947 service nova] Creating event network-changed:8a928c32-e301-4df3-9dd3-df2f9da3fdc0 for instance ed037684-51f8-4762-9f7e-04784883f269 on nch1-master-1 Nov 06 21:12:09.599016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ccaa4638-4fc8-4f2e-a90a-e115af021917 req-45ac19f9-36c6-4136-bc33-4817e4cd8947 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Nov 06 21:12:09.600380 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3327/6557] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:09.886053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:09.886667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:09.897478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:09.898272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:09.899091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:09.899540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:10.130688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:10.144558 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-809ace04-a6d7-45a0-9c4d-cbf1b32fb4b2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1270 microversion: 2.1 time: 0.275596 Nov 06 21:12:10.147621 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3231/6558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:09 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:11.164508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:11.165408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:11.172548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:11.173119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:11.174054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:11.174601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:11.429283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:11.442784 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc181041-d6aa-42a0-982b-d93a1384fb6e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1312 microversion: 2.1 time: 0.284403 Nov 06 21:12:11.443382 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3328/6559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:11 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:12.461045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:12.461765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:12.469329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:12.469920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:12.471620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:12.472135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:12.708662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:12.716201 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbfbaad8-8ce6-43c7-bc75-74a2ec7c333d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.259630 Nov 06 21:12:12.716805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3232/6560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:12 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:12.773955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c379a97a-fe16-4823-9ac1-5b85d4e721fb req-e9a4ce2d-9e24-436c-b122-63c3f8e6592c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "tag": "1a9d6e5a-4989-4507-93d9-8ab9fa01ca48"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:12.775608 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:12.775608 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:12.786524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c379a97a-fe16-4823-9ac1-5b85d4e721fb req-e9a4ce2d-9e24-436c-b122-63c3f8e6592c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:12.786982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c379a97a-fe16-4823-9ac1-5b85d4e721fb req-e9a4ce2d-9e24-436c-b122-63c3f8e6592c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:12.799219 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c379a97a-fe16-4823-9ac1-5b85d4e721fb req-e9a4ce2d-9e24-436c-b122-63c3f8e6592c service nova] Creating event network-changed:1a9d6e5a-4989-4507-93d9-8ab9fa01ca48 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:12.803973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c379a97a-fe16-4823-9ac1-5b85d4e721fb req-e9a4ce2d-9e24-436c-b122-63c3f8e6592c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034529 Nov 06 21:12:12.804623 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3329/6561] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:13.733780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:13.734597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:13.741835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:13.742291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:13.743079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:13.743525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:13.993664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:14.001298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20a7f988-4b80-4b2f-b4b5-095a2f197a59 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.271314 Nov 06 21:12:14.001991 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3233/6562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:13 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:14.840337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "tag": "e8c9084a-77f6-4d3e-8b38-8b3733b15c40"}, {"name": "network-changed", "server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "tag": "3980a6d5-192d-4d01-969b-2e0cf2d43533"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:14.842007 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:14.842007 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:14.849776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:14.850290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:14.860707 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] Creating event network-changed:e8c9084a-77f6-4d3e-8b38-8b3733b15c40 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:14.866466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] Creating event network-changed:3980a6d5-192d-4d01-969b-2e0cf2d43533 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:14.866608 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-61cb2051-b547-4581-aa86-6264fea958de req-0ca9b4d2-811b-4f5f-a1a7-33a4275475bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030923 Nov 06 21:12:14.867273 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3330/6563] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:14 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:15.017193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:15.017800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:15.025102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:15.025556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:15.026363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:15.026799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:15.230641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:15.237966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72ec3e52-7b72-494e-9c39-038091e3798e tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.224392 Nov 06 21:12:15.238543 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3234/6564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:15 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:16.256335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:16.257059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:16.268150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:16.268618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:16.269706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:16.270144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:16.492770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:16.500090 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b61ba7b5-a843-440b-807a-f8489b582806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.249001 Nov 06 21:12:16.500887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3331/6565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:16 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:17.517215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:17.517973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:17.526375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:17.526915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:17.527709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:17.528146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:17.684153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:17.692546 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e243635d-72f4-405a-b205-f34c7c44e93c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.179165 Nov 06 21:12:17.693112 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3235/6566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:17 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:18.709774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:18.710819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:18.717442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:18.717903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:18.718703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:18.719149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:18.867835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:18.875292 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e0639fa-b382-48a8-884e-3c131d6dfbdd tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.169662 Nov 06 21:12:18.875774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3332/6567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:18 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:19.898425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:19.898425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:19.904471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:19.904935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:19.905920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:19.906365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:20.081310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:20.089612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68c06844-b0f0-4b13-9dfd-3ce9e41fa706 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.199769 Nov 06 21:12:20.092612 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3236/6568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:19 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:21.106707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:21.107311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:21.114688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:21.115138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:21.115928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:21.116388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:21.299497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:21.307406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f90867df-3768-4a94-a03b-8aae9f48290d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.204354 Nov 06 21:12:21.308004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3333/6569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:21 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:22.324375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:22.325038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:22.332565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:22.333039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:22.333814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:22.334253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:22.486268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:22.494007 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f0208a3-dc7d-43e2-9b9d-a45fbee9a245 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.173666 Nov 06 21:12:22.494810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3237/6570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:22 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:23.511943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:23.512583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:23.518974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:23.519432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:23.520223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:23.520690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:23.668213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:23.675711 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3060276f-3e20-49f8-ae14-8837549cc3af tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.167663 Nov 06 21:12:23.676288 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3334/6571] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:23 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:23.716730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-af58dfb9-a6f5-4c43-aafb-dfcaacd4cb72 req-ab60de1d-d8fb-4515-b6ca-565d8f77be37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-plugged", "status": "completed", "tag": "1a9d6e5a-4989-4507-93d9-8ab9fa01ca48"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:23.718344 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:23.718344 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:23.726813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-af58dfb9-a6f5-4c43-aafb-dfcaacd4cb72 req-ab60de1d-d8fb-4515-b6ca-565d8f77be37 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:23.727294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-af58dfb9-a6f5-4c43-aafb-dfcaacd4cb72 req-ab60de1d-d8fb-4515-b6ca-565d8f77be37 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:23.738804 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-af58dfb9-a6f5-4c43-aafb-dfcaacd4cb72 req-ab60de1d-d8fb-4515-b6ca-565d8f77be37 service nova] Creating event network-vif-plugged:1a9d6e5a-4989-4507-93d9-8ab9fa01ca48 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:23.745118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-af58dfb9-a6f5-4c43-aafb-dfcaacd4cb72 req-ab60de1d-d8fb-4515-b6ca-565d8f77be37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Nov 06 21:12:23.745717 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3238/6572] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:24.691568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:24.692182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:24.698980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:24.699437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:24.700222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:24.700690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:25.170404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:25.178288 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a23ad70-5e98-4034-af30-f73ac2cedc41 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.490442 Nov 06 21:12:25.178879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3335/6573] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:24 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:25.796082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-plugged", "status": "completed", "tag": "e8c9084a-77f6-4d3e-8b38-8b3733b15c40"}, {"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-plugged", "status": "completed", "tag": "3980a6d5-192d-4d01-969b-2e0cf2d43533"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:25.799040 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:25.799040 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:25.808382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:25.808838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:25.823139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] Creating event network-vif-plugged:e8c9084a-77f6-4d3e-8b38-8b3733b15c40 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:25.823740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] Creating event network-vif-plugged:3980a6d5-192d-4d01-969b-2e0cf2d43533 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:25.829325 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5d3eede2-03bb-44cc-9749-0269db6788ba req-7d15eedf-55c5-47fa-a9bb-417ce7d5c761 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040877 Nov 06 21:12:25.830100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3239/6574] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:25 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:26.195963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:26.196597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:26.203318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:26.203767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:26.204602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:26.205039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:26.358470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:26.367063 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fefb5425-9aee-4ee9-8cd2-078b413dbef4 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.175577 Nov 06 21:12:26.367650 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3336/6575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:26 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:27.384048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:27.384959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:27.391840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:27.392322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:27.393114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:27.393585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:27.554805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:27.562463 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10d8ec12-cf85-453d-8285-61086e48ba51 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1354 microversion: 2.1 time: 0.182590 Nov 06 21:12:27.563031 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3240/6576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:27 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:28.578708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:28.579423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:28.586655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.587107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.587920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.588384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.740690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:28.748274 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af13d747-43e8-4a89-97eb-9a0bb0d00cd6 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1804 microversion: 2.1 time: 0.173279 Nov 06 21:12:28.748948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3337/6577] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:28 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:28.764999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:28.765533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:28.772727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.773177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.773961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.774401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.797889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f117763-3c2c-46e0-9f81-d3fc84a46c4d tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066/ips" status: 200 len: 218 microversion: 2.1 time: 0.036400 Nov 06 21:12:28.798389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3241/6578] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:12:28 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066/ips => generated 218 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:28.808579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:28.809236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:28.815212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.815666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.817206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.817654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.842778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:12:28.926982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f6653df-44bd-44e1-8862-3dddcfd30244 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 204 len: 0 microversion: 2.1 time: 0.121606 Nov 06 21:12:28.927738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3338/6579] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:12:28 2021] DELETE /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:12:28.936151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:28.936882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:28.943355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.943999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:28.944724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:28.945163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:29.133037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:29.140490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9dae957d-aff4-43b3-af3e-39a0502afd84 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1810 microversion: 2.1 time: 0.207859 Nov 06 21:12:29.140973 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3242/6580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:28 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:30.158290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:30.159018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:30.165592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:30.166301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:30.167080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:30.167515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:30.318424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:30.326208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-71a324e7-f068-4afc-b895-dffd4872ac73 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1810 microversion: 2.1 time: 0.171931 Nov 06 21:12:30.326992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3339/6581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:30 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:31.119947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2efe6879-6721-497e-a10f-d2d92032be4a req-aaa8ad8d-996e-4073-8465-54558f4ccf57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-deleted", "tag": "e8c9084a-77f6-4d3e-8b38-8b3733b15c40"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:31.122216 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:31.122216 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:31.135535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2efe6879-6721-497e-a10f-d2d92032be4a req-aaa8ad8d-996e-4073-8465-54558f4ccf57 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:31.135996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2efe6879-6721-497e-a10f-d2d92032be4a req-aaa8ad8d-996e-4073-8465-54558f4ccf57 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:31.155750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2efe6879-6721-497e-a10f-d2d92032be4a req-aaa8ad8d-996e-4073-8465-54558f4ccf57 service nova] Creating event network-vif-deleted:e8c9084a-77f6-4d3e-8b38-8b3733b15c40 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:31.178350 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2efe6879-6721-497e-a10f-d2d92032be4a req-aaa8ad8d-996e-4073-8465-54558f4ccf57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061431 Nov 06 21:12:31.180384 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3243/6582] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:31.345056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:31.345794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:31.352849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:31.353307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:31.354116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:31.354557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:31.562296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:31.572354 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f5bc69c-9dce-475d-bb54-70b60eb58977 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1632 microversion: 2.1 time: 0.231484 Nov 06 21:12:31.583225 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3340/6583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:31 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1632 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:32.592413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:32.593145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:32.599363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:32.599815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:32.600630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:32.601065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:32.651935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:32.652429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:32.653952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lazy-loading 'fault' on Instance uuid 7f30f582-d6fc-4018-a10a-74be37b1e066 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:12:32.698192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:32.705602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1681700f-6ca1-417d-8cd4-deeb9ba2d9ee tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 200 len: 1302 microversion: 2.1 time: 0.118921 Nov 06 21:12:32.706184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3244/6584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:32 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 1302 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:33.203932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-deleted", "tag": "3980a6d5-192d-4d01-969b-2e0cf2d43533"}, {"server_uuid": "7f30f582-d6fc-4018-a10a-74be37b1e066", "name": "network-vif-deleted", "tag": "1a9d6e5a-4989-4507-93d9-8ab9fa01ca48"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:33.205639 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:33.205639 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:33.214690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:33.215235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:33.232011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] Creating event network-vif-deleted:3980a6d5-192d-4d01-969b-2e0cf2d43533 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:33.232638 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] Creating event network-vif-deleted:1a9d6e5a-4989-4507-93d9-8ab9fa01ca48 for instance 7f30f582-d6fc-4018-a10a-74be37b1e066 on nch2-master-1 Nov 06 21:12:33.238052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ed11b306-5ea5-4ab8-9887-e3a7f0601ef0 req-cac3e171-9b4f-4eba-b32a-8ec31b72259f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037723 Nov 06 21:12:33.239294 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3341/6585] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:33 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:33.722684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:33.724127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:33.730741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:33.731195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:33.731980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:33.732458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:33.745832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. Nov 06 21:12:33.746437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:12:33.747268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbf48bfc-f63d-4dc7-91ef-c2d9fb74650f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 404 len: 111 microversion: 2.1 time: 0.028264 Nov 06 21:12:33.747801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3245/6586] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:33 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:12:34.353730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:34.355665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:34.365524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:34.366409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:34.367773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:34.368434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:34.428688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9f91052-3790-4f2c-985f-964e00700972 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action" status: 200 len: 24568 microversion: 2.1 time: 0.080585 Nov 06 21:12:34.429350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3342/6587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:12:34 2021] POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:12:36.918437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2014166308", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "ddfcde71-b41b-4a72-ae5b-c5089d90a6c9"}, {"uuid": "379c4223-3649-4101-a2b4-0dc1f265138e"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:36.985578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] validate_networks() for [('ddfcde71-b41b-4a72-ae5b-c5089d90a6c9', None, None, None, None, None), ('379c4223-3649-4101-a2b4-0dc1f265138e', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:12:37.707002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:12:37.708070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:12:37.708739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:12:37.709812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:12:37.710416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:12:37.721303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:37.721531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:37.722529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:37.723641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:37.757600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Getting quotas for project 91115e7524fc466e90e6ff1734a2f3d9. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:12:37.763107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Getting quotas for user 0a773d18f637474aac479d84de088eaa and project 91115e7524fc466e90e6ff1734a2f3d9. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:12:37.784929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:12:37.789273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:12:37.846364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-596173d3-25b2-4d7f-a5c5-d10d8682a105 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931932 Nov 06 21:12:37.848222 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3246/6588] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:12:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:12:37.859668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9af5a33-ded2-4e16-88d7-8f55b8157d13 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:37.861036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9af5a33-ded2-4e16-88d7-8f55b8157d13 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:37.927092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a9af5a33-ded2-4e16-88d7-8f55b8157d13 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:37.934874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9af5a33-ded2-4e16-88d7-8f55b8157d13 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1213 microversion: 2.1 time: 0.080099 Nov 06 21:12:37.935464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3343/6589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:37 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:38.952854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:38.953754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:38.963829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:38.964680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:38.965764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:38.966655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:39.097031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:39.109353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d867db09-c648-4904-92d4-54cc4e02dcde tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1273 microversion: 2.1 time: 0.160199 Nov 06 21:12:39.116069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3247/6590] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:38 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:40.133663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:40.134275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:40.142261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:40.142759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:40.143796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:40.144244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:40.383951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:40.393642 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f6e27e3-e59a-4de2-a519-54369af24b27 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1313 microversion: 2.1 time: 0.264831 Nov 06 21:12:40.403863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3344/6591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:40 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:41.411089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:41.412575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:41.419675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:41.420656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:41.421551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:41.422248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:41.478527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f5ba6cd2-d444-4dd3-af79-a4867e9aa56e req-4ddf4aeb-98e2-4612-82e6-cfbc6e3a98ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "tag": "9b19d893-74de-406e-b86b-c6dab533bad3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:41.480106 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:41.480106 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:41.493242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f5ba6cd2-d444-4dd3-af79-a4867e9aa56e req-4ddf4aeb-98e2-4612-82e6-cfbc6e3a98ce service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:41.493799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f5ba6cd2-d444-4dd3-af79-a4867e9aa56e req-4ddf4aeb-98e2-4612-82e6-cfbc6e3a98ce service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:41.519084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f5ba6cd2-d444-4dd3-af79-a4867e9aa56e req-4ddf4aeb-98e2-4612-82e6-cfbc6e3a98ce service nova] Creating event network-changed:9b19d893-74de-406e-b86b-c6dab533bad3 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:12:41.525090 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f5ba6cd2-d444-4dd3-af79-a4867e9aa56e req-4ddf4aeb-98e2-4612-82e6-cfbc6e3a98ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347772 Nov 06 21:12:41.526184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3248/6592] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:41.697095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:41.705557 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7baf1ccf-9d65-489c-9f78-934cfd2d8806 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.298468 Nov 06 21:12:41.706388 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3345/6593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:41 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:42.731959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:42.732925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:42.740279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:42.740882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:42.741962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:42.742619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:43.258518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:43.266668 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0168179-84e2-4574-acc4-270a6edde734 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.540471 Nov 06 21:12:43.267240 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3249/6594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:42 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:43.550042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9af1fb12-6788-4300-aaa0-f7bcfb4ece25 req-793aecd5-115d-45d1-9128-3bc992eb966c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "tag": "69ad5200-d41d-48cc-b129-94f2a9be2d66"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:43.551974 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:43.551974 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:43.559671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9af1fb12-6788-4300-aaa0-f7bcfb4ece25 req-793aecd5-115d-45d1-9128-3bc992eb966c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:43.560116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9af1fb12-6788-4300-aaa0-f7bcfb4ece25 req-793aecd5-115d-45d1-9128-3bc992eb966c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:43.571467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9af1fb12-6788-4300-aaa0-f7bcfb4ece25 req-793aecd5-115d-45d1-9128-3bc992eb966c service nova] Creating event network-changed:69ad5200-d41d-48cc-b129-94f2a9be2d66 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:12:43.576556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9af1fb12-6788-4300-aaa0-f7bcfb4ece25 req-793aecd5-115d-45d1-9128-3bc992eb966c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030662 Nov 06 21:12:43.577334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3346/6595] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:44.284845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:44.286347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:44.293438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.293895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.294898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.295344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.443581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:44.451148 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4fa0130-0b4e-4640-ad1f-b992d0072f6f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.170516 Nov 06 21:12:44.451405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:44.452165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3250/6596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:44 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:44.452446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:44.459191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.459647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.460471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.460912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.490081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-130b4644-c88b-41d6-81cf-242737090c91 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042855 Nov 06 21:12:44.490886 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3347/6597] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:12:44 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:12:44.547821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:44.548243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:44.554417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.554869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.555647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.556086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.582392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:12:44.662144 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6307ea25-8372-480b-b299-cd7fea507603 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 204 len: 0 microversion: 2.1 time: 0.117929 Nov 06 21:12:44.663005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3251/6598] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:12:44 2021] DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:12:44.671722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:44.672426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:44.680123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.680614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.681444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:44.681876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:44.822968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:44.830330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-969526f9-25fc-49e6-9eec-62b102b991da tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1674 microversion: 2.1 time: 0.162637 Nov 06 21:12:44.830895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3348/6599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:44 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:45.469309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:45.470008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:45.477384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:45.477834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:45.478612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:45.479049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:45.623414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:45.631996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cec5e8ec-b6a8-4815-9268-74e28fd011cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.166748 Nov 06 21:12:45.632627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3252/6600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:45 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:45.847164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:45.848262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:45.855128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:45.855583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:45.856404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:45.856840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:45.999820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:46.007316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc7faaf0-7648-4229-bb93-a05a1259564b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1674 microversion: 2.1 time: 0.163923 Nov 06 21:12:46.008067 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3349/6601] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:45 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:46.652090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:46.653371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:46.661132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:46.661785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:46.662655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:46.663171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:46.950608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:46.965440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8ddd42c-46e9-44b7-b3c3-cc840045e412 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.319768 Nov 06 21:12:46.975276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3253/6602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:46 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:47.026048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:47.030138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:47.037608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:47.038308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:47.039305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:47.039931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:47.131302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:47.146147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-43079d74-20dd-4477-9a23-1a35c5251efd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 200 len: 1606 microversion: 2.1 time: 0.124771 Nov 06 21:12:47.149292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3350/6603] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:47 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 1606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:47.172189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6f9cfa3c-3218-4f68-a330-6b573643819d req-82d2409d-38c5-4d27-95dd-43db4151249a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8565783d-e8fd-4786-9848-138d58914019", "name": "network-vif-deleted", "tag": "9373871f-a511-4c47-9d92-654088c8202d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:47.173761 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:47.173761 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:47.187196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f9cfa3c-3218-4f68-a330-6b573643819d req-82d2409d-38c5-4d27-95dd-43db4151249a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:47.188646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6f9cfa3c-3218-4f68-a330-6b573643819d req-82d2409d-38c5-4d27-95dd-43db4151249a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:47.208097 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6f9cfa3c-3218-4f68-a330-6b573643819d req-82d2409d-38c5-4d27-95dd-43db4151249a service nova] Creating event network-vif-deleted:9373871f-a511-4c47-9d92-654088c8202d for instance 8565783d-e8fd-4786-9848-138d58914019 on nch1-master-1 Nov 06 21:12:47.213764 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6f9cfa3c-3218-4f68-a330-6b573643819d req-82d2409d-38c5-4d27-95dd-43db4151249a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044828 Nov 06 21:12:47.219533 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3254/6604] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:47.983395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:47.984359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:47.993475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:47.994237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:47.995226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:47.995840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:48.169638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:48.170333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:48.188144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:48.188795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:48.189606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:48.190048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:48.227274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. Nov 06 21:12:48.236037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:48.252146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:12:48.255689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7703fc4e-9dfd-4ba0-ab8b-9c1212373207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 404 len: 111 microversion: 2.1 time: 0.092492 Nov 06 21:12:48.256940 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3255/6605] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:48 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:12:48.257813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d770ad1-4bee-4270-ab52-f20558de4f87 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.271955 Nov 06 21:12:48.264045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3351/6606] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:47 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:48.276717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd722a30-d3a8-4f09-a790-81a02bea53db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '.version_select at 0x7f6715adbb80>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:48.297109 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd722a30-d3a8-4f09-a790-81a02bea53db tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470063633" status: 202 len: 0 microversion: 2.1 time: 0.034227 Nov 06 21:12:48.298083 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3256/6607] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:12:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470063633 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:12:49.071587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: .version_select at 0x7f6714aa9790>, body: {"keypair": {"name": "tempest-keypair-1538449392"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:49.091190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:12:49.098137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:12:49.282997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:49.284467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:49.295020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:49.295845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:49.297040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:49.297830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:49.481181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:49.490556 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96167da7-b1ff-41f1-bc05-e8ecc7cc8284 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.213712 Nov 06 21:12:49.492323 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3257/6608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:49 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:49.593390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:12:49.599885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:12:49.614835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20c4ed11-48d6-4912-82a0-9758036528e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.547788 Nov 06 21:12:49.615989 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3352/6609] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:12:49 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:50.510961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:50.516140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:50.526420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:50.527176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:50.528494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:50.529163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:50.822691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:50.835329 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e9c28d3-2f7d-475d-ae67-4785d0dbd0f9 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.331380 Nov 06 21:12:50.836517 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3258/6610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:50 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:51.662649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-270957932", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "868d34b9-2a4b-44dd-9b37-b695b577f3c0"}], "security_groups": [{"name": "tempest-securitygroup--1187924517"}], "key_name": "tempest-keypair-1538449392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:51.853998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:51.855194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:51.856254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] validate_networks() for [('868d34b9-2a4b-44dd-9b37-b695b577f3c0', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:12:51.864505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:51.865227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:51.866219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:51.866826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:52.731415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:52.741505 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-460d8c77-d4e6-4e17-8f5c-0287f18e7605 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.891293 Nov 06 21:12:52.751913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3259/6611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:51 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:52.925779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0131f67d-4a18-47c1-af07-8034ec1d7e99 req-e277ece9-afe1-469e-a3ee-98a31b44e12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "name": "network-vif-plugged", "status": "completed", "tag": "69ad5200-d41d-48cc-b129-94f2a9be2d66"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:52.927510 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:52.927510 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:52.934540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0131f67d-4a18-47c1-af07-8034ec1d7e99 req-e277ece9-afe1-469e-a3ee-98a31b44e12b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:52.934988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0131f67d-4a18-47c1-af07-8034ec1d7e99 req-e277ece9-afe1-469e-a3ee-98a31b44e12b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:52.946419 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0131f67d-4a18-47c1-af07-8034ec1d7e99 req-e277ece9-afe1-469e-a3ee-98a31b44e12b service nova] Creating event network-vif-plugged:69ad5200-d41d-48cc-b129-94f2a9be2d66 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:12:52.951555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0131f67d-4a18-47c1-af07-8034ec1d7e99 req-e277ece9-afe1-469e-a3ee-98a31b44e12b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197917 Nov 06 21:12:52.955346 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3260/6612] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:52.994965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:12:52.995738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:12:52.996536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:12:52.997054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:12:52.997865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:12:53.012220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:53.012942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:53.013759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:53.014642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:53.033169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:12:53.039182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Getting quotas for user 1c526b6ddfc74a84b74b8f2608a0ee15 and project 487ddbc94d984ebb9aa64f586ae2fbf8. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:12:53.054026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:12:53.056612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:12:53.102979 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88084c0b-2d89-43e1-a7c1-4953630847e4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.446723 Nov 06 21:12:53.103787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3353/6613] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:12:51 2021] POST /compute/v2.1/servers => generated 402 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:12:53.114436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff47e3eb-b8d4-4306-84cd-97720baeac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:53.115243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff47e3eb-b8d4-4306-84cd-97720baeac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:53.171997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ff47e3eb-b8d4-4306-84cd-97720baeac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:53.178859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff47e3eb-b8d4-4306-84cd-97720baeac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1237 microversion: 2.1 time: 0.068863 Nov 06 21:12:53.188386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3261/6614] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:53 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:53.760409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:53.761566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:53.771329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:53.772271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:53.773536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:53.774220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:54.009445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:54.022142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b11b11dc-2b52-4fea-bfbf-f30b7b5b761c tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.266149 Nov 06 21:12:54.024115 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3354/6615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:53 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:54.196606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:54.197477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:54.211036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:54.211742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:54.213645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:54.218195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:54.329459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:54.340420 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf061f2a-aadc-424a-966d-8c4477965922 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1307 microversion: 2.1 time: 0.147396 Nov 06 21:12:54.341724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3262/6616] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:54 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:55.006198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f8e1cdbb-a406-4d84-9b45-adf8c63f3261 req-55ecea7c-07af-40b4-b5b8-dfadfd671494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "name": "network-vif-plugged", "status": "completed", "tag": "9b19d893-74de-406e-b86b-c6dab533bad3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:55.008221 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:55.008221 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:55.027137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f8e1cdbb-a406-4d84-9b45-adf8c63f3261 req-55ecea7c-07af-40b4-b5b8-dfadfd671494 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:55.028430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f8e1cdbb-a406-4d84-9b45-adf8c63f3261 req-55ecea7c-07af-40b4-b5b8-dfadfd671494 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:55.044188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:55.046677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:55.057386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:55.058152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:55.059093 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f8e1cdbb-a406-4d84-9b45-adf8c63f3261 req-55ecea7c-07af-40b4-b5b8-dfadfd671494 service nova] Creating event network-vif-plugged:9b19d893-74de-406e-b86b-c6dab533bad3 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:12:55.059326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:55.060700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:55.068972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f8e1cdbb-a406-4d84-9b45-adf8c63f3261 req-55ecea7c-07af-40b4-b5b8-dfadfd671494 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067592 Nov 06 21:12:55.069581 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3355/6617] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:55.359597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:55.360845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:55.368649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:55.369389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:55.374006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:55.374734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:55.410429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:55.424878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bca29e29-daa7-4278-bb42-0917ed716b18 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.386680 Nov 06 21:12:55.425564 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3263/6618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:55 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:55.696087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:55.704313 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1d8c0e6-b4ae-41e7-b5fb-3d83f9b9d062 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.349288 Nov 06 21:12:55.714673 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3356/6619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:55 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:56.122753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-1a7ac675-f47e-419b-9c67-001cce49e07f req-4c2de6f3-123c-4bae-be9a-348c49a2dd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb66840-a75a-4c90-95d1-b220fdd9ae15", "tag": "c1722b04-68c2-4bd2-b024-60d66153e901"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:56.129608 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:56.129608 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:12:56.144191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1a7ac675-f47e-419b-9c67-001cce49e07f req-4c2de6f3-123c-4bae-be9a-348c49a2dd52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:56.144687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-1a7ac675-f47e-419b-9c67-001cce49e07f req-4c2de6f3-123c-4bae-be9a-348c49a2dd52 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:56.170398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-1a7ac675-f47e-419b-9c67-001cce49e07f req-4c2de6f3-123c-4bae-be9a-348c49a2dd52 service nova] Creating event network-changed:c1722b04-68c2-4bd2-b024-60d66153e901 for instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 on nch1-master-1 Nov 06 21:12:56.185412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-1a7ac675-f47e-419b-9c67-001cce49e07f req-4c2de6f3-123c-4bae-be9a-348c49a2dd52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067374 Nov 06 21:12:56.187949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3264/6620] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:12:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:56.443377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:56.444876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:56.463400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:56.464005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:56.465189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:56.465653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:56.722422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:56.723762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:56.736738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:56.737951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:56.741933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:56.742680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:56.988230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:56.995943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d4d9ace1-47e5-411c-961d-f1a4f58192ad tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1334 microversion: 2.1 time: 0.557058 Nov 06 21:12:57.000543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3357/6621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:56 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1334 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:57.146399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:57.155495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6f8d1da-5d28-4397-b95f-63248f03091e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.437495 Nov 06 21:12:57.156172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3265/6622] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:56 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:12:58.024334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:58.025663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:58.033386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.034095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.035098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.040020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.173191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:58.174358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:58.185920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.187562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.193612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.194367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.543751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:58.561505 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11343168-a7df-487e-b2cb-a56c75cb694b tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1669 microversion: 2.1 time: 0.547366 Nov 06 21:12:58.562150 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3358/6623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:58 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:58.580117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:58.580633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:58.595614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.599573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.601002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.601458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.667128 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85ffc039-c328-4c4c-9713-81f0a124bddf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4/ips" status: 200 len: 179 microversion: 2.1 time: 0.091377 Nov 06 21:12:58.667761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3359/6624] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:12:58 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4/ips => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:12:58.674180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:58.679901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:58.680900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:58.682831 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e71b5569-3f77-4eb9-bd18-a3612d1623d8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.513538 Nov 06 21:12:58.684440 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3266/6625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:58 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:58.690035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.691314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.692867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.693597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.737725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:12:58.865506 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d4186269-73d0-4b2e-933f-c483e0e15411 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 204 len: 0 microversion: 2.1 time: 0.189789 Nov 06 21:12:58.866951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3360/6626] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:12:58 2021] DELETE /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:12:58.883296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:58.884405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:58.893338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.894182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:58.895273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:58.895914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:59.137939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:59.148849 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40aefa7e-31c2-4005-a00c-23c4203fc83f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1675 microversion: 2.1 time: 0.277508 Nov 06 21:12:59.151092 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3267/6627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:58 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:12:59.547732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:59.548594 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:12:59.548594 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:12:59.550719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:59.551182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:59.552038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:59.552507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:59.576377 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca5139e0-790b-47a7-9075-7043d99e6ae0 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.153998 Nov 06 21:12:59.576980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3361/6628] 10.222.0.13 () {58 vars in 1184 bytes} [Sat Nov 6 21:12:59 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:12:59.674049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-545548771", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "71a3aa55-b60a-413f-acda-abd42a54e1a2"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:12:59.704930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:12:59.705399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:12:59.714565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:59.715282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:59.716241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:12:59.716871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:12:59.737922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] validate_networks() for [('71a3aa55-b60a-413f-acda-abd42a54e1a2', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:12:59.927995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:12:59.935628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25c4f168-82ff-4e2c-818f-b9580b39433e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.234890 Nov 06 21:12:59.936196 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3362/6629] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:12:59 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:00.166721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:00.177950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:00.190680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.192643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:00.193910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.194655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:00.205245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:13:00.205672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:13:00.206194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:13:00.206640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:13:00.207057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:13:00.216685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.217135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:00.217939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.218373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:00.236634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Getting quotas for project a67fa5e798e94d4c9e3e0bf1d057de1e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:13:00.243171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Getting quotas for user 2ee9f26f1da342db9765115db15ab561 and project a67fa5e798e94d4c9e3e0bf1d057de1e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:13:00.259102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:13:00.261722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:13:00.317562 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3694922c-8bdc-486a-80cd-6dca6e501105 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646494 Nov 06 21:13:00.321767 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3268/6630] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:12:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:13:00.330724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86aebc1f-a9c9-47b3-9cbd-30de8aaac688 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:00.331878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86aebc1f-a9c9-47b3-9cbd-30de8aaac688 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:00.399078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:00.406543 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de1a99b9-77eb-446a-ba44-c94717ab14cf tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1675 microversion: 2.1 time: 0.244278 Nov 06 21:13:00.418495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3363/6631] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:00 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:00.429992 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86aebc1f-a9c9-47b3-9cbd-30de8aaac688 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1328 microversion: 2.1 time: 0.102922 Nov 06 21:13:00.430564 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3269/6632] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:00 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:00.953268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:00.953765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:00.962117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.962776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:00.963752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:00.964382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.068566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-60bfc230-200d-4a90-8ac6-00a64addcec7 req-0ee8b199-6d90-438e-84d0-9bf28eb721d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "name": "network-vif-deleted", "tag": "69ad5200-d41d-48cc-b129-94f2a9be2d66"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:01.076139 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:01.076139 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:01.089221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60bfc230-200d-4a90-8ac6-00a64addcec7 req-0ee8b199-6d90-438e-84d0-9bf28eb721d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:01.091910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-60bfc230-200d-4a90-8ac6-00a64addcec7 req-0ee8b199-6d90-438e-84d0-9bf28eb721d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.116421 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-60bfc230-200d-4a90-8ac6-00a64addcec7 req-0ee8b199-6d90-438e-84d0-9bf28eb721d6 service nova] Creating event network-vif-deleted:69ad5200-d41d-48cc-b129-94f2a9be2d66 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:13:01.133227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-60bfc230-200d-4a90-8ac6-00a64addcec7 req-0ee8b199-6d90-438e-84d0-9bf28eb721d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068402 Nov 06 21:13:01.137437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3270/6633] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:01.208952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:01.217183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be7677e2-ad25-44be-affd-11937d1066f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.267544 Nov 06 21:13:01.218795 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3364/6634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:00 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:01.426480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:01.427623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:01.434973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:01.435881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.437178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:01.438013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.447028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:01.448060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:01.458998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:01.467989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.469297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:01.469979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:01.587620 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fe96e19-d232-40de-b380-b0a81a0eb82b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1415 microversion: 2.1 time: 0.144149 Nov 06 21:13:01.588156 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3365/6635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:01 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1415 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:01.847369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a773d18f637474aac479d84de088eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91115e7524fc466e90e6ff1734a2f3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:01.858093 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1c4fc60c-a59f-4484-b388-4ac8306e0392 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 200 len: 1497 microversion: 2.1 time: 0.436381 Nov 06 21:13:01.858696 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3271/6636] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:01 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:02.238040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:02.238746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:02.247489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.248251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.251029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.251713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.604911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:02.606355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:02.614738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.615296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.616183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.616724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.895058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:02.905290 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a6f7eea-58dd-4030-8888-938d59f22c79 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.672649 Nov 06 21:13:02.905883 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3366/6637] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:02 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:02.911840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:02.912729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:02.926326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.926879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.927704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:02.928576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:02.943103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. Nov 06 21:13:02.943998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:02.944914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e380968-b08f-441f-8b06-8f597aee0595 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 404 len: 111 microversion: 2.1 time: 0.037685 Nov 06 21:13:02.945703 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3367/6638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:02 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:13:03.067552 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aacc3268-f10a-4628-ba36-e8478b0b73ef tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.464548 Nov 06 21:13:03.068832 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3272/6639] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:02 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:03.157677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7724cb61-38e8-4644-9be7-41da4ae1504c req-b0509063-3edf-4363-b9f1-cf7b0a43ae5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b826b40d-74cd-418e-84a2-316b943458b4", "name": "network-vif-deleted", "tag": "9b19d893-74de-406e-b86b-c6dab533bad3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:03.160048 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:03.160048 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:03.179929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7724cb61-38e8-4644-9be7-41da4ae1504c req-b0509063-3edf-4363-b9f1-cf7b0a43ae5d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:03.182990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7724cb61-38e8-4644-9be7-41da4ae1504c req-b0509063-3edf-4363-b9f1-cf7b0a43ae5d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:03.197971 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7724cb61-38e8-4644-9be7-41da4ae1504c req-b0509063-3edf-4363-b9f1-cf7b0a43ae5d service nova] Creating event network-vif-deleted:9b19d893-74de-406e-b86b-c6dab533bad3 for instance b826b40d-74cd-418e-84a2-316b943458b4 on nch2-master-1 Nov 06 21:13:03.202917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7724cb61-38e8-4644-9be7-41da4ae1504c req-b0509063-3edf-4363-b9f1-cf7b0a43ae5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048991 Nov 06 21:13:03.204107 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3368/6640] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:03.725118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b4e5ef8c-ea80-4b82-b0d0-0e29c02d96bf req-0d3497a4-2c51-4df3-b48d-1a8bab0bd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f056496d-0887-4e24-a9ef-72033e9367b5", "tag": "9d54e755-fa08-4c54-aa91-492af054eab4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:03.734755 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:03.734755 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:03.764097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b4e5ef8c-ea80-4b82-b0d0-0e29c02d96bf req-0d3497a4-2c51-4df3-b48d-1a8bab0bd5a4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:03.770925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b4e5ef8c-ea80-4b82-b0d0-0e29c02d96bf req-0d3497a4-2c51-4df3-b48d-1a8bab0bd5a4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:03.803367 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b4e5ef8c-ea80-4b82-b0d0-0e29c02d96bf req-0d3497a4-2c51-4df3-b48d-1a8bab0bd5a4 service nova] Creating event network-changed:9d54e755-fa08-4c54-aa91-492af054eab4 for instance f056496d-0887-4e24-a9ef-72033e9367b5 on nch1-master-1 Nov 06 21:13:03.817426 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b4e5ef8c-ea80-4b82-b0d0-0e29c02d96bf req-0d3497a4-2c51-4df3-b48d-1a8bab0bd5a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119955 Nov 06 21:13:03.818797 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3273/6641] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:03.925919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:03.927269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:03.948839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:03.949306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:03.953803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:03.954703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:04.086922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:04.088025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:04.103077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:04.103605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:04.104436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:04.104881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:04.464889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:04.474138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76ce8aa8-2abf-424f-af2f-693e53e4524e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.554849 Nov 06 21:13:04.474721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3369/6642] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:03 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:04.490671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-70dd5501-e536-44c2-9cdb-ade392bd1082 req-582f426d-dd4b-45e2-bf16-b6f077ebd8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb66840-a75a-4c90-95d1-b220fdd9ae15", "name": "network-vif-plugged", "status": "completed", "tag": "c1722b04-68c2-4bd2-b024-60d66153e901"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:04.495696 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:04.495696 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:04.511638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-333d77bd-6d45-41ea-bfb7-e2f2fd97e1f5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.429050 Nov 06 21:13:04.512160 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3274/6643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:04 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:04.522495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-70dd5501-e536-44c2-9cdb-ade392bd1082 req-582f426d-dd4b-45e2-bf16-b6f077ebd8d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:04.522495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-70dd5501-e536-44c2-9cdb-ade392bd1082 req-582f426d-dd4b-45e2-bf16-b6f077ebd8d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:04.541947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-70dd5501-e536-44c2-9cdb-ade392bd1082 req-582f426d-dd4b-45e2-bf16-b6f077ebd8d1 service nova] Creating event network-vif-plugged:c1722b04-68c2-4bd2-b024-60d66153e901 for instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 on nch1-master-1 Nov 06 21:13:04.547186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-70dd5501-e536-44c2-9cdb-ade392bd1082 req-582f426d-dd4b-45e2-bf16-b6f077ebd8d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066140 Nov 06 21:13:04.548517 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3370/6644] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:04.957843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:04.960925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:04.970686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:04.971343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:04.973073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:04.973694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.216976 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-272b1201-f4f8-433a-b91e-e69f901a2a82 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1834 microversion: 2.1 time: 0.264681 Nov 06 21:13:05.228888 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3275/6645] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:04 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1834 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:05.238329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.239072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.246303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.246771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.248686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.249164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.474006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:05.483315 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6108c3d-81c4-4248-a7ad-021965d5b6de tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1683 microversion: 2.1 time: 0.251809 Nov 06 21:13:05.484143 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3371/6646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:05 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:05.502798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.503969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.512163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.517439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.518360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.520544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.529707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.530666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.538720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.539717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.541272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.542325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.855866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:05.864199 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ac508c4-81ac-437a-9c97-5b54301c7108 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1363 microversion: 2.1 time: 0.366120 Nov 06 21:13:05.865079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3276/6647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:05 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:05.869785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:05.870945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.877191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.878541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.879510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.880315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.882374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ec0da90-3aee-4b85-8b4d-92582d512d65 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.354920 Nov 06 21:13:05.883356 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3372/6648] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:05 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:05.888729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.889462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.896026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.896697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.897514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.897953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.911772 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. Nov 06 21:13:05.912431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:05.913440 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e8566df-e2d7-4d5a-bf4e-132515a1bc80 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 404 len: 111 microversion: 2.1 time: 0.028811 Nov 06 21:13:05.914001 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3373/6649] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:13:05 2021] DELETE /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:13:05.922550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.923592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: b826b40d-74cd-418e-84a2-316b943458b4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.931673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.932363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.933358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.933806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.938065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27985478-99a7-4230-81a7-46c405cabfa8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action" status: 200 len: 32643 microversion: 2.1 time: 0.071605 Nov 06 21:13:05.938809 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3277/6650] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:05 2021] POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action => generated 32643 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:05.949140 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. Nov 06 21:13:05.949837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance b826b40d-74cd-418e-84a2-316b943458b4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:05.950728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba9a69d0-08b2-4803-91ea-1b5faebb754f tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4" status: 404 len: 111 microversion: 2.1 time: 0.032202 Nov 06 21:13:05.951336 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3374/6651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:05 2021] GET /compute/v2.1/servers/b826b40d-74cd-418e-84a2-316b943458b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:13:05.959994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.960631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.967614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.968062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.968865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.969302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:05.982495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. Nov 06 21:13:05.983049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:05.983872 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7fc3533e-0dba-466f-9f96-65d3f833a8e2 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 404 len: 111 microversion: 2.1 time: 0.028418 Nov 06 21:13:05.984416 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3278/6652] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:13:05 2021] DELETE /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:13:05.992231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:05.992891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] [instance: 7f30f582-d6fc-4018-a10a-74be37b1e066] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:05.998770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:05.999228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.000009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.000597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.015577 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] HTTP exception thrown: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. Nov 06 21:13:06.016170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] Returning 404 to user: Instance 7f30f582-d6fc-4018-a10a-74be37b1e066 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:06.017016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e34cee09-71e7-4592-867d-a714facd6a02 tempest-ServersTestMultiNic-28395568 tempest-ServersTestMultiNic-28395568-project] 10.222.0.13 "GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066" status: 404 len: 111 microversion: 2.1 time: 0.028480 Nov 06 21:13:06.017540 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3375/6653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:05 2021] GET /compute/v2.1/servers/7f30f582-d6fc-4018-a10a-74be37b1e066 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:13:06.146191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:06.146865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:06.157225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.157719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.158521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.159032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.249208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '242853ef565f4fc494cafa2ecbc4f9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c7249d344a55a13dbbf7314c345c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:06.249822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] flavor_id is None. Assuming migration. {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 06 21:13:06.250271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:13:06.596204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d88b027-c408-4e58-b7eb-bd467e39329b tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action" status: 202 len: 0 microversion: 2.1 time: 0.453874 Nov 06 21:13:06.597452 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3279/6654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:06 2021] POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:13:06.605085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:06.606570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:06.614056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.614525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.615314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.615752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.758563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:06.766472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eea4d172-99a2-49c0-8e81-9279755e2324 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1692 microversion: 2.1 time: 0.165104 Nov 06 21:13:06.767114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3376/6655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:06 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:06.883627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:06.884665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:06.891290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.891753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.892679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.893154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.900166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:06.901054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:06.906828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.907508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:06.908638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:06.909782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:07.150201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d9b2a38e-8209-42d5-8c37-d219d563d0ff tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.254424 Nov 06 21:13:07.158790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3377/6656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:06 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:07.161778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:07.172804 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64aed608-9c16-4077-a75b-89dfad64a895 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1550 microversion: 2.1 time: 0.294421 Nov 06 21:13:07.173639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3280/6657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:06 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:07.191439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:07.191942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:07.198624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:07.199130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:07.199928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:07.200415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:07.307053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9146b7e9-764d-4fb9-853e-35033a50c591 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120620 Nov 06 21:13:07.309012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3378/6658] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:13:07 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:07.784812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:07.785912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:07.792911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:07.793576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:07.794957 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:07.795829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.049937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:08.060912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c97a33c-7f9b-4f14-8f94-8afeb8d0e01d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1692 microversion: 2.1 time: 0.276893 Nov 06 21:13:08.061925 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3281/6659] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:07 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1692 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:08.173948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:08.174781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:08.181428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:08.182016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.183138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:08.183793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.403043 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af79df25-009a-4aeb-a45b-6df9231809ae tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.234486 Nov 06 21:13:08.413020 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3379/6660] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:08 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:08.663420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:08.665243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:08.679435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:08.681915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.682892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:08.683660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.686172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ca10723e-c29c-4b8c-8ff3-17cc32ec62ca req-b37990ee-fda1-4fae-a448-ffa0eea1a5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb66840-a75a-4c90-95d1-b220fdd9ae15", "tag": "c1722b04-68c2-4bd2-b024-60d66153e901"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:08.688110 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:08.688110 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:08.701126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ca10723e-c29c-4b8c-8ff3-17cc32ec62ca req-b37990ee-fda1-4fae-a448-ffa0eea1a5a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:08.701813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ca10723e-c29c-4b8c-8ff3-17cc32ec62ca req-b37990ee-fda1-4fae-a448-ffa0eea1a5a5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:08.716497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ca10723e-c29c-4b8c-8ff3-17cc32ec62ca req-b37990ee-fda1-4fae-a448-ffa0eea1a5a5 service nova] Creating event network-changed:c1722b04-68c2-4bd2-b024-60d66153e901 for instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 on nch1-master-1 Nov 06 21:13:08.729280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0cfefa6d-6871-40ab-88e2-a6714ed6debb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.070530 Nov 06 21:13:08.730687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3282/6661] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:08 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:08.732897 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ca10723e-c29c-4b8c-8ff3-17cc32ec62ca req-b37990ee-fda1-4fae-a448-ffa0eea1a5a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046863 Nov 06 21:13:08.733711 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3380/6662] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:13:09.079615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:09.080605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:09.089454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.090406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.091656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.092503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.392326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:09.399927 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-829161a7-710d-47a9-8e0a-7bdea5c11563 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.325047 Nov 06 21:13:09.400759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3283/6663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:09 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:09.427214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:09.428848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:09.437753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.438448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.439426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.440680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.740618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:09.741543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:09.754748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.755373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.756470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:09.757667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:09.829834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f92f6f55-8b6d-4c2c-9c3d-c0524c720420 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.092444 Nov 06 21:13:09.830596 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3284/6664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:09 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:10.124590 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5486708a-a5e0-4896-937e-7078fc441cfe tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.707402 Nov 06 21:13:10.135004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3381/6665] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:09 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:10.213748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-76d088bb-19c3-4cdd-b01f-8de98303c87e req-df6f789f-62b6-42ad-b469-7d3d707d3801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f056496d-0887-4e24-a9ef-72033e9367b5", "name": "network-vif-plugged", "status": "completed", "tag": "9d54e755-fa08-4c54-aa91-492af054eab4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:10.215471 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:10.215471 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:10.232176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-76d088bb-19c3-4cdd-b01f-8de98303c87e req-df6f789f-62b6-42ad-b469-7d3d707d3801 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:10.233826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-76d088bb-19c3-4cdd-b01f-8de98303c87e req-df6f789f-62b6-42ad-b469-7d3d707d3801 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:10.247099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-76d088bb-19c3-4cdd-b01f-8de98303c87e req-df6f789f-62b6-42ad-b469-7d3d707d3801 service nova] Creating event network-vif-plugged:9d54e755-fa08-4c54-aa91-492af054eab4 for instance f056496d-0887-4e24-a9ef-72033e9367b5 on nch1-master-1 Nov 06 21:13:10.254838 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-76d088bb-19c3-4cdd-b01f-8de98303c87e req-df6f789f-62b6-42ad-b469-7d3d707d3801 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045087 Nov 06 21:13:10.255649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3285/6666] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:10.417844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:10.418571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:10.426274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:10.427393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:10.428916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:10.429627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:10.632578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:10.640051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1ca24cb-50c4-4312-8660-b10ab43e223c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.226115 Nov 06 21:13:10.640889 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3382/6667] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:10 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:10.841472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:10.842462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:10.850996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:10.850996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:10.850996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:10.854992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:10.892934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-414cdf33-5585-4905-9f5f-42104f89f964 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.056296 Nov 06 21:13:10.896595 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3286/6668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:10 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:11.142954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:11.144777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:11.151007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.151550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.152410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.152855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.286201 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-01290ab9-888c-4a2e-834d-89e7f63add9f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1463 microversion: 2.1 time: 0.147242 Nov 06 21:13:11.286853 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3383/6669] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:11 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:11.658175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:11.658877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:11.665449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.666391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.667183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.667621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.841727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:11.852697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7937a92a-d511-44fe-95c6-4e3b4aa68b22 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.198237 Nov 06 21:13:11.854245 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3287/6670] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:11 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:11.906448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:11.907921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:11.916201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.916780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.918455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:11.918999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:11.963889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54d8d878-c7cb-4077-bb8a-ca1b5ffc4b1a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.063136 Nov 06 21:13:11.964667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3384/6671] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:11 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:12.303472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:12.304276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:12.312989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.313604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.314523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.315561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.459159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f012bc3f-dc1c-4abb-8272-87abb49d2511 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1648 microversion: 2.1 time: 0.159815 Nov 06 21:13:12.459745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3288/6672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:12 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1648 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:12.476791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:12.477866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:12.485068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.485785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.486684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.487228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.631019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab71c62f-7ded-4965-9f93-ebb95a2bd9b5 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1648 microversion: 2.1 time: 0.156861 Nov 06 21:13:12.631232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3385/6673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:12 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1648 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:12.646489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:12.647104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:12.654177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.654636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.655439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.655880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.798753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3600eda8-86e5-47f4-a535-a4fd423cf1c6 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1648 microversion: 2.1 time: 0.155843 Nov 06 21:13:12.799448 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3289/6674] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:12 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1648 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:12.870730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:12.871342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:12.882858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.883870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.884821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:12.885730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:12.923562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-900789753", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "71a3aa55-b60a-413f-acda-abd42a54e1a2"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:12.998186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] validate_networks() for [('71a3aa55-b60a-413f-acda-abd42a54e1a2', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:13:13.195698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:13.229863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24fec6d4-0685-4509-8b8e-ce41bb3e162c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.362644 Nov 06 21:13:13.230792 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3386/6675] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:12 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:13.247958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:13.249505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:13.262875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:13.263577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:13.264621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:13.270616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:13.334899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-908e993d-faa0-42ca-a945-a9c2f3ae0a39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.102573 Nov 06 21:13:13.335530 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3387/6676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:13 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:13.514613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:13:13.515126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:13:13.515817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:13:13.516487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:13:13.517115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:13:13.534534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:13.535060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:13.535953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:13.536496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:13.556212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Getting quotas for project a67fa5e798e94d4c9e3e0bf1d057de1e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:13:13.561734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Getting quotas for user 2ee9f26f1da342db9765115db15ab561 and project a67fa5e798e94d4c9e3e0bf1d057de1e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:13:13.574539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:13:13.576873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:13:13.631309 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-039d977d-880d-4185-a812-1b6fa0e57666 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711252 Nov 06 21:13:13.631956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3290/6677] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:13:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 06 21:13:13.642589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1be83f43-978b-4a3c-afe3-f38054fd2225 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:13.643827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1be83f43-978b-4a3c-afe3-f38054fd2225 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:13.724399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1be83f43-978b-4a3c-afe3-f38054fd2225 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1328 microversion: 2.1 time: 0.085787 Nov 06 21:13:13.735460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3388/6678] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:13 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:14.250316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:14.252591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:14.265956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.266736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:14.268248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.268898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:14.345807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:14.347344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:14.357177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.357628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:14.359600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.360205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:14.415754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca08a90a-625c-495a-8351-f26bbe3f8661 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.073315 Nov 06 21:13:14.417234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3389/6679] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:14 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:14.548105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:14.559157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c05536fb-0a9d-406a-a393-d93fddb61797 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.315535 Nov 06 21:13:14.568343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3291/6680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:14 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:14.744932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:14.745940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:14.754139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.754772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:14.755735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:14.756173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.100070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4681f40d-a253-4da2-9e30-7f9ce35dcd3f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1423 microversion: 2.1 time: 0.359242 Nov 06 21:13:15.102411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3390/6681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:14 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1423 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:15.136906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:15.137311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:15.147538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.147940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.148775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.149388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.184502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3cee3fdb-650a-4a93-8dba-af4f3e2bc4bd tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051286 Nov 06 21:13:15.186256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3292/6682] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Nov 6 21:13:15 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269/os-server-password => generated 116 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:15.448525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:15.461414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:15.481228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.486963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.489059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.489701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.576177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:15.576865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:15.585557 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df17581c-b4a7-462d-8c20-d9fa4d9bdc8a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.161651 Nov 06 21:13:15.589976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.590423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.591216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:15.595367 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3391/6683] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:15 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:15.597805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:15.946248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:15.957969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6b3fdf4-876c-4252-a202-3c3e8fa6b54a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.385082 Nov 06 21:13:15.971946 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3293/6684] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:15 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:16.123201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:16.124327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:16.141917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.143942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.145366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.161389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.473324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a07d3b04-43eb-4bb5-a44c-9ee6b32f722d tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.354978 Nov 06 21:13:16.474702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3392/6685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:16 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:16.597261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:16.598801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:16.610206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.611270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.613846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.616248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.666771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a915045f-4b30-44cc-aea2-bd9b3b2cd480 req-e3c1b6b7-d95f-4400-986d-9926bb19085f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b926b16-6800-4434-bba1-eaecd376a004", "tag": "4f216ee9-de9d-482f-8670-f62ca79d0a08"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:16.669369 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:16.669369 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:16.677833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a915045f-4b30-44cc-aea2-bd9b3b2cd480 req-e3c1b6b7-d95f-4400-986d-9926bb19085f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.678573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a915045f-4b30-44cc-aea2-bd9b3b2cd480 req-e3c1b6b7-d95f-4400-986d-9926bb19085f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.693750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a915045f-4b30-44cc-aea2-bd9b3b2cd480 req-e3c1b6b7-d95f-4400-986d-9926bb19085f service nova] Creating event network-changed:4f216ee9-de9d-482f-8670-f62ca79d0a08 for instance 3b926b16-6800-4434-bba1-eaecd376a004 on nch2-master-1 Nov 06 21:13:16.696133 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ceeefc5-2b62-4f6d-bddd-089815e349cc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.103025 Nov 06 21:13:16.696811 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3393/6686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:16 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:16.701644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a915045f-4b30-44cc-aea2-bd9b3b2cd480 req-e3c1b6b7-d95f-4400-986d-9926bb19085f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283911 Nov 06 21:13:16.702676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3294/6687] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:16.976979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:16.977680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:16.987368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.988170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:16.989668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:16.990389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:17.204698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:17.218379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-060c040f-7dff-4223-aba6-9203cd528002 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.245165 Nov 06 21:13:17.219465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3394/6688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:16 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:17.495873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:17.496811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:17.510104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:17.510859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:17.513324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:17.514523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:17.710847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:17.711958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:17.725716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:17.726392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:17.727381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:17.727976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:17.797237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b314ac69-09e5-41e4-9af6-466ff6bf82e9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.090579 Nov 06 21:13:17.798176 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3395/6689] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:17 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:17.804753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d25e154-32ab-4346-90db-f37eaf72626c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.314165 Nov 06 21:13:17.805360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3295/6690] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:17 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:18.239393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:18.240337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:18.249371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.250126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.250936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.251534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.398636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:18.406556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f93247bf-35f4-495f-86d7-f9f6e83f18ad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.171316 Nov 06 21:13:18.407504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3396/6691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:18 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:18.808949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:18.810127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:18.817160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.817692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.818726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.819226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.822235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:18.822856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:18.833842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.834566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.835370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:18.835806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:18.859925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ddff696-675f-4abd-8637-61fc5dd22c94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 14 microversion: 2.1 time: 0.055139 Nov 06 21:13:18.861221 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3296/6692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:18 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:13:18.981466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76d8eed5-71a3-48ec-9636-2ba149ffee30 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.163313 Nov 06 21:13:18.982051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3397/6693] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:18 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:19.424420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:19.425131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:19.432018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:19.432527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:19.433313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:19.433755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:19.574562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:19.582674 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab5ee915-0e12-47fb-9c52-f6339f7a1753 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.162270 Nov 06 21:13:19.583250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3297/6694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:19 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:19.873192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:19.874739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:19.890514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:19.892530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:19.893689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:19.895067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:19.967281 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8f767bc-5167-46bb-946f-628e7243a6f3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 8154 microversion: 2.1 time: 0.099379 Nov 06 21:13:19.968244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3398/6695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:19 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 8154 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:20.004348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:20.005659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:20.014858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.015501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:20.016890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.017518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:20.196532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b991288c-8053-4e7d-a107-1ef9e9abfc54 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.201165 Nov 06 21:13:20.197718 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3298/6696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:19 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:20.601370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:20.602673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:20.609852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.611205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:20.612474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.613102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:20.773874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:20.781593 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1ce837f-50ee-43cb-ab82-ffe9eb8e5ce7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1697 microversion: 2.1 time: 0.184509 Nov 06 21:13:20.782181 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3399/6697] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:20 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:20.979735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:20.981009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:20.987716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.988220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:20.989056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:20.989501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:21.065532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0d5a847-9be1-4bc1-8cd8-0d6894d1c8a4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 16343 microversion: 2.1 time: 0.089632 Nov 06 21:13:21.066776 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3299/6698] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:20 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 16343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:21.216673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:21.218780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:21.227005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:21.227707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:21.228703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:21.229209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:21.542658 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edb57fb3-b533-4123-a332-a501c1d8d3fa tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.332008 Nov 06 21:13:21.543667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3400/6699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:21 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:21.658614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-unplugged", "status": "completed", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:21.660186 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:21.660186 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:21.670336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:21.670904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:21.686990 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] Creating event network-vif-unplugged:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch1-master-1 Nov 06 21:13:21.694131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:13:21.710442 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-04c12264-c148-4427-8c7e-ab6749544836 req-0535b50b-4ac7-42e0-808a-7a3cd7216227 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057234 Nov 06 21:13:21.712752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3300/6700] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:21.799960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:21.800685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:21.807306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:21.807831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:21.808671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:21.809120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:22.022813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ea53e8bb-f636-4d2b-a2ab-cdf5d3211739 req-1e40f6cd-b17b-49ef-97a2-a5c0a876db11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b926b16-6800-4434-bba1-eaecd376a004", "name": "network-vif-plugged", "status": "completed", "tag": "4f216ee9-de9d-482f-8670-f62ca79d0a08"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:22.024544 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:22.024544 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:22.033873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ea53e8bb-f636-4d2b-a2ab-cdf5d3211739 req-1e40f6cd-b17b-49ef-97a2-a5c0a876db11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:22.034389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ea53e8bb-f636-4d2b-a2ab-cdf5d3211739 req-1e40f6cd-b17b-49ef-97a2-a5c0a876db11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:22.048680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ea53e8bb-f636-4d2b-a2ab-cdf5d3211739 req-1e40f6cd-b17b-49ef-97a2-a5c0a876db11 service nova] Creating event network-vif-plugged:4f216ee9-de9d-482f-8670-f62ca79d0a08 for instance 3b926b16-6800-4434-bba1-eaecd376a004 on nch2-master-1 Nov 06 21:13:22.051052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:22.055788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ea53e8bb-f636-4d2b-a2ab-cdf5d3211739 req-1e40f6cd-b17b-49ef-97a2-a5c0a876db11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037375 Nov 06 21:13:22.057124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3301/6701] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:13:22.063229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea9d6deb-6072-44d9-9376-3aa26844e5bc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1696 microversion: 2.1 time: 0.268065 Nov 06 21:13:22.075163 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3401/6702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:21 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1696 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:22.085945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:22.091371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:22.100160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:22.100785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:22.101589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:22.102201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:22.151042 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58ef2ad1-f954-4444-a47a-00ffe730f912 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 16343 microversion: 2.1 time: 0.071053 Nov 06 21:13:22.151042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3302/6703] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:22 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 16343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:22.560311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:22.561635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:22.569490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:22.570375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:22.571502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:22.572143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.185734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:23.186290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:23.193765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:23.194410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.195394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:23.195922 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6735e729-f09e-47de-bfc0-da5793e324a7 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1463 microversion: 2.1 time: 0.639233 Nov 06 21:13:23.196074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.206072 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3402/6704] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:22 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1463 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:23.206072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:23.206072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:23.208549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:23.209011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.209803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:23.210244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.249865 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aaabe76b-4198-4b8b-bf9a-9a553328fa39 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 16343 microversion: 2.1 time: 0.051724 Nov 06 21:13:23.252582 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3403/6705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:23 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 16343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:23.521486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:23.531195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4ee6a07-332a-4e19-8885-de14454d4c11 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1696 microversion: 2.1 time: 0.453310 Nov 06 21:13:23.532833 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3303/6706] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:23 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1696 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:23.728520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:23.730180 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:23.730180 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:23.738644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:23.739091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:23.751078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] Creating event network-changed:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch1-master-1 Nov 06 21:13:23.758650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:13:23.770034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8151741e-d486-49ac-aac3-51e793ee09e6 req-23b57ed5-f0a2-47a3-ab4a-f5b02c883adf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045668 Nov 06 21:13:23.770779 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3404/6707] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:24.212591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:24.213197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.220413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.233049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.233994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.234443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.262823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:24.263866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.274237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.276626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.277984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.278631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.342759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19504340-8239-4509-91d9-ea2aef60ab3d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 16343 microversion: 2.1 time: 0.083855 Nov 06 21:13:24.343695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3405/6708] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:24 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 16343 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:24.461386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6c38d40-400e-42b0-a4d4-35d2f3b4668f tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1649 microversion: 2.1 time: 0.252267 Nov 06 21:13:24.461963 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3304/6709] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:24 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1649 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:24.480208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:24.480954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.487665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.488112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.488930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.489546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.558272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:24.559506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.570426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.571408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.572218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.573131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.636112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b78c06d-c9af-4e04-a300-e84f8174c4c4 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1649 microversion: 2.1 time: 0.160745 Nov 06 21:13:24.637203 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3406/6710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:24 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:24.654924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:24.655647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.674736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.675278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.677306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.677870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.825973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:24.834739 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae8426d4-50c7-4880-ba54-1b47ac9e764e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1694 microversion: 2.1 time: 0.285172 Nov 06 21:13:24.835356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3305/6711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:24 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1694 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:24.934547 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-402c1e65-c7d6-4f83-897a-ec4b84ef9406 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1649 microversion: 2.1 time: 0.285341 Nov 06 21:13:24.935375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3407/6712] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:24 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1649 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:24.952719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:24.953318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:24.960941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.961412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.962226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:24.962671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:24.991271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:13:25.075624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecf2ac0f-4771-4c5b-ada6-f90940f2ef27 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 204 len: 0 microversion: 2.1 time: 0.126282 Nov 06 21:13:25.076214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3306/6713] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:13:24 2021] DELETE /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:13:25.085814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:25.086577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:25.099440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.099851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:25.100687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.101334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:25.249482 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-915811c2-6a06-4e46-83c8-349fb7f567ad tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1655 microversion: 2.1 time: 0.167988 Nov 06 21:13:25.250070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3408/6714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:25 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:25.357823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:25.359862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:25.371277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.372683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:25.374397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.375804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:25.424939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75989628-cc65-4f53-b696-cd4ba66aedb0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 16343 microversion: 2.1 time: 0.072101 Nov 06 21:13:25.429907 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3307/6715] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:25 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 16343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:25.852886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:25.853917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:25.861344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.862080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:25.863090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:25.863534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:26.028070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:26.043746 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e605cdf7-560d-4e8a-8c8c-ea99b90c80d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1694 microversion: 2.1 time: 0.194334 Nov 06 21:13:26.058251 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3409/6716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:25 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:26.270404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:26.271483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:26.295476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:26.296249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:26.325547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:26.326258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:26.439228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:26.441356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:26.452270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:26.453691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:26.454751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:26.455600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:26.515524 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f59d45a-4410-40b4-a880-1ac337e8ae43 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.082455 Nov 06 21:13:26.516228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3410/6717] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:26 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:26.558661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3aec242-05d2-4aa2-836e-964684b5578b tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1655 microversion: 2.1 time: 0.295158 Nov 06 21:13:26.564366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3308/6718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:26 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1655 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:26.918014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'create', calling method: .version_select at 0x7f6707e41e50>, body: {"keypair": {"name": "tempest-keypair-482404392"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:26.955890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for project 2091e07dbaca4b439d38b56488c3048f. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:13:26.971828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for user 8ba94a4d3b5f43c1991b1c155b3c2853 and project 2091e07dbaca4b439d38b56488c3048f. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:13:27.061216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:27.062321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:27.075883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.076821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.077826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.078443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.156647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for project 2091e07dbaca4b439d38b56488c3048f. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:13:27.168114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for user 8ba94a4d3b5f43c1991b1c155b3c2853 and project 2091e07dbaca4b439d38b56488c3048f. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:13:27.208870 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f748329-dd12-4207-af8a-d6cb40cd8016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.32 time: 0.295473 Nov 06 21:13:27.209495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3411/6719] 10.222.0.13 () {62 vars in 1198 bytes} [Sat Nov 6 21:13:26 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 297 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:13:27.280928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6fb41b6a-c37f-413e-b215-36abbc8f9422 req-e59d4a35-9dd3-4cf3-885a-1c67899b6708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b926b16-6800-4434-bba1-eaecd376a004", "name": "network-vif-deleted", "tag": "4f216ee9-de9d-482f-8670-f62ca79d0a08"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:27.282525 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:27.282525 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:27.301538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6fb41b6a-c37f-413e-b215-36abbc8f9422 req-e59d4a35-9dd3-4cf3-885a-1c67899b6708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.303374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6fb41b6a-c37f-413e-b215-36abbc8f9422 req-e59d4a35-9dd3-4cf3-885a-1c67899b6708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.322051 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6fb41b6a-c37f-413e-b215-36abbc8f9422 req-e59d4a35-9dd3-4cf3-885a-1c67899b6708 service nova] Creating event network-vif-deleted:4f216ee9-de9d-482f-8670-f62ca79d0a08 for instance 3b926b16-6800-4434-bba1-eaecd376a004 on nch2-master-1 Nov 06 21:13:27.328566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6fb41b6a-c37f-413e-b215-36abbc8f9422 req-e59d4a35-9dd3-4cf3-885a-1c67899b6708 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052052 Nov 06 21:13:27.329505 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3412/6720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:27.384078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:27.395488 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d70a610e-a288-4998-851f-9015879344c1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1691 microversion: 2.1 time: 0.337927 Nov 06 21:13:27.396764 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3309/6721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:27 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:27.415270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:27.416481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:27.429160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.429734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.431183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.431845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.535362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:27.537030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:27.545814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.547222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.548433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.550348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.599795 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85907ed7-f080-4137-b881-7dbc59f610be tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action" status: 202 len: 0 microversion: 2.1 time: 0.189703 Nov 06 21:13:27.601560 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3413/6722] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:27 2021] POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:13:27.608913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:27.609780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:27.615131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-da02a41b-ca1f-4e0c-a875-f65dcded04d3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.090847 Nov 06 21:13:27.617035 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3310/6723] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:27 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:27.620339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.621485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.622424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.623045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.623776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:27.625040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:27.638102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.639903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.641010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.641918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.659781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:27.660630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:27.661135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lazy-loading 'fault' on Instance uuid 3b926b16-6800-4434-bba1-eaecd376a004 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:13:27.779605 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ba95bc3-4c1b-4a1c-b89c-7ea5e3b3ca40 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 200 len: 1453 microversion: 2.1 time: 0.174689 Nov 06 21:13:27.784853 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3414/6724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:27 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:28.006438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:28.016422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-143401c5-faa0-4cd8-9715-45698db3414b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.397760 Nov 06 21:13:28.017900 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3311/6725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:27 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:28.627965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:28.629690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:28.637013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.637823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.638878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.639543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.690950 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2b89715-172a-4b89-90f3-bf8777d555d4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.065147 Nov 06 21:13:28.692237 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3415/6726] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:28 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:28.803011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:28.804311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: 3b926b16-6800-4434-bba1-eaecd376a004] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:28.812008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.812690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.813672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.814106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.829414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] HTTP exception thrown: Instance 3b926b16-6800-4434-bba1-eaecd376a004 could not be found. Nov 06 21:13:28.830559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Returning 404 to user: Instance 3b926b16-6800-4434-bba1-eaecd376a004 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:28.831631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5afe2e1-0b13-4b92-a67d-5ef7e6058669 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004" status: 404 len: 111 microversion: 2.1 time: 0.033439 Nov 06 21:13:28.832181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3312/6727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:28 2021] GET /compute/v2.1/servers/3b926b16-6800-4434-bba1-eaecd376a004 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:13:28.842208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:28.843245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:28.851146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.851819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.852803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.854069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.879607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:13:28.936829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1703000170", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9d05c836-9ebe-45c6-ac6b-bc9513b61535"}, {"port": "65197fdc-c361-4fe6-bfc2-c5e8a6e80918", "tag": "port-1"}, {"port": "a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c", "tag": "port-2"}, {"uuid": "538a8624-f3bf-4857-8ec1-74778884f05f", "tag": "net-1"}, {"uuid": "538a8624-f3bf-4857-8ec1-74778884f05f"}, {"uuid": "99b40b59-cbc5-4528-be4b-431bf31e7971", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "99b40b59-cbc5-4528-be4b-431bf31e7971", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "26bcd7cd-d641-407f-9d6e-463c54fc3025", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4e056961-b9e2-465b-b784-f4012c5e4f43", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4422ae34-1eb5-41ba-9b68-f992e04d069f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--675845291"}], "key_name": "tempest-keypair-482404392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:28.967150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad37e0f1-e326-4800-aa10-ebbfcf49fedd tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 204 len: 0 microversion: 2.1 time: 0.129756 Nov 06 21:13:28.967786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3416/6728] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:13:28 2021] DELETE /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:13:28.976952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:28.977658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:28.983680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.984408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:28.985211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:28.985647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:29.084580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] validate_networks() for [('9d05c836-9ebe-45c6-ac6b-bc9513b61535', None, None, None, None, None), (None, None, '65197fdc-c361-4fe6-bfc2-c5e8a6e80918', None, None, None), (None, None, 'a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c', None, None, None), ('538a8624-f3bf-4857-8ec1-74778884f05f', None, None, None, None, None), ('538a8624-f3bf-4857-8ec1-74778884f05f', None, None, None, None, None), ('99b40b59-cbc5-4528-be4b-431bf31e7971', '10.2.2.100', None, None, None, None), ('99b40b59-cbc5-4528-be4b-431bf31e7971', '10.2.2.200', None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:13:29.216629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a810f253-123e-4e73-924a-298f8c7af426 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1654 microversion: 2.1 time: 0.243643 Nov 06 21:13:29.217202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3417/6729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:28 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1654 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:29.227064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:29.227821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:29.234082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:29.234608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:29.235462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:29.235986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:29.479090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:29.486453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-871a4a49-099a-4e29-a3b1-bd3115c172e2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.268281 Nov 06 21:13:29.487041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3418/6730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:29 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:29.702599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:29.703516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:29.709782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:29.710228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:29.711005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:29.711442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:29.760835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e514e2f0-7373-423a-88e3-5b5a7e95d798 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.061674 Nov 06 21:13:29.761796 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3419/6731] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:29 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:30.216117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-plugged", "status": "completed", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:30.217775 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:30.217775 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:30.226664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.227216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.239734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] Creating event network-vif-plugged:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch1-master-1 Nov 06 21:13:30.245970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:13:30.263683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-34c67010-3b68-4022-8c70-db25b9bc071c req-55455b53-1711-41b9-b7f7-e6eef07f0c3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051537 Nov 06 21:13:30.264288 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3420/6732] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:13:30.270840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:30.271747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:30.278126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.278801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.279790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.280424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.491643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b03a6968-212c-4ed8-abd7-fdf06edd54ac tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1654 microversion: 2.1 time: 0.225939 Nov 06 21:13:30.492222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3421/6733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:30 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1654 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:30.503773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:30.504413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:30.512061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.512550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.513358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.513807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.749765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:30.757406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6527a168-451d-4ba5-91a0-57b22951e0c2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.257713 Nov 06 21:13:30.757979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3422/6734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:30 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:30.772606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:30.773530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:30.779864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.780347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.781138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:30.781569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:30.823479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd4bcbd1-0444-495b-a329-48c1ac92d837 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.054287 Nov 06 21:13:30.825500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3423/6735] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:30 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:31.184635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:13:31.185142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:13:31.185574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:13:31.186245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:13:31.186548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:13:31.196082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.196568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.197409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.197844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.215123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for project 2091e07dbaca4b439d38b56488c3048f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:13:31.220323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Getting quotas for user 8ba94a4d3b5f43c1991b1c155b3c2853 and project 2091e07dbaca4b439d38b56488c3048f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:13:31.383763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:13:31.386839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='26bcd7cd-d641-407f-9d6e-463c54fc3025',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4e056961-b9e2-465b-b784-f4012c5e4f43',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4422ae34-1eb5-41ba-9b68-f992e04d069f',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:13:31.512553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:31.513777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:31.522564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.525965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.527388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.528860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.650358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5dfffea7-ece8-4113-94d8-d2124aa3ce3c tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 200 len: 1612 microversion: 2.1 time: 0.142521 Nov 06 21:13:31.662629 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3424/6736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:31 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 1612 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:31.667828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c4ce164c-d6c7-4734-855f-24f779a4dd8a req-a94d8273-d3e2-4455-b642-b45854e74380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f056496d-0887-4e24-a9ef-72033e9367b5", "name": "network-vif-deleted", "tag": "9d54e755-fa08-4c54-aa91-492af054eab4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:31.669458 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:31.669458 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:31.677403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c4ce164c-d6c7-4734-855f-24f779a4dd8a req-a94d8273-d3e2-4455-b642-b45854e74380 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.677865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c4ce164c-d6c7-4734-855f-24f779a4dd8a req-a94d8273-d3e2-4455-b642-b45854e74380 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.690820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c4ce164c-d6c7-4734-855f-24f779a4dd8a req-a94d8273-d3e2-4455-b642-b45854e74380 service nova] Creating event network-vif-deleted:9d54e755-fa08-4c54-aa91-492af054eab4 for instance f056496d-0887-4e24-a9ef-72033e9367b5 on nch1-master-1 Nov 06 21:13:31.696368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c4ce164c-d6c7-4734-855f-24f779a4dd8a req-a94d8273-d3e2-4455-b642-b45854e74380 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Nov 06 21:13:31.697185 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3425/6737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:31.782639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:31.783590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:31.793189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.793819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.794767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.795968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.819194 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a23fb42b-52cb-4c47-8975-d4b32e370507 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 2.886338 Nov 06 21:13:31.820635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3313/6738] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Nov 6 21:13:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 2888 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 06 21:13:31.826535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-unplugged", "status": "completed", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:31.828763 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:31.828763 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:31.840370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:31.840835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:31.854267 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] Creating event network-vif-unplugged:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:13:31.861719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:13:31.882544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e72e50c6-b20a-44e0-8e73-d4e091b9ae4c req-5a690929-2aae-4937-af4d-0ae14dfa788a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060402 Nov 06 21:13:31.887613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3314/6739] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:31.896053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:31.897263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:31.983814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:31.997676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:31.999560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:32.001479 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b09a525-7403-4ae1-9071-2804e1f95b69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1285 microversion: 2.32 time: 0.111465 Nov 06 21:13:32.003084 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3315/6740] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:31 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:32.008035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:32.009298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:32.016650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:32.017013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:32.017860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:32.018303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:32.080517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15a98ae5-f309-40a3-a702-aa9303987c61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.071066 Nov 06 21:13:32.082927 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3316/6741] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:32 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:32.146254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:32.167359 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-952a0e5d-7882-4438-ae79-f8369fdf9aed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.395844 Nov 06 21:13:32.170101 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3426/6742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:31 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:13:32.669313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:32.670017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] [instance: f056496d-0887-4e24-a9ef-72033e9367b5] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:32.679071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:32.680634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:32.681460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:32.681896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:32.697561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] HTTP exception thrown: Instance f056496d-0887-4e24-a9ef-72033e9367b5 could not be found. Nov 06 21:13:32.698171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] Returning 404 to user: Instance f056496d-0887-4e24-a9ef-72033e9367b5 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:13:32.699195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd21c6d1-0152-4657-8453-afb55d369ff1 tempest-TestServerMultinode-1525071989 tempest-TestServerMultinode-1525071989-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5" status: 404 len: 111 microversion: 2.1 time: 0.034429 Nov 06 21:13:32.699962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3317/6743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:32 2021] GET /compute/v2.1/servers/f056496d-0887-4e24-a9ef-72033e9367b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:13:33.021637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:33.022898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:33.030231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.031525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.032452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.033570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.091934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:33.093166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:33.101451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.101967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.103140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.103697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.128136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:33.140256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:33.142827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:33.146060 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77f5c35b-ba93-4483-9eee-4dfb0f5bee66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1583 microversion: 2.32 time: 0.128349 Nov 06 21:13:33.147549 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3427/6744] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:33 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1583 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:33.147684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13abdb5d-6a99-4756-beff-b749fb80db22 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.060150 Nov 06 21:13:33.160127 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3318/6745] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:33 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:33.189396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:33.190121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:33.197406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.198086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.198965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.200427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.354994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:33.363485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-320f30cc-3530-4583-a1fc-f09f5ad51ce9 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.180650 Nov 06 21:13:33.364275 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3428/6746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:33 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:33.906521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:33.911338 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:33.911338 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:33.919667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:33.920198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:33.932757 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] Creating event network-changed:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:13:33.938533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:13:33.953386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a8cfd39a-0c65-4673-8544-4ff539ce8469 req-cab7dcee-10e0-47a5-80a8-234b577e50f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051066 Nov 06 21:13:33.955705 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3319/6747] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:34.167318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:34.168549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:34.176930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:34.181191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.182269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.182607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:34.183721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.184349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.214714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.217722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.218755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.221483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.257913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:34.267564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:34.269737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:34.270985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a516ab77-f5fd-47b6-afd7-46357d565908 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1593 microversion: 2.32 time: 0.107982 Nov 06 21:13:34.271713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3429/6748] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:34 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1593 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:34.274410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4333cdd0-fc42-455b-9d33-eb87eefebd51 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.106405 Nov 06 21:13:34.275585 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3320/6749] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:34 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:34.382349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:34.383602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:34.390978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.391746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.393778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:34.394554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:34.975157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:34.989489 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1702440-da84-4501-a10e-cbfc86c0363e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.610745 Nov 06 21:13:34.990480 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3430/6750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:34 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:35.289394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:35.291381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:35.292156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:35.292807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:35.301288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:35.301715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:35.301960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:35.302615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:35.303341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:35.303797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:35.304070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:35.304737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:35.356423 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-449b087b-f591-4c83-977a-e6bbfeee4f13 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.073333 Nov 06 21:13:35.361672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3321/6751] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:35 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:35.490451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:35.503157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:35.504917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:35.506743 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e94dab40-f54f-4fe0-bebd-aeb2144825dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1660 microversion: 2.32 time: 0.219670 Nov 06 21:13:35.508060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3431/6752] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:35 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1660 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:13:36.007557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:36.008142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:36.024031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.041119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.051709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.052597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.308581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:36.319030 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3258eea3-596b-4828-84cd-2fcac5df0306 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1690 microversion: 2.1 time: 0.315527 Nov 06 21:13:36.319926 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3322/6753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:36 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1690 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:36.392931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:36.395128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:36.407068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.408412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.409428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.410727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.499393 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4207ca8-6ddb-47f2-9f2b-0b46586fae76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.133915 Nov 06 21:13:36.500883 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3432/6754] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:36 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:36.532806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:36.533548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:36.546033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.546793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.547946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:36.548645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:36.847937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:36.857770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:36.859257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:36.860424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36bb1a83-c93e-4e25-a61c-3ca6380471ea tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1706 microversion: 2.32 time: 0.337486 Nov 06 21:13:36.867907 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3323/6755] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:36 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1706 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:37.339091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:37.339933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:37.348044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.348662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:37.349551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.350059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:37.511495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:37.512616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:37.520546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.521004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:37.521830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.522265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:37.575287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2d6aacbd-f429-43bb-941b-db6f9b113f09 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.067476 Nov 06 21:13:37.576046 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3324/6756] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:37 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:37.694536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:37.721422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02b385ce-12d9-4151-a564-a6a93c70a161 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1683 microversion: 2.1 time: 0.385545 Nov 06 21:13:37.722759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3433/6757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:13:37 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1683 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:13:37.888112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:37.888996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:37.895897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.900998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:37.903638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:37.905366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:38.203587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:38.216037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-df593a54-0aa9-4b37-8359-916b108cac74 req-bbe69c37-b0ac-4163-a487-961c7aa81be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-plugged", "status": "completed", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:38.217697 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:38.217697 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:38.229437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:38.235290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:38.239623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df593a54-0aa9-4b37-8359-916b108cac74 req-bbe69c37-b0ac-4163-a487-961c7aa81be6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:38.239802 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09debf6c-22c1-41a0-8668-e92477d63ad4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1740 microversion: 2.32 time: 0.356130 Nov 06 21:13:38.240083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df593a54-0aa9-4b37-8359-916b108cac74 req-bbe69c37-b0ac-4163-a487-961c7aa81be6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:38.241344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3325/6758] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:37 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:38.273186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-df593a54-0aa9-4b37-8359-916b108cac74 req-bbe69c37-b0ac-4163-a487-961c7aa81be6 service nova] Creating event network-vif-plugged:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:13:38.285773 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-df593a54-0aa9-4b37-8359-916b108cac74 req-bbe69c37-b0ac-4163-a487-961c7aa81be6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071888 Nov 06 21:13:38.286712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3434/6759] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:38.587330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:38.588936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:38.598359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:38.600879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:38.608009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:38.608919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:38.676072 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40689212-2145-48ff-965f-65ab3ac24368 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.092618 Nov 06 21:13:38.676935 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3326/6760] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:38 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:39.259669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:39.261200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:39.270473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:39.271206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:39.272222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:39.272939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:39.553076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:39.562430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:39.564250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:39.565531 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1ff736a-c492-432a-9a44-66b3c45e368f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1832 microversion: 2.32 time: 0.310181 Nov 06 21:13:39.566370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3435/6761] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:39 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1832 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:39.687906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:39.694427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:39.704536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:39.705361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:39.706389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:39.707033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:39.761171 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0976f0c-3f90-4bf6-8acd-751188ed6428 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.076572 Nov 06 21:13:39.762225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3327/6762] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:39 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:39.920435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5d6eed1a-4b62-4ee3-87fe-e47f1debd749 req-9ad849c9-80db-4665-991a-a9ad7f8a2b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:39.922155 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:39.922155 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:39.933113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5d6eed1a-4b62-4ee3-87fe-e47f1debd749 req-9ad849c9-80db-4665-991a-a9ad7f8a2b0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:39.933493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5d6eed1a-4b62-4ee3-87fe-e47f1debd749 req-9ad849c9-80db-4665-991a-a9ad7f8a2b0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:39.949622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5d6eed1a-4b62-4ee3-87fe-e47f1debd749 req-9ad849c9-80db-4665-991a-a9ad7f8a2b0e service nova] Creating event network-changed:caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:39.955843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5d6eed1a-4b62-4ee3-87fe-e47f1debd749 req-9ad849c9-80db-4665-991a-a9ad7f8a2b0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039785 Nov 06 21:13:39.957244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3436/6763] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:40.585082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:40.586195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:40.595703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:40.596449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:40.597685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:40.598481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:40.781663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:40.784158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:40.793389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:40.794354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:40.795998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:40.797528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:40.833412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:40.843410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:40.845569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:40.849525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e21e5be-ff6a-45a5-a6ac-0b16fbddfdf9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1853 microversion: 2.32 time: 0.268557 Nov 06 21:13:40.850361 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3328/6764] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:40 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1853 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:40.866261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e23591a-2713-4f04-a498-ac3bee9818af tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.096417 Nov 06 21:13:40.866996 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3437/6765] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:40 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:41.870455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:41.871053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:41.883999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:41.884547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:41.885555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:41.886059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:41.886719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:41.887107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:41.896954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:41.897740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:41.899666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:41.900390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:41.964518 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf41c953-e576-4b43-b5c0-8ccde402d6bf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.090031 Nov 06 21:13:41.969477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3438/6766] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:41 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:42.003141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f8c65d0d-f12b-43c6-bdca-0285640d66e7 req-cda5c25a-67de-4e33-b5e9-778d4a329eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "65197fdc-c361-4fe6-bfc2-c5e8a6e80918"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:42.005111 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:42.005111 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:42.028124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f8c65d0d-f12b-43c6-bdca-0285640d66e7 req-cda5c25a-67de-4e33-b5e9-778d4a329eab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:42.028898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f8c65d0d-f12b-43c6-bdca-0285640d66e7 req-cda5c25a-67de-4e33-b5e9-778d4a329eab service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:42.045668 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f8c65d0d-f12b-43c6-bdca-0285640d66e7 req-cda5c25a-67de-4e33-b5e9-778d4a329eab service nova] Creating event network-changed:65197fdc-c361-4fe6-bfc2-c5e8a6e80918 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:42.051042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f8c65d0d-f12b-43c6-bdca-0285640d66e7 req-cda5c25a-67de-4e33-b5e9-778d4a329eab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053146 Nov 06 21:13:42.052345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3439/6767] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:42.799623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:42.812202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:42.814793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:42.816586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c55f2cb-c5ff-4f8b-b2f4-aef9a17dc6d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.949661 Nov 06 21:13:42.828636 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3329/6768] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:41 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:42.978012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:42.979412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:42.988355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:42.989019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:42.990635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:42.991301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:43.047541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c91d32e9-f522-4075-bf3d-b2e09a5efc10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.065819 Nov 06 21:13:43.050492 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3440/6769] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:42 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:43.836053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:43.837494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:43.846409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:43.856893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:43.858026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:43.858780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:44.063394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:44.065018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:44.072867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:44.073730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:44.074762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:44.075425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:44.141809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90bb2de9-14f4-4225-a8c9-9f15cd25c980 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.084526 Nov 06 21:13:44.149312 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3441/6770] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:44 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:44.163365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c"}, {"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "f7d05032-4b91-4c3e-8527-9398846f0081"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:44.165477 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:44.165477 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:44.182553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:44.183494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:44.208606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] Creating event network-changed:a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:44.209509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] Creating event network-changed:f7d05032-4b91-4c3e-8527-9398846f0081 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:44.217437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-641c179d-8f77-49d5-96a6-8f954ecd1781 req-c32be74d-0326-4419-ae7f-44a4404e3969 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066247 Nov 06 21:13:44.218283 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3442/6771] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:44.268811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:44.284276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:44.287342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:44.288866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00ea0069-4cba-4f89-b78c-98288dc1c50d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.456700 Nov 06 21:13:44.305219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3330/6772] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:43 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:45.158845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:45.161434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:45.175927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:45.177085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:45.180140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:45.180949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:45.254273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19c6dbe3-bba9-4779-8a05-29668073c0e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.103195 Nov 06 21:13:45.258138 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3443/6773] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:45 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:45.309429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:45.310155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:45.317052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:45.317723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:45.318701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:45.319298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:45.526153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:45.536245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:45.538058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:45.539450 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8372114c-bb44-45b3-ad0d-0e75a57a8268 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.234816 Nov 06 21:13:45.552937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3331/6774] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:45 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:46.251134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "89e5b536-ea65-4af4-a7d6-a983f8c270b9"}, {"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "c1811b60-ace5-4089-a26b-30b8d0069c32"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:46.253944 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:46.253944 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:13:46.265975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:46.267313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:46.270641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:46.271937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:46.284133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:46.284646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:46.284793 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] Creating event network-changed:89e5b536-ea65-4af4-a7d6-a983f8c270b9 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:46.285299 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] Creating event network-changed:c1811b60-ace5-4089-a26b-30b8d0069c32 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:46.285561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:46.286004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:46.292229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c56da4e4-6bdd-4258-af25-e0bb3c4429cd req-d4c611f7-e217-40df-8563-3802d494fbec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046753 Nov 06 21:13:46.292942 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3444/6775] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:46 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:46.350737 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91b8c333-5715-45e6-94b8-1d9dc2f2f27c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.086223 Nov 06 21:13:46.355629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3332/6776] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:46 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:46.562126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:46.563053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:46.573581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:46.574104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:46.574923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:46.575422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:46.940527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:46.951141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:46.952768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:46.953961 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd368381-21f8-43f3-83cb-77bdca959dac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.398831 Nov 06 21:13:46.957313 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3445/6777] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:46 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:47.367456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:47.368503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:47.376225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:47.377171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:47.378153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:47.378829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:47.418756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14fafdcb-63c1-44cf-8fc5-4e1e58ffd0c1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.055154 Nov 06 21:13:47.419404 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3333/6778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:47 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:47.975665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:47.976493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:47.984203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:47.984803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:47.985648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:47.986115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:48.203993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:48.215366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:48.217223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:48.218404 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7807b17a-e91f-48f9-8475-9be94718a460 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.246528 Nov 06 21:13:48.230133 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3446/6779] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:47 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:48.350264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ccaa19db-41e2-4366-9ce2-39e4b08d41af req-ef4fb4f2-46aa-4b63-829c-e4479cb62d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "5f331138-9e82-4582-82e6-5987fc8432ec"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:48.351950 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:13:48.351950 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:13:48.365958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ccaa19db-41e2-4366-9ce2-39e4b08d41af req-ef4fb4f2-46aa-4b63-829c-e4479cb62d42 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:48.366834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ccaa19db-41e2-4366-9ce2-39e4b08d41af req-ef4fb4f2-46aa-4b63-829c-e4479cb62d42 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:48.393571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ccaa19db-41e2-4366-9ce2-39e4b08d41af req-ef4fb4f2-46aa-4b63-829c-e4479cb62d42 service nova] Creating event network-changed:5f331138-9e82-4582-82e6-5987fc8432ec for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:13:48.402786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ccaa19db-41e2-4366-9ce2-39e4b08d41af req-ef4fb4f2-46aa-4b63-829c-e4479cb62d42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056693 Nov 06 21:13:48.404992 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3334/6780] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:13:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:13:48.431567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:48.432520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:48.439828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:48.440730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:48.442528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:48.443323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:48.490472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16415153-4e14-46e0-94a7-2ac375280db9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.063312 Nov 06 21:13:48.492175 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3447/6781] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:48 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:49.238103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:49.238835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:49.245212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:49.245662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:49.246440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:49.246872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:49.441995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:49.450786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:49.452383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:49.453616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c434f31-d6dc-4620-b514-8d3ed5973e16 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.219649 Nov 06 21:13:49.454855 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3335/6782] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:49 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:49.502733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:49.503772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:49.510978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:49.511425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:49.512212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:49.512671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:49.552621 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-566fe4c9-be4a-4297-9603-cfe6b3eb6571 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.053627 Nov 06 21:13:49.553627 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3448/6783] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:49 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:50.475718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:50.477020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:50.488167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:50.489862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:50.491044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:50.491980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:50.566949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:50.568824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:50.577959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:50.578692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:50.579815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:50.580636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:50.637984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab720e6b-f68c-486b-bece-40451c78d0e6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.076655 Nov 06 21:13:50.642922 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3449/6784] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:50 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:50.828843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:50.840062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:50.842284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:50.844457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d744e5d9-d481-4c91-9ec1-7766437b0578 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.374974 Nov 06 21:13:50.858163 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3336/6785] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:50 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:51.653150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:51.654186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:51.662505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:51.662967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:51.664274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:51.664970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:51.737659 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-636df3bd-293c-411b-a56d-596258d6b80e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.090430 Nov 06 21:13:51.738612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3450/6786] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:51 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:51.869280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:51.869919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:51.882631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:51.883089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:51.883906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:51.889733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:52.176813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:52.186070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:52.187595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:52.188845 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b771cca-7f7c-46c0-96af-7b8fc1816454 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.328552 Nov 06 21:13:52.205727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3337/6787] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:51 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:52.750448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:52.752411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:52.760850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:52.761320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:52.762130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:52.762614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:52.808011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1de10ff-c996-4538-b2cb-fc5a428578e8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.061588 Nov 06 21:13:52.809305 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3451/6788] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:52 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:53.219263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:53.220941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:53.233021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:53.234175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:53.236633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:53.237735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:53.577613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:53.597427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:53.599640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:53.602099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6536a24-40d9-4e48-a63c-0d78499da498 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.389628 Nov 06 21:13:53.603856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3338/6789] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:53 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:53.830860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:53.833477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:53.851495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:53.852260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:53.853454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:53.855113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:53.914685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-888f5ff3-73d5-4cfb-a3eb-abaaa8517b01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.098593 Nov 06 21:13:53.916498 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3452/6790] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:53 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:13:54.622608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:54.624092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:54.637271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:54.638125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:54.639322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:54.640055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:54.927042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:54.928180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:54.940281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:54.940758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:54.941573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:54.942020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:55.006328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3d22e87-df1f-4748-a7b5-7fe205883b7a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.083587 Nov 06 21:13:55.007290 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3453/6791] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:54 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:55.127680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:55.146422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:55.150585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:55.152169 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21d87c96-e7f9-4959-8397-a4d92a93dfaf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.533889 Nov 06 21:13:55.154431 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3339/6792] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:54 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:56.019022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:56.020856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:56.028459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:56.029312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:56.030377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:56.031074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:56.076196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f97853b-3eed-4f2f-ac25-ea1d13740e41 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.061306 Nov 06 21:13:56.077202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3454/6793] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:56 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:56.177502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:56.178761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:56.186534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:56.187522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:56.189007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:56.189750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:56.435687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:56.445045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:56.446537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:56.447680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd6c69d9-8d87-4fe5-b2d4-861a290b61fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.274889 Nov 06 21:13:56.448613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3340/6794] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:56 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:57.088756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:57.089781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:57.098515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:57.098908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:57.099564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:57.100009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:57.147093 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d47789a-4def-4b17-8716-b8602664dfc3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.062262 Nov 06 21:13:57.147788 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3455/6795] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:57 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:57.466729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:57.467340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:57.475308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:57.475763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:57.476607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:57.477041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:57.704875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:57.714975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:57.716998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:57.717989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fb8cf62-62c1-4cd1-9df3-2700c5c1d25d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.255087 Nov 06 21:13:57.718547 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3341/6796] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:57 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:13:58.160233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:58.161400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:58.175334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:58.175518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:58.176556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:58.179362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:58.245938 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0003a58-2a99-4828-9963-6316cebb961f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.090065 Nov 06 21:13:58.246877 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3456/6797] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:58 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:13:58.736914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:13:58.737678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:58.745780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:58.747015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:58.747897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:58.748436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:59.012454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:59.021493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:59.023169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:13:59.024748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57c9146e-1c04-45be-a3a3-d14e998109a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.291351 Nov 06 21:13:59.025536 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3342/6798] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:13:58 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:13:59.259458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:13:59.261159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:13:59.269584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:59.270449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:59.277294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:13:59.277770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:13:59.328826 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-018894a5-4096-43b7-8db9-b5ef44638e48 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.073659 Nov 06 21:13:59.329900 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3457/6799] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:13:59 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:00.045000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:00.045808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:00.054776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:00.055284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:00.056264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:00.056825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:00.260873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:00.272383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:00.274057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:00.275296 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5ae0ab4-844f-4cf5-a677-4f992af35129 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.235299 Nov 06 21:14:00.275865 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3343/6800] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:00 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:14:00.341188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:00.342316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:00.350471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:00.350927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:00.351718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:00.352162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:00.392105 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-847d497f-dde7-4213-952f-9b0857c612b9 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.054988 Nov 06 21:14:00.392932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3458/6801] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:00 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:00.578225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-464042117", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3c5000a8-e03a-4e24-bc89-dd47a4e195c6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:00.684217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:14:01.151528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:14:01.152179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:14:01.153358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:14:01.154183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:14:01.154709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:14:01.166467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.167320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.168419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.168994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.188772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:01.194466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:01.209746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:14:01.211995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3c5000a8-e03a-4e24-bc89-dd47a4e195c6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:14:01.295832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721389 Nov 06 21:14:01.296648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3344/6802] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:14:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:14:01.301610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:01.302945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:01.306705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc26de47-07b1-4372-a82a-d3757fc7352b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:01.307560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc26de47-07b1-4372-a82a-d3757fc7352b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:01.318347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.319807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.321590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.322226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.431600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dc26de47-07b1-4372-a82a-d3757fc7352b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:01.441567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc26de47-07b1-4372-a82a-d3757fc7352b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1056 microversion: 2.1 time: 0.138246 Nov 06 21:14:01.442560 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3345/6803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:01 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1056 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:01.459861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:01.461628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:01.468227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.469027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.470574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:01.471192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:01.520537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf884de8-c89d-41d5-a2e1-ac7c3fa289c6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.066324 Nov 06 21:14:01.521432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3346/6804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:01 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:01.648964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:01.660007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:01.661598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:01.663175 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc0070e9-351d-4d3e-9ba0-feba934a855c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.372556 Nov 06 21:14:01.664809 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3459/6805] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:01 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:14:02.460555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:02.461270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:02.468786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.469287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.470073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.470513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.532890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:02.533824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:02.542775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.543249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.544058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.545008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.573118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:02.582811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a21f9bbf-8ae2-4bf8-8ada-ccab17a17938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1126 microversion: 2.1 time: 0.126707 Nov 06 21:14:02.583620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3347/6806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:02 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1126 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:02.593480 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f0c2ad2-0a99-4aea-8565-81efb66f7904 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.064442 Nov 06 21:14:02.594311 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3460/6807] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:02 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:02.683219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:02.683890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:02.690990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.691453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.692244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:02.692717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:02.983243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:02.994985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:02.996929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:02.998096 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7643aa73-baf3-45d6-aa5a-6d0a96f85a95 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.319285 Nov 06 21:14:02.998646 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3348/6808] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:02 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:03.600479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:03.601105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:03.606500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:03.607426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:03.608524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:03.608978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:03.610443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:03.611074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:03.614816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:03.615278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:03.616081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:03.616551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:03.656194 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d10bdb24-af89-40d0-ab90-0b63fc56a54a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.053352 Nov 06 21:14:03.659956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3349/6809] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:03 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:03.858660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:03.870411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0371db41-f1d6-4d93-b5ac-4339c520e44a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1168 microversion: 2.1 time: 0.274090 Nov 06 21:14:03.871024 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3461/6810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:03 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1168 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:04.005204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a5c66392-8b0a-4e33-8edb-b948f2ab91d2 req-d14ab251-476d-4e6b-b3bf-201d95e2c02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a16319-9c25-43d9-b62a-f62f73ec23c2", "tag": "6090dab7-2731-4bd6-b69b-d8b51521b463"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:04.007245 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:04.007245 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:04.019673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:04.021090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:04.022707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a5c66392-8b0a-4e33-8edb-b948f2ab91d2 req-d14ab251-476d-4e6b-b3bf-201d95e2c02f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.023263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a5c66392-8b0a-4e33-8edb-b948f2ab91d2 req-d14ab251-476d-4e6b-b3bf-201d95e2c02f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.039041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.039874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.041206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.041958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.051079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a5c66392-8b0a-4e33-8edb-b948f2ab91d2 req-d14ab251-476d-4e6b-b3bf-201d95e2c02f service nova] Creating event network-changed:6090dab7-2731-4bd6-b69b-d8b51521b463 for instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 on nch1-master-1 Nov 06 21:14:04.057431 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a5c66392-8b0a-4e33-8edb-b948f2ab91d2 req-d14ab251-476d-4e6b-b3bf-201d95e2c02f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058534 Nov 06 21:14:04.058969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3350/6811] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:04.236836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-699a60e7-4f60-4684-a377-054ba940a257 req-2d838238-f2a2-427d-95d3-e863bded84af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:04.238541 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:04.238541 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:04.246572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-699a60e7-4f60-4684-a377-054ba940a257 req-2d838238-f2a2-427d-95d3-e863bded84af service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.246841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-699a60e7-4f60-4684-a377-054ba940a257 req-2d838238-f2a2-427d-95d3-e863bded84af service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.264179 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-699a60e7-4f60-4684-a377-054ba940a257 req-2d838238-f2a2-427d-95d3-e863bded84af service nova] Creating event network-vif-plugged:caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:04.269612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-699a60e7-4f60-4684-a377-054ba940a257 req-2d838238-f2a2-427d-95d3-e863bded84af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Nov 06 21:14:04.270571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3351/6812] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:14:04.371788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:04.381632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:04.383271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:04.384478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aaac0f57-557a-40cf-8788-086fb5c1dd53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.370224 Nov 06 21:14:04.385058 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3462/6813] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:04 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:04.669479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:04.670506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:04.677273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.677729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.678518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.678958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.721497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89c44d8d-b0e8-4363-8254-bee1f7e6d0f8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.057163 Nov 06 21:14:04.725313 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3352/6814] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:04 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:04.887051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:04.887700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:04.894600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.895058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:04.895849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:04.896354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:05.134862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:05.143213 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aff7e939-ce32-4dde-8fc9-f2dfc7881023 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1168 microversion: 2.1 time: 0.259943 Nov 06 21:14:05.143791 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3463/6815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:04 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1168 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:05.403431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:05.404137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:05.411109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:05.411565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:05.412374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:05.412813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:05.601714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:05.610882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:05.612419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:05.613578 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bb098b9-743f-4cb5-a62c-662aea38a278 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.214289 Nov 06 21:14:05.614146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3353/6816] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:05 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:05.733256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:05.734148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:05.740824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:05.741328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:05.742241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:05.742796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:05.781800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55f7525b-72d6-4e09-9b1f-9df858a19b77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.052377 Nov 06 21:14:05.782653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3464/6817] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:05 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:06.160262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:06.161545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:06.171021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.171499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.173457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.173912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.295587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-074c3c52-126c-47d2-851b-547ff88419f1 req-e217c382-eff8-4267-a9c0-bdd9e49fe849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "89e5b536-ea65-4af4-a7d6-a983f8c270b9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:06.299535 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:06.299535 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:06.308978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-074c3c52-126c-47d2-851b-547ff88419f1 req-e217c382-eff8-4267-a9c0-bdd9e49fe849 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.309681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-074c3c52-126c-47d2-851b-547ff88419f1 req-e217c382-eff8-4267-a9c0-bdd9e49fe849 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.322142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:06.326757 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-074c3c52-126c-47d2-851b-547ff88419f1 req-e217c382-eff8-4267-a9c0-bdd9e49fe849 service nova] Creating event network-vif-plugged:89e5b536-ea65-4af4-a7d6-a983f8c270b9 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:06.329618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9b61686-29e3-4b5b-be48-dea0d6da61c8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1168 microversion: 2.1 time: 0.173440 Nov 06 21:14:06.330131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3354/6818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:06 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:06.333089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-074c3c52-126c-47d2-851b-547ff88419f1 req-e217c382-eff8-4267-a9c0-bdd9e49fe849 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044585 Nov 06 21:14:06.334436 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3465/6819] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:14:06.633019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:06.633642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:06.639795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.640241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.641806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.642253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.794759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:06.797453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:06.804528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.805430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.806425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:06.807071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:06.851623 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ed0811b5-4cc3-44d3-908e-73255a4a5340 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.061553 Nov 06 21:14:06.852824 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3466/6820] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:06 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:06.855272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:06.865183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:06.866688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:06.867854 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0a8041d-5c1e-4d0b-bfba-6a194d57d51a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.238823 Nov 06 21:14:06.868733 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3355/6821] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:06 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:07.347359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:07.348747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:07.357937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.357937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.358839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.360205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.495128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:07.502973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40ac6809-8409-4979-97df-a71d551b6108 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.160036 Nov 06 21:14:07.503534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3467/6822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:07 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:07.863474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:07.864425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:07.871169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.871624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.872463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.872907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.889785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:07.890419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:07.896969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.897433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.898262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:07.898703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:07.912882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-895b0828-6e83-475e-a16e-5a854c101604 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.053473 Nov 06 21:14:07.914491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3356/6823] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:07 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:08.089952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:08.099676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:08.101238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:08.102405 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df5967e8-6aa9-4d5d-af23-43d050aeaeba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.217467 Nov 06 21:14:08.102995 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3468/6824] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:07 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:14:08.362857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "f7d05032-4b91-4c3e-8527-9398846f0081"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "5f331138-9e82-4582-82e6-5987fc8432ec"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "65197fdc-c361-4fe6-bfc2-c5e8a6e80918"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-plugged", "status": "completed", "tag": "c1811b60-ace5-4089-a26b-30b8d0069c32"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:08.364856 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:08.364856 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:08.372729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:08.373169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:08.384889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Creating event network-vif-plugged:a5dc497e-cfbd-4ded-8cf6-c606d4dd8a9c for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:08.385395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Creating event network-vif-plugged:f7d05032-4b91-4c3e-8527-9398846f0081 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:08.385889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Creating event network-vif-plugged:5f331138-9e82-4582-82e6-5987fc8432ec for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:08.386384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Creating event network-vif-plugged:65197fdc-c361-4fe6-bfc2-c5e8a6e80918 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:08.386867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] Creating event network-vif-plugged:c1811b60-ace5-4089-a26b-30b8d0069c32 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:08.392838 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-eefee9cf-e53d-407d-85ab-b3834d6eb02a req-e2deff6b-a0f4-403b-ab73-c13929f6ba99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.033928 Nov 06 21:14:08.393435 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3357/6825] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:08.520561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:08.521194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:08.527703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:08.528156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:08.528972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:08.529655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:08.661225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:08.669430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12ac4b0b-3e1a-4bd5-aedc-3a7683ec9af6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.153238 Nov 06 21:14:08.670022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3469/6826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:08 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:08.926241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:08.927256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:08.933336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:08.933782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:08.934542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:08.934972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:08.973305 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2d80b3c6-dd21-41cf-8823-2340a7b8be26 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.051939 Nov 06 21:14:08.973916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3358/6827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:08 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:09.120966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:09.121585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:09.128010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.128558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:09.129300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.129740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:09.315468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:09.324279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:09.325809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:09.326961 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41ddf4fe-3a0d-434f-a1f6-8a89990f912b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1874 microversion: 2.32 time: 0.209760 Nov 06 21:14:09.327535 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3470/6828] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:09 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1874 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:09.687245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:09.687981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:09.695364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.695825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:09.696638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.697086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:09.830570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:09.837970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-03ab7e67-e295-48d7-bf0d-70b2793a7a45 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.154739 Nov 06 21:14:09.838544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3359/6829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:09 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:09.985122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:09.985979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:09.992472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.992875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:09.993663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:09.994099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.033840 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a4709ef0-2f94-42d3-9d26-42cdd9abcbd6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 24511 microversion: 2.1 time: 0.052458 Nov 06 21:14:10.034683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3471/6830] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:09 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 24511 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:10.345423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:10.346074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:10.352453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.352911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.353697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.354140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.542164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:10.551358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:10.552923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:10.554142 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85151463-561d-451d-a02e-c6931d3c0ec2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2828 microversion: 2.32 time: 0.212458 Nov 06 21:14:10.554698 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3360/6831] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:14:10 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2828 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:14:10.574138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:10.574724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:10.581629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.582086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.582874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.583318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.708189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-858b3670-8182-4a0a-8490-50f041cfb4d5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.138051 Nov 06 21:14:10.708819 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3472/6832] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 21:14:10 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/os-interface => generated 1832 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:10.853920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:10.854532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:10.861750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.862218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:10.863024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:10.863467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:11.046738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:11.047709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:11.055622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:11.056881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:11.057861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:11.058509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:11.113445 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e9e154d-8b06-4831-94a9-7a0206961cdc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.071175 Nov 06 21:14:11.114114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3473/6833] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:11 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:11.462085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:11.469521 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90826cd9-d803-4acb-9d0a-f07077f18aca tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.619173 Nov 06 21:14:11.470094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3361/6834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:10 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:11.997631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:11.998637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:12.006415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.006868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.007663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.008098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.067553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f37c3d4d-56bc-4c68-aeca-17d5ec14f656 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action" status: 200 len: 63114 microversion: 2.1 time: 0.073780 Nov 06 21:14:12.068141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:12.069016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:12.069261 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3474/6835] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:11 2021] POST /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc/action => generated 63114 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:12.075887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-da6d74e7-0481-4283-b2b6-41a5447d6098 req-c87f29a0-73ab-4fe5-80d6-d9cbd7a08b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "tag": "caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:12.076065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.076647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.077515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.077647 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:12.077647 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:12.078227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.089587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-da6d74e7-0481-4283-b2b6-41a5447d6098 req-c87f29a0-73ab-4fe5-80d6-d9cbd7a08b82 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.090035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-da6d74e7-0481-4283-b2b6-41a5447d6098 req-c87f29a0-73ab-4fe5-80d6-d9cbd7a08b82 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.103526 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-da6d74e7-0481-4283-b2b6-41a5447d6098 req-c87f29a0-73ab-4fe5-80d6-d9cbd7a08b82 service nova] Creating event network-changed:caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:14:12.108971 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-da6d74e7-0481-4283-b2b6-41a5447d6098 req-c87f29a0-73ab-4fe5-80d6-d9cbd7a08b82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037344 Nov 06 21:14:12.109570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3475/6836] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:12.126322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:12.127697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:12.128779 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ad1cddf-35dd-42d5-992c-7b395a9c52bd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.065354 Nov 06 21:14:12.130188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3362/6837] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:12 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:12.135685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.136137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.136985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.137421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.178747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9790354d-3778-4ccd-9196-a98771b7ecdf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.056788 Nov 06 21:14:12.179715 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3476/6838] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:12 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:12.487801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:12.488628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:12.495566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.496029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.496863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:12.497309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:12.643577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:12.651252 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a95ba00f-1ad8-441e-b9f2-29c08dc5b050 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.167538 Nov 06 21:14:12.651830 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3363/6839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:12 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:13.139660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:13.140707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:13.147974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.148472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.149260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.149701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.190823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:13.191755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:13.197268 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6738bea-0876-418f-a668-039866d5e432 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.061626 Nov 06 21:14:13.201820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3477/6840] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:13 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:13.202191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.203446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.204816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.205423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.249782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca8abccc-4ba5-4ca1-8b02-fc30d1e29243 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.062480 Nov 06 21:14:13.251298 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3364/6841] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:13 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:13.669223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:13.669846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:13.676919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.677370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.678176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:13.678609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:13.814389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:13.821937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-487306f7-69b8-4a4e-96ed-8a299786783d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.157292 Nov 06 21:14:13.822499 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3478/6842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:13 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:14.209819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:14.210857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:14.218009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.218459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.219243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.219672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.258756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb7d8060-406c-4721-b6c2-d82eb6792d8b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.052897 Nov 06 21:14:14.259617 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3365/6843] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:14.261682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:14.262601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:14.269969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.270418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.271196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.271632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.311219 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17dc4828-39ae-4f4b-a170-69d64b4ad4f2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.053026 Nov 06 21:14:14.312104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3479/6844] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:14 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:14.432073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a57c75fd-e26a-4925-bdc9-652c747a52d9 req-424bb4fc-b31a-4f29-8e06-ee4bdc3b6708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a16319-9c25-43d9-b62a-f62f73ec23c2", "name": "network-vif-plugged", "status": "completed", "tag": "6090dab7-2731-4bd6-b69b-d8b51521b463"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:14.433665 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:14.433665 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:14.441958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a57c75fd-e26a-4925-bdc9-652c747a52d9 req-424bb4fc-b31a-4f29-8e06-ee4bdc3b6708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.442538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a57c75fd-e26a-4925-bdc9-652c747a52d9 req-424bb4fc-b31a-4f29-8e06-ee4bdc3b6708 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.453354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a57c75fd-e26a-4925-bdc9-652c747a52d9 req-424bb4fc-b31a-4f29-8e06-ee4bdc3b6708 service nova] Creating event network-vif-plugged:6090dab7-2731-4bd6-b69b-d8b51521b463 for instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 on nch1-master-1 Nov 06 21:14:14.458137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a57c75fd-e26a-4925-bdc9-652c747a52d9 req-424bb4fc-b31a-4f29-8e06-ee4bdc3b6708 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030197 Nov 06 21:14:14.458715 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3366/6845] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:14.839307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:14.840012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:14.847654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.848109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.848928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:14.849373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:14.981645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:14.989086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35dcf223-d760-417b-9db4-d71c27f1eba8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1202 microversion: 2.1 time: 0.153830 Nov 06 21:14:14.989656 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3480/6846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:14 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:15.271428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:15.272369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:15.278512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:15.278970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:15.279754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:15.280194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:15.318610 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b34090db-aadb-4a10-97bb-e8febcad8533 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.052530 Nov 06 21:14:15.319963 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3367/6847] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:15.323332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:15.324302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:15.332455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:15.332945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:15.333734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:15.334179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:15.376722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84940e31-8d5c-42c0-b45b-6599e3a915ca tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.057294 Nov 06 21:14:15.377360 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3481/6848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:15 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:16.007940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:16.008669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.017118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.017573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.018356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.018794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.158024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:16.165463 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1842c73-b9d3-4c0b-9234-724ba3bfbdb3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1390 microversion: 2.1 time: 0.162549 Nov 06 21:14:16.166292 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3368/6849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:16 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:16.182654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:16.183366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.190323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.190788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.191582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.192027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.329778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:16.330831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.330964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:16.338249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.338566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e3a7d59-63b4-457e-bca6-e4fad6e4771f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1390 microversion: 2.1 time: 0.160006 Nov 06 21:14:16.338691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.339146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3482/6850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:16 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:16.339485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.339990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.354722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:16.355334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.361102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.361561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.362348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.362789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.379353 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-711cd14d-3dca-4868-8629-a6e636ee7d91 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.053642 Nov 06 21:14:16.379967 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3369/6851] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:16 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:16.388391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:16.389374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.396410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.396861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.397667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.398101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.439924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-971c1ca9-a443-4b2c-bd83-32bb2a489251 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.054985 Nov 06 21:14:16.440508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3370/6852] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:16 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:16.498032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:16.505512 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-baf631cd-bd7c-48da-a2a3-d81be44640cd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1390 microversion: 2.1 time: 0.154335 Nov 06 21:14:16.506095 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3483/6853] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:16 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:16.572084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:16.572702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.580187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.580664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.581449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.581891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.606270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:14:16.677661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 204 len: 0 microversion: 2.1 time: 0.109178 Nov 06 21:14:16.678346 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3371/6854] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:14:16 2021] DELETE /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:14:16.686166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:16.686786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:16.693221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.693608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.694390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:16.694824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:16.833468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:16.841567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f65aea89-562b-497f-ae30-e2e83138219c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1396 microversion: 2.1 time: 0.159019 Nov 06 21:14:16.842135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3484/6855] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:16 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1396 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:17.390748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:17.391791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:17.399130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.399612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:17.400430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.400875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:17.440399 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-efc38601-2490-40f7-ab7b-bdef9f45af3a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.053542 Nov 06 21:14:17.441216 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3372/6856] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:17.451238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:17.452151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:17.458917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.459365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:17.460144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.460628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:17.501971 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7bd865cb-e62c-4f54-bd5e-484ca083cc77 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.054261 Nov 06 21:14:17.502601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3485/6857] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:17 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:17.858927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:17.859661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:17.867277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.867733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:17.868555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:17.868997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.010000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:18.018178 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b988f51-22e4-4b1c-a348-a2f74acfefc6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1396 microversion: 2.1 time: 0.163309 Nov 06 21:14:18.018743 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3373/6858] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:17 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:18.451510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:18.452532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:18.459767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:18.460228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.461043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:18.461536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.501523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03a2cd15-071d-48ec-aa66-bb3f62d5d6c4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.053274 Nov 06 21:14:18.502323 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3486/6859] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:18.513498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:18.514494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:18.521939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:18.522500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.523344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:18.523850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.564213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a59d849-c7ff-471c-b63c-a566c6c2d28c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.054224 Nov 06 21:14:18.568337 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3374/6860] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:18 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:18.823035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a8fa6268-3779-4686-bf59-5cf8bba63884 req-de9ad794-a3ef-42f9-8f27-89358facaa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a16319-9c25-43d9-b62a-f62f73ec23c2", "name": "network-vif-deleted", "tag": "6090dab7-2731-4bd6-b69b-d8b51521b463"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:18.824627 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:18.824627 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:18.833500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a8fa6268-3779-4686-bf59-5cf8bba63884 req-de9ad794-a3ef-42f9-8f27-89358facaa05 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:18.833945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a8fa6268-3779-4686-bf59-5cf8bba63884 req-de9ad794-a3ef-42f9-8f27-89358facaa05 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:18.849734 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a8fa6268-3779-4686-bf59-5cf8bba63884 req-de9ad794-a3ef-42f9-8f27-89358facaa05 service nova] Creating event network-vif-deleted:6090dab7-2731-4bd6-b69b-d8b51521b463 for instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 on nch1-master-1 Nov 06 21:14:18.855689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a8fa6268-3779-4686-bf59-5cf8bba63884 req-de9ad794-a3ef-42f9-8f27-89358facaa05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036530 Nov 06 21:14:18.856489 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3487/6861] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:19.036369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:19.037054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:19.057402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.057923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.058648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.059079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.135232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:19.142859 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4af0b9e4-d34f-4fff-8ae8-b85178c16714 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 200 len: 1187 microversion: 2.1 time: 0.111728 Nov 06 21:14:19.143420 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3375/6862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:19 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:19.513069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:19.514102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:19.521562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.522018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.522795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.523233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.562352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51b33999-12ae-418f-8463-6bb0e772f873 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.053267 Nov 06 21:14:19.563496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3488/6863] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:19 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:19.575560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:19.576507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:19.583842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.584330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.585103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:19.585543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:19.624534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4215b5fb-35c7-4da0-9dba-cd3e05225295 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.052396 Nov 06 21:14:19.625086 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3376/6864] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:19 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:20.160766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:20.161395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:20.168546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.168999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.169775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.170208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.183905 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. Nov 06 21:14:20.184515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:14:20.185326 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-619f2f39-5cb4-4c67-aeb5-e0e09ea8b12b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 404 len: 111 microversion: 2.1 time: 0.029398 Nov 06 21:14:20.185847 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3489/6865] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:20 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:14:20.213749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:20.214334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:20.221704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.222156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.222929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.223364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.237036 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. Nov 06 21:14:20.237615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:14:20.238425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d99ba0f-0381-49c4-b71e-7bace76e2681 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 404 len: 111 microversion: 2.1 time: 0.028689 Nov 06 21:14:20.238933 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3377/6866] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:14:20 2021] DELETE /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:14:20.246611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:20.247219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 44a16319-9c25-43d9-b62a-f62f73ec23c2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:20.253442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.253892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.254661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.255092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.268589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. Nov 06 21:14:20.269169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 44a16319-9c25-43d9-b62a-f62f73ec23c2 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:14:20.269968 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-134800e7-7bc0-4850-b985-af4a370942be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2" status: 404 len: 111 microversion: 2.1 time: 0.027042 Nov 06 21:14:20.270477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3490/6867] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:20 2021] GET /compute/v2.1/servers/44a16319-9c25-43d9-b62a-f62f73ec23c2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:14:20.574467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:20.575447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:20.583576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.584177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.584838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.585384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.628945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e57d7f19-f86c-4fce-8458-a65b6e75f337 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.058715 Nov 06 21:14:20.629559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3378/6868] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:20.636464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:20.637380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:20.644785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.645236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.646012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:20.646443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:20.692227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bff904ad-6be3-4791-a022-71175f7698cd tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059277 Nov 06 21:14:20.692909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3491/6869] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:20 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:21.642226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:21.643692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:21.653816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:21.654399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:21.655400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:21.656195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:21.705627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:21.706544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:21.713723 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60bcd0ab-ea12-4c2d-8d1e-4fbdcde8515a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.076912 Nov 06 21:14:21.714630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:21.714782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3379/6870] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:21.714936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:21.715678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:21.716117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:21.770816 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b09f33a-08bd-4cf3-9d8c-fc81ccb02e42 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.069279 Nov 06 21:14:21.775405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3492/6871] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:21 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:22.725715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:22.726700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:22.733937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:22.734381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:22.735815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:22.736243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:22.780481 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1284fcb-44a0-4f28-9b74-f1d7b8d5afd2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 14 microversion: 2.32 time: 0.058686 Nov 06 21:14:22.781872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3380/6872] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:22.783919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:22.784952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:22.792528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:22.792989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:22.793841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:22.794321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:22.838951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51039ecd-85b6-47b4-8b04-f7aaf9929c4d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059308 Nov 06 21:14:22.839992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3493/6873] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:22 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:23.793423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:23.794388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:23.803198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:23.803816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:23.804627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:23.805064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:23.851898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:23.853187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:23.862861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3f8f5746-f8e4-4569-9f62-3a2317e1b1a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 8206 microversion: 2.32 time: 0.070740 Nov 06 21:14:23.865228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:23.867277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:23.869433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:23.870172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:23.870828 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3381/6874] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:23 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 8206 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:14:23.933784 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd33a376-a50d-43bb-b678-6ac64f136939 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.086037 Nov 06 21:14:23.936397 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3494/6875] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:23 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:24.878003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:24.879018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:24.886371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:24.886956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:24.887858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:24.888517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:24.948065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:24.949297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:24.949542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ce91127-bba8-47bf-a476-7d15d8c2eb6f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 16396 microversion: 2.32 time: 0.075641 Nov 06 21:14:24.951029 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3382/6876] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 16396 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:24.958527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:24.959093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:24.959946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:24.960522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:25.002319 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3126f65a-3ad7-49cd-8c09-998130db9488 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058353 Nov 06 21:14:25.003066 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3495/6877] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:24 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:25.961480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:25.962490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:25.969779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:25.970231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:25.971053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:25.971490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:26.013081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07486504-806b-4046-86d1-bf42e21d73bb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 16396 microversion: 2.32 time: 0.055595 Nov 06 21:14:26.013898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3383/6878] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:25 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 16396 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:26.014992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:26.016062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:26.023686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:26.024135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:26.024945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:26.025381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:26.068153 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c1e6966-c4a0-4fc8-a2fd-0821bc287009 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.057093 Nov 06 21:14:26.069399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3496/6879] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:26 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:26.161947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1852924961", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "30e31686-d6ad-41a8-9b56-75a9763a23d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:26.219018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:14:26.586323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:14:26.586752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:14:26.587233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:14:26.587650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:14:26.588093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:14:26.597134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:26.597585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:26.598416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:26.598852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:26.615192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:26.620112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:26.675597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:14:26.678047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30e31686-d6ad-41a8-9b56-75a9763a23d5',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:14:26.799763 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-873c77a8-0e80-4711-8743-111d61213434 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641810 Nov 06 21:14:26.800737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3384/6880] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:14:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:14:26.811347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8339341-9729-4ff5-a885-fa620c336769 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:26.812195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8339341-9729-4ff5-a885-fa620c336769 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:26.872527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d8339341-9729-4ff5-a885-fa620c336769 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:26.881656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8339341-9729-4ff5-a885-fa620c336769 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1071 microversion: 2.1 time: 0.074842 Nov 06 21:14:26.882255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3497/6881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:26 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1071 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:27.024738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:27.025738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:27.032579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.033044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.033837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.034278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.080343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:27.081293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:27.081447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-acc81ee8-e1dd-4730-8a09-0e3571027cb3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 16396 microversion: 2.32 time: 0.060303 Nov 06 21:14:27.085901 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3385/6882] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:27 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 16396 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:27.089343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.089802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.090628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.091090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.141076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4fbae29e-7b3e-434a-a9ae-14d37f22efd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064498 Nov 06 21:14:27.141848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3498/6883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:27 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:27.900014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:27.900797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:27.908146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.908918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.909888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:27.910338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:27.984182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:27.992102 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43a91fbc-d404-4538-9c45-19d68a28aa46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1187 microversion: 2.1 time: 0.097044 Nov 06 21:14:27.992927 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3386/6884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:27 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:28.093173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:28.095212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:28.102598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.103131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.104181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.105966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.154325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:28.156771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:28.156934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a1695e2-34c8-4fcf-ad82-0f1108a4d7e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 16396 microversion: 2.32 time: 0.066872 Nov 06 21:14:28.157956 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3499/6885] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:28 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 16396 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:28.166757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.167529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.168672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.169326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.216780 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74e9a0de-ad80-461e-9c55-9520f422df76 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.067048 Nov 06 21:14:28.218102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3387/6886] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:28 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:28.629179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:28.629911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:28.644604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.645072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.645941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:28.646386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:28.907520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-344d9f95-7b4b-4b7b-99b3-98f3ed5fcb44 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1834 microversion: 2.1 time: 0.527151 Nov 06 21:14:28.908359 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3500/6887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:28 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1834 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:29.010886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:29.011620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:29.018559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.019022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.019818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.020262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.169643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:29.170679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:29.179360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.180366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.181189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.181968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.245242 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e16aafcc-1438-471d-a13f-162f934e638d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.079407 Nov 06 21:14:29.246062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3501/6888] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:29.253387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:29.254665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:29.265710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.266429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.267435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.268219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.320872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a8f266a-f4a6-4ae7-b647-247e425e4b5c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.072582 Nov 06 21:14:29.323537 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3502/6889] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:29 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:29.423204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:29.434050 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e216b13-2d8b-4f79-819a-f5ab5c0f1cfc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.426960 Nov 06 21:14:29.434864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3388/6890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:29 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:29.677177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-fbfa1a44-2f0e-455a-a327-ba4acb9b3a96 req-056c7564-a325-41d0-b6cc-2f7a83bd1a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2071d671-763b-44cf-9037-2041ce4aba8c", "tag": "75d70963-502a-42c6-8cc4-6be35746612d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:29.679281 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:29.679281 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:29.689387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-fbfa1a44-2f0e-455a-a327-ba4acb9b3a96 req-056c7564-a325-41d0-b6cc-2f7a83bd1a6d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:29.690585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-fbfa1a44-2f0e-455a-a327-ba4acb9b3a96 req-056c7564-a325-41d0-b6cc-2f7a83bd1a6d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:29.714279 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-fbfa1a44-2f0e-455a-a327-ba4acb9b3a96 req-056c7564-a325-41d0-b6cc-2f7a83bd1a6d service nova] Creating event network-changed:75d70963-502a-42c6-8cc4-6be35746612d for instance 2071d671-763b-44cf-9037-2041ce4aba8c on nch1-master-1 Nov 06 21:14:29.721767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-fbfa1a44-2f0e-455a-a327-ba4acb9b3a96 req-056c7564-a325-41d0-b6cc-2f7a83bd1a6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052314 Nov 06 21:14:29.722842 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3503/6891] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:30.258115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:30.259235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:30.267559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.268021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.268910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.269346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.316283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74dccfc2-eebb-4899-a7ad-6adafffddc32 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.061928 Nov 06 21:14:30.323103 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3389/6892] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:30 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:30.334658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:30.335698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:30.343813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.344268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.345451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.346592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.395248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0d943ed-aee6-4c01-bde3-38c17865e35e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064848 Nov 06 21:14:30.396182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3504/6893] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:30 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:30.455886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:30.456663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:30.463694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.464150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.464980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:30.465422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:30.806896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:30.815745 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4236edc1-481a-46c0-9330-dff9f0e3c1ab tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.363945 Nov 06 21:14:30.816534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3390/6894] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:30 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:31.081782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:31.082696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:31.090208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.090661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.091599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.092035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.122369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:14:31.208140 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8df4f32b-5b5e-41bc-85b9-1393df60292d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 204 len: 0 microversion: 2.1 time: 0.131688 Nov 06 21:14:31.209621 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3505/6895] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:14:31 2021] DELETE /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:14:31.218517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:31.219799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:31.227300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.227865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.228746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.229257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.332309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:31.333529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:31.340563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.341260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.342024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.342559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.392653 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da0e35d3-bbd9-4d99-8234-1c215ab9d347 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.064784 Nov 06 21:14:31.397250 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3506/6896] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:31 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:31.409012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:31.410417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:31.418142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.419110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.420087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.420665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.473396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4bec5c69-ce5f-4318-b30e-9e4445008aa4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.069936 Nov 06 21:14:31.474437 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3507/6897] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:31 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:31.506958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:31.519980 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54077442-7f8f-4b9c-862d-afdf65ea97dd tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1689 microversion: 2.1 time: 0.305708 Nov 06 21:14:31.533244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3391/6898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:31 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1689 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:31.739011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f89ceac4-8182-4a24-aeae-fc4bf5376eb3 req-b06075df-70f7-4389-99fc-611f141b90f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:31.740715 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:31.740715 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:31.748737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f89ceac4-8182-4a24-aeae-fc4bf5376eb3 req-b06075df-70f7-4389-99fc-611f141b90f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.749300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f89ceac4-8182-4a24-aeae-fc4bf5376eb3 req-b06075df-70f7-4389-99fc-611f141b90f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.762422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f89ceac4-8182-4a24-aeae-fc4bf5376eb3 req-b06075df-70f7-4389-99fc-611f141b90f7 service nova] Creating event network-changed:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:14:31.768126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f89ceac4-8182-4a24-aeae-fc4bf5376eb3 req-b06075df-70f7-4389-99fc-611f141b90f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Nov 06 21:14:31.769371 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3508/6899] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:31.835932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:31.836956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:31.844135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.844720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.845527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:31.846266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:31.994703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:32.003241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b6d1a0e-976d-47ed-809c-346182da95db tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.174852 Nov 06 21:14:32.008389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3392/6900] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:31 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:32.407332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:32.408445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:32.414970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.415417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.416486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.416917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.460825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8df475d-19fe-4e68-a3c2-35ac5bbc3032 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.059572 Nov 06 21:14:32.461595 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3509/6901] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:32.487396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:32.488472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:32.497052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.497580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.498527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.498983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.541152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:32.541889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:32.549537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.550075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.550851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:32.551291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:32.583165 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4f078cf-2f4c-4d12-b2ca-598af67a755c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.100297 Nov 06 21:14:32.584212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3393/6902] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:32 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:32.692188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:32.700046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72e8a29a-c575-438b-be88-a8791c1d930f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1570 microversion: 2.1 time: 0.163469 Nov 06 21:14:32.700639 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3510/6903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:32 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:33.020961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:33.021680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:33.032481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.033014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.033910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.034374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.182855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:33.192482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74c9bb13-cbd2-49ec-8456-62a85f89e77f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.175375 Nov 06 21:14:33.193178 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3394/6904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:33 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:33.311050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-de828d69-ef9f-41ff-8bfc-19c199ce5f62 req-814b6f4f-59cd-410a-ad1b-0b312d8768bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3707478e-4d1f-4bb6-a83a-38b441df31bc", "name": "network-vif-deleted", "tag": "e8b11155-24fd-4fc2-808c-429b581602a3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:33.312804 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:33.312804 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:33.321249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-de828d69-ef9f-41ff-8bfc-19c199ce5f62 req-814b6f4f-59cd-410a-ad1b-0b312d8768bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.321678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-de828d69-ef9f-41ff-8bfc-19c199ce5f62 req-814b6f4f-59cd-410a-ad1b-0b312d8768bc service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.333463 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-de828d69-ef9f-41ff-8bfc-19c199ce5f62 req-814b6f4f-59cd-410a-ad1b-0b312d8768bc service nova] Creating event network-vif-deleted:e8b11155-24fd-4fc2-808c-429b581602a3 for instance 3707478e-4d1f-4bb6-a83a-38b441df31bc on nch2-master-1 Nov 06 21:14:33.338682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-de828d69-ef9f-41ff-8bfc-19c199ce5f62 req-814b6f4f-59cd-410a-ad1b-0b312d8768bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Nov 06 21:14:33.339438 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3511/6905] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:33.473664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:33.474498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:33.480926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.481402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.482187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.482625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.524797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6d18647-7486-4ddc-8780-1ab80a6a726c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.054850 Nov 06 21:14:33.525347 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3395/6906] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:33 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:33.600433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:33.601744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:33.609289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.609915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.610854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.611503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.672900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8274a363-5a6c-4e85-98aa-7773e9f9d3fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.080483 Nov 06 21:14:33.673580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3512/6907] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:33 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:33.720252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:33.721632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:33.728827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.729288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.730990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.731650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.770870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:33.771369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:33.771822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lazy-loading 'fault' on Instance uuid 3707478e-4d1f-4bb6-a83a-38b441df31bc {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:14:33.815546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:33.824048 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20fdb1ea-8fd6-452b-8a4b-5057165f9604 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 200 len: 1356 microversion: 2.1 time: 0.109439 Nov 06 21:14:33.824638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3396/6908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:33 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:34.210056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:34.210757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:34.217746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.218227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.219091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.219529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.351608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:34.360721 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8731589-44a5-43d8-811e-95d8fb1bded6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.154677 Nov 06 21:14:34.361255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3513/6909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:34 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:34.536508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:34.537558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:34.544263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.544753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.545542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.545984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.587853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc4bf714-748e-418a-9c5e-3eb5ab0afac7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.054680 Nov 06 21:14:34.588588 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3397/6910] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:34.684550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:34.685718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:34.692715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.693180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.694005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.694513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.736564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-418802e9-0cb6-4dac-bc14-99c93bf566bb tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.055725 Nov 06 21:14:34.737200 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3514/6911] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:34 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:34.846265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:34.846980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 3707478e-4d1f-4bb6-a83a-38b441df31bc] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:34.854035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.854523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.855296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:34.855740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:34.870957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] HTTP exception thrown: Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc could not be found. Nov 06 21:14:34.871501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Returning 404 to user: Instance 3707478e-4d1f-4bb6-a83a-38b441df31bc could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:14:34.872381 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-004055ce-2bdd-4fc6-8680-faff61e4aec8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc" status: 404 len: 111 microversion: 2.1 time: 0.030735 Nov 06 21:14:34.872945 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3398/6912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:34 2021] GET /compute/v2.1/servers/3707478e-4d1f-4bb6-a83a-38b441df31bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:14:35.377670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:35.378640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:35.386515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.387135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.387940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.388566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.595975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:35.601052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:35.602575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:35.604426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-508cee82-c39d-424c-8f47-dc432b1df56a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.230933 Nov 06 21:14:35.605050 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3515/6913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:35 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:35.611543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.612484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.613437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.614073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.659840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0141b8c3-f8d3-4d52-a75f-92ecb44d4502 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.063481 Nov 06 21:14:35.660523 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3399/6914] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:35 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:35.748682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:35.749783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:35.758566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.759081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.760173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:35.760664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:35.801694 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f96f807-4909-43ea-a3f7-cb572fbc2407 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.056932 Nov 06 21:14:35.802588 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3516/6915] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:35 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:36.502859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c5697968-b4a7-4012-ad2e-3aa4d2c31e9c req-c0714b35-3e2f-4e60-930f-c4f91aa04a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2071d671-763b-44cf-9037-2041ce4aba8c", "name": "network-vif-plugged", "status": "completed", "tag": "75d70963-502a-42c6-8cc4-6be35746612d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:36.504986 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:36.504986 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:36.513869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c5697968-b4a7-4012-ad2e-3aa4d2c31e9c req-c0714b35-3e2f-4e60-930f-c4f91aa04a6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.514626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c5697968-b4a7-4012-ad2e-3aa4d2c31e9c req-c0714b35-3e2f-4e60-930f-c4f91aa04a6b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.528708 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c5697968-b4a7-4012-ad2e-3aa4d2c31e9c req-c0714b35-3e2f-4e60-930f-c4f91aa04a6b service nova] Creating event network-vif-plugged:75d70963-502a-42c6-8cc4-6be35746612d for instance 2071d671-763b-44cf-9037-2041ce4aba8c on nch1-master-1 Nov 06 21:14:36.534240 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c5697968-b4a7-4012-ad2e-3aa4d2c31e9c req-c0714b35-3e2f-4e60-930f-c4f91aa04a6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036841 Nov 06 21:14:36.535038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3400/6916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:36.624598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:36.626343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:36.639102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.639751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.640740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.641314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.677939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:36.682374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:36.692413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.692849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.693794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.694419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.747509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bd22d19-61ea-4f53-94de-c2f083d9aa06 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.078291 Nov 06 21:14:36.753097 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3401/6917] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:36.818415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:36.820224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:36.829766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.830363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.831266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:36.832061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:36.877122 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-546a089c-62f4-490a-a5cc-6dffe974ee2e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.065969 Nov 06 21:14:36.878121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3402/6918] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:36 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:36.978208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:36.990729 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78150552-561b-4a04-b730-c9cd3f2a03e1 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.370925 Nov 06 21:14:36.991502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3517/6919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:36 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:37.761697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:37.763791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:37.772903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:37.773761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:37.775775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:37.776706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:37.832055 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e58bf15b-3c15-4a16-98be-dc1ed3230c23 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.075102 Nov 06 21:14:37.836648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3403/6920] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:37.889909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:37.891713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:37.901454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:37.901985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:37.902842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:37.903507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:37.975552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6984bbbd-a497-485f-9433-747453a13b2a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.089378 Nov 06 21:14:37.977245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3518/6921] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:37 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:38.009292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:38.010012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:38.019137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:38.019609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:38.020454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:38.020903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:38.352001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:38.361915 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ab300e6-e8f8-4847-bb76-31a7c98a6059 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1217 microversion: 2.1 time: 0.357232 Nov 06 21:14:38.362964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3404/6922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:38 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:38.853530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:38.854334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:38.865159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:38.865751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:38.866673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:38.867256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:38.928065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa1b6b75-d5ec-4824-bd6d-2fe9370be2db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.085507 Nov 06 21:14:38.928954 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3519/6923] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:38.961390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5e6c824-7b76-46b6-afb7-e7e35ffb76cb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '.version_select at 0x7f6714bca820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:38.984446 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5e6c824-7b76-46b6-afb7-e7e35ffb76cb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1717002790" status: 202 len: 0 microversion: 2.1 time: 0.027181 Nov 06 21:14:38.988826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3405/6924] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Nov 6 21:14:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1717002790 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:38.993948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:38.995627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:39.005127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.006173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.006709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.007339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.027274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: .version_select at 0x7f67153e4e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1372491887"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:39.048052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:39.053788 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b60aa2cb-9a9f-4aef-a0d6-d852aeb5191c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.069216 Nov 06 21:14:39.054558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:39.055832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3520/6925] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:38 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:39.382123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:39.383136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:39.391196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.391658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.392558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.393002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.393378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:39.399368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:39.417908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f12ec91-7b5e-4516-821e-05681c8d2fad tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.395457 Nov 06 21:14:39.418784 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3406/6926] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:14:39 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:39.539109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:39.550958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a4dbc31-c6bf-473b-8114-6137ec6b9154 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1404 microversion: 2.1 time: 0.174225 Nov 06 21:14:39.551698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3521/6927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:39 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:39.568973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:39.570024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:39.576622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.577317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.578842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.579511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.748196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:39.757357 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-185df9b9-c011-4d83-acdc-8ca4f72bfc9f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1404 microversion: 2.1 time: 0.192835 Nov 06 21:14:39.758315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3407/6928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:39 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:39.775465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-669746329"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:39.776558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:39.784217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.784968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.785986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.786454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.905411 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Attempting to quiesce instance before volume snapshot. Nov 06 21:14:39.940254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:39.941366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:39.947339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.947799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.948616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:39.949220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:39.961879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 06 21:14:39.994861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f9fa5f4-4be4-45b3-9458-8c38019936fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.058695 Nov 06 21:14:39.997254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3408/6929] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:40.063545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Creating snapshot from volume 30e31686-d6ad-41a8-9b56-75a9763a23d5. {{(pid=134827) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Nov 06 21:14:40.068087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:40.069182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:40.077360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:40.079077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:40.080125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:40.080982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:40.130993 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8ce4d0c-e292-4144-9280-be262fa3923e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.067637 Nov 06 21:14:40.132279 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3409/6930] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:40 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:41.007823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:41.008892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:41.021423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:41.022203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:41.024477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:41.024981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:41.088517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f76a931e-2a45-4b58-a10f-cbaca3a84eff tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.084549 Nov 06 21:14:41.089932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3410/6931] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:41.144430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:41.146359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:41.157135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:41.157696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:41.158875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:41.159573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:41.172697 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c/action" status: 202 len: 0 microversion: 2.1 time: 1.400908 Nov 06 21:14:41.173395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3522/6932] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:39 2021] POST /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c/action => generated 0 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 21:14:41.211443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cfa608da-b91d-44f2-a90b-4e74a55aebb2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.072277 Nov 06 21:14:41.212162 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3411/6933] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:41 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:41.307112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1249054432", "imageRef": "67bbfe4f-be87-4496-9c90-d6638a028d0d", "flavorRef": "452", "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:41.373615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:14:42.101823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:42.103600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:42.112185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.112803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.113798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.114741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.164244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be4b03d8-57e4-44a7-b879-415170a2c91a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.066897 Nov 06 21:14:42.165147 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3412/6934] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:42.224481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:42.225913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:42.235991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.236631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.237638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.238186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.287985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23a6ee07-51cd-435c-88c0-da178d1cfaec tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.067610 Nov 06 21:14:42.289536 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3413/6935] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:42 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:42.536065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:14:42.536630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:14:42.537052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:14:42.537486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:14:42.537929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:14:42.551975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.552476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.553352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:42.556221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:42.577027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:42.582950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:42.595927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:14:42.598688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='30252fc7-a962-49e0-ab42-1a1dbbd09d60',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:14:42.690531 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcc6683b-dc82-45b7-bfc9-3602902f1175 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387622 Nov 06 21:14:42.691477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3523/6936] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:14:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:14:42.703973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f48d9fce-8878-4cc9-aaed-dc504cea004a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:42.711981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f48d9fce-8878-4cc9-aaed-dc504cea004a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:43.181043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:43.182562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:43.194370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:43.195722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:43.196907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:43.197805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:43.217984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f48d9fce-8878-4cc9-aaed-dc504cea004a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:43.227838 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f48d9fce-8878-4cc9-aaed-dc504cea004a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1230 microversion: 2.1 time: 0.528466 Nov 06 21:14:43.230311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3414/6937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:42 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1230 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:43.261323 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-348b10f7-4b9a-44bd-9f51-497767d7e80c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.086398 Nov 06 21:14:43.263014 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3524/6938] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:43.301539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:43.302798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:43.309157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:43.309612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:43.313508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:43.316582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:43.366527 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ee1b640-8c66-42a8-868d-e817b0eba000 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.069067 Nov 06 21:14:43.368070 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3415/6939] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:43 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:44.250456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:44.251374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:44.273836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:44.276037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:44.279750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.281964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.283579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.284951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.290255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.296931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.298100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.298787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.378024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8aadcf6b-552a-4629-a8f3-0c59a3d6d41e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.108138 Nov 06 21:14:44.379082 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3416/6940] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:44.384198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:44.385243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:44.402376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.408181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.409386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:44.410012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:44.510108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:44.522327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d13b8a6-8e38-4d73-ad56-4d38fffb12b4 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1300 microversion: 2.1 time: 0.278456 Nov 06 21:14:44.523705 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3525/6941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:44 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:44.543666 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d90f9e80-90c7-486c-8767-38d5a7661607 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.159328 Nov 06 21:14:44.545051 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3417/6942] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:44 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:45.390449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:45.392147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:45.399749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.400528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.401538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.402968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.498782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d8d0cc9f-a1c8-47d5-8fa1-6e6244e1fa18 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.112600 Nov 06 21:14:45.504887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3526/6943] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:45 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:45.542815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:45.543703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:45.563101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:45.564239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:45.574428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.579543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.582131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.582589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.583343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.583479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:45.583838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.585039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:45.678985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da99607b-bdbc-455a-be5a-ba5fd3548956 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.124835 Nov 06 21:14:45.680319 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3527/6944] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:45 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:45.936016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:45.948051 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b60546ee-8f5a-4386-b670-f4ac384dfa68 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1342 microversion: 2.1 time: 0.410369 Nov 06 21:14:45.951944 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3418/6945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:45 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1342 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:46.520642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:46.522508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:46.536760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.541965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:46.543140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.545062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:46.613976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f75276fa-9408-4805-9cf0-e02972067ef3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.098708 Nov 06 21:14:46.618802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3528/6946] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:46 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:46.699985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:46.713631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:46.744269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.744760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:46.745587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.746024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:46.814012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1267148a-a058-4cf8-bce5-3e0d18aaca0d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.123309 Nov 06 21:14:46.816121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3419/6947] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:46 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:46.968904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:46.970190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:46.984519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.985525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:46.987384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:46.987964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.378524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:47.391649 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-286215d3-1519-42d7-8d20-a666ccc1920a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1342 microversion: 2.1 time: 0.427656 Nov 06 21:14:47.394261 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3529/6948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:46 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1342 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:47.626500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:47.627533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:47.638059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:47.642227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.644450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:47.646006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.726241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f95f74d1-e007-49d2-bb34-7e572ff9f434 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.101955 Nov 06 21:14:47.729674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3420/6949] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:47.793453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-99262a9f-b27e-4138-a5ee-1e0041bd830a req-313da7d6-e6f1-4c59-a6e0-e9f739baa368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28892ef3-f12e-49ec-b6e1-d5e117f67dd8", "tag": "8e2c5150-a7b7-4393-93c2-b21601c3c7f7"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:47.795644 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:47.795644 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:47.835838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:47.837433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:47.847762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-99262a9f-b27e-4138-a5ee-1e0041bd830a req-313da7d6-e6f1-4c59-a6e0-e9f739baa368 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:47.848247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-99262a9f-b27e-4138-a5ee-1e0041bd830a req-313da7d6-e6f1-4c59-a6e0-e9f739baa368 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.854193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:47.854937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.856064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:47.856739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:47.891233 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-99262a9f-b27e-4138-a5ee-1e0041bd830a req-313da7d6-e6f1-4c59-a6e0-e9f739baa368 service nova] Creating event network-changed:8e2c5150-a7b7-4393-93c2-b21601c3c7f7 for instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 on nch2-master-1 Nov 06 21:14:47.897919 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-99262a9f-b27e-4138-a5ee-1e0041bd830a req-313da7d6-e6f1-4c59-a6e0-e9f739baa368 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109693 Nov 06 21:14:47.898999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3530/6950] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:47.955989 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-56ef3bee-ac10-4c31-a0f4-f63f4f18ddbe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.131026 Nov 06 21:14:47.958582 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3421/6951] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:47 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:48.401487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1899682829", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "d76cf4a6-2b40-4d99-9b64-1ec3595f58f3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1372491887", "security_groups": [{"name": "tempest-secgroup-smoke-1897462639"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:48.413203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:48.414181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:48.432691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.434178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:48.442047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.443077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:48.664814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] validate_networks() for [('d76cf4a6-2b40-4d99-9b64-1ec3595f58f3', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:14:48.791660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:48.806518 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6edf05ce-5f21-45e2-908c-b028c262bf8e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1342 microversion: 2.1 time: 0.396922 Nov 06 21:14:48.807444 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3422/6952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:48 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1342 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:48.815838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:48.821775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:48.835091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.836421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:48.841046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.841774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:48.932926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe5f5e48-36a1-4064-939e-fe2aa593ce92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.123717 Nov 06 21:14:48.944635 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3423/6953] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:48.970805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:48.972183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:48.986431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.987500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:48.988373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:48.988991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.056321 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a83c172d-b3a8-4775-8024-e50949390768 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.090482 Nov 06 21:14:49.061165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3424/6954] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:48 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:49.297530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:14:49.298653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:14:49.299473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:14:49.300097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:14:49.300908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:14:49.311637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.312497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.313555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.314432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.336335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:14:49.343500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:14:49.365173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:14:49.368408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:14:49.435276 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5235583d-fbfe-4375-b52e-7f00a073957a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038794 Nov 06 21:14:49.442444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3531/6955] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:14:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:14:49.448190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b4ab23d7-7d12-4faa-9065-d23dd069f20c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:49.450737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b4ab23d7-7d12-4faa-9065-d23dd069f20c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:49.573164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b4ab23d7-7d12-4faa-9065-d23dd069f20c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:49.587906 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b4ab23d7-7d12-4faa-9065-d23dd069f20c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1267 microversion: 2.1 time: 0.144389 Nov 06 21:14:49.590178 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3425/6956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:49 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:49.825323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:49.826186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:49.841748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.842476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.844399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.845223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.951523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:49.953608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:49.974464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.975555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:49.977097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:49.978046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:50.087157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-380ab95c-20f8-4528-86ee-b42e710ec5dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.139313 Nov 06 21:14:50.092846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3426/6957] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:50.106601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:50.113460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:50.127765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:50.138032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:50.139336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:50.140091 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-143455ec-0d86-4d51-b648-9f8f7f7edb89 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1388 microversion: 2.1 time: 0.319026 Nov 06 21:14:50.140243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:50.141642 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3532/6958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:49 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1388 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:50.144619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:50.196366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-15704920-4985-4401-80be-78f48404f8e3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.099553 Nov 06 21:14:50.197268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3427/6959] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:50 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:50.606780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:50.607443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:50.615280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:50.616025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:50.617072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:50.617530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:50.684447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:50.693654 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-574538d8-6e30-445e-a73e-f4686ea0e7e8 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1319 microversion: 2.1 time: 0.090789 Nov 06 21:14:50.694242 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3533/6960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:50 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:51.103408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:51.105332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:51.123036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.123933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.125084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.125587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.158567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:51.159337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:51.174125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.174651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.175465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.176091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.215117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6119f389-bca2-40f9-bc9f-e5ea97fed8b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.117864 Nov 06 21:14:51.215919 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3428/6961] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:51.221883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:51.222900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:51.230086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.230802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.231770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.232419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.281861 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22a1f928-20d3-4f6f-b427-96a30f2a2f53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064330 Nov 06 21:14:51.283208 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3429/6962] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:51 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:51.425528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:51.438208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3f5da64f-3d7b-4c89-af7a-03ebba0f5a71 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.283231 Nov 06 21:14:51.440465 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3534/6963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:51 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:51.713784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:51.714490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:51.722691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.723152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.723953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:51.724420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:51.852228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:51.862480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6ee80be-45a6-42d1-b4da-9d2b55738a70 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1325 microversion: 2.1 time: 0.152645 Nov 06 21:14:51.863068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3430/6964] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:51 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:52.236608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:52.237406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:52.247756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.248226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.249728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.250185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.298293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:52.299403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:52.307786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.308200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.309084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.309530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.334418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aba71cbf-06ca-479a-8407-2c032d4a5c8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.109511 Nov 06 21:14:52.335125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3535/6965] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:52.379180 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-162ef89b-a1d5-4504-8930-2db21c69347a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.089313 Nov 06 21:14:52.379914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3431/6966] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:52 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:52.458322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:52.459669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:52.470766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.472157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.473455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.474217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.747718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:52.759778 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dbcfc04c-eca3-44d2-91c7-4f9c1aa312e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.306056 Nov 06 21:14:52.760386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3536/6967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:52 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:52.883492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:52.884215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:52.893744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.895136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:52.896878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:52.897570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.020337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b2276213-ee20-495e-bdb4-0067e6027aa1 req-e2e3d265-031b-4497-b6ab-97eac7d81e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:53.022097 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:53.022097 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:53.037384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b2276213-ee20-495e-bdb4-0067e6027aa1 req-e2e3d265-031b-4497-b6ab-97eac7d81e9f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.038948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b2276213-ee20-495e-bdb4-0067e6027aa1 req-e2e3d265-031b-4497-b6ab-97eac7d81e9f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.055036 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b2276213-ee20-495e-bdb4-0067e6027aa1 req-e2e3d265-031b-4497-b6ab-97eac7d81e9f service nova] Creating event network-changed:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:14:53.062355 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b2276213-ee20-495e-bdb4-0067e6027aa1 req-e2e3d265-031b-4497-b6ab-97eac7d81e9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045663 Nov 06 21:14:53.063775 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3537/6968] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:53.189573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:53.199351 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0bb4bdc1-6469-4ac7-b9d0-4e5ff825718c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.322980 Nov 06 21:14:53.199956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3432/6969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:52 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:53.348558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:53.350498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:53.358101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.359120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.359971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.360453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.391763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:53.393047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:53.400062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.400593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.401441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.401910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.404998 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-059a31c4-1db5-469e-aa8b-5304fbba7685 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.060332 Nov 06 21:14:53.409786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3538/6970] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:53 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:53.447047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e89b62e4-f588-4f16-8fc9-a35071829118 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059064 Nov 06 21:14:53.448131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3433/6971] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:53 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:53.777083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:53.777889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:53.785426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.785893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:53.786725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:53.787178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.008121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:54.017579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5800097a-7f02-49b6-9a80-8e308f8a201b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.245050 Nov 06 21:14:54.018297 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3539/6972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:53 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:54.217661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:54.218502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:54.226092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.226665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.227520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.227970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.383136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:54.393010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab549e90-9f4d-45b9-90c0-f143d1e71249 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.179821 Nov 06 21:14:54.394443 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3434/6973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:54 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:54.417985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:54.419496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:54.427636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.428117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.429025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.429561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.461152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:54.462817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:54.469711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.470431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.471425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:54.472039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:54.475197 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b0c4335-4eb1-4056-94cc-466dc78a0c77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.061276 Nov 06 21:14:54.476194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3540/6974] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:54.523004 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98dad6bb-959b-4053-ae50-d7e349ae6d6f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.067153 Nov 06 21:14:54.529836 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3435/6975] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:54 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:55.037004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:55.037811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:55.045729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.046314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.047158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.047615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.202235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:55.211042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e987140f-b6e7-48d4-8ce2-d181682faf31 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.178715 Nov 06 21:14:55.211971 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3541/6976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:55 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:55.412900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:55.413634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:55.422111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.422667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.423540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.424083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.487937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:55.489064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:55.497540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.498021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.499694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.500167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.544000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-105f9cf2-95e8-4223-bd83-cd6ebd940a15 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.060307 Nov 06 21:14:55.546625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3542/6977] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:55.551974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:55.553035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:55.560365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.560834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.562179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:55.562635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:55.594845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:55.604632 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bb63cd98-e895-493f-aabf-2d2113508a2a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.196178 Nov 06 21:14:55.605286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3436/6978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:55 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:55.607226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2da0d582-7b09-4b89-8f57-f2e492b19f7b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058949 Nov 06 21:14:55.607848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3543/6979] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:55 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:56.228676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:56.229462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:56.236781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.237364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.238392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.238892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.384823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:56.395062 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1bf118b-38ff-4700-94ad-6688944e7384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.170478 Nov 06 21:14:56.396181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3437/6980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:56 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:56.558515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:56.560597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:56.571591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.572381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.573393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.574580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.594117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ae560b13-61e7-4115-97fc-e2ff56233d52 req-ed659c6b-ee97-40f7-9331-a492d7575b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28892ef3-f12e-49ec-b6e1-d5e117f67dd8", "name": "network-vif-plugged", "status": "completed", "tag": "8e2c5150-a7b7-4393-93c2-b21601c3c7f7"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:56.597386 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:56.597386 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:14:56.611950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ae560b13-61e7-4115-97fc-e2ff56233d52 req-ed659c6b-ee97-40f7-9331-a492d7575b93 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.612832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ae560b13-61e7-4115-97fc-e2ff56233d52 req-ed659c6b-ee97-40f7-9331-a492d7575b93 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.629946 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ae560b13-61e7-4115-97fc-e2ff56233d52 req-ed659c6b-ee97-40f7-9331-a492d7575b93 service nova] Creating event network-vif-plugged:8e2c5150-a7b7-4393-93c2-b21601c3c7f7 for instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 on nch2-master-1 Nov 06 21:14:56.635600 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ae560b13-61e7-4115-97fc-e2ff56233d52 req-ed659c6b-ee97-40f7-9331-a492d7575b93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049074 Nov 06 21:14:56.636279 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3438/6981] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:14:56.638806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33f4c911-9048-4ca3-96c4-1d87fb051c33 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.083282 Nov 06 21:14:56.641969 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3544/6982] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:56.656315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:56.658762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:56.660495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:56.663459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:56.678440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.679363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.679812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.680108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.681105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.681756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.682155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:56.682648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:56.753580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb4810f2-3636-47cc-a866-7ef58ba580a6 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.113567 Nov 06 21:14:56.754679 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3439/6983] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:56 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:56.914063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:56.924183 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d0b4bdd-4852-4ff3-92cf-68802f073f1e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.279486 Nov 06 21:14:56.925293 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3545/6984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:56 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:57.415869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:57.416592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:57.424267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.424754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.425588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.426027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.568688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:57.577041 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c1113db-2252-4aec-b33d-de2ebde30b38 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1376 microversion: 2.1 time: 0.165848 Nov 06 21:14:57.577621 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3440/6985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:57 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:57.653835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:57.655341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:57.665086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.665910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.667173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.667766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.716549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f491aff6-ba77-4d71-9b72-d12f092e4106 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.067546 Nov 06 21:14:57.717275 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3546/6986] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:57.766151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:57.767037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:57.775760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.776234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.777063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.777508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.819178 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0bc3836b-ca03-4508-823f-69b0d6265ea0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.056883 Nov 06 21:14:57.820066 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3441/6987] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:57 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:14:57.945359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:57.946227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:57.954325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.954953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:57.955855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:57.956458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.106919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:58.115629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63da0c3a-4122-4eec-b885-13a76c04c65d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.176737 Nov 06 21:14:58.116386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3547/6988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:57 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:58.595267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:58.595975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:58.604582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.605231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.606093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.606703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.662090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-28a99e15-b2ce-46d1-be80-e27f35368beb req-b7a84c96-90c6-4bec-8510-ade57128b8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "name": "network-vif-plugged", "status": "completed", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:58.663815 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:14:58.663815 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:14:58.673643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-28a99e15-b2ce-46d1-be80-e27f35368beb req-b7a84c96-90c6-4bec-8510-ade57128b8a2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.674880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-28a99e15-b2ce-46d1-be80-e27f35368beb req-b7a84c96-90c6-4bec-8510-ade57128b8a2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.692070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-28a99e15-b2ce-46d1-be80-e27f35368beb req-b7a84c96-90c6-4bec-8510-ade57128b8a2 service nova] Creating event network-vif-plugged:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:14:58.697540 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-28a99e15-b2ce-46d1-be80-e27f35368beb req-b7a84c96-90c6-4bec-8510-ade57128b8a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039660 Nov 06 21:14:58.699065 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3548/6989] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:14:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:14:58.729857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:58.733157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:58.750502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.751119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.753185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.754102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.768272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:58.779689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1050bf97-dc10-44e4-b54a-c5332aa5ff46 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1564 microversion: 2.1 time: 0.188363 Nov 06 21:14:58.794392 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3442/6990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:58 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1564 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:58.801062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:58.802172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:58.808640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1fea474-e6db-4d00-9cac-8ce5a6f8b615 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.083625 Nov 06 21:14:58.810431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3549/6991] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:58 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:14:58.810700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.811785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.812855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.813555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.832852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:58.834044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:58.841436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.841910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.842832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:58.843339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:58.892558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf21b32a-45c5-4999-98ab-c96fff40e3a8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.063712 Nov 06 21:14:58.896385 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3550/6992] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:58 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:14:58.994709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:59.004013 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ffe56faa-fccf-4617-af36-c70ae9a494a0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1564 microversion: 2.1 time: 0.207870 Nov 06 21:14:59.004636 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3443/6993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:58 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:14:59.076833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:59.077449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:59.084566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.085040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.085851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.086320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.113798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:14:59.133108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:59.133806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:59.141202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.141708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.142811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.143511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.210825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1033af21-841a-45c3-9288-513af08aab06 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 204 len: 0 microversion: 2.1 time: 0.137748 Nov 06 21:14:59.211432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3551/6994] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:14:59 2021] DELETE /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:14:59.221979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:14:59.223046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:59.231320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.232885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.232885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.234000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.373800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:59.382538 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a189791a-e8f3-424e-b492-5d3da04e14b2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1393 microversion: 2.1 time: 0.253135 Nov 06 21:14:59.383343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3444/6995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:59 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:59.447209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:14:59.455522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12d968ba-09aa-4219-a286-7d92dc18f629 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1570 microversion: 2.1 time: 0.238974 Nov 06 21:14:59.456098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3552/6996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:14:59 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:14:59.833057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:59.834153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:59.841419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.842104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.843441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.843882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.888738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-514f58ad-618c-4e47-8b0d-64bd0e489d66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.069741 Nov 06 21:14:59.890005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3445/6997] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:14:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:14:59.907271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:14:59.908479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:14:59.916773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.917314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.918272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:14:59.918758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:14:59.965748 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09a8482d-cbfa-42ef-8640-83ef2219220b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.063688 Nov 06 21:14:59.966427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3553/6998] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:14:59 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:00.401568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:00.402236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:00.409630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.410140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.410934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.411408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.475280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:00.476529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:00.485175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.485824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.486805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.487334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.602154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:00.610743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ea4b576-c9de-4da4-8d34-c11ebac318d6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1565 microversion: 2.1 time: 0.213457 Nov 06 21:15:00.611590 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3446/6999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:00 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:00.627834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:00.628469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:00.634350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.634896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.635687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.636127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.694013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:00.701924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ebda1e6-dda7-46cf-87a9-c7c99860b384 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1570 microversion: 2.1 time: 0.231495 Nov 06 21:15:00.702507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3554/7000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:00 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:15:00.798752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:00.811355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05b7fcc0-7fa0-4cf9-9ef6-d8720d69c5b6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1565 microversion: 2.1 time: 0.187658 Nov 06 21:15:00.812605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3447/7001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:00 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:15:00.902011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:00.903006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:00.922026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.923034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.923259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.923712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.970499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c84228f-8753-419b-96e6-562434fafc86 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.072793 Nov 06 21:15:00.971454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3555/7002] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:00 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:00.979235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:00.981901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:00.991261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.991996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:00.993360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:00.994298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:01.041000 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7a370da9-a491-4e96-863e-15f972885559 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.066064 Nov 06 21:15:01.041653 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3448/7003] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:00 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:01.727466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:01.728252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:01.752262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:01.752893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-64837190-bc0f-498e-b1f6-6a68b6ffb6db req-ad5cdfdc-806f-49e5-9b24-fd68b1d1df4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28892ef3-f12e-49ec-b6e1-d5e117f67dd8", "name": "network-vif-deleted", "tag": "8e2c5150-a7b7-4393-93c2-b21601c3c7f7"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:01.753497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:01.758492 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:01.758492 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:15:01.760016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:01.760705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:01.770029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-64837190-bc0f-498e-b1f6-6a68b6ffb6db req-ad5cdfdc-806f-49e5-9b24-fd68b1d1df4e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:01.770807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-64837190-bc0f-498e-b1f6-6a68b6ffb6db req-ad5cdfdc-806f-49e5-9b24-fd68b1d1df4e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:01.790014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-64837190-bc0f-498e-b1f6-6a68b6ffb6db req-ad5cdfdc-806f-49e5-9b24-fd68b1d1df4e service nova] Creating event network-vif-deleted:8e2c5150-a7b7-4393-93c2-b21601c3c7f7 for instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 on nch2-master-1 Nov 06 21:15:01.798435 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-64837190-bc0f-498e-b1f6-6a68b6ffb6db req-ad5cdfdc-806f-49e5-9b24-fd68b1d1df4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050149 Nov 06 21:15:01.799699 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3449/7004] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:01.936103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:01.951213 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33b5fe74-e8a2-466a-b861-26a50e4584aa tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 200 len: 1361 microversion: 2.1 time: 0.232488 Nov 06 21:15:01.953795 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3556/7005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:01 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:01.984440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:01.986132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:01.994123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:01.994653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:01.995480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:01.996038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:02.041824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99df2516-e7f8-45aa-ac14-991730b0db27 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.062391 Nov 06 21:15:02.046223 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3450/7006] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:01 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:02.053323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:02.054963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:02.065052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:02.065697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:02.066757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:02.067635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:02.150534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f6a50f6-8ed5-4dcc-ba3f-40587408ed94 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.100985 Nov 06 21:15:02.153018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3557/7007] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:02 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:02.972074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:02.972790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:02.980522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:02.980977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:02.981854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:02.982429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:02.999270 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. Nov 06 21:15:03.000193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:03.000822 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df0a18d2-8d29-428b-ab3a-1dc170b6985d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 404 len: 111 microversion: 2.1 time: 0.033809 Nov 06 21:15:03.001426 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3451/7008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:02 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:03.055145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:03.056168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:03.067142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.067616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.068758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.069434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.120634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fd6e3087-2405-4de5-abff-2d5dcaa7d074 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.070060 Nov 06 21:15:03.125803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3558/7009] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:03.167299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:03.168697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:03.176398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.177027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.177932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.178572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.225397 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d9f2e89-c617-4d2e-8f87-6d776f5e8481 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064677 Nov 06 21:15:03.226238 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3452/7010] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:03 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:03.645147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:03.645981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:03.653596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.654101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.655228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.655504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.815253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:03.819192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-107f841b-9460-48ab-991d-b22f7a6b7aa1 req-8f62cf30-1ca9-4cc6-9b9f-4993286c9c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:03.820794 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:03.820794 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:15:03.824747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e11001f1-605f-434c-8a74-d31ae45f4290 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1565 microversion: 2.1 time: 0.184215 Nov 06 21:15:03.831507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-107f841b-9460-48ab-991d-b22f7a6b7aa1 req-8f62cf30-1ca9-4cc6-9b9f-4993286c9c54 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:03.832322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-107f841b-9460-48ab-991d-b22f7a6b7aa1 req-8f62cf30-1ca9-4cc6-9b9f-4993286c9c54 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:03.836972 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3559/7011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:03 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:03.866355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-107f841b-9460-48ab-991d-b22f7a6b7aa1 req-8f62cf30-1ca9-4cc6-9b9f-4993286c9c54 service nova] Creating event network-changed:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:15:03.875512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-107f841b-9460-48ab-991d-b22f7a6b7aa1 req-8f62cf30-1ca9-4cc6-9b9f-4993286c9c54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061515 Nov 06 21:15:03.876674 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3453/7012] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:15:04.142768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:04.144175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:04.156068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:04.156623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:04.157875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:04.158908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:04.215557 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e4f1eba-58a6-4823-9126-6c7948fd2164 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.080982 Nov 06 21:15:04.217977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3560/7013] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:04.239987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:04.241246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:04.251925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:04.252481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:04.253754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:04.254224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:04.308385 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-136809dd-298b-4ad3-9ba4-16d6bcdd9ce3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.073459 Nov 06 21:15:04.309914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3454/7014] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:04 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:05.230462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:05.231627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:05.239347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:05.239853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:05.240749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:05.241276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:05.284306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ab4a3f7-d0b8-4c77-98cd-1e0492ca3d77 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.057982 Nov 06 21:15:05.285159 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3561/7015] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:05.323451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:05.324631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:05.333460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:05.333984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:05.334867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:05.335373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:05.377414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bb32c70-5529-41e5-a51e-fc7300b67c44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058375 Nov 06 21:15:05.378095 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3455/7016] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:05 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:06.297447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:06.298620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:06.306491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:06.306961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:06.307763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:06.308221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:06.354856 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5f147bf-8d25-4139-a5d1-2b48ff5eb280 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 24583 microversion: 2.32 time: 0.062263 Nov 06 21:15:06.355503 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3562/7017] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 24583 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:06.390399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:06.391481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:06.399754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:06.400308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:06.401100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:06.401574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:06.444194 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-299ab13a-e88a-4249-916c-faba08f401b7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058144 Nov 06 21:15:06.444869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3456/7018] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:06 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:07.367979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:07.369028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:07.377003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:07.377472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:07.378271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:07.378721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:07.432950 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d37cfa7-9d69-4c8c-90d1-f9110a7585bf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 32607 microversion: 2.32 time: 0.069024 Nov 06 21:15:07.433583 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3563/7019] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 32607 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:07.457808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:07.458810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:07.467976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:07.468542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:07.469383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:07.470376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:07.511139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e4d67082-2429-41b5-bace-f4d17bade3b3 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058106 Nov 06 21:15:07.512006 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3457/7020] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:07 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:08.445011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:08.445955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:08.453349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:08.453879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:08.455297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:08.455748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:08.499033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-376368d4-6a98-43e4-a078-a1c7191daecd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 32607 microversion: 2.32 time: 0.058039 Nov 06 21:15:08.499679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3564/7021] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:08 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 32607 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:08.523248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:08.524242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:08.531180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:08.531625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:08.532924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:08.533363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:08.573135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-886826f9-d702-46b6-ae9b-94b76e71cb92 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.053699 Nov 06 21:15:08.573874 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3458/7022] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:08 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:09.511381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:09.512441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:09.520032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:09.520613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:09.521469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:09.521883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:09.572771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c80339db-aa43-4d0c-8dc9-d1d3808df30a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 32607 microversion: 2.32 time: 0.065068 Nov 06 21:15:09.573720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3565/7023] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 32607 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:09.585786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:09.586839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:09.594711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:09.595728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:09.596132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:09.596603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:09.640713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c37844b9-e00f-4220-a9d4-6da5b67db451 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059021 Nov 06 21:15:09.641513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3459/7024] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:09 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:10.586489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:10.587516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:10.595470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:10.596096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:10.596948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:10.597404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:10.642714 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0eec6148-6d3f-421d-8de6-d0769c74ee24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 32607 microversion: 2.32 time: 0.060034 Nov 06 21:15:10.647019 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3566/7025] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 32607 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:10.653022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:10.654066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:10.661775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:10.662241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:10.663124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:10.663580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:10.710567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20ea53d0-5895-4afe-b554-75900438b941 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.061534 Nov 06 21:15:10.711200 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3460/7026] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:10 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:11.656348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:11.658146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:11.666708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:11.667211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:11.668268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:11.668750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:11.713033 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-679f6e04-6cd8-4185-89f5-e941e57bf881 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 32607 microversion: 2.32 time: 0.061314 Nov 06 21:15:11.713685 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3567/7027] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 32607 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:11.724318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:11.725442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:11.733420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:11.733984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:11.734811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:11.735365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:11.776663 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5a96558-f4dd-4454-ad58-45d36e408fe1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.057292 Nov 06 21:15:11.777306 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3461/7028] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:11 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:12.726552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:12.727511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:12.734916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:12.735990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:12.736811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:12.737513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:12.789995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:12.791277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:12.799779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:12.800233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:12.801052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:12.801179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85b5a7b2-9cbb-4276-970b-556ae9bb526e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.078516 Nov 06 21:15:12.801491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:12.802155 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3568/7029] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:12 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:12.844791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b63b255-a8d4-442a-8e04-d2463c0b528d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059117 Nov 06 21:15:12.845999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3462/7030] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:12 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:13.814726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:13.815830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:13.825381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:13.825841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:13.826708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:13.827211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:13.861002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:13.866506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:13.887712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:13.888176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:13.888323 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf4b32ca-8363-4b4c-97bd-76160da875a2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.077940 Nov 06 21:15:13.889583 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3569/7031] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:13 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:13.889988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:13.890615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:13.935525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4162bd98-93c3-46b5-a532-6e048b96dd1e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.081089 Nov 06 21:15:13.936227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3463/7032] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:13 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:14.903662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:14.905958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:14.914587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:14.915305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:14.916647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:14.917374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:14.949446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:14.951311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:14.959995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:14.960807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:14.961723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:14.962191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:14.969967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33de40bd-df67-482d-934a-70758d4e5331 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.071118 Nov 06 21:15:14.975710 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3570/7033] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:15.009224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cdd5e7d4-947f-4f2a-8150-973460387c2f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064368 Nov 06 21:15:15.009872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3464/7034] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:14 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:15.984842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:15.986212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:15.997984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:15.998568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:15.999693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:16.000216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:16.022000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:16.023010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:16.030328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:16.030887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:16.032633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:16.033232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:16.053316 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cfd19d57-2b13-4997-a779-3a5804a63fad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072953 Nov 06 21:15:16.054090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3571/7035] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:16.087405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3026ba25-4767-48da-927d-02ef2c6ac1ae tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.070321 Nov 06 21:15:16.092181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3465/7036] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:16 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:17.066806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:17.067909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:17.075421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:17.075889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:17.076719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:17.077171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:17.101237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:17.102445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:17.111729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:17.112854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:17.114126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:17.114818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:17.124409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23824acf-8407-4eba-a5df-ab0a5e132531 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061580 Nov 06 21:15:17.125561 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3572/7037] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:17.164462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bca6984c-a271-45f7-bd8c-ecc82636828d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.068189 Nov 06 21:15:17.165117 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3466/7038] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:17 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:18.139034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:18.140180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:18.148219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:18.148730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:18.149678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:18.150369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:18.180543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:18.181590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:18.190527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:18.191012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:18.192010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:18.192656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:18.204872 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-06ac6759-0420-431d-bcce-7f216f2dda7e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.071018 Nov 06 21:15:18.206114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3573/7039] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:18.238893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3692c389-8606-4643-afd9-b5c47611eb53 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.065116 Nov 06 21:15:18.240076 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3467/7040] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:18 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:19.217290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:19.218301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:19.225568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:19.226032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:19.226816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:19.227261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:19.251448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:19.252482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:19.261262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:19.261720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:19.262515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:19.262960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:19.272324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d392f8f4-0e67-4111-b14b-75d5807d9de4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059079 Nov 06 21:15:19.276551 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3574/7041] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:19 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:19.302792 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b009440f-4d79-48df-811f-757b21c62207 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.055393 Nov 06 21:15:19.303429 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3468/7042] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:19 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:20.284695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:20.285728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:20.293311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:20.293803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:20.294597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:20.295048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:20.313839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:20.314917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:20.325555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:20.326004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:20.326975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:20.327409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:20.338642 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa091453-ff0f-4b7b-a7eb-5a2d888ad79e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057997 Nov 06 21:15:20.342926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3575/7043] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:20.368251 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce667b2e-bb22-4961-af34-1e24b91b0e36 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.058279 Nov 06 21:15:20.368907 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3469/7044] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:20 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:21.351871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:21.352954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:21.360618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:21.361097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:21.361895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:21.362350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:21.380144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:21.381219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:21.388667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:21.389124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:21.389915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:21.390512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:21.405403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31d6a8eb-1175-4e2d-a779-a7644ad094aa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058104 Nov 06 21:15:21.406295 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3576/7045] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:21.431581 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e5ec1e4-e2b4-4667-aded-bb76aa287811 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.055304 Nov 06 21:15:21.436079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3470/7046] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:21 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:22.418349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:22.419331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:22.427079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:22.427544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:22.428368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:22.428821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:22.443426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:22.444602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:22.451839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:22.452310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:22.453172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:22.453579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:22.473280 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cc87365-d10d-443e-9e48-8e75600b8906 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058574 Nov 06 21:15:22.473973 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3577/7047] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:22.499350 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e8104f5-24a1-400a-83b2-a69dec3bdd44 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059753 Nov 06 21:15:22.500009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3471/7048] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:22 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:23.484993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:23.486013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:23.493457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:23.493919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:23.494716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:23.495168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:23.511255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:23.512244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:23.519327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:23.520413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:23.521200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:23.521630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:23.540015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1c3ff79-3441-4a24-9eb4-19e6d4a20b8c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059045 Nov 06 21:15:23.541579 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3578/7049] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:23 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:23.568110 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3419c73-5e21-4933-b717-026df5d8eca0 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.060647 Nov 06 21:15:23.568753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3472/7050] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:23 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:24.553456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:24.554498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:24.562121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:24.562618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:24.563479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:24.563958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:24.579671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:24.581374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:24.589216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:24.589675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:24.590461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:24.590901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:24.609796 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc5822de-60a4-406a-8e20-c9573ce7f950 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060452 Nov 06 21:15:24.614032 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3579/7051] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:24.635065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e000147b-35ef-47ed-879f-09ff827ecea2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059590 Nov 06 21:15:24.635689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3473/7052] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:24 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:25.623041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:25.624072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:25.632177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:25.632678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:25.633519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:25.634000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:25.646752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:25.647847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:25.655766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:25.656282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:25.657311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:25.657835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:25.682417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8aae60ff-c27f-43b1-be34-b507fecb01d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063406 Nov 06 21:15:25.686677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3580/7053] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:25 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:25.700285 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34a6cce5-20f8-4484-9abf-7163934b5aaf tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.057589 Nov 06 21:15:25.700928 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3474/7054] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:25 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:26.694818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:26.696480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:26.704077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:26.704602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:26.705401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:26.705852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:26.712873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:26.713876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:26.721737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:26.722354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:26.723426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:26.723856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:26.749806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6604c00f-b2e5-4c7b-a31c-fa8d2589229b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058800 Nov 06 21:15:26.754220 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3581/7055] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:26 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:26.769458 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a64ac0b7-eb4a-42c2-b8d3-565cc8574d01 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.060774 Nov 06 21:15:26.770322 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3475/7056] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:26 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:27.763633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:27.764892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:27.773600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:27.774522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:27.775330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:27.776439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:27.785033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:27.785033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:27.794260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:27.794821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:27.795898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:27.796597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:27.826168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-708fef2a-d58e-4ec0-adc8-d99fbcf3b884 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066715 Nov 06 21:15:27.826847 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3582/7057] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:27 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:27.844614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a7f4857-c2a5-45e7-a99c-4566ddb4b957 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.065528 Nov 06 21:15:27.846146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3476/7058] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:27 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:28.839385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:28.840465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:28.848665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:28.849250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:28.850067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:28.850552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:28.857767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:28.858767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:28.867041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:28.867041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:28.867862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:28.868414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:28.898166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e27d2a4e-996f-4ba1-b74e-5b8a1e9717a7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063646 Nov 06 21:15:28.904085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3583/7059] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:28 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:28.921056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ed876a92-3d4f-4c23-92e4-a1669fae472a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.067143 Nov 06 21:15:28.921789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3477/7060] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:28 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:29.911537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:29.912587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:29.920415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:29.920884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:29.921672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:29.922121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:29.933764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:29.934818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:29.941978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:29.942345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:29.943131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:29.943568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:29.967053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc4e8e07-1321-4c74-be11-61f101c3536a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059475 Nov 06 21:15:29.970855 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3584/7061] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:29.983362 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41d2015c-d357-4cf2-bafa-64c624e3ec8d tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.054173 Nov 06 21:15:29.983987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3478/7062] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:29 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:30.979564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:30.981266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:30.988685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:30.989162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:30.989977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:30.990441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:30.995325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:30.996357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:31.003847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:31.004323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:31.005137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:31.005578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:31.034266 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e228718-5d5f-4a1e-8f1c-ee67331c4035 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058694 Nov 06 21:15:31.034932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3585/7063] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:30 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:31.046400 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df999460-61fe-4e44-b790-8ab8d5598ad2 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.055009 Nov 06 21:15:31.047015 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3479/7064] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:30 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:32.048747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:32.050277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:32.059379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:32.059606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:32.060068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:32.060503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:32.060938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:32.061444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:32.069791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:32.070646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:32.072162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:32.072760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:32.113523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eced4aeb-115a-4b04-a6cd-cab2429d1c67 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.069478 Nov 06 21:15:32.119920 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3586/7065] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:32.122347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bc43db2-fa9a-4c4a-85bc-e83f6bb3e5de tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.066733 Nov 06 21:15:32.123401 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3480/7066] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:32 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:33.127554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:33.128702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:33.134858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:33.135868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:33.136209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.136708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.137518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.137972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.143115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.143604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.144417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.144860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.181119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e395333-3f21-46a3-a692-504d9f755ac3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057539 Nov 06 21:15:33.182062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3587/7067] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:33 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:33.185134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e6d18bd-630a-4293-b78f-9947b861c048 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.054213 Nov 06 21:15:33.185755 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3481/7068] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:33 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:33.953046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:33.953754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:33.960716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.961183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.961979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:33.962440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:33.986449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:15:34.062331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc8b8772-0110-47c7-adc4-1c1315a51c95 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 204 len: 0 microversion: 2.1 time: 0.113089 Nov 06 21:15:34.062885 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3588/7069] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:15:33 2021] DELETE /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:15:34.071742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:34.073118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:34.079899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.080374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.081160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.081601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.193982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:34.195003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:34.203279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.203743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.204571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.205014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.213329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:34.221286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d1a90c3-2458-40fa-ad1c-3b6803f396c0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1410 microversion: 2.1 time: 0.153587 Nov 06 21:15:34.221852 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3482/7070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:34 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:34.226196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:34.227185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:34.233468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.233924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.234706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:34.235148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:34.247168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84d51681-4eda-44d2-9ac1-d261e1e86f35 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057517 Nov 06 21:15:34.251515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3589/7071] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:34.278099 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5723c10a-aa3d-4af4-9bc6-9abd2250e985 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.055059 Nov 06 21:15:34.278719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3483/7072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:34 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:35.239218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:35.239842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:35.247214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.247680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.248572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.249027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.259554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:35.261747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:35.269953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.270411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.271205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.271649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.314472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b213e2f-99cc-4fca-978d-e534f886b0dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058760 Nov 06 21:15:35.315546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3484/7073] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:35 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:35.321455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:35.323134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:35.330010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.330466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.331397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:35.331835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:35.375924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f5f0f8e-a71d-4ebe-bf5f-72fe1c0cce0c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.059263 Nov 06 21:15:35.379859 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3485/7074] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:35 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:35.385953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:35.393589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc7517b7-413c-44a7-9abb-76de14ad3ae3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1410 microversion: 2.1 time: 0.158495 Nov 06 21:15:35.394150 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3590/7075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:35 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:36.223105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b6dd70e8-edd2-40d5-aef7-49e7052b1300 req-c1af95b4-851d-4449-be97-f126ae250f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2071d671-763b-44cf-9037-2041ce4aba8c", "name": "network-vif-deleted", "tag": "75d70963-502a-42c6-8cc4-6be35746612d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:36.224727 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:36.224727 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:15:36.234243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b6dd70e8-edd2-40d5-aef7-49e7052b1300 req-c1af95b4-851d-4449-be97-f126ae250f78 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.234693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b6dd70e8-edd2-40d5-aef7-49e7052b1300 req-c1af95b4-851d-4449-be97-f126ae250f78 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.246244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b6dd70e8-edd2-40d5-aef7-49e7052b1300 req-c1af95b4-851d-4449-be97-f126ae250f78 service nova] Creating event network-vif-deleted:75d70963-502a-42c6-8cc4-6be35746612d for instance 2071d671-763b-44cf-9037-2041ce4aba8c on nch1-master-1 Nov 06 21:15:36.250922 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b6dd70e8-edd2-40d5-aef7-49e7052b1300 req-c1af95b4-851d-4449-be97-f126ae250f78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Nov 06 21:15:36.251510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3486/7076] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:36.326579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:36.327575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:36.335461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.335932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.336763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.337219 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.386152 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04a3afe4-6cfe-43aa-92a2-276d1289770b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063015 Nov 06 21:15:36.388436 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3591/7077] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:36.389346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:36.390455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:36.397038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.397603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.398495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.399000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.410116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:36.410831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:36.418658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.419117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.419938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:36.420637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:36.449205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be90bcf0-74ce-4267-b67c-fe280e6ede10 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.064649 Nov 06 21:15:36.451364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3487/7078] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:36 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:36.497133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:36.506085 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f57561d-5bee-404a-aeba-dfdd2997d3a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 200 len: 1202 microversion: 2.1 time: 0.099889 Nov 06 21:15:36.507068 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3592/7079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:36 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 1202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:15:37.398899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:37.399903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:37.407151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.407602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.408402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.408838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.451055 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-990fee8d-90fb-4d8f-a2d3-65f397861e65 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056107 Nov 06 21:15:37.451966 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3488/7080] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:37.459687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:37.460645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:37.467360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.467824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.468643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.469090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.508718 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5bbc440a-557a-4da9-a80a-d73556d28be4 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.052527 Nov 06 21:15:37.509341 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3593/7081] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:37 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:37.523527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:37.524226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:37.531171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.531636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.532423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:37.532860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:37.547487 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. Nov 06 21:15:37.548076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:37.548932 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b48e7bbd-f17d-471f-bd8e-70ab7629e938 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 404 len: 111 microversion: 2.1 time: 0.029453 Nov 06 21:15:37.549466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3489/7082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:37 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:38.464024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:38.465025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:38.472525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.472999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.473802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.474259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.515682 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-62ada7cd-4846-49d0-a60b-21363cd775ba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056198 Nov 06 21:15:38.516351 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3594/7083] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:38.521033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:38.521969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:38.528874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.529329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.530107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.530548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.571210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b38d0d2-4ec5-4300-bdfe-934be6d07c24 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 32590 microversion: 2.1 time: 0.053680 Nov 06 21:15:38.571847 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3490/7084] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:38 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 32590 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:38.625641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:38.626247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:38.633214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.633691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.634487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.634945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.648546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. Nov 06 21:15:38.649155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:38.649995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-814c7c73-512b-45e4-94cb-7bb56beb792a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 404 len: 111 microversion: 2.1 time: 0.028402 Nov 06 21:15:38.651022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3595/7085] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:15:38 2021] DELETE /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:38.659236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:38.659947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 28892ef3-f12e-49ec-b6e1-d5e117f67dd8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:38.667648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.668104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.668919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:38.669361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:38.682910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. Nov 06 21:15:38.683494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 28892ef3-f12e-49ec-b6e1-d5e117f67dd8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:38.684322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9b45c65-0b3b-4add-833c-afff7d7415ce tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8" status: 404 len: 111 microversion: 2.1 time: 0.029063 Nov 06 21:15:38.684826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3491/7086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:38 2021] GET /compute/v2.1/servers/28892ef3-f12e-49ec-b6e1-d5e117f67dd8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:15:39.024213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:39.024860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.031725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.032191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.033021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.033475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.047555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. Nov 06 21:15:39.048154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:39.049017 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fb53dc8-b704-47e2-b5fb-c707ee0a23e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 404 len: 111 microversion: 2.1 time: 0.028535 Nov 06 21:15:39.049538 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3596/7087] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:15:39 2021] DELETE /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:39.058228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:39.058930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 2071d671-763b-44cf-9037-2041ce4aba8c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.065283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.065739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.066515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.066951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.079984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. Nov 06 21:15:39.080594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 2071d671-763b-44cf-9037-2041ce4aba8c could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:39.081408 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0550d24-da49-450c-9491-4781003c4f32 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c" status: 404 len: 111 microversion: 2.1 time: 0.027839 Nov 06 21:15:39.081920 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3492/7088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:39 2021] GET /compute/v2.1/servers/2071d671-763b-44cf-9037-2041ce4aba8c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:39.142166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: .version_select at 0x7f671537cee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2096105306"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:39.160957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:15:39.162669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:39.163603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.166991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:15:39.170773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.171231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.172024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.172542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.221349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5f86c0fd-7fe8-4943-ba91-16e1dc9f7748 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action" status: 200 len: 24565 microversion: 2.1 time: 0.062248 Nov 06 21:15:39.221995 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3493/7089] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:39 2021] POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action => generated 24565 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:15:39.528661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:39.529709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.537072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.537536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.538328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.538798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.573580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:15:39.579107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:15:39.581037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3d0be5f-2990-4d01-a1b2-96cbd90cd126 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056857 Nov 06 21:15:39.585203 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3494/7090] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:39.586631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:39.587624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.594516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7ac051f-af89-4b52-ab4c-6bd96cec1a9a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.456079 Nov 06 21:15:39.595059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.595222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3597/7091] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:15:39 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:39.595522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.596330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.596774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.646484 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4134d07e-ba33-4525-a952-4eb360099ab8 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action" status: 200 len: 40734 microversion: 2.1 time: 0.063300 Nov 06 21:15:39.652840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3495/7092] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:15:39 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/action => generated 40734 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:15:39.658057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:39.658641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:39.664734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.665210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.666291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:39.666751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:39.690357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b51426e-c567-4eaa-a3fa-d635db881d61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/ips" status: 200 len: 147 microversion: 2.1 time: 0.035980 Nov 06 21:15:39.690945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3598/7093] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Nov 6 21:15:39 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:40.594171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:40.595158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:40.602792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:40.603968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:40.604793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:40.605231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:40.649204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7cc87cf2-b067-4c1f-b8a3-d441deb55ec4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058953 Nov 06 21:15:40.649852 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3496/7094] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:40 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:41.021659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:41.022736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:41.030372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:41.030908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:41.031791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:41.032338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:41.269328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251259 Nov 06 21:15:41.269938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3599/7095] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:15:41 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:41.662687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:41.663660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:41.671892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:41.672385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:41.673172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:41.673616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:41.716117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6b9d3660-ee06-4d1d-b9ca-8f5620cf442d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057474 Nov 06 21:15:41.716774 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3497/7096] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:42.729438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:42.730447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:42.736588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:42.737060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:42.737867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:42.738315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:42.783116 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-75413faf-eaee-4311-982a-0c5e7885f383 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059075 Nov 06 21:15:42.784052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3600/7097] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:43.146069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1030964119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096105306", "security_groups": [{"name": "tempest-secgroup-smoke-1302622068"}], "block_device_mapping_v2": [{"uuid": "ae02902c-20dc-4c0a-94a0-2e35f8de1240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:43.262608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:15:43.643881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:15:43.644332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:15:43.644812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:15:43.645224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:15:43.645636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:15:43.655004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:43.655315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:43.656125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:43.656602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:43.676637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:15:43.682274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:15:43.741949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:15:43.744759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae02902c-20dc-4c0a-94a0-2e35f8de1240',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:15:43.805001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:43.808202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:43.824457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:43.825190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:43.826442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:43.827181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:43.902010 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0b0c64f1-7593-42a6-b8dc-163982e5662e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.109501 Nov 06 21:15:43.906578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3601/7098] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:43.950733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6af489c1-18c1-4985-b00b-644f03bd6146 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809089 Nov 06 21:15:43.956827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3498/7099] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:15:43 2021] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:15:43.963385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00c7a177-d651-4919-b493-b0f1954b393b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:43.965058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00c7a177-d651-4919-b493-b0f1954b393b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:44.034263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00c7a177-d651-4919-b493-b0f1954b393b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:44.048633 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00c7a177-d651-4919-b493-b0f1954b393b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1095 microversion: 2.1 time: 0.090422 Nov 06 21:15:44.049977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3602/7100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:43 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:44.548339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:44.551954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:44.567363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.567848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:44.571610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.572231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:44.604733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1f06b1e-e9de-4738-a797-d18d0aed5a33 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067426 Nov 06 21:15:44.605921 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3499/7101] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:15:44 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:44.615555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:44.616574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:44.623778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.624245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:44.625095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.625550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:44.656516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c7e7b94-ea1f-4555-9c34-f75990c4d29f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d" status: 200 len: 194 microversion: 2.1 time: 0.044687 Nov 06 21:15:44.657127 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3603/7102] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Nov 6 21:15:44 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:15:44.914412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:44.924076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:44.932837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.933351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:44.935110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:44.935998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:45.001475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-301f8f59-b1e9-4744-b862-107d14427687 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.090507 Nov 06 21:15:45.002866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3500/7103] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:45.067196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:45.069065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:45.078994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:45.079901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:45.081129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:45.081876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:45.155337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:45.164481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca24aac2-1126-4f77-bc11-d09de2199543 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1201 microversion: 2.1 time: 0.101551 Nov 06 21:15:45.165024 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3604/7104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:45 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:45.986376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "651b92bb-26f2-4ee5-af90-ea7056902361"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:45.988156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:45.995768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:45.996230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:45.997072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:45.997713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:46.016574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:46.018604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:46.041708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:46.049334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:46.052046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:46.053297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:46.112996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00a99852-c7a5-411f-8a41-7cecb10f60f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.102282 Nov 06 21:15:46.115526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3605/7105] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:46 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:46.181715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:46.182426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:46.205148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:46.206839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:46.208205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:46.208703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:46.336887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-267b9a32-6875-4cc1-9b8d-b08a080244b1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354186 Nov 06 21:15:46.338924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3501/7106] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:15:45 2021] POST /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:46.417783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:46.427179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15d9ee18-df59-4d8d-9bfd-f64ac1d547e5 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1279 microversion: 2.1 time: 0.249520 Nov 06 21:15:46.427960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3606/7107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:46 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:15:47.128678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:47.130646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:47.137050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:47.137619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:47.138503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:47.139041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:47.187825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88489b60-d945-4393-85c3-edc95c5ff8f0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064160 Nov 06 21:15:47.188860 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3502/7108] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:47.407670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-db5757a3-d0c6-4996-881a-2ee088229845 req-1d4bdd45-ba23-4267-8c93-9352a260c86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65f8275-232c-4352-b2dc-d80a46ce45e8", "tag": "4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:47.409725 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:47.409725 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:15:47.421620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db5757a3-d0c6-4996-881a-2ee088229845 req-1d4bdd45-ba23-4267-8c93-9352a260c86f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:47.422381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db5757a3-d0c6-4996-881a-2ee088229845 req-1d4bdd45-ba23-4267-8c93-9352a260c86f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:47.451427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:47.452286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:47.455628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-db5757a3-d0c6-4996-881a-2ee088229845 req-1d4bdd45-ba23-4267-8c93-9352a260c86f service nova] Creating event network-changed:4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9 for instance e65f8275-232c-4352-b2dc-d80a46ce45e8 on nch2-master-1 Nov 06 21:15:47.468317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:47.470549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:47.473457 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-db5757a3-d0c6-4996-881a-2ee088229845 req-1d4bdd45-ba23-4267-8c93-9352a260c86f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066155 Nov 06 21:15:47.475490 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3607/7109] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:47.475724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:47.476375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:47.638123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:47.646034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52dc6ef8-f1d7-499c-9424-01556cdcdad3 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.199511 Nov 06 21:15:47.646687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3503/7110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:47 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:48.200877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:48.201896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:48.208388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.208785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.209594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.210051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.250883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05619b39-cdd0-4520-9c18-f84bda45832c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055250 Nov 06 21:15:48.255020 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3608/7111] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:48.607961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:48.608926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:48.618209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.619258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.620049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.620538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.649077 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01d5e3be-498c-45f3-b756-f5e1502c5f38 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044853 Nov 06 21:15:48.649640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3504/7112] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:15:48 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:48.663339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:48.664064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:48.673507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.673916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.678677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.679186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.816973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:48.817598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:48.821694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:48.823641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.824177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.825043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.825547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.829421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45249b7e-83ed-4c86-abba-2ba757cbb309 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.170168 Nov 06 21:15:48.829997 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3609/7113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:48 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:48.854033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8ab23f2-f720-4dc9-b8e3-eeedb5d181c7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d" status: 200 len: 194 microversion: 2.1 time: 0.040787 Nov 06 21:15:48.854605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3505/7114] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Nov 6 21:15:48 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:15:48.863899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:48.864463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:48.871114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.871588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.872428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:48.872887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:48.950010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lazy-loading 'services' on Instance uuid ffb66840-a75a-4c90-95d1-b220fdd9ae15 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:15:49.018026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8be7a172-35ab-4f72-858c-f9ada21d160b tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d" status: 202 len: 0 microversion: 2.1 time: 0.157640 Nov 06 21:15:49.018620 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3610/7115] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:15:48 2021] DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:49.263139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:49.264089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:49.270367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:49.270819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:49.271592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:49.272026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:49.313430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0afa9ce-c8be-40c1-99cc-e764e9df85d2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.054360 Nov 06 21:15:49.314099 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3506/7116] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:49.847519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:49.848232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:49.854547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:49.855013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:49.855810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:49.856282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:49.996832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:50.004358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-036cb6e9-9883-44cf-8172-7264b859eeb9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.161758 Nov 06 21:15:50.004932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3611/7117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:49 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:50.125125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:50.125828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:50.133138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.133595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.134437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.134872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.163594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b691cbef-d638-4d52-80aa-010047714719 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/651b92bb-26f2-4ee5-af90-ea7056902361" status: 200 len: 194 microversion: 2.1 time: 0.042656 Nov 06 21:15:50.164179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3507/7118] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Nov 6 21:15:50 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/651b92bb-26f2-4ee5-af90-ea7056902361 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:50.174397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:50.174898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:50.180683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.181771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.182716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.183168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.258687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lazy-loading 'services' on Instance uuid ffb66840-a75a-4c90-95d1-b220fdd9ae15 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:15:50.325588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:50.325817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a70c3e1c-864e-4aa9-9310-253c470cac9a tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/651b92bb-26f2-4ee5-af90-ea7056902361" status: 202 len: 0 microversion: 2.1 time: 0.154981 Nov 06 21:15:50.326389 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3612/7119] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:15:50 2021] DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments/651b92bb-26f2-4ee5-af90-ea7056902361 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:50.326515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:50.333810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.334252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.335022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:50.335648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:50.388397 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45c7a59e-b1d5-498a-9055-348cc35487bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066420 Nov 06 21:15:50.393023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3508/7120] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:50 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:51.023176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:51.023912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.030640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.031104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.031893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.032369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.169502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:51.176994 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5014a340-0d90-48d2-8412-ac62e088d6cc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.159623 Nov 06 21:15:51.177564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3613/7121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:51 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:51.401139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:51.402870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.410177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.410615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.411411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.411851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.458071 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92716b32-40ff-472b-b1d8-7df64de786b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060860 Nov 06 21:15:51.459284 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3509/7122] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:51.488897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:51.490070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.496649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.497129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.497930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.498385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.526511 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a7cfd5a-ea10-460a-8628-b57f5a83d1a5 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041421 Nov 06 21:15:51.527092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3614/7123] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:15:51 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:15:51.625938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:51.626945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.633761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.634215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.634998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.635438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.663343 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f738f426-55db-4a9a-b501-dc64bc647186 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041499 Nov 06 21:15:51.663884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3510/7124] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:15:51 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:15:51.717812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:51.718386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.724311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.724802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.725610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.726066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.751506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:15:51.826180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2e1ffe1-c74b-4d9e-a341-3210f3ee51fa tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 204 len: 0 microversion: 2.1 time: 0.111994 Nov 06 21:15:51.826948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3615/7125] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:15:51 2021] DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:15:51.835828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:51.836492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:51.842691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.843146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.844836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:51.845284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:51.988115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:51.995412 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c367d20-2c21-4387-8491-eb9c50b76565 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1675 microversion: 2.1 time: 0.164027 Nov 06 21:15:51.995976 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3511/7126] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:51 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:52.194728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:52.195379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:52.201731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:52.202229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:52.203030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:52.203480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:52.334344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:52.342330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b20d94a1-5069-424e-b021-dc6f2cbbfbc8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.151771 Nov 06 21:15:52.342899 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3616/7127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:52 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:52.469417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:52.470336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:52.477008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:52.477461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:52.478246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:52.478681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:52.519847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2b578ea-e80a-4a8d-ac86-30e2d64f5ef2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.054042 Nov 06 21:15:52.520518 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3512/7128] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:52.840340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5681a351-5cd4-4508-9f62-16ed9449dd2b req-e6ee32f8-7507-4559-be76-4d109d79f1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65f8275-232c-4352-b2dc-d80a46ce45e8", "name": "network-vif-plugged", "status": "completed", "tag": "4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:52.841852 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:52.841852 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:15:52.849406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5681a351-5cd4-4508-9f62-16ed9449dd2b req-e6ee32f8-7507-4559-be76-4d109d79f1b4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:52.849870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5681a351-5cd4-4508-9f62-16ed9449dd2b req-e6ee32f8-7507-4559-be76-4d109d79f1b4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:52.861194 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5681a351-5cd4-4508-9f62-16ed9449dd2b req-e6ee32f8-7507-4559-be76-4d109d79f1b4 service nova] Creating event network-vif-plugged:4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9 for instance e65f8275-232c-4352-b2dc-d80a46ce45e8 on nch2-master-1 Nov 06 21:15:52.866265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5681a351-5cd4-4508-9f62-16ed9449dd2b req-e6ee32f8-7507-4559-be76-4d109d79f1b4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 Nov 06 21:15:52.867134 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3617/7129] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:53.014174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:53.014922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:53.022194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.022648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.023432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.023869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.157639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:53.165011 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2a8ad2e9-8108-45e8-8bac-f38a3282d00f tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1675 microversion: 2.1 time: 0.154994 Nov 06 21:15:53.166077 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3513/7130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:53 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:53.359043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:53.359746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:53.366319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.366783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.367598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.368047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.507614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:53.514988 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1dcfb6ac-3011-4765-b012-190b8beb4ecb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1267 microversion: 2.1 time: 0.159937 Nov 06 21:15:53.515611 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3618/7131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:53 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:53.532063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:53.533026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:53.541607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.542069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.542860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:53.543302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:53.584957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10acfd8e-cb7e-496b-b570-e079e866b162 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056427 Nov 06 21:15:53.585609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3514/7132] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:53 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:54.183579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:54.184199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:54.190847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.191307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.192096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.192572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.432331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:54.439640 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e5df50b-1761-4c8a-98ef-aa9e29982bd1 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1675 microversion: 2.1 time: 0.260503 Nov 06 21:15:54.440208 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3619/7133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:54 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:54.531551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:54.532343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:54.539561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.540042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.541351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.541798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.598040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:54.599075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:54.606174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.606641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.607602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:54.608256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:54.653946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d622d49f-b2ab-443b-8a85-0459361f6466 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059815 Nov 06 21:15:54.658121 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3620/7134] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:15:55.018076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:55.026013 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3126cfc-8302-480f-9fe7-5cbcc93b789a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1454 microversion: 2.1 time: 0.498639 Nov 06 21:15:55.026577 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3515/7135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:54 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1454 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:55.043867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:55.044603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:55.051733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.052185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.053026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.053577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.101257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7bc26438-2cb7-4ad0-89f7-4aaa1b1a40a4 req-4fd21424-88c3-476f-9e85-8c0e82d4fca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb66840-a75a-4c90-95d1-b220fdd9ae15", "name": "network-vif-deleted", "tag": "c1722b04-68c2-4bd2-b024-60d66153e901"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:55.103901 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:55.103901 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:15:55.113004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7bc26438-2cb7-4ad0-89f7-4aaa1b1a40a4 req-4fd21424-88c3-476f-9e85-8c0e82d4fca4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.113840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7bc26438-2cb7-4ad0-89f7-4aaa1b1a40a4 req-4fd21424-88c3-476f-9e85-8c0e82d4fca4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.127305 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7bc26438-2cb7-4ad0-89f7-4aaa1b1a40a4 req-4fd21424-88c3-476f-9e85-8c0e82d4fca4 service nova] Creating event network-vif-deleted:c1722b04-68c2-4bd2-b024-60d66153e901 for instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 on nch1-master-1 Nov 06 21:15:55.134252 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7bc26438-2cb7-4ad0-89f7-4aaa1b1a40a4 req-4fd21424-88c3-476f-9e85-8c0e82d4fca4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036369 Nov 06 21:15:55.134981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3516/7136] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:55.204362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:55.213186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e8e86350-d867-463c-9c90-5652f85b74bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1454 microversion: 2.1 time: 0.174222 Nov 06 21:15:55.214105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3621/7137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:55 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:55.457706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:55.458570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:55.465670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.466115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.467133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.467765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.510531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.510988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.511637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lazy-loading 'fault' on Instance uuid ffb66840-a75a-4c90-95d1-b220fdd9ae15 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:15:55.583317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c526b6ddfc74a84b74b8f2608a0ee15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ddbc94d984ebb9aa64f586ae2fbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:15:55.599451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e1701fc-8f1e-4ec6-a6a0-17c112424184 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 200 len: 1327 microversion: 2.1 time: 0.146171 Nov 06 21:15:55.600881 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3517/7138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:55 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:15:55.666450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:55.667390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:55.674707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.675180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.676119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:55.676771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:55.722948 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1edb957-c12b-43eb-83c5-b6b72a26938f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060863 Nov 06 21:15:55.723631 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3622/7139] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:56.618686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:56.619373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:56.626119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:56.626510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:56.627417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:56.627863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:56.643200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. Nov 06 21:15:56.644093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:56.644994 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e73ed6b-b027-4924-96b9-c31e5d75af61 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 404 len: 111 microversion: 2.1 time: 0.030499 Nov 06 21:15:56.645546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3518/7140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:56 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:56.654262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1a71f20-908c-4065-a01d-c1da48882d3e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '.version_select at 0x7f6714a1d160>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:56.675058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1a71f20-908c-4065-a01d-c1da48882d3e tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538449392" status: 202 len: 0 microversion: 2.1 time: 0.024832 Nov 06 21:15:56.679018 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3623/7141] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:15:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538449392 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:56.735635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:56.736667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:56.742572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:56.743027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:56.744510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:56.744955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:56.791470 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-178b848e-b872-41a8-881f-536f327c370b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058408 Nov 06 21:15:56.792734 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3519/7142] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:56.955376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d71e1862-aece-4b95-b865-8f99398aacfc req-fa013031-25e6-43a0-bafa-a389d7944fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65f8275-232c-4352-b2dc-d80a46ce45e8", "tag": "4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:56.957267 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:15:56.957267 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:15:56.969043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d71e1862-aece-4b95-b865-8f99398aacfc req-fa013031-25e6-43a0-bafa-a389d7944fd5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:56.969787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d71e1862-aece-4b95-b865-8f99398aacfc req-fa013031-25e6-43a0-bafa-a389d7944fd5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:56.982838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d71e1862-aece-4b95-b865-8f99398aacfc req-fa013031-25e6-43a0-bafa-a389d7944fd5 service nova] Creating event network-changed:4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9 for instance e65f8275-232c-4352-b2dc-d80a46ce45e8 on nch2-master-1 Nov 06 21:15:56.988641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d71e1862-aece-4b95-b865-8f99398aacfc req-fa013031-25e6-43a0-bafa-a389d7944fd5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038258 Nov 06 21:15:56.992772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3624/7143] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:15:57.805383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:57.807030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:57.819723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:57.820564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:57.821417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:57.822140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:57.873579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c879ebc-345e-403d-a2e3-4bec5199a778 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.073237 Nov 06 21:15:57.874951 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3520/7144] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:58.887126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:58.888227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:58.896743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:58.897217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:58.898026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:58.898512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:58.948740 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0232fa7d-fb8c-409c-b92c-b1b0c4d5126a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066052 Nov 06 21:15:58.949694 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3625/7145] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:58 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:15:59.659191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:59.659774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:59.667559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.668007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:59.668816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.669252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:59.682398 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. Nov 06 21:15:59.682984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:59.683794 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ca63688-7bc3-4863-b479-5d50e29978d7 tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 404 len: 111 microversion: 2.1 time: 0.028640 Nov 06 21:15:59.684322 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3521/7146] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:15:59 2021] DELETE /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:59.692602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:15:59.693349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: ffb66840-a75a-4c90-95d1-b220fdd9ae15] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:59.700211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.700709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:59.701503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.701958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:59.716143 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. Nov 06 21:15:59.716770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance ffb66840-a75a-4c90-95d1-b220fdd9ae15 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:15:59.717599 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-76520462-bafa-4b8a-846a-d090d052fdba tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15" status: 404 len: 111 microversion: 2.1 time: 0.029121 Nov 06 21:15:59.718117 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3626/7147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:15:59 2021] GET /compute/v2.1/servers/ffb66840-a75a-4c90-95d1-b220fdd9ae15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:15:59.961822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:15:59.963299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:15:59.969645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.970094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:15:59.970879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:15:59.971319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:00.012917 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9271eced-fecd-40ac-89c2-5afa76875bf4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.054785 Nov 06 21:16:00.015589 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3522/7148] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:15:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:00.845932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:00.846432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:00.853614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:00.854083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:00.854880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:00.855331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:00.870018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. Nov 06 21:16:00.870625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:16:00.871493 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3070482-6ff6-4e74-8e4f-69420744c78c tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 404 len: 111 microversion: 2.1 time: 0.029365 Nov 06 21:16:00.872017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3627/7149] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:16:00 2021] DELETE /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:16:00.880246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:00.880970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] [instance: 8565783d-e8fd-4786-9848-138d58914019] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:00.888263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:00.888752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:00.889534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:00.889978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:00.904326 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] HTTP exception thrown: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. Nov 06 21:16:00.904914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] Returning 404 to user: Instance 8565783d-e8fd-4786-9848-138d58914019 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:16:00.905738 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a42f44c1-2d59-40eb-bad1-08f3eff0bafe tempest-AttachVolumeTestJSON-2096905218 tempest-AttachVolumeTestJSON-2096905218-project] 10.222.0.13 "GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019" status: 404 len: 111 microversion: 2.1 time: 0.029468 Nov 06 21:16:00.906268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3523/7150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:00 2021] GET /compute/v2.1/servers/8565783d-e8fd-4786-9848-138d58914019 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:16:01.025506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:01.026447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:01.032817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:01.033287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:01.034087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:01.034540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:01.078726 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-de0f9671-8189-4bba-a263-f7fc5a79ca98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057181 Nov 06 21:16:01.079312 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3628/7151] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:01 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:02.091179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:02.092723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:02.100936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:02.101395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:02.102185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:02.103290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:02.145837 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa2a01fe-46c8-4d83-a5e8-0480707b4e24 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058674 Nov 06 21:16:02.146823 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3524/7152] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:02 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:03.159031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:03.160049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:03.168338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:03.168808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:03.169600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:03.170046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:03.213567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32112ca8-e5cf-404f-928e-c003d9c73f69 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058571 Nov 06 21:16:03.217764 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3629/7153] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:04.226022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:04.228587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:04.235814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:04.236272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:04.237456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:04.238104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:04.283489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2fdc3da4-9f02-4dda-85a1-6021f254bf48 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061253 Nov 06 21:16:04.284312 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3525/7154] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:05.298049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:05.299109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:05.307552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:05.308018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:05.308843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:05.309291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:05.356616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7417a06-ef9a-45dd-a903-e3611221f2e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062599 Nov 06 21:16:05.357818 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3630/7155] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:05.995661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1566239893", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "002af318-7415-4004-9cdf-d72664bf5d96"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:06.047716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] validate_networks() for [('002af318-7415-4004-9cdf-d72664bf5d96', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:16:06.370172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:06.371336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:06.378600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:06.379062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:06.379857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:06.380319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:06.407920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:16:06.408373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:16:06.409031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:16:06.409450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:16:06.409866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:16:06.418941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:06.419293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:06.420130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:06.420588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:06.424670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3de9180d-96f0-461c-9046-cd520279035c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059184 Nov 06 21:16:06.429142 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3631/7156] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:06.437928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:06.443012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for user 1644cf9a6ae142159bb3c6b69c47d827 and project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:06.455464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:16:06.457929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:16:06.502143 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3fa3bb28-016e-4fed-b692-c3e7297eb878 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620775 Nov 06 21:16:06.502788 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3526/7157] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:16:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:16:06.512906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1024c963-1fdc-4938-8c32-549d2eefb7d2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:06.513618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1024c963-1fdc-4938-8c32-549d2eefb7d2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:06.572245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1024c963-1fdc-4938-8c32-549d2eefb7d2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:06.578841 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1024c963-1fdc-4938-8c32-549d2eefb7d2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1218 microversion: 2.1 time: 0.069891 Nov 06 21:16:06.579423 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3632/7158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:06 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:07.437172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:07.438895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:07.446805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:07.447751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:07.448790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:07.449260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:07.496422 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8e411a8e-28c0-44c3-9d1f-882a64ed8cdf tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062945 Nov 06 21:16:07.497623 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3527/7159] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:07.594884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:07.595505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:07.602405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:07.602871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:07.603723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:07.604200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:07.679260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:07.687290 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-426d746b-451a-437b-836c-5796e3a446de tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1276 microversion: 2.1 time: 0.096053 Nov 06 21:16:07.687997 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3633/7160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:07 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:08.508557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:08.509550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:08.517497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:08.518102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:08.518894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:08.519331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:08.704872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:08.705462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:08.713359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:08.714135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:08.715224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:08.716107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:08.823976 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-036c7802-a196-4ed7-abad-c404f8873c85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.319268 Nov 06 21:16:08.824897 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3528/7161] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:08 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:08.971577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:08.979105 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ab29e7f-9258-4f7f-a42f-3ce383f7a469 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.278062 Nov 06 21:16:08.979678 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3634/7162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:08 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:09.134429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7cf9f512-9213-49f5-8101-670eda81daf3 req-77f752f1-e0cc-4948-b333-0c6e68eec627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd73eaa9-7dc4-4c01-90be-3af6d045291d", "tag": "f4f4ac47-b622-493a-ba70-73c70c72d6e1"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:09.137376 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:09.137376 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:09.147272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7cf9f512-9213-49f5-8101-670eda81daf3 req-77f752f1-e0cc-4948-b333-0c6e68eec627 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.147726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7cf9f512-9213-49f5-8101-670eda81daf3 req-77f752f1-e0cc-4948-b333-0c6e68eec627 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.160066 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7cf9f512-9213-49f5-8101-670eda81daf3 req-77f752f1-e0cc-4948-b333-0c6e68eec627 service nova] Creating event network-changed:f4f4ac47-b622-493a-ba70-73c70c72d6e1 for instance cd73eaa9-7dc4-4c01-90be-3af6d045291d on nch1-master-1 Nov 06 21:16:09.164897 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7cf9f512-9213-49f5-8101-670eda81daf3 req-77f752f1-e0cc-4948-b333-0c6e68eec627 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034965 Nov 06 21:16:09.165751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3529/7163] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:09.610258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:09.610876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:09.617275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.617736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.618528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.619558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.836729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:09.838257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:09.845192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.845643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.846419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.846849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.859637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:09.867660 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66fb0169-8828-453f-a453-97d2d889ef40 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1683 microversion: 2.1 time: 0.261082 Nov 06 21:16:09.868570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3635/7164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:09 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1683 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:09.900821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f5f1f31-35d4-4855-adb9-54ba5d259728 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065047 Nov 06 21:16:09.904552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3530/7165] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:09.961831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:09.963356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:09.969410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.969887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.970695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:09.971152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:09.995972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:09.997289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:10.005526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.005990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.006787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.007231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.023450 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3196a23a-4c52-46fd-b52e-258f58fd1ff1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action" status: 200 len: 32630 microversion: 2.1 time: 0.065338 Nov 06 21:16:10.024117 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3636/7166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:16:09 2021] POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action => generated 32630 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:16:10.204933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:10.212205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2236ed76-0d8e-40fa-b9a1-bcd695fb4740 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.220240 Nov 06 21:16:10.213324 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3531/7167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:09 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:10.232929 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:10.233642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:10.240545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.241015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.241810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.242261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.370490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3c2574b-2178-41a9-8a29-95cc1974e8ee tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1834 microversion: 2.1 time: 0.142152 Nov 06 21:16:10.371056 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3637/7168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:10 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1834 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:10.387478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:10.388687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:10.395003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.395403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.396184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.396646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.419996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lazy-loading 'flavor' on Instance uuid 70740f6c-c71d-494c-a15b-25f7b86d98ec {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:16:10.431031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Going to try to live migrate instance to another host {{(pid=134828) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 06 21:16:10.915889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:10.917580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:10.924560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.925022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.925865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:10.926317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:10.968530 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bbbc68d-9d32-4bf7-8b87-12ccaee7b862 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056737 Nov 06 21:16:10.969274 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3638/7169] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:11.230028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:11.230768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:11.237740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.238204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:11.238999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.239542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:11.378994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:11.387150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35e6e34b-5949-48bf-b595-156d0553717a tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.161100 Nov 06 21:16:11.387729 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3639/7170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:11 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:11.699242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2a7c76c-6170-46a6-ab75-6c50e38f9187 tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action" status: 202 len: 0 microversion: 2.1 time: 1.315757 Nov 06 21:16:11.703289 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3532/7171] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:16:10 2021] POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:11.708495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:11.709126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:11.716443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.716916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:11.717716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.718170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:11.873681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:11.882683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-073cba41-34e8-4f1f-8081-0c44c245ee97 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.178216 Nov 06 21:16:11.883273 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3640/7172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:11 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:11.981951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:11.982866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:11.991512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.991512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:11.992209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:11.992671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:12.039190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6eaa948-c841-4df9-9ef4-fd57ae3eebae tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062158 Nov 06 21:16:12.045510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3533/7173] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:12.405008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:12.405716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:12.412995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:12.413494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:12.414315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:12.414806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:12.557913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:12.566065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-361ad1e0-966c-4fa2-906b-67a91db9f401 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.164722 Nov 06 21:16:12.566662 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3641/7174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:12 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:12.901087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:12.901793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:12.909227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:12.909692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:12.910482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:12.910924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.051680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:13.056401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:13.058186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:13.061251 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6549e723-9992-4230-93d7-505f9527447d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.164163 Nov 06 21:16:13.062157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3534/7175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:12 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:13.066348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.066835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.067719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.068450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.112193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa05953b-adbb-483f-b753-9909fe1c3a59 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062088 Nov 06 21:16:13.116322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3642/7176] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:13 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:13.130213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-34ce659d-d45b-4534-abac-70cf29d066e1 req-efbc26ae-ea92-4cb6-a60d-148bea8f2f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:13.132070 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:13.132070 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:13.141371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-34ce659d-d45b-4534-abac-70cf29d066e1 req-efbc26ae-ea92-4cb6-a60d-148bea8f2f76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.141820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-34ce659d-d45b-4534-abac-70cf29d066e1 req-efbc26ae-ea92-4cb6-a60d-148bea8f2f76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.152182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-34ce659d-d45b-4534-abac-70cf29d066e1 req-efbc26ae-ea92-4cb6-a60d-148bea8f2f76 service nova] Creating event network-vif-unplugged:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:16:13.157134 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-34ce659d-d45b-4534-abac-70cf29d066e1 req-efbc26ae-ea92-4cb6-a60d-148bea8f2f76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030663 Nov 06 21:16:13.157713 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3535/7177] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:13.506976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-747ca97f-ba79-4b1a-adef-8a273d15ba65 req-8e79d573-e6f2-48d5-8cf9-74cceede2463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "name": "network-vif-plugged", "status": "completed", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:13.508535 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:13.508535 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:13.517121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-747ca97f-ba79-4b1a-adef-8a273d15ba65 req-8e79d573-e6f2-48d5-8cf9-74cceede2463 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.517883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-747ca97f-ba79-4b1a-adef-8a273d15ba65 req-8e79d573-e6f2-48d5-8cf9-74cceede2463 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.530822 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-747ca97f-ba79-4b1a-adef-8a273d15ba65 req-8e79d573-e6f2-48d5-8cf9-74cceede2463 service nova] Creating event network-vif-plugged:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:16:13.535924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-747ca97f-ba79-4b1a-adef-8a273d15ba65 req-8e79d573-e6f2-48d5-8cf9-74cceede2463 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034051 Nov 06 21:16:13.537125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3643/7178] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:16:13.585965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:13.588344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:13.596135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.596720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.597735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:13.598314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:13.752731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:13.760394 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3999bee-dc22-4916-a725-58f41baabdc5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.181035 Nov 06 21:16:13.760970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3536/7179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:13 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:14.079751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:14.080648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:14.086796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.087271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.088117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.088605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.124890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:14.125806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:14.132548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.132929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.133722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.134156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.179948 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31600f79-8103-4b9f-8b7d-d365fcd860a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058596 Nov 06 21:16:14.184658 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3537/7180] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:14.227363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:14.235350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2712fd03-6ed0-4e0d-960b-bd6dc21eaf35 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.160101 Nov 06 21:16:14.235912 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3644/7181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:14 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:14.789901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:14.790856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:14.800193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.800826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.801729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:14.802466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:14.963355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:14.970763 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-adb6393f-1587-4b42-8f46-4dd51766cf4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.186243 Nov 06 21:16:14.971388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3538/7182] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:14 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:15.174460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a5186e79-0692-4098-a4bc-d12f7688785a req-ec19acd9-05f6-41ba-948d-9306cdc49db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:15.175952 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:15.175952 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:15.184400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a5186e79-0692-4098-a4bc-d12f7688785a req-ec19acd9-05f6-41ba-948d-9306cdc49db3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.184859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a5186e79-0692-4098-a4bc-d12f7688785a req-ec19acd9-05f6-41ba-948d-9306cdc49db3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.192276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:15.193213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:15.197408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a5186e79-0692-4098-a4bc-d12f7688785a req-ec19acd9-05f6-41ba-948d-9306cdc49db3 service nova] Creating event network-changed:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:16:15.201151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.201577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.202350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a5186e79-0692-4098-a4bc-d12f7688785a req-ec19acd9-05f6-41ba-948d-9306cdc49db3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031558 Nov 06 21:16:15.202480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.202788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.202930 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3645/7183] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:16:15.247894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b7870daa-07a0-461b-b61a-f5ea4823a0da tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059195 Nov 06 21:16:15.248718 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3539/7184] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:15.253766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:15.254641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:15.261228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.261702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.262507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.262958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.520867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:15.529168 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6cda76a4-e46e-480d-98cd-60ce519428d7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.279427 Nov 06 21:16:15.535213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3646/7185] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:15 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:15.573083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-86962224-53bb-49cf-b7bc-d9abb19a3596 req-f16e0c55-3f84-46c7-9f46-ca0901dbe879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd73eaa9-7dc4-4c01-90be-3af6d045291d", "name": "network-vif-plugged", "status": "completed", "tag": "f4f4ac47-b622-493a-ba70-73c70c72d6e1"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:15.575236 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:15.575236 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:15.583430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-86962224-53bb-49cf-b7bc-d9abb19a3596 req-f16e0c55-3f84-46c7-9f46-ca0901dbe879 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.583910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-86962224-53bb-49cf-b7bc-d9abb19a3596 req-f16e0c55-3f84-46c7-9f46-ca0901dbe879 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.597195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-86962224-53bb-49cf-b7bc-d9abb19a3596 req-f16e0c55-3f84-46c7-9f46-ca0901dbe879 service nova] Creating event network-vif-plugged:f4f4ac47-b622-493a-ba70-73c70c72d6e1 for instance cd73eaa9-7dc4-4c01-90be-3af6d045291d on nch1-master-1 Nov 06 21:16:15.601966 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-86962224-53bb-49cf-b7bc-d9abb19a3596 req-f16e0c55-3f84-46c7-9f46-ca0901dbe879 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Nov 06 21:16:15.602562 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3540/7186] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:15.987144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:15.987764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:15.994133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.994596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:15.995383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:15.996414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:16.143403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:16.151898 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2de32710-04a2-4d5f-94d7-ba86f914a288 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.168400 Nov 06 21:16:16.152495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3647/7187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:15 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:16.261108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:16.262089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:16.268168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:16.268575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:16.269397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:16.269827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:16.311747 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8c52c91-a4ed-46fe-9622-71ed4e365075 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055373 Nov 06 21:16:16.312391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3541/7188] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:16 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:16.547849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:16.548429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:16.554870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:16.555340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:16.556158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:16.556636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:16.696516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:16.704438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9a4583e-d80f-4c4e-9424-7bec58f84b05 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.160336 Nov 06 21:16:16.705017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3648/7189] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:16 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:17.170297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:17.171026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:17.178003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.178459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.179249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.179688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.318162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:17.326758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:17.328053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:17.328205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b304471-8f94-439e-bcaa-154d4ef968ff tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1318 microversion: 2.1 time: 0.161743 Nov 06 21:16:17.336185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.336837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.337752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.338390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.338772 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3542/7190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:17 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:17.393087 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d731f242-d699-473d-9369-5f482c7d7294 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072491 Nov 06 21:16:17.394138 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3649/7191] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:17.722371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:17.723009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:17.731061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.731565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.732601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:17.733070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:17.884200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:17.892021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa55494a-7f10-4965-ab07-5b46a6517289 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.173609 Nov 06 21:16:17.892615 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3543/7192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:17 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:18.346921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:18.347725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:18.356136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.356621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:18.357417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.357862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:18.405274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:18.406884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:18.414199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.414881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:18.416130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.416823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:18.476184 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d16d1fb4-9d50-4f87-9a82-adab0843c45c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.074977 Nov 06 21:16:18.477912 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3544/7193] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:18.530483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:18.538760 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88731bc2-efe0-4c59-a4ec-58c3e3b27489 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1508 microversion: 2.1 time: 0.196227 Nov 06 21:16:18.539377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3650/7194] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:18 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:18.911217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:18.912004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:18.920620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.921096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:18.922113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:18.922524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:19.080862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:19.088374 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a08cd30d-179c-4419-b2f2-e4e748aeb1d4 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.181837 Nov 06 21:16:19.088941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3545/7195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:18 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:19.488182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:19.489151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:19.495898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:19.496398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:19.497224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:19.497672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:19.539899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72ae6995-8815-4f42-b4ec-abdbec781532 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055225 Nov 06 21:16:19.540947 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3651/7196] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:19 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:19.925371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5604ed9b-3982-42e7-b394-002095287e15"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:19.926440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:19.933737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:19.934709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:19.935684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:19.936125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:20.109441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:20.110556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:20.123453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:20.124053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:20.125215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:20.126560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:20.197145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a85224c2-3f2c-4210-9920-eef2785f5af4 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274764 Nov 06 21:16:20.198214 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3546/7197] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:16:19 2021] POST /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:20.304203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:20.313918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-088547f7-804d-48f9-8842-cfd2706cd625 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.211235 Nov 06 21:16:20.314851 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3652/7198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:20 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:20.554021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:20.555409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:20.563505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:20.563988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:20.564857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:20.565260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:20.614008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ea1bef8-4867-451a-9a96-2f6ada5565fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064117 Nov 06 21:16:20.615781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3547/7199] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:21.332186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:21.332937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:21.341701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:21.342181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:21.342993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:21.343463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:21.500987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:21.509753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e23a825d-bf63-4d32-8c66-4dae78893842 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.181313 Nov 06 21:16:21.510494 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3653/7200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:21 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:21.627154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:21.628252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:21.636798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:21.637333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:21.638250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:21.638728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:21.686471 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d017e089-d211-4371-b2e0-49f13da31b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063776 Nov 06 21:16:21.687358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3548/7201] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:22.441243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3627628b-dd91-4339-9556-2bc04dababbe req-0b5ee9e9-c335-48e8-ad2d-30bcd63cb702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:22.444268 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:22.444268 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:22.455204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3627628b-dd91-4339-9556-2bc04dababbe req-0b5ee9e9-c335-48e8-ad2d-30bcd63cb702 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:22.455666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3627628b-dd91-4339-9556-2bc04dababbe req-0b5ee9e9-c335-48e8-ad2d-30bcd63cb702 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:22.485953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3627628b-dd91-4339-9556-2bc04dababbe req-0b5ee9e9-c335-48e8-ad2d-30bcd63cb702 service nova] Creating event network-vif-unplugged:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch1-master-1 Nov 06 21:16:22.494117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3627628b-dd91-4339-9556-2bc04dababbe req-0b5ee9e9-c335-48e8-ad2d-30bcd63cb702 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058079 Nov 06 21:16:22.494960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3654/7202] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:22.530229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:22.530933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:22.540163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:22.540901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:22.541759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:22.542296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:22.706861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:22.708899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:22.718622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:22.719411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:22.720879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:22.721537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:22.889856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:22.898684 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c904206f-fd6d-4a5d-a66f-287bd567f3c7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.373158 Nov 06 21:16:22.899949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3549/7203] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:22 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:23.542760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1592464836", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "002af318-7415-4004-9cdf-d72664bf5d96"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:23.608794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] validate_networks() for [('002af318-7415-4004-9cdf-d72664bf5d96', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:16:23.807920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eff4b659-a0d8-4d85-8548-8488ca36d915 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 1.111256 Nov 06 21:16:23.810686 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3655/7204] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:23.922127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:23.923764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:23.933828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:23.934642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:23.935533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:23.936227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:24.109417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:16:24.109988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:16:24.110635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:16:24.111194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:16:24.111717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:16:24.123146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:24.123770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:24.124868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:24.125379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:24.143412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:24.149515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for user 1644cf9a6ae142159bb3c6b69c47d827 and project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:24.152443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:24.160042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1afaf9f9-8cde-44a8-9aaa-ba0cff9bb2ba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1693 microversion: 2.1 time: 0.244987 Nov 06 21:16:24.160657 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3656/7205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:23 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:24.162398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:16:24.164883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:16:24.239493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-660b8508-3fe2-491d-96c1-93df8452de16 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700869 Nov 06 21:16:24.240696 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3550/7206] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:16:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:16:24.255483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bda2924-dae8-45ca-82ed-61bf8c215f03 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:24.256607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bda2924-dae8-45ca-82ed-61bf8c215f03 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:24.333167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bda2924-dae8-45ca-82ed-61bf8c215f03 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:24.341498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bda2924-dae8-45ca-82ed-61bf8c215f03 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1218 microversion: 2.1 time: 0.091468 Nov 06 21:16:24.342157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3657/7207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:24 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:24.822027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:24.823380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:24.830427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:24.831238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:24.832114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:24.832658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:24.886003 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4970cbb6-1765-4c94-bf2f-4afc2fdbac21 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067667 Nov 06 21:16:24.893732 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3551/7208] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:25.179525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:25.180537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.189063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.189681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.190625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.191183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.352895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:25.366529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:25.368687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.381259 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4001dba7-8646-4349-ab72-1d35ef94791a tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1683 microversion: 2.1 time: 0.206719 Nov 06 21:16:25.383787 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3658/7209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:25 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:25.384622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.385312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.386234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.386674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.403395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:25.404067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.412282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.412874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.413791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.414499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.468887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:25.477512 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13819aca-f951-46e6-b739-f17d699ad89e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1276 microversion: 2.1 time: 0.122278 Nov 06 21:16:25.478086 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3552/7210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:25 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:25.564361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2efb44b7-e662-4bd7-8245-32e0309bef9c tempest-TestNetworkAdvancedServerOps-1099338386 tempest-TestNetworkAdvancedServerOps-1099338386-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1834 microversion: 2.1 time: 0.165491 Nov 06 21:16:25.565162 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3659/7211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:25 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1834 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:25.581625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:25.582229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.588991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.589446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.590783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.591245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.752903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:25.762881 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff378eb0-26c6-40a3-8018-878cd850e29d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1683 microversion: 2.1 time: 0.184335 Nov 06 21:16:25.763546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3553/7212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:25 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:25.880382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:25.881351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.889202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.889819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.890782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.891332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.906909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:25.908469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:25.916346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.916799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:25.917787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:25.918643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:28.541293 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-831fb503-5a0a-4d29-ba1f-75a933826a13 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action" status: 200 len: 38354 microversion: 2.1 time: 2.664981 Nov 06 21:16:28.542010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3660/7213] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:16:25 2021] POST /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec/action => generated 38354 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:16:28.547547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:28.548264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:28.556578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:28.557048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:28.557624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47c2b732-3a8c-4e8a-8174-9b7669f95b88 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 2.655093 Nov 06 21:16:28.558191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:28.558308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:28.558897 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3554/7214] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:25 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:28.707591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:28.715848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4cc999a5-54a1-4fbd-a521-d8975cae3512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.172539 Nov 06 21:16:28.716543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3661/7215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:28 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:29.572826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:29.573991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:29.585290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:29.586019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:29.587194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:29.588077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:29.644224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35a01221-cbaf-4aee-9634-0b7d9ab79855 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.076109 Nov 06 21:16:29.645184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3555/7216] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:29.701276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-114d1ac6-e538-4451-b811-b1ecbc136fd5 req-0255703a-1547-4250-a91e-eb404452cb53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451e0e47-f3f4-4c68-a06c-d76669d1a37f", "tag": "edb0c6c0-2020-46ee-8c6c-6b2c645b65a5"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:29.702887 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:29.702887 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:29.724809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-114d1ac6-e538-4451-b811-b1ecbc136fd5 req-0255703a-1547-4250-a91e-eb404452cb53 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:29.725270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-114d1ac6-e538-4451-b811-b1ecbc136fd5 req-0255703a-1547-4250-a91e-eb404452cb53 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:29.735909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:29.737462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:29.737634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-114d1ac6-e538-4451-b811-b1ecbc136fd5 req-0255703a-1547-4250-a91e-eb404452cb53 service nova] Creating event network-changed:edb0c6c0-2020-46ee-8c6c-6b2c645b65a5 for instance 451e0e47-f3f4-4c68-a06c-d76669d1a37f on nch2-master-1 Nov 06 21:16:29.742813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-114d1ac6-e538-4451-b811-b1ecbc136fd5 req-0255703a-1547-4250-a91e-eb404452cb53 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045792 Nov 06 21:16:29.743753 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3662/7217] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:16:29.748177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:29.748570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:29.749500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:29.749946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:29.918092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:29.928362 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-675cded7-761c-4d72-9630-ac45e8633121 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.198361 Nov 06 21:16:29.929446 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3556/7218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:29 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:30.306538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:30.307303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:30.313980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.314591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.315573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.316112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.349212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:16:30.460765 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e6828e7-a1c3-46e9-b92c-3849c57da350 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 204 len: 0 microversion: 2.1 time: 0.159378 Nov 06 21:16:30.461467 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3663/7219] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:16:30 2021] DELETE /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:16:30.471508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:30.472192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:30.478973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.479453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.480282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.480924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.640056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:30.648066 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1857f253-d775-4d53-8c2a-ec97ddd007e1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1689 microversion: 2.1 time: 0.181274 Nov 06 21:16:30.648685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3557/7220] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:30 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:30.659210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:30.659622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:30.667393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.667943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.669452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.669976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.720865 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a57e457-afb7-444e-ab2a-4a0a1e8d7cba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067744 Nov 06 21:16:30.723330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3664/7221] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:30 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:30.946472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:30.947492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:30.956229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.956802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:30.957695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:30.958495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:31.132464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:31.143991 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99fc8085-57ec-4d49-86b2-21d992505966 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.201318 Nov 06 21:16:31.144787 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3558/7222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:30 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:31.668533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:31.669855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:31.678265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:31.678854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:31.679676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:31.680393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:31.735136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:31.736061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:31.744064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:31.744581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:31.745398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:31.745927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:31.794682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0841b468-c31f-4803-8df9-0d320d92936a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063276 Nov 06 21:16:31.799936 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3559/7223] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:31 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:31.859793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:31.874258 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-67393283-12b2-42f6-afeb-141f91eb5a15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 200 len: 1689 microversion: 2.1 time: 0.210587 Nov 06 21:16:31.875165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3665/7224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:31 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:31.980628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-5df3e14d-407c-4214-8616-776068658bc5 req-3cb5d6d1-d59e-48d0-b3a3-10529b8da938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:31.983109 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:31.983109 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:31.991652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5df3e14d-407c-4214-8616-776068658bc5 req-3cb5d6d1-d59e-48d0-b3a3-10529b8da938 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:31.992225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-5df3e14d-407c-4214-8616-776068658bc5 req-3cb5d6d1-d59e-48d0-b3a3-10529b8da938 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.006075 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-5df3e14d-407c-4214-8616-776068658bc5 req-3cb5d6d1-d59e-48d0-b3a3-10529b8da938 service nova] Creating event network-changed:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch2-master-1 Nov 06 21:16:32.011232 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-5df3e14d-407c-4214-8616-776068658bc5 req-3cb5d6d1-d59e-48d0-b3a3-10529b8da938 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035628 Nov 06 21:16:32.012017 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3560/7225] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:32.162364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:32.163218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:32.171117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.171802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.172848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.173577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.322138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:32.331520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d87ec9c5-e970-41fa-9f39-0b810a76f691 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.173179 Nov 06 21:16:32.332415 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3666/7226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:32 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:32.808976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:32.810257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:32.817795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.818391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.819272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.819780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.871112 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72d813a6-0cf4-4aa8-ac7c-558faa87243f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067069 Nov 06 21:16:32.872114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3561/7227] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:32.892570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:32.893206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 70740f6c-c71d-494c-a15b-25f7b86d98ec] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:32.900926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.901560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.902485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:32.903546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:32.923811 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] HTTP exception thrown: Instance 70740f6c-c71d-494c-a15b-25f7b86d98ec could not be found. Nov 06 21:16:32.924467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Returning 404 to user: Instance 70740f6c-c71d-494c-a15b-25f7b86d98ec could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:16:32.925685 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25e6449a-011b-4cf9-900f-cf4081c253bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec" status: 404 len: 111 microversion: 2.1 time: 0.036716 Nov 06 21:16:32.929269 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3667/7228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:32 2021] GET /compute/v2.1/servers/70740f6c-c71d-494c-a15b-25f7b86d98ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:16:33.349394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:33.350099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:33.358170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:33.358654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:33.359543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:33.360032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:33.885184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:33.886423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:33.894748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:33.895579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:33.896568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:33.897136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:33.947751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f84cb4e-9e37-4234-9cb1-e15c8a0748f1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067611 Nov 06 21:16:33.949566 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3668/7229] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:33 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:33.979900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:33.989028 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-437fcb9f-4809-4878-8017-2ea01afe205c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.643872 Nov 06 21:16:33.989642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3562/7230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:33 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:34.029257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a42333a5-36f6-41a4-a244-1c8f7ae2fa75 req-53f0fc7c-fcc5-480b-b030-7cfefc2033b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70740f6c-c71d-494c-a15b-25f7b86d98ec", "name": "network-vif-deleted", "tag": "ceac2deb-f0c5-4c4c-8896-4b3ae8de1307"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:34.030795 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:34.030795 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:34.039399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a42333a5-36f6-41a4-a244-1c8f7ae2fa75 req-53f0fc7c-fcc5-480b-b030-7cfefc2033b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:34.039900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a42333a5-36f6-41a4-a244-1c8f7ae2fa75 req-53f0fc7c-fcc5-480b-b030-7cfefc2033b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:34.059637 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a42333a5-36f6-41a4-a244-1c8f7ae2fa75 req-53f0fc7c-fcc5-480b-b030-7cfefc2033b8 service nova] Creating event network-vif-deleted:ceac2deb-f0c5-4c4c-8896-4b3ae8de1307 for instance 70740f6c-c71d-494c-a15b-25f7b86d98ec on nch2-master-1 Nov 06 21:16:34.066186 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a42333a5-36f6-41a4-a244-1c8f7ae2fa75 req-53f0fc7c-fcc5-480b-b030-7cfefc2033b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Nov 06 21:16:34.066895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3669/7231] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:34.962435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:34.963849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:34.972312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:34.973039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:34.974020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:34.974646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:35.010188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:35.011335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:35.020181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:35.020923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:35.021154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a32d5f2-6bd6-4aaf-94a2-9b35fddbab71 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062886 Nov 06 21:16:35.024555 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3563/7232] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:35.026233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:35.026800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:35.272916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:35.281617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46c70af1-2ad8-47be-91d8-0da3575c2b22 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.276215 Nov 06 21:16:35.292420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3670/7233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:35 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:35.323622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e793c7f5-551c-46bf-bdb4-d8118f6be2e9 req-80a41e3d-3af0-401d-b8ee-54dedf308257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451e0e47-f3f4-4c68-a06c-d76669d1a37f", "name": "network-vif-plugged", "status": "completed", "tag": "edb0c6c0-2020-46ee-8c6c-6b2c645b65a5"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:35.325782 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:35.325782 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:35.334513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e793c7f5-551c-46bf-bdb4-d8118f6be2e9 req-80a41e3d-3af0-401d-b8ee-54dedf308257 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:35.335206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e793c7f5-551c-46bf-bdb4-d8118f6be2e9 req-80a41e3d-3af0-401d-b8ee-54dedf308257 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:35.350219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e793c7f5-551c-46bf-bdb4-d8118f6be2e9 req-80a41e3d-3af0-401d-b8ee-54dedf308257 service nova] Creating event network-vif-plugged:edb0c6c0-2020-46ee-8c6c-6b2c645b65a5 for instance 451e0e47-f3f4-4c68-a06c-d76669d1a37f on nch2-master-1 Nov 06 21:16:35.357150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e793c7f5-551c-46bf-bdb4-d8118f6be2e9 req-80a41e3d-3af0-401d-b8ee-54dedf308257 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038032 Nov 06 21:16:35.358289 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3564/7234] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:36.034765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:36.035757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:36.047976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:36.048812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:36.049836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:36.050462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:36.110583 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d756842a-b19a-4778-81df-5ac302b9bfe0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.080010 Nov 06 21:16:36.111504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3671/7235] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:36.300006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:36.300769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:36.306732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:36.307188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:36.307971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:36.308441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:36.464774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:36.473151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee779df6-823d-453d-8b2a-09f0b2be464c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1318 microversion: 2.1 time: 0.177898 Nov 06 21:16:36.473722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3565/7236] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:36 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:36.726782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf65fc09-cd27-4504-bc94-6b8d3ca11cdf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '.version_select at 0x7f671513aee0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:36.746723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf65fc09-cd27-4504-bc94-6b8d3ca11cdf tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1372491887" status: 202 len: 0 microversion: 2.1 time: 0.023873 Nov 06 21:16:36.752072 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3672/7237] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Nov 6 21:16:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1372491887 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:36.767452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: .version_select at 0x7f671424cb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1977052409"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:36.787591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:36.793251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:36.954378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:36.959211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:36.973773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe65daa2-5df6-4324-a2ce-840a1309ba9c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.210019 Nov 06 21:16:36.974377 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3566/7238] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:16:36 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:37.124158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:37.125346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:37.140284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.140798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.141627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.142086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.189088 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e346256b-4573-4c73-adc1-f0d876b4eb98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.069230 Nov 06 21:16:37.190324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3673/7239] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:37.491257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:37.491874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:37.499903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.500422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.501230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.501671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.691810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:37.700741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1fd81e3a-79fc-4ab6-95b2-35a31e9dc655 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1509 microversion: 2.1 time: 0.214044 Nov 06 21:16:37.701459 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3567/7240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:37 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:37.718623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5604ed9b-3982-42e7-b394-002095287e15"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:37.720110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:37.727619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.728082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.729553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:37.730011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:37.942302 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Invalid volume: volume 5604ed9b-3982-42e7-b394-002095287e15 is already attached to instances: cd73eaa9-7dc4-4c01-90be-3af6d045291d Nov 06 21:16:37.942920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 400 to user: Invalid volume: volume 5604ed9b-3982-42e7-b394-002095287e15 is already attached to instances: cd73eaa9-7dc4-4c01-90be-3af6d045291d {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:16:37.943786 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ca6adaf-3039-4983-b301-7e30a7154512 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.230081 Nov 06 21:16:37.944370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3674/7241] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:16:37 2021] POST /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f/os-volume_attachments => generated 174 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:16:38.007629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:38.008198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:38.014997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.015462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.016266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.016750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.099660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lazy-loading 'services' on Instance uuid cd73eaa9-7dc4-4c01-90be-3af6d045291d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:16:38.178823 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7121a5aa-e9c9-4400-be91-694ff7282398 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments/5604ed9b-3982-42e7-b394-002095287e15" status: 202 len: 0 microversion: 2.1 time: 0.174826 Nov 06 21:16:38.183142 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3568/7242] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:16:38 2021] DELETE /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments/5604ed9b-3982-42e7-b394-002095287e15 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:38.189198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:38.191015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:38.209429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:38.209657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.211166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:38.219298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.219814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.220650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.221091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.221259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.222344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:38.222910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:38.286787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a491173e-1b22-443b-bc25-c0bc3ca38244 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102250 Nov 06 21:16:38.287038 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-025fa015-e551-4e27-ac53-30c375856a1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.086914 Nov 06 21:16:38.287875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3569/7243] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:38.293011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3675/7244] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:16:38 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:39.299724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:39.300432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:39.300946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:39.301376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:39.308023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.308604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.309404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.309586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.310004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.310160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.311178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.311694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.344104 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0320284-6ebd-4de7-a8ea-cb499bd60959 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048009 Nov 06 21:16:39.344843 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3676/7245] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:16:39 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:16:39.359874 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-836d5223-d360-4e59-be34-b557173b2219 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063984 Nov 06 21:16:39.360866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3570/7246] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:39.447587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-823731474", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "002af318-7415-4004-9cdf-d72664bf5d96"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:39.501611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] validate_networks() for [('002af318-7415-4004-9cdf-d72664bf5d96', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:16:39.878426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:16:39.880311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:16:39.880311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:16:39.880311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:16:39.880732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:16:39.889800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.890260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.891088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:39.892590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:39.920139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:39.925704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for user 1644cf9a6ae142159bb3c6b69c47d827 and project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:39.938220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:16:39.940599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:16:39.991523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33327c46-4dcb-48c8-9ba6-2174d11aa1be tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547481 Nov 06 21:16:39.992545 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3677/7247] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:16:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:16:40.003638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c67ba057-b41e-46cc-878f-239f8f31b063 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:40.004380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c67ba057-b41e-46cc-878f-239f8f31b063 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:40.152698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c67ba057-b41e-46cc-878f-239f8f31b063 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:40.161247 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c67ba057-b41e-46cc-878f-239f8f31b063 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1217 microversion: 2.1 time: 0.162481 Nov 06 21:16:40.162250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3571/7248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:39 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:40.372708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:40.374291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:40.382515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:40.383422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:40.385316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:40.386061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:40.441389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5e8bdc0-3017-4efe-b3c0-7a125c35c69b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.070562 Nov 06 21:16:40.442202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3678/7249] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:40 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:41.182790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:41.183545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:41.195847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:41.196420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:41.201108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:41.201849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:41.305139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:41.318953 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b29795d7-8b13-448c-be2c-4333b1194b09 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1287 microversion: 2.1 time: 0.139664 Nov 06 21:16:41.321554 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3572/7250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:41 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:41.457491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:41.458580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:41.475378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:41.476367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:41.482535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:41.483154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:41.552900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49b888a8-1c74-48c3-acfc-a7d6e9e2040f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.101668 Nov 06 21:16:41.554300 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3679/7251] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:42.341902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:42.343599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:42.355626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:42.357158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:42.359605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:42.359605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:42.575000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:42.576954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:42.612450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:42.616240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:42.617540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:42.625832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:42.704491 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-52380a02-c0bc-4c28-aae2-37fb7870de60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.139208 Nov 06 21:16:42.712074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3680/7252] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:42.783899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:42.792824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-516c4b93-20e1-4eb8-86ad-6cff71afc098 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.456781 Nov 06 21:16:42.793520 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3573/7253] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:42 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:43.293327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a0b34b98-f524-4ff6-a77f-625d46f30556 req-5915f402-45a2-41d9-9da8-1928b63a61b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f445f016-1639-4ccf-bbc9-64841874e40b", "tag": "4c1f79d0-950d-432b-a1d8-730ebf768793"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:43.296957 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:43.296957 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:43.315031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a0b34b98-f524-4ff6-a77f-625d46f30556 req-5915f402-45a2-41d9-9da8-1928b63a61b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:43.315752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a0b34b98-f524-4ff6-a77f-625d46f30556 req-5915f402-45a2-41d9-9da8-1928b63a61b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:43.357806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a0b34b98-f524-4ff6-a77f-625d46f30556 req-5915f402-45a2-41d9-9da8-1928b63a61b5 service nova] Creating event network-changed:4c1f79d0-950d-432b-a1d8-730ebf768793 for instance f445f016-1639-4ccf-bbc9-64841874e40b on nch1-master-1 Nov 06 21:16:43.368918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a0b34b98-f524-4ff6-a77f-625d46f30556 req-5915f402-45a2-41d9-9da8-1928b63a61b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083109 Nov 06 21:16:43.372904 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3681/7254] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:16:43.720597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:43.721705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:43.737418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:43.739853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:43.740922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:43.741768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:43.807917 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3004b3c3-cfc1-4610-af37-fa8ed76f121f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.088098 Nov 06 21:16:43.811644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3574/7255] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:43.817734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:43.819824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:43.828737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:43.829364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:43.830232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:43.830701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:43.983811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-215803908", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "8ceab72c-17bb-4431-b274-3d972f24a055"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1977052409", "security_groups": [{"name": "tempest-secgroup-smoke-1515318460"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:44.210373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:44.227656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3f46185-6148-4709-9e7a-d8f34e1fc502 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.414518 Nov 06 21:16:44.229749 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3682/7256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:43 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:44.234393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] validate_networks() for [('8ceab72c-17bb-4431-b274-3d972f24a055', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:16:44.823370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:44.824507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:44.834738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:44.835508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:44.836393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:44.837062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:44.891005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-445694ee-8ccc-4363-8471-2cf40b93bc30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072248 Nov 06 21:16:44.893486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3683/7257] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:45.248004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:45.249095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:45.262269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.269107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:45.272121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.272822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:45.340009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:16:45.340717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:16:45.341511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:16:45.341934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:16:45.342355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:16:45.354246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.355103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:45.356406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.357200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:45.378020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:45.384451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Getting quotas for user 67902d7d41f547ec9b88ed6832411ca0 and project 5f8c001debad4d98b1531db2b7d91349. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:45.400813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:16:45.404004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:16:45.466498 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d91dcb69-4f01-4b35-a19e-7a0f0d4a5362 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.487868 Nov 06 21:16:45.467585 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3575/7258] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:16:43 2021] POST /compute/v2.1/servers => generated 406 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:16:45.479584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c1ed4c7-ff44-4a70-abe7-269e59cd8d5c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:45.480658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c1ed4c7-ff44-4a70-abe7-269e59cd8d5c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:45.556081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:45.564873 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0a77e63-824a-4c0e-b8ef-be55d23c3bdf tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.321764 Nov 06 21:16:45.575443 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3684/7259] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:45 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:45.602540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6c1ed4c7-ff44-4a70-abe7-269e59cd8d5c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:45.614557 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c1ed4c7-ff44-4a70-abe7-269e59cd8d5c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1266 microversion: 2.1 time: 0.140298 Nov 06 21:16:45.615227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3576/7260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:45 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:45.904728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:45.905745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:45.924639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.925232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:45.926030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:45.926476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:46.020939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f684441b-566d-425e-9bea-36d7800cb76f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.120735 Nov 06 21:16:46.021638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3685/7261] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:45 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:46.582681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:46.583382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:46.591374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:46.592180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:46.593337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:46.593995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:46.634663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:46.635374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:46.645478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:46.645965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:46.647000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:46.647644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:46.781506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:46.793349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0415a88-4bf9-41ff-9036-032fa35916ae tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1318 microversion: 2.1 time: 0.163310 Nov 06 21:16:46.794652 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3686/7262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:46 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:46.838142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:46.849065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83934741-c17e-463b-905a-502a71099808 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.270448 Nov 06 21:16:46.850506 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3577/7263] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:46 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:47.057345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:47.058439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:47.068688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.069455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.070658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.072095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.139977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e15987c-9397-46c8-8948-a15a6b93219c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.110096 Nov 06 21:16:47.140743 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3687/7264] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:47.811615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:47.812153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:47.822094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.823006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.823680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.824189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.867959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:47.869072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:47.878125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.878590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.879702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:47.880249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:47.920660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:47.930136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50773783-cde0-4223-b57f-55b6504735ca tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1324 microversion: 2.1 time: 0.122529 Nov 06 21:16:47.931123 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3578/7265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:47 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1324 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:48.051921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:48.061434 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20248d99-5d15-4132-8240-0df52980a83c tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.198356 Nov 06 21:16:48.062952 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3688/7266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:47 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:48.154480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:48.156062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:48.163965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:48.164487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:48.165827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:48.166150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:48.227975 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5eef7911-2a43-44f4-a57a-444428ea8f7a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.078714 Nov 06 21:16:48.233079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3579/7267] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:48.949754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:48.951842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:48.962051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:48.962909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:48.964148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:48.964797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:48.995783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3e1585ba-99f8-4d29-8568-30052951a09d req-85b9f962-fd21-4491-8dce-78d96ce3d140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f445f016-1639-4ccf-bbc9-64841874e40b", "name": "network-vif-plugged", "status": "completed", "tag": "4c1f79d0-950d-432b-a1d8-730ebf768793"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:48.997882 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:48.997882 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:16:49.011359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e1585ba-99f8-4d29-8568-30052951a09d req-85b9f962-fd21-4491-8dce-78d96ce3d140 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.011817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e1585ba-99f8-4d29-8568-30052951a09d req-85b9f962-fd21-4491-8dce-78d96ce3d140 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.044973 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3e1585ba-99f8-4d29-8568-30052951a09d req-85b9f962-fd21-4491-8dce-78d96ce3d140 service nova] Creating event network-vif-plugged:4c1f79d0-950d-432b-a1d8-730ebf768793 for instance f445f016-1639-4ccf-bbc9-64841874e40b on nch1-master-1 Nov 06 21:16:49.056873 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3e1585ba-99f8-4d29-8568-30052951a09d req-85b9f962-fd21-4491-8dce-78d96ce3d140 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063951 Nov 06 21:16:49.107568 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3580/7268] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:49.125273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:49.126582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:49.138178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.138811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.147308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.148825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.173358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:49.188656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72d0339d-9336-4706-b9b1-ca4111a8a898 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.244348 Nov 06 21:16:49.189525 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3689/7269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:48 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:49.241156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:49.242446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:49.250034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.250810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.251822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.252491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.314297 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a1154d6-bc49-488e-a550-8d3140b88172 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.076797 Nov 06 21:16:49.315520 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3690/7270] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:49.407688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:49.419676 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-05bd4073-fa40-4e40-aad7-8d19d8038c60 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.306020 Nov 06 21:16:49.420613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3581/7271] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:49 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:49.843028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e4b28956-a497-45e3-b7e9-2905b64c9da9 req-984fab85-0bff-41d0-82f2-e44c890798c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:49.844793 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:49.844793 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:49.852773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e4b28956-a497-45e3-b7e9-2905b64c9da9 req-984fab85-0bff-41d0-82f2-e44c890798c2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:49.853477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e4b28956-a497-45e3-b7e9-2905b64c9da9 req-984fab85-0bff-41d0-82f2-e44c890798c2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:49.873770 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e4b28956-a497-45e3-b7e9-2905b64c9da9 req-984fab85-0bff-41d0-82f2-e44c890798c2 service nova] Creating event network-changed:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:16:49.879445 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e4b28956-a497-45e3-b7e9-2905b64c9da9 req-984fab85-0bff-41d0-82f2-e44c890798c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040260 Nov 06 21:16:49.880624 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3691/7272] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:50.206410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:50.207153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:50.213918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.214454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.215292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.215737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.327747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:50.329429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:50.335798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.336539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.337573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.338023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.362256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:50.370008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24f834d9-0c8c-45e9-a301-928e2a90253f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.167459 Nov 06 21:16:50.370587 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3582/7273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:50 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:50.385509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f0c20b6-3da2-49a3-a698-4e4ef030cae5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062664 Nov 06 21:16:50.386519 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3692/7274] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:50 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:50.437136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:50.437789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:50.443602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.444063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.444890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:50.445334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:50.585146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:50.598904 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19e68da1-1245-4e1c-b6ee-f07e75e272aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1317 microversion: 2.1 time: 0.165403 Nov 06 21:16:50.599512 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3583/7275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:50 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:51.386626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:51.387942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:51.395545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.396033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.396862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.397309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.397880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:51.398804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:51.405604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.406066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.406853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.407293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.449298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8b0a0c0-c1f5-446c-a737-ea68b72d1057 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.054992 Nov 06 21:16:51.451072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3584/7276] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:51.535188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:51.542827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-daf5bdf4-daab-44b0-a4c6-2849f1d6d5d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.160289 Nov 06 21:16:51.543422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3693/7277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:51 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:51.617144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:51.617866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:51.625210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.625659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.626431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:51.626866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:51.757565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:51.765993 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43044837-e77a-45a0-9035-89645c2f8ed6 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1508 microversion: 2.1 time: 0.152912 Nov 06 21:16:51.766552 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3585/7278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:51 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:52.461996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:52.462930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:52.470130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:52.470600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:52.471402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:52.471859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:52.515378 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d409205a-6df7-4b26-9d46-b780284c3648 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057056 Nov 06 21:16:52.516012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3694/7279] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:52.559460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:52.560074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:52.566801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:52.567277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:52.568071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:52.568569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:52.698469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:52.706279 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ef7b4c6d-7837-4206-8f7b-c21442452fd1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.150457 Nov 06 21:16:52.706845 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3586/7280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:52 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:53.077203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:53.078347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:53.085327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.085790 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.086575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.087019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.313904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec29e70a-f019-43ef-bf44-22d430ca370b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241119 Nov 06 21:16:53.314506 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3695/7281] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:16:53 2021] POST /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:53.527252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:53.528194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:53.534766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.535226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.536031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.536514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.578721 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-442d7095-9355-4b45-ad06-419b68442870 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055127 Nov 06 21:16:53.579423 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3587/7282] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:53 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:53.724005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:53.724645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:53.732229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.732735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.733545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:53.733998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:53.875864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:53.884020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82db3803-ea8e-4522-832d-de1680d296d2 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.164187 Nov 06 21:16:53.884637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3696/7283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:53 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:54.591226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:54.592236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:54.599588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:54.600045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:54.600865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:54.601304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:54.643467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23cf95a6-e11e-40a6-9dd7-db1d8f25957c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056849 Nov 06 21:16:54.644099 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3588/7284] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:54.900857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:54.901508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:54.908209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:54.908724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:54.909518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:54.909966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:55.043669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:55.051097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-692be7ec-15f3-4332-a03f-9b5a955f5aaa tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.153898 Nov 06 21:16:55.051786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3697/7285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:54 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:55.656114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:55.657284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:55.665008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:55.665760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:55.666554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:55.666990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:55.711720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-293b1ef5-f8b7-48f4-b939-0cee06894096 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060068 Nov 06 21:16:55.712442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3589/7286] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:56.069428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:56.070076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:56.077279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.077745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.078538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.078987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.212384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:56.220529 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b22d96c9-235e-4355-b8b8-6afac9bb02f6 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.155329 Nov 06 21:16:56.221101 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3698/7287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:56 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:56.571682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:56.572880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:56.580479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.580944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.581735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.582182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.658895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Invalid volume: volume e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac is already attached to instances: f445f016-1639-4ccf-bbc9-64841874e40b Nov 06 21:16:56.659497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 400 to user: Invalid volume: volume e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac is already attached to instances: f445f016-1639-4ccf-bbc9-64841874e40b {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:16:56.660378 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0668335-a52b-46fb-ad7a-1b50a6875944 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093001 Nov 06 21:16:56.660915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3590/7288] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:16:56 2021] POST /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:16:56.717084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:56.717587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:56.723752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.723931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:56.724270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.724844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:56.725041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.725494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.732883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.733344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.734172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.734619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.775759 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-78c71528-1ecb-4979-b788-4d56b24cbe98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055446 Nov 06 21:16:56.780150 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3591/7289] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:16:56.803631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lazy-loading 'services' on Instance uuid f445f016-1639-4ccf-bbc9-64841874e40b {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:16:56.869645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3395863-5379-40b1-aa34-43c0a4ad73c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments/e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac" status: 202 len: 0 microversion: 2.1 time: 0.155960 Nov 06 21:16:56.870232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3699/7290] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:16:56 2021] DELETE /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments/e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:56.879830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:56.880862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:56.888148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.888611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.889415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:56.889856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:56.921598 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1db9d9a7-a348-4c6e-afe0-b9b59e46af9b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Nov 06 21:16:56.922155 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3592/7291] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:16:56 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:57.152481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1f7a20cf-4dfd-4fbd-95d1-ba56e7f459e1 req-110a7686-f75d-4d7d-9bde-b9f00f59e81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "name": "network-vif-plugged", "status": "completed", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:57.154521 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:16:57.154521 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:16:57.161804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1f7a20cf-4dfd-4fbd-95d1-ba56e7f459e1 req-110a7686-f75d-4d7d-9bde-b9f00f59e81c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.162271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1f7a20cf-4dfd-4fbd-95d1-ba56e7f459e1 req-110a7686-f75d-4d7d-9bde-b9f00f59e81c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.174200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1f7a20cf-4dfd-4fbd-95d1-ba56e7f459e1 req-110a7686-f75d-4d7d-9bde-b9f00f59e81c service nova] Creating event network-vif-plugged:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:16:57.179020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1f7a20cf-4dfd-4fbd-95d1-ba56e7f459e1 req-110a7686-f75d-4d7d-9bde-b9f00f59e81c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031370 Nov 06 21:16:57.179599 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3700/7292] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:16:57.237740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:57.238556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:57.245020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.245510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.246335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.246823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.380516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:57.387719 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-787f882c-fd85-4079-a82d-a376e5337535 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.154339 Nov 06 21:16:57.388266 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3593/7293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:57 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:57.788012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:57.789016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:57.795792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.796312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.797113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.797562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.839732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fda7a74d-f6b6-491d-bf00-f4a17b727bf2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055772 Nov 06 21:16:57.840411 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3701/7294] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:57.933372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:57.934818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:57.941468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.941922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.942698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:57.943133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:57.971834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-670f85bd-d206-4afb-a5bd-4b58fb3ef816 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042212 Nov 06 21:16:57.972386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3594/7295] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:16:57 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:16:58.066833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-997738398", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "002af318-7415-4004-9cdf-d72664bf5d96"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:58.116900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] validate_networks() for [('002af318-7415-4004-9cdf-d72664bf5d96', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:16:58.404284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:58.404928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:58.411208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.411661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.412497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.412938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.531465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:16:58.532002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:16:58.532538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:16:58.533024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:16:58.533773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:16:58.542892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.543943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.544879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.545401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.563286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:16:58.568704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Getting quotas for user 1644cf9a6ae142159bb3c6b69c47d827 and project 672009b3c8024ef891de3084390a04f1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:16:58.582078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:16:58.584583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:16:58.585230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:58.593466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73803d45-5bdc-4a62-8cac-5fe9d4ca1fba tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1392 microversion: 2.1 time: 0.192825 Nov 06 21:16:58.594366 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3595/7296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:58 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:58.632645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9dd91d8d-dfc5-47cc-a78d-58a7bf9963ae tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570866 Nov 06 21:16:58.638142 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3702/7297] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:16:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:16:58.645186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc009437-0d0c-4fcf-8b06-d5d56b881911 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:58.645790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc009437-0d0c-4fcf-8b06-d5d56b881911 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:58.699061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bc009437-0d0c-4fcf-8b06-d5d56b881911 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:58.706117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc009437-0d0c-4fcf-8b06-d5d56b881911 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1217 microversion: 2.1 time: 0.064543 Nov 06 21:16:58.706687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3596/7298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:58 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:58.852499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:58.854076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:58.861888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.862658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.864703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:58.865338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:58.910047 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04657009-b582-4e45-bf17-d2ba6893ec30 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062009 Nov 06 21:16:58.910933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3703/7299] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:58 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:16:59.610755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:59.611393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:59.618453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.618811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.619597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.620372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.723704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:59.724444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:59.731844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.732403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.733259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.733818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.819576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:59.827678 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8807a023-0602-43d6-9dd2-e61e8f944bb1 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1275 microversion: 2.1 time: 0.108122 Nov 06 21:16:59.828256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3704/7300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:59 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:16:59.863356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:16:59.871516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bcb581c6-ff82-405d-84ce-9ac0c2d66eb7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1564 microversion: 2.1 time: 0.264559 Nov 06 21:16:59.872923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3597/7301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:59 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:16:59.888106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:16:59.889104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:59.899796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.900634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.901378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.901959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.922056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:16:59.923099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:16:59.931244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.934963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.935863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:16:59.940839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:16:59.985193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2817b54b-052e-48af-a6a7-3665456e9e72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066673 Nov 06 21:16:59.985982 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3598/7302] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:16:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:00.116695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:00.124689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65ae9b8a-95e2-41f6-afc6-a37eb6597647 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1564 microversion: 2.1 time: 0.240782 Nov 06 21:17:00.125270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3705/7303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:16:59 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:17:00.846190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:00.846899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:00.855225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:00.856976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:00.857144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:00.857702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:00.997612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:00.999191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:01.006162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:01.006629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:01.007639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:01.008278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:01.051904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e03e9907-d8d5-4600-b453-9993b75fb500 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058046 Nov 06 21:17:01.052598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3706/7304] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:00 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:01.076017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:01.087543 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8fc49f6-7c72-4c43-9530-59c63d51932b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.245396 Nov 06 21:17:01.088242 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3599/7305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:00 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:01.156015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a34b1d81-a7f8-49f0-b430-cd962cdbb9ce req-a7601f1d-14c8-4225-874e-745a551e7e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927fcd55-d52f-46b8-b03f-96b765418eee", "tag": "952a328d-09a8-46b0-8c0c-416afb3fbc80"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:01.158029 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:01.158029 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:01.166421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a34b1d81-a7f8-49f0-b430-cd962cdbb9ce req-a7601f1d-14c8-4225-874e-745a551e7e12 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:01.166875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a34b1d81-a7f8-49f0-b430-cd962cdbb9ce req-a7601f1d-14c8-4225-874e-745a551e7e12 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:01.180103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a34b1d81-a7f8-49f0-b430-cd962cdbb9ce req-a7601f1d-14c8-4225-874e-745a551e7e12 service nova] Creating event network-changed:952a328d-09a8-46b0-8c0c-416afb3fbc80 for instance 927fcd55-d52f-46b8-b03f-96b765418eee on nch1-master-1 Nov 06 21:17:01.187339 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a34b1d81-a7f8-49f0-b430-cd962cdbb9ce req-a7601f1d-14c8-4225-874e-745a551e7e12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036091 Nov 06 21:17:01.187945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3707/7306] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:02.064441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:02.065252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:02.073023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.073629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.075659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.076198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.106866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:02.107696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:02.121195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.121372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.122358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.124368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.174561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c47d512f-3ad1-4e85-a8e1-f2f4bb540a7c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.114260 Nov 06 21:17:02.175629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3600/7307] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:02 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:02.180892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:02.181808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:02.188814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.189273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.190057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.190516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.325991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:02.335953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b18c30a-bc33-4352-8147-76b8d772c29b tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.234539 Nov 06 21:17:02.337145 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3708/7308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:02 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:02.342395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-904df254-ba7c-4b6a-86d7-4694856b676f req-2ac66f70-2ef0-46f9-90fb-bf6233197130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:02.343883 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:02.343883 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:02.353413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-904df254-ba7c-4b6a-86d7-4694856b676f req-2ac66f70-2ef0-46f9-90fb-bf6233197130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:02.353996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-904df254-ba7c-4b6a-86d7-4694856b676f req-2ac66f70-2ef0-46f9-90fb-bf6233197130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:02.367034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-904df254-ba7c-4b6a-86d7-4694856b676f req-2ac66f70-2ef0-46f9-90fb-bf6233197130 service nova] Creating event network-changed:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:17:02.373767 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-904df254-ba7c-4b6a-86d7-4694856b676f req-2ac66f70-2ef0-46f9-90fb-bf6233197130 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034817 Nov 06 21:17:02.374470 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3709/7309] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:02.399725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:02.408406 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23fed61d-c85f-43f3-ab89-e50f69f9d878 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1564 microversion: 2.1 time: 0.230945 Nov 06 21:17:02.409119 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3601/7310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:02 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1564 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:03.187295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:03.188280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:03.195244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:03.195709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:03.196535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:03.196991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:03.239810 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-750d824b-aa55-439f-9375-436f6943166f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057123 Nov 06 21:17:03.244119 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3710/7311] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:03.352835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:03.353518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:03.360235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:03.360731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:03.361520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:03.361965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:03.494599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:03.502618 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bbae34db-d6d6-4733-8715-4bdcecc731a2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.153462 Nov 06 21:17:03.503182 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3602/7312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:03 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:04.251451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:04.252498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:04.259685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:04.260144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:04.260954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:04.261398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:04.307627 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09ec4a4c-a0e1-405d-bbee-bed3f91a473c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060018 Nov 06 21:17:04.308310 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3711/7313] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:04.518904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:04.519465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:04.526359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:04.526816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:04.528311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:04.528761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:04.660626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:04.668354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7994eab2-154c-4fd0-8fa7-851a69d17781 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.153291 Nov 06 21:17:04.668923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3603/7314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:04 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:05.319384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:05.320425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:05.327683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:05.328145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:05.328980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:05.329427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:05.370823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fee9bd3-a83d-40bd-a418-8dbfb8a6ca66 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055362 Nov 06 21:17:05.371528 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3712/7315] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:05.684268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:05.684914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:05.691661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:05.692119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:05.692949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:05.693402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:05.825847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:05.833235 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-209f29cb-34f0-4106-bced-2f6ab95b63c2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.152702 Nov 06 21:17:05.833808 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3604/7316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:05 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:17:06.382460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:06.383490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:06.391461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:06.391917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:06.392727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:06.393170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:06.434468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ff737a46-a6f4-4d3a-a606-e9974596f2fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055512 Nov 06 21:17:06.435362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3713/7317] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:06.850781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:06.851427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:06.858847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:06.859492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:06.860095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:06.860578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:06.991079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:06.998832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60888a46-dfd0-46de-812c-3660fd5265aa tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.151736 Nov 06 21:17:06.999400 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3605/7318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:06 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:07.026437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2140110f-4efe-473d-9a84-bb52e30c84fc req-681b43a3-9206-420c-8d6d-ba28262df5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927fcd55-d52f-46b8-b03f-96b765418eee", "name": "network-vif-plugged", "status": "completed", "tag": "952a328d-09a8-46b0-8c0c-416afb3fbc80"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:07.028462 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:07.028462 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:07.036393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2140110f-4efe-473d-9a84-bb52e30c84fc req-681b43a3-9206-420c-8d6d-ba28262df5b1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:07.036835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2140110f-4efe-473d-9a84-bb52e30c84fc req-681b43a3-9206-420c-8d6d-ba28262df5b1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:07.048955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2140110f-4efe-473d-9a84-bb52e30c84fc req-681b43a3-9206-420c-8d6d-ba28262df5b1 service nova] Creating event network-vif-plugged:952a328d-09a8-46b0-8c0c-416afb3fbc80 for instance 927fcd55-d52f-46b8-b03f-96b765418eee on nch1-master-1 Nov 06 21:17:07.053645 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2140110f-4efe-473d-9a84-bb52e30c84fc req-681b43a3-9206-420c-8d6d-ba28262df5b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Nov 06 21:17:07.054255 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3714/7319] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:07.446042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:07.446925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:07.453499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:07.453962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:07.454754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:07.455197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:07.506981 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27e13030-d255-4ccc-ab7d-71f8ac65445f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064610 Nov 06 21:17:07.507609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3606/7320] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:08.016155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:08.016898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:08.023104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:08.023574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:08.024401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:08.024854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:08.155551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:08.162758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-150dd8c4-1a17-462e-89b3-ff8af380b243 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1317 microversion: 2.1 time: 0.151556 Nov 06 21:17:08.163317 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3715/7321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:08 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:08.519655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:08.520610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:08.527986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:08.528482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:08.529263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:08.529702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:08.571692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54c0f007-01d0-4950-ae5c-01d0b1fee6e0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056299 Nov 06 21:17:08.572334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3607/7322] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:08 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:09.180280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:09.180843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:09.188197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:09.188701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:09.189496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:09.189940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:09.320987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:09.328915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63d5248d-8e8a-4d84-b407-1747e73db17e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1507 microversion: 2.1 time: 0.152397 Nov 06 21:17:09.329485 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3716/7323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:09 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:09.583509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:09.584510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:09.592369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:09.592839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:09.593671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:09.594098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:09.638624 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3cef1fe9-d7e9-42f4-89a8-6ac6a6152e94 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059054 Nov 06 21:17:09.639378 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3608/7324] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:10.628463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6213b51-c08e-456c-ba51-bab6ebeaa6ea"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:10.629527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:10.637274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:10.637741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:10.638528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:10.638974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:10.651140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:10.652359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:10.659496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:10.659952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:10.660776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:10.661222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:10.703814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5a3bd21-570c-4153-85ff-c28c40e3c04c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056659 Nov 06 21:17:10.704510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3609/7325] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:10.863382 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e64dcf06-f343-4bff-8b04-81bf9f912f23 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "POST /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238466 Nov 06 21:17:10.864195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3717/7326] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:17:10 2021] POST /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:11.716593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:11.717624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:11.726051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:11.726823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:11.727619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:11.728058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:11.777884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e357f2d6-673a-439e-9f3f-d6d54a699372 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065705 Nov 06 21:17:11.778546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3610/7327] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:12.791396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:12.792477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:12.799144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:12.799640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:12.800468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:12.800918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:12.844760 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5baf6341-f6b9-4480-ac9b-6d329bc48b0d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058510 Nov 06 21:17:12.845391 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3718/7328] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:12 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:13.856421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:13.857434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:13.864837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:13.865298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:13.866161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:13.866620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:13.917103 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d06b4ed1-17d8-4148-8c0d-843ba9471f79 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064722 Nov 06 21:17:13.917737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3611/7329] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:13 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:14.208781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:14.209369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:14.216592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.217078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.217861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.218307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.295641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lazy-loading 'services' on Instance uuid 927fcd55-d52f-46b8-b03f-96b765418eee {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:17:14.364991 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24f6feb3-88c6-4706-b20c-00eae1920342 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments/d6213b51-c08e-456c-ba51-bab6ebeaa6ea" status: 202 len: 0 microversion: 2.1 time: 0.160088 Nov 06 21:17:14.365639 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3719/7330] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:17:14 2021] DELETE /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments/d6213b51-c08e-456c-ba51-bab6ebeaa6ea => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:14.374466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:14.375424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:14.382165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.382635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.383530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.383985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.414390 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a64c19f-0e69-4b9c-b0dd-5c7468e7e017 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Nov 06 21:17:14.415284 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3612/7331] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:17:14 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:14.930147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:14.931161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:14.937479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.937947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.938739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:14.939197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:14.982517 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7ed3c906-218f-4736-9b5b-eaaaddb6ec1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056824 Nov 06 21:17:14.983170 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3720/7332] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:15.426438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:15.427267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:15.434606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:15.435059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:15.435829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:15.436268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:15.464679 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d86f4c49-956c-4fb2-be9f-ac177c3e8bd9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042199 Nov 06 21:17:15.465227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3613/7333] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:17:15 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:17:15.994970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:15.995998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:16.003383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.003857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.004705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.005165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.048365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9dffc1f-fe1f-48b6-a8a1-490917ff474c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057346 Nov 06 21:17:16.048999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3721/7334] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:16.639036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:16.639527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:16.646223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.646692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.647480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.647922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.672421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:17:16.746136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d7fe312-5ecf-4c96-a83d-9a9f2b7a9738 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 204 len: 0 microversion: 2.1 time: 0.110985 Nov 06 21:17:16.747424 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3614/7335] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:16 2021] DELETE /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:17:16.755992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:16.756746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:16.764384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.764864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.765668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:16.766121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:16.902186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:16.909951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ddfe6848-5503-4dc5-bdd9-45c536fddc99 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1513 microversion: 2.1 time: 0.158128 Nov 06 21:17:16.910527 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3722/7336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:16 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:17.061032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:17.062049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:17.069072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:17.069532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:17.070319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:17.070759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:17.115429 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d283b7f-71ad-409f-b4df-c1eae5f8f64d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059041 Nov 06 21:17:17.116079 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3615/7337] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:17.927880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:17.928591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:17.935382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:17.935852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:17.936716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:17.937905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:18.069785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:18.077822 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-70f00c14-6010-448c-b645-20f1757e3a63 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1513 microversion: 2.1 time: 0.153701 Nov 06 21:17:18.078391 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3723/7338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:17 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:18.128690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:18.129698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:18.137748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:18.138152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:18.138935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:18.139373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:18.187840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a414348a-c445-40be-8892-7fdb2a78a66e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063147 Nov 06 21:17:18.188515 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3616/7339] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:19.021086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a1cecabb-b46f-4734-a15c-a6e9c6c966f1 req-989a785f-59e6-47ab-a049-2a9de267599e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927fcd55-d52f-46b8-b03f-96b765418eee", "name": "network-vif-deleted", "tag": "952a328d-09a8-46b0-8c0c-416afb3fbc80"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:19.023005 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:19.023005 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:17:19.032625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a1cecabb-b46f-4734-a15c-a6e9c6c966f1 req-989a785f-59e6-47ab-a049-2a9de267599e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.033475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a1cecabb-b46f-4734-a15c-a6e9c6c966f1 req-989a785f-59e6-47ab-a049-2a9de267599e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.034123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:19.034710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:19.044181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.044765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.045591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.046399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.051215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a1cecabb-b46f-4734-a15c-a6e9c6c966f1 req-989a785f-59e6-47ab-a049-2a9de267599e service nova] Creating event network-vif-deleted:952a328d-09a8-46b0-8c0c-416afb3fbc80 for instance 927fcd55-d52f-46b8-b03f-96b765418eee on nch1-master-1 Nov 06 21:17:19.061029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a1cecabb-b46f-4734-a15c-a6e9c6c966f1 req-989a785f-59e6-47ab-a049-2a9de267599e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043830 Nov 06 21:17:19.062135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3617/7340] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:17:19.096042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:19.096677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:19.097803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:17:19.123737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.126431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.127299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.127751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.205740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:19.217791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-389e6515-d945-4fed-820e-b76410de8e3d tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 200 len: 1302 microversion: 2.1 time: 0.125657 Nov 06 21:17:19.218662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3618/7341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:19 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:19.223930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:19.225263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:19.232628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.233531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.235082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.235841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.238854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9cfc6aa4-c185-4b56-aaf4-573465fb33a4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 204 len: 0 microversion: 2.1 time: 0.403718 Nov 06 21:17:19.240070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3724/7342] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:18 2021] DELETE /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:17:19.249272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:19.250159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:19.257485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.257956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.258761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:19.259208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:19.285655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dcacf50d-f574-4f08-b2e9-3c07e4abb1ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065346 Nov 06 21:17:19.286697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3619/7343] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:19 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:19.412323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:19.420586 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41683f51-e98e-4ecc-b210-719e8e0da4fe tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1731 microversion: 2.1 time: 0.175446 Nov 06 21:17:19.421160 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3725/7344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:19 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:17:20.236024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:20.236778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 927fcd55-d52f-46b8-b03f-96b765418eee] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:20.244206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.244695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.245477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.245913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.261894 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Instance 927fcd55-d52f-46b8-b03f-96b765418eee could not be found. Nov 06 21:17:20.262502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 404 to user: Instance 927fcd55-d52f-46b8-b03f-96b765418eee could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:20.263515 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0cf48d3-d0ec-4638-a848-e0f3028daa82 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee" status: 404 len: 111 microversion: 2.1 time: 0.031479 Nov 06 21:17:20.263920 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3620/7345] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:20 2021] GET /compute/v2.1/servers/927fcd55-d52f-46b8-b03f-96b765418eee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:17:20.298481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:20.299484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:20.306203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.306673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.307492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.307955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.359741 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5b0ab13-5e88-41a9-b25c-39fda41f940c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064673 Nov 06 21:17:20.362643 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3726/7346] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:20.439050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:20.439677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:20.446461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.447494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.448811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:20.449622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:20.554908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbaa05ffa1428e91caa26d9b1ebe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7bb72df2e54f4aa72356d80aae9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:20.568943 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1523acc9-acf8-47d5-89b9-5f4beb056b33 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 200 len: 1663 microversion: 2.1 time: 0.133795 Nov 06 21:17:20.569655 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3621/7347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:20 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 1663 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:21.081798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-83e77bda-3628-4a01-a0bc-28dddfa020ca req-f1cc7963-28d0-4ab4-a834-224acdc223f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed037684-51f8-4762-9f7e-04784883f269", "name": "network-vif-deleted", "tag": "8a928c32-e301-4df3-9dd3-df2f9da3fdc0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:21.083408 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:21.083408 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:21.092323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-83e77bda-3628-4a01-a0bc-28dddfa020ca req-f1cc7963-28d0-4ab4-a834-224acdc223f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.092801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-83e77bda-3628-4a01-a0bc-28dddfa020ca req-f1cc7963-28d0-4ab4-a834-224acdc223f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.103911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-83e77bda-3628-4a01-a0bc-28dddfa020ca req-f1cc7963-28d0-4ab4-a834-224acdc223f5 service nova] Creating event network-vif-deleted:8a928c32-e301-4df3-9dd3-df2f9da3fdc0 for instance ed037684-51f8-4762-9f7e-04784883f269 on nch1-master-1 Nov 06 21:17:21.108777 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-83e77bda-3628-4a01-a0bc-28dddfa020ca req-f1cc7963-28d0-4ab4-a834-224acdc223f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031061 Nov 06 21:17:21.109628 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3727/7348] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:21.372780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:21.373828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:21.380761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.381241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.382061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.382495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.413583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:21.414210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:21.422552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.423153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.424035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.424518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.427523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22d965e4-913e-4145-b840-138fdc3e6e92 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058959 Nov 06 21:17:21.428183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3622/7349] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:21.450963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:17:21.526751 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99324bfc-f36a-40b4-8e79-fcca114a939e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 204 len: 0 microversion: 2.1 time: 0.116967 Nov 06 21:17:21.527379 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3728/7350] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:21 2021] DELETE /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:17:21.536592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:21.537294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:21.544902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.545355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.546133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.546573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.587116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:21.587823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:21.594178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.594637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.595441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:21.595888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:21.609959 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] HTTP exception thrown: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. Nov 06 21:17:21.610517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Returning 404 to user: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:21.611358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-06e670a0-282e-4a70-899c-3f7193ffa395 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 404 len: 111 microversion: 2.1 time: 0.028255 Nov 06 21:17:21.612760 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3729/7351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:21 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:17:21.703530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:21.711365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62fba142-9ae2-41f8-96f3-0b99a3b1757f tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1514 microversion: 2.1 time: 0.178888 Nov 06 21:17:21.711946 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3623/7352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:21 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:22.115715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:22.116218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:22.122579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.123033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.123814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.124253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.137012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] HTTP exception thrown: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. Nov 06 21:17:22.137597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Returning 404 to user: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:22.138407 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07374af7-29a8-4d87-bdcd-e74b79538ead tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 404 len: 111 microversion: 2.1 time: 0.026619 Nov 06 21:17:22.138918 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3730/7353] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:22 2021] DELETE /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:17:22.146680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:22.147302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] [instance: ed037684-51f8-4762-9f7e-04784883f269] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:22.154282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.154747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.155542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.155986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.169938 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] HTTP exception thrown: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. Nov 06 21:17:22.170537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Returning 404 to user: Instance ed037684-51f8-4762-9f7e-04784883f269 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:22.171366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab1d10f5-bbac-45b4-8aaf-1d055edad4f4 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269" status: 404 len: 111 microversion: 2.1 time: 0.028378 Nov 06 21:17:22.171895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3624/7354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:22 2021] GET /compute/v2.1/servers/ed037684-51f8-4762-9f7e-04784883f269 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:17:22.328365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccb0fbda-16aa-496a-b739-e8f1fc822ba5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] Calling method '.version_select at 0x7f67147cf790>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:22.350641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccb0fbda-16aa-496a-b739-e8f1fc822ba5 tempest-TestServerBasicOps-2010902782 tempest-TestServerBasicOps-2010902782-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-271288739" status: 202 len: 0 microversion: 2.1 time: 0.026396 Nov 06 21:17:22.350949 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3731/7355] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Nov 6 21:17:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-271288739 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:22.438902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:22.440245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:22.446932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.447391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.448185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.448649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.496493 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdd15675-1b85-4d46-95f2-8ca75184b672 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061098 Nov 06 21:17:22.500778 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3625/7356] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:22.729395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:22.730142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:22.739477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.740381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.740803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:22.741262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:22.871674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:22.880164 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80f2ac26-d49c-4142-9102-f878b5ac1008 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1514 microversion: 2.1 time: 0.154721 Nov 06 21:17:22.880507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3732/7357] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:22 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:23.510490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:23.513361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:23.525311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:23.525798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:23.526643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:23.527717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:23.587834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18c5ecc5-4aa4-4c93-a550-9b7a97d7a964 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.082563 Nov 06 21:17:23.589355 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3626/7358] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:23 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:23.897425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:23.898110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:23.906157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:23.906620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:23.907425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:23.907869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:24.124492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:24.133398 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ab662ee-9a7a-4e3a-a78a-59ac37d712e5 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 200 len: 1514 microversion: 2.1 time: 0.239700 Nov 06 21:17:24.134934 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3733/7359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:23 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:24.331588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-32954546-3f32-4455-bc7e-647989bbfcba req-33d8126a-41ff-4530-988c-710d55984740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f445f016-1639-4ccf-bbc9-64841874e40b", "name": "network-vif-deleted", "tag": "4c1f79d0-950d-432b-a1d8-730ebf768793"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:24.341335 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:24.341335 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:17:24.358799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-32954546-3f32-4455-bc7e-647989bbfcba req-33d8126a-41ff-4530-988c-710d55984740 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:24.360408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-32954546-3f32-4455-bc7e-647989bbfcba req-33d8126a-41ff-4530-988c-710d55984740 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:24.374135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-32954546-3f32-4455-bc7e-647989bbfcba req-33d8126a-41ff-4530-988c-710d55984740 service nova] Creating event network-vif-deleted:4c1f79d0-950d-432b-a1d8-730ebf768793 for instance f445f016-1639-4ccf-bbc9-64841874e40b on nch1-master-1 Nov 06 21:17:24.380355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-32954546-3f32-4455-bc7e-647989bbfcba req-33d8126a-41ff-4530-988c-710d55984740 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056956 Nov 06 21:17:24.385442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3627/7360] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:17:24.599939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:24.600896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:24.607376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:24.607837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:24.608873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:24.609524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:24.655924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fd61527-9264-4c8a-975e-48bf2a986729 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059526 Nov 06 21:17:24.656985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3734/7361] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:25.155578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:25.156062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: f445f016-1639-4ccf-bbc9-64841874e40b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:25.163342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.163342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.164103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.164241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.178848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Instance f445f016-1639-4ccf-bbc9-64841874e40b could not be found. Nov 06 21:17:25.179459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 404 to user: Instance f445f016-1639-4ccf-bbc9-64841874e40b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:25.180342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c70068e5-1ffb-4b35-95c2-8083a79c7707 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b" status: 404 len: 111 microversion: 2.1 time: 0.031664 Nov 06 21:17:25.183740 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3628/7362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:25 2021] GET /compute/v2.1/servers/f445f016-1639-4ccf-bbc9-64841874e40b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:17:25.189405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:25.190012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:25.198086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.198783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.200365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.200916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.233404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:17:25.330551 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35a17c0c-cd69-470f-a91e-4acb07a181f8 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 204 len: 0 microversion: 2.1 time: 0.144814 Nov 06 21:17:25.331496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3735/7363] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:25 2021] DELETE /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:17:25.339557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:25.340929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:25.347288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.347688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.348512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.349102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.531015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:25.539476 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5cd7de3f-870c-4c55-a616-948968443fa3 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1515 microversion: 2.1 time: 0.203724 Nov 06 21:17:25.540719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3629/7364] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:25 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:25.673578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:25.674041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:25.680603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.681067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.681872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:25.682318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:25.733383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56c3b518-d41b-4c64-a0f4-df0539107a4b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.068360 Nov 06 21:17:25.734759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3736/7365] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:25 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:26.557090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:26.557668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:26.564207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:26.564689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:26.565475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:26.565912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:26.703842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:26.713567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1742fde-4258-47a6-8992-3507fa730b15 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1515 microversion: 2.1 time: 0.160170 Nov 06 21:17:26.714167 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3630/7366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:26 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:26.745672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:26.746788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:26.754519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:26.754994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:26.755797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:26.756326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:26.797860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fd1858d-440e-4d6c-a0ac-ae71ca5c3ea0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056253 Nov 06 21:17:26.798743 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3737/7367] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:26 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:27.731386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:27.732032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:27.738756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:27.739216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:27.740004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:27.740473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:27.810800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:27.813139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:27.824664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:27.824664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:27.825577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:27.826397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:27.877372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42e47897-aaf6-47b0-abcf-c27b52a1c4fe tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.070319 Nov 06 21:17:27.878667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3738/7368] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:27 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:27.885748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:27.893309 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9137bef4-e1e6-4431-a532-3530a807f8c9 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 200 len: 1515 microversion: 2.1 time: 0.166313 Nov 06 21:17:27.894011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3631/7369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:27 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:28.078588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2fa6cf62-b22b-4098-9cc9-f67d99fcc0d3 req-b6421c40-e1ed-4c43-a5e2-f74ad39dab64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451e0e47-f3f4-4c68-a06c-d76669d1a37f", "name": "network-vif-deleted", "tag": "edb0c6c0-2020-46ee-8c6c-6b2c645b65a5"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:28.080078 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:28.080078 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:28.088682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2fa6cf62-b22b-4098-9cc9-f67d99fcc0d3 req-b6421c40-e1ed-4c43-a5e2-f74ad39dab64 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:28.089144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2fa6cf62-b22b-4098-9cc9-f67d99fcc0d3 req-b6421c40-e1ed-4c43-a5e2-f74ad39dab64 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:28.103174 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2fa6cf62-b22b-4098-9cc9-f67d99fcc0d3 req-b6421c40-e1ed-4c43-a5e2-f74ad39dab64 service nova] Creating event network-vif-deleted:edb0c6c0-2020-46ee-8c6c-6b2c645b65a5 for instance 451e0e47-f3f4-4c68-a06c-d76669d1a37f on nch2-master-1 Nov 06 21:17:28.110346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2fa6cf62-b22b-4098-9cc9-f67d99fcc0d3 req-b6421c40-e1ed-4c43-a5e2-f74ad39dab64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036016 Nov 06 21:17:28.115326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3739/7370] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:28.891095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:28.892143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:28.898816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:28.899273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:28.900087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:28.900554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:28.912211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:28.913237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: 451e0e47-f3f4-4c68-a06c-d76669d1a37f] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:28.920978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:28.921560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:28.922465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:28.923117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:28.938254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Instance 451e0e47-f3f4-4c68-a06c-d76669d1a37f could not be found. Nov 06 21:17:28.938950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 404 to user: Instance 451e0e47-f3f4-4c68-a06c-d76669d1a37f could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:28.939860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48091c04-4330-4acd-b0e8-d0720bd631a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f" status: 404 len: 111 microversion: 2.1 time: 0.032772 Nov 06 21:17:28.940518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3740/7371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:28 2021] GET /compute/v2.1/servers/451e0e47-f3f4-4c68-a06c-d76669d1a37f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:17:28.947193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2b07aeb-3878-4472-8152-8f71a1aba7e1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060311 Nov 06 21:17:28.948779 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3632/7372] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:28 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:29.960721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:29.961831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:29.969160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:29.969857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:29.970833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:29.971677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:30.017464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80110ad3-62ba-4bc3-ac2e-71cf37cf5c53 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060190 Nov 06 21:17:30.018156 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3741/7373] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:30.072448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:30.073051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:30.082190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:30.082973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:30.084090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:30.084559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:30.111634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:17:30.199707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2102a94c-5417-439d-904b-ac7c7050c5a7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 204 len: 0 microversion: 2.1 time: 0.131033 Nov 06 21:17:30.200350 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3633/7374] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:17:30 2021] DELETE /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:17:30.208879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:30.209720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:30.216610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:30.217111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:30.218012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:30.218380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:30.444496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:30.452082 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c832472-bb38-4ec7-afec-5a49562d9f4e tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1514 microversion: 2.1 time: 0.247399 Nov 06 21:17:30.452680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3742/7375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:30 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:31.031241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:31.032273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:31.039016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:31.039471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:31.040571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:31.041016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:31.088404 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf03e99e-43c1-45ff-963f-0403ecd95469 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061482 Nov 06 21:17:31.089109 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3634/7376] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:31 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:31.469719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:31.470274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:31.477760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:31.478227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:31.479028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:31.479479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:31.610758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:31.618126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6594f5b-d7b0-4d5d-a774-babff80dd7e2 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1514 microversion: 2.1 time: 0.152863 Nov 06 21:17:31.618691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3743/7377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:31 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:32.102321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:32.103506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:32.111455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.111943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.112782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.113245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.158514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca34f8be-0dad-4b99-8a53-0cb34f958a62 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060435 Nov 06 21:17:32.162689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3635/7378] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:32.519489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-df2acd97-3327-4431-b51f-de5e7b488e77 req-6542581a-339f-4ab4-9188-82243eae7200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd73eaa9-7dc4-4c01-90be-3af6d045291d", "name": "network-vif-deleted", "tag": "f4f4ac47-b622-493a-ba70-73c70c72d6e1"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:32.521741 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:17:32.521741 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:17:32.530318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df2acd97-3327-4431-b51f-de5e7b488e77 req-6542581a-339f-4ab4-9188-82243eae7200 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.530793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-df2acd97-3327-4431-b51f-de5e7b488e77 req-6542581a-339f-4ab4-9188-82243eae7200 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.544027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-df2acd97-3327-4431-b51f-de5e7b488e77 req-6542581a-339f-4ab4-9188-82243eae7200 service nova] Creating event network-vif-deleted:f4f4ac47-b622-493a-ba70-73c70c72d6e1 for instance cd73eaa9-7dc4-4c01-90be-3af6d045291d on nch1-master-1 Nov 06 21:17:32.548809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-df2acd97-3327-4431-b51f-de5e7b488e77 req-6542581a-339f-4ab4-9188-82243eae7200 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Nov 06 21:17:32.549389 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3744/7379] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:17:32.637242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:32.638050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:32.644947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.645403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.646183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.646621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.679741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:32.680164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:32.680584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lazy-loading 'fault' on Instance uuid cd73eaa9-7dc4-4c01-90be-3af6d045291d {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:17:32.720627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1644cf9a6ae142159bb3c6b69c47d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672009b3c8024ef891de3084390a04f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:17:32.727977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27486dc2-c972-4708-b290-3288550e0dd7 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 200 len: 1308 microversion: 2.1 time: 0.095360 Nov 06 21:17:32.728576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3636/7380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:32 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:17:33.171714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:33.172770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:33.178852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:33.179315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:33.180096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:33.180575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:33.227277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc41ee1e-699d-413b-892b-1071ce9da3bc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059962 Nov 06 21:17:33.228182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3745/7381] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:33 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:33.744645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:17:33.745237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] [instance: cd73eaa9-7dc4-4c01-90be-3af6d045291d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:33.752580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:33.753035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:33.753846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:33.754284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:33.767145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] HTTP exception thrown: Instance cd73eaa9-7dc4-4c01-90be-3af6d045291d could not be found. Nov 06 21:17:33.767726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] Returning 404 to user: Instance cd73eaa9-7dc4-4c01-90be-3af6d045291d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:17:33.768559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-65ac8437-3cc1-4c65-9e8e-58c44b68bf54 tempest-AttachVolumeNegativeTest-995217399 tempest-AttachVolumeNegativeTest-995217399-project] 10.222.0.13 "GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d" status: 404 len: 111 microversion: 2.1 time: 0.027706 Nov 06 21:17:33.769074 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3637/7382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:17:33 2021] GET /compute/v2.1/servers/cd73eaa9-7dc4-4c01-90be-3af6d045291d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:17:34.239808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:34.240943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:34.249000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:34.249616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:34.250632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:34.251078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:34.297122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-410fb5a1-3214-44e1-9418-e3610d36b13b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061529 Nov 06 21:17:34.298052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3746/7383] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:35.308885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:35.309816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:35.316612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:35.317067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:35.317845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:35.318278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:35.364473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-02dfc010-1686-4e32-ac7d-648cb9c71d36 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059019 Nov 06 21:17:35.368627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3638/7384] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:35 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:35.708747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:35.709760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:35.717927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:35.718393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:35.719193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:35.719639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:35.769815 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a55a31b4-5a21-4217-b7d0-2349190f1d26 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action" status: 200 len: 24572 microversion: 2.1 time: 0.064986 Nov 06 21:17:35.770659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3747/7385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:17:35 2021] POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action => generated 24572 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:17:36.377558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:36.378679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:36.386858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:36.387308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:36.388120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:36.388577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:36.436783 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b119e2c4-cee2-405b-986a-2c593c2ac024 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063029 Nov 06 21:17:36.437358 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3639/7386] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:37.449330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:37.450478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:37.457748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:37.458215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:37.459022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:37.459479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:37.501181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-98f2a1b1-fbed-4d29-bf4c-8cae6fb0dc64 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056404 Nov 06 21:17:37.505430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3748/7387] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:38.513683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:38.514700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:38.521570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:38.522026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:38.522810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:38.523250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:38.566971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9cafb347-2274-4490-9bc9-cb32927e8b74 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057349 Nov 06 21:17:38.567619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3640/7388] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:39.579886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:39.580918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:39.588082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:39.588579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:39.589382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:39.589831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:39.635114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3734a875-7262-4e12-b219-fcd253fdd4b8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059119 Nov 06 21:17:39.639844 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3749/7389] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:40.648106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:40.649142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:40.657556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:40.658235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:40.659269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:40.659904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:40.704417 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-189895fe-c0c0-4b09-b915-648bdc87434b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060155 Nov 06 21:17:40.705152 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3641/7390] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:40 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:41.718162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:41.719352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:41.728508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:41.728984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:41.729791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:41.730347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:41.785155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9695430-9433-4daf-957f-84d0ad98bae0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.071922 Nov 06 21:17:41.785908 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3750/7391] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:42.797897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:42.798927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:42.806456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:42.806920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:42.807720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:42.808159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:42.850956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5c8824b-f3e0-4ce9-be7f-d05c62cde639 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057702 Nov 06 21:17:42.856162 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3642/7392] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:43.864379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:43.865413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:43.878120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:43.878621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:43.879741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:43.879970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:43.927647 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-af7e68de-3df7-48b0-98de-6aea5f9aa918 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067235 Nov 06 21:17:43.928556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3751/7393] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:44.940262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:44.941240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:44.949222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:44.949828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:44.950736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:44.951422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:44.997825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-46d277ac-9d16-42b5-a196-9d5e7fd4fa72 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061595 Nov 06 21:17:44.998838 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3643/7394] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:46.010118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:46.013569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:46.019104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:46.019574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:46.020406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:46.021106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:46.065861 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07bc014f-488d-4e5a-a95a-38556661fbe4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059734 Nov 06 21:17:46.070366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3752/7395] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:46 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:47.079259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:47.080349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:47.087524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:47.087988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:47.088804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:47.089244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:47.140278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3874ff8-84f7-45a7-a680-0c178ca42830 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065114 Nov 06 21:17:47.141818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3644/7396] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:48.153320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:48.154349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:48.162113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:48.162942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:48.163844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:48.164429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:48.208730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-923b9e99-3da2-4d22-a726-a36f8e22be6a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059386 Nov 06 21:17:48.209396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3753/7397] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:49.221072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:49.222127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:49.229394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:49.229872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:49.230633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:49.231066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:49.275069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-506d0567-c489-4c87-96a1-ca05877ed485 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058146 Nov 06 21:17:49.279388 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3645/7398] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:50.288956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:50.290379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:50.298666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:50.299120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:50.299978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:50.300492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:50.345650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc495856-774a-4f41-bb42-091a37dfa02f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061586 Nov 06 21:17:50.349946 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3754/7399] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:50 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:51.360214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:51.361959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:51.369470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:51.369932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:51.370735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:51.371210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:51.416174 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e5279ac-51b2-4ebb-99d8-f747f63f430b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060591 Nov 06 21:17:51.416942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3646/7400] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:52.430518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:52.431576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:52.442384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:52.442999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:52.444156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:52.444895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:52.494293 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc34431d-90b7-45c5-96f3-746368ec23ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.069455 Nov 06 21:17:52.494963 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3755/7401] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:53.511640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:53.513907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:53.527150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:53.528283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:53.530287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:53.531079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:53.584777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54d7b502-524c-4e24-9b23-c06936ec4053 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.080198 Nov 06 21:17:53.585490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3647/7402] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:53 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:54.597368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:54.598392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:54.605679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:54.606145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:54.606943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:54.607393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:54.655179 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5835e484-0749-45e2-8d24-972565db1a49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061772 Nov 06 21:17:54.655828 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3756/7403] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:55.667641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:55.668760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:55.679835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:55.679835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:55.679835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:55.679835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:55.727015 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-85f38503-608b-4e83-a10d-1ca803e363fd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063633 Nov 06 21:17:55.727675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3648/7404] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:56.740251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:56.741495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:56.748964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:56.749411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:56.750730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:56.751925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:56.802748 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b825b8fb-eba0-450c-ac74-a925cb9fd016 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066717 Nov 06 21:17:56.806966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3757/7405] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:57.817025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:57.818041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:57.825378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:57.825883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:57.826681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:57.827126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:57.874612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbd51aba-dbbb-407a-b25a-18388112eac1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062478 Nov 06 21:17:57.875557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3649/7406] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:17:58.887193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:58.888793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:58.896271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:58.897063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:58.897680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:58.898131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:58.955970 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5793ea0-a26d-4ac9-bff4-077c354e3957 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072719 Nov 06 21:17:58.956673 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3758/7407] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:58 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:17:59.969415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:17:59.970462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:17:59.977824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:59.978286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:17:59.979082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:17:59.979526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:00.024778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34dbd1cc-d538-4760-b9fa-79df3807693e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059814 Nov 06 21:18:00.025617 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3650/7408] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:17:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:01.037141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:01.038232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:01.046125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:01.046595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:01.047404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:01.047859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:01.088859 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e20db7c2-2c60-45e8-9168-dfa25e34acce tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055690 Nov 06 21:18:01.089762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3759/7409] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:01 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:02.101903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:02.103002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:02.110719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:02.111175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:02.111966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:02.112457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:02.157202 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf21ee29-3cf6-403d-b55f-692cbb3d6790 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059200 Nov 06 21:18:02.158118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3651/7410] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:02 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:03.169949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:03.170965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:03.178257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:03.178723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:03.179511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:03.179961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:03.224132 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83344094-5f67-4ecd-97e8-3a5536e927f6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058094 Nov 06 21:18:03.224820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3760/7411] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:04.012801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:04.013260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:04.020826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.021288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.022084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.022532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.049478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:18:04.127141 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 204 len: 0 microversion: 2.1 time: 0.118114 Nov 06 21:18:04.127816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3652/7412] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:18:04 2021] DELETE /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:18:04.137163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:04.137924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:04.144825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.145291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.146090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.146539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.238172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:04.239703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:04.247719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.248187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.249006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:04.249446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:04.302435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:04.303545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc17dbfb-6bce-47a8-b61b-5dc907095e99 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.070902 Nov 06 21:18:04.304465 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3653/7413] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:04.311209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-475a5cc3-48a8-4c00-a928-3b1f8e5dcf3a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1578 microversion: 2.1 time: 0.178786 Nov 06 21:18:04.311873 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3761/7414] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:04 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:05.315859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:05.316889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:05.324641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:05.325772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:05.326677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:05.327220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:05.329083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:05.329857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:05.337833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:05.338312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:05.339127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:05.339586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:05.377262 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fcd740a0-e22b-4bba-98e8-bc54898d12fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065516 Nov 06 21:18:05.378121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3654/7415] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:05.553525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:05.561286 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2917048f-e40c-47f0-8da6-49374fd3bbeb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1578 microversion: 2.1 time: 0.236393 Nov 06 21:18:05.561899 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3762/7416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:05 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:18:06.254695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:06.256189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:06.263259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.263713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.264627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.265067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.348986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:18:06.349662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:18:06.350097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:18:06.350606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:18:06.351154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:18:06.390519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:06.392149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:06.399681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.400483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.401502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.402171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.441283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:06.456282 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2321931-6ab3-4213-8320-c5514b3e273d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.069957 Nov 06 21:18:06.457102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.459701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.461565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.462360 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3763/7417] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:06.463120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.495106 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e19028f-d8c3-460b-90dd-10a170fcd75d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action" status: 202 len: 1136 microversion: 2.1 time: 0.244370 Nov 06 21:18:06.496184 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3655/7418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:18:06 2021] POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action => generated 1136 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 06 21:18:06.512430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:06.513466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:06.536152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.537308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.538454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.539119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.582657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:06.583546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:06.591290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.593294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.594384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.595008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.745968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:06.768221 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74a0006f-13a5-48b7-bddf-2f2671d2008c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 200 len: 1510 microversion: 2.1 time: 0.190907 Nov 06 21:18:06.768751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3656/7419] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:06 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:06.894574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:06.905765 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58d5f641-f458-412d-a653-51defde2c445 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.397232 Nov 06 21:18:06.910903 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3764/7420] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:06 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:06.952551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-62bf7ce6-fa76-4598-a804-c83b9b8a4905 req-6fb7bca7-f043-4bfb-884f-9077367630d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65f8275-232c-4352-b2dc-d80a46ce45e8", "name": "network-vif-deleted", "tag": "4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:06.954564 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:06.954564 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:18:06.977257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-62bf7ce6-fa76-4598-a804-c83b9b8a4905 req-6fb7bca7-f043-4bfb-884f-9077367630d8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:06.977714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-62bf7ce6-fa76-4598-a804-c83b9b8a4905 req-6fb7bca7-f043-4bfb-884f-9077367630d8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:06.996172 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-62bf7ce6-fa76-4598-a804-c83b9b8a4905 req-6fb7bca7-f043-4bfb-884f-9077367630d8 service nova] Creating event network-vif-deleted:4e6b89f2-97ee-4ca4-b5d0-c35bddce27c9 for instance e65f8275-232c-4352-b2dc-d80a46ce45e8 on nch2-master-1 Nov 06 21:18:07.001678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-62bf7ce6-fa76-4598-a804-c83b9b8a4905 req-6fb7bca7-f043-4bfb-884f-9077367630d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053402 Nov 06 21:18:07.002471 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3657/7421] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:18:07.470639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:07.472335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:07.480616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.481082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.482242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.483811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.550448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f377fd1-4635-48f8-81e3-6e33f8c231d6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.084171 Nov 06 21:18:07.552759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3765/7422] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:07.787119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:07.788719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:07.795894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.796590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.797584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.798027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.817268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. Nov 06 21:18:07.818352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:18:07.819554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac493f75-33fa-4a67-bc11-16d95a5d5cfb tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 404 len: 111 microversion: 2.1 time: 0.037656 Nov 06 21:18:07.820206 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3658/7423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:07 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:18:07.925183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:07.925912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:07.939063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.939549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.940402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:07.941150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:07.945362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-126564420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096105306", "security_groups": [{"name": "tempest-secgroup-smoke-1302622068"}], "block_device_mapping_v2": [{"uuid": "ae02902c-20dc-4c0a-94a0-2e35f8de1240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:08.449765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:18:08.609422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:08.618485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f53b735-19c1-4e54-8f94-9bf53f21af0c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.697978 Nov 06 21:18:08.619074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3766/7424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:07 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:08.634397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:08.635704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:08.643141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:08.643606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:08.644660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:08.645114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:08.691960 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e2e683a-baec-4d6c-8ffb-2988f0718fee tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061636 Nov 06 21:18:08.692733 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3767/7425] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:08 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:09.186841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:18:09.187325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:18:09.187749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:18:09.188164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:18:09.188660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:18:09.199034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.199425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.200256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.200726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.217631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:18:09.222776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:18:09.279227 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:18:09.281503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae02902c-20dc-4c0a-94a0-2e35f8de1240',volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:18:09.417107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-201e30ca-5253-434e-adc0-9d55cd26c505 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.476573 Nov 06 21:18:09.423406 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3659/7426] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:18:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:18:09.429176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53035fa1-8646-486e-9cfd-a5ce1b27d3bd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:09.429887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53035fa1-8646-486e-9cfd-a5ce1b27d3bd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:09.506138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-53035fa1-8646-486e-9cfd-a5ce1b27d3bd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:09.515561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53035fa1-8646-486e-9cfd-a5ce1b27d3bd tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1094 microversion: 2.1 time: 0.089420 Nov 06 21:18:09.516561 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3768/7427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:09 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:09.636478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:09.637104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:09.645508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.646179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.647202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.647655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.703375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:09.704742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:09.716791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.718065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.719525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:09.720361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:09.784473 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-080c1326-7f33-4cb1-adb0-66e3fdc3e537 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.084426 Nov 06 21:18:09.785870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3769/7428] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:09.815216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:09.830151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ead2f9ec-4c8b-4cc5-8178-9190226a6f23 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.197390 Nov 06 21:18:09.830762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3660/7429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:09 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:10.532689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:10.533323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:10.541764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.542239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.543052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.543502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.616432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:10.625516 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59928641-9b9e-4ec2-a9f9-2586f715ca53 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1192 microversion: 2.1 time: 0.096944 Nov 06 21:18:10.626194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3770/7430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:10 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:10.797648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:10.800078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:10.807907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.808943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.810187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.810891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.849824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:10.851946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:10.869134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.869608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.870451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:10.870913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:10.899007 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ad10ab0-9c58-43a9-b9ca-a8178ae967db tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.105590 Nov 06 21:18:10.905647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3661/7431] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:11.142276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:11.155412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-50c35e5b-3445-40ec-9cc3-b3e93bfe28bb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.310247 Nov 06 21:18:11.160521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3771/7432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:10 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:18:11.648348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:11.649527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:11.657275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:11.657732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:11.658528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:11.658963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:11.903177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:11.915519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ce21f561-193b-410e-8725-73b1b98d4793 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1278 microversion: 2.1 time: 0.273866 Nov 06 21:18:11.916533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:11.918507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:11.927424 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3662/7433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:11 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:11.929775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:11.930247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:11.931054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:11.931498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:11.987245 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c12b9b8-af70-46de-a03b-edc43baddb09 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.075477 Nov 06 21:18:11.993867 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3772/7434] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:12.175422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:12.176843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:12.184230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:12.184994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:12.185955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:12.186500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:12.445804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:12.454769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c56510bb-ff57-48f9-8717-a6c701fd47d3 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.284063 Nov 06 21:18:12.455758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3663/7435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:12 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:12.740280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0d7e7bcc-51c3-4335-a4a6-88a99607a22a req-9de08247-0a84-407b-9452-69a17aa72ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fc8d98-0232-495c-b045-c07a8a328d7a", "tag": "6c24608c-1640-4444-9edd-a9836259cfab"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:12.742283 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:12.742283 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:18:12.751805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0d7e7bcc-51c3-4335-a4a6-88a99607a22a req-9de08247-0a84-407b-9452-69a17aa72ba6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:12.752271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0d7e7bcc-51c3-4335-a4a6-88a99607a22a req-9de08247-0a84-407b-9452-69a17aa72ba6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:12.771493 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0d7e7bcc-51c3-4335-a4a6-88a99607a22a req-9de08247-0a84-407b-9452-69a17aa72ba6 service nova] Creating event network-changed:6c24608c-1640-4444-9edd-a9836259cfab for instance 55fc8d98-0232-495c-b045-c07a8a328d7a on nch1-master-1 Nov 06 21:18:12.777704 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0d7e7bcc-51c3-4335-a4a6-88a99607a22a req-9de08247-0a84-407b-9452-69a17aa72ba6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224735 Nov 06 21:18:12.778317 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3773/7436] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:18:12.933914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:12.935374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:12.941931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:12.942592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:12.943570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:12.944191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:13.003719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:13.005443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:13.012830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:13.013536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:13.014874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:13.015329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:13.061097 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32046e18-c268-40de-b32e-ccfb44c16479 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061590 Nov 06 21:18:13.069722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3774/7437] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:12 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:13.146883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:13.156609 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-82ca4946-6306-4590-8a98-503051427b0a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.226385 Nov 06 21:18:13.158036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3664/7438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:12 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:13.472873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:13.473846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:13.480828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:13.481299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:13.482109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:13.482621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:13.967081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:13.976205 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-945c2e59-698f-4516-867f-b06fa4dfb229 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.506888 Nov 06 21:18:13.976960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3775/7439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:13 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:14.074481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:14.075399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:14.083003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:14.083465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:14.084257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:14.084733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:14.128105 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ec36fa0-3d55-4071-b62d-c6372add8723 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057238 Nov 06 21:18:14.129143 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3665/7440] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:14.174368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:14.175028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:14.182415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:14.182878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:14.183671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:14.184128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:14.324559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:14.332802 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29072855-85d2-4839-a93d-6c586cf8c35a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.162040 Nov 06 21:18:14.333394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3776/7441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:14 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:14.994331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:14.995097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:15.004701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.005238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.006119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.006626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.139681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:15.140991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:15.147218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.147889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.148712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.149161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.157044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:15.165403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bae7710e-68ca-4a03-af15-f863e7d20d82 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.174932 Nov 06 21:18:15.166237 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3666/7442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:14 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:15.198889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f8c42b0-d168-4065-9c14-907eeba2db73 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062821 Nov 06 21:18:15.200004 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3777/7443] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:15.350826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:15.351561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:15.359425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.359969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.360875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:15.361319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:15.496322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:15.504034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d49d9ec-8239-4b8a-a323-734e9f3bc9df tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.156928 Nov 06 21:18:15.504656 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3667/7444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:15 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:16.183690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:16.184685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:16.192805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.193415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.194326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.194888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.358491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:16.359479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:16.364577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:16.365563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.366236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.367222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.367837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.375321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e479a28a-5049-4344-b4fa-9aa510996940 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.195883 Nov 06 21:18:16.376481 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3778/7445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:16 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:16.417465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14d0d4cb-e964-4926-a74d-d4a4c1c9d20f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.210672 Nov 06 21:18:16.418311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3668/7446] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:16 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:16.521740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:16.522617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:16.529440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.530208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.531082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:16.531743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:16.674618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:16.682575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a98c7cea-c15b-4bf2-84ea-af0d9939ac6a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.165435 Nov 06 21:18:16.683257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3779/7447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:16 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:17.393862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:17.395181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:17.402809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.403505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.405092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.405536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.430996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:17.432156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:17.438961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.439432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.440242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.440767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.492315 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd97aa12-4e0a-483f-9acb-b33c7cf42ea8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064755 Nov 06 21:18:17.500278 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3780/7448] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:17.569925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:17.580130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76595fe3-6792-42b4-ba87-107dd1f2cd1d tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.190943 Nov 06 21:18:17.581328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3669/7449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:17 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:17.702355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:17.703460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:17.712873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.713606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.714798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:17.715401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:17.875035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:17.883368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b975890-98c8-40ff-8b41-f5eaa192602f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.186823 Nov 06 21:18:17.884154 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3781/7450] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:17 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:18.508028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:18.510244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:18.518403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.523152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:18.524423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.525236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:18.575268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc5833d7-ebd5-46bd-8c98-1cd8742133af tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072716 Nov 06 21:18:18.577321 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3670/7451] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:18.598806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:18.599440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:18.606395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.606759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:18.607630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.608415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:18.841068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:18.848639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93732eed-8982-4432-9341-559500c04c15 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.253882 Nov 06 21:18:18.849218 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3782/7452] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:18 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:18.903623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:18.904710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:18.912573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.913090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:18.913953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:18.916826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:19.149289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:19.157486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b15c8904-b89b-4f6e-b0b5-ef0850839ec0 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.260038 Nov 06 21:18:19.158309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3671/7453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:18 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:19.587721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:19.588773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:19.595693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:19.596217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:19.597038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:19.597482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:19.646617 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c59afd80-a99a-450e-bc38-39c3b92b0de0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062594 Nov 06 21:18:19.647756 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3783/7454] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:19 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:19.871518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:19.872092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:19.885888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:19.886593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:19.887396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:19.888052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:20.134415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:20.142268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e304b45-2b6e-4923-b0cc-9e34af0a4218 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.274539 Nov 06 21:18:20.142847 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3672/7455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:19 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:20.175832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:20.176744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:20.183762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:20.184238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:20.185063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:20.185522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:20.427488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:20.435065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a396a18e-7abe-4ea5-91e8-4b234c0716a7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.263310 Nov 06 21:18:20.435727 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3784/7456] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:20 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:20.659246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:20.660252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:20.666928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:20.667365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:20.668161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:20.668644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:20.711407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a9ced6dd-71b5-4030-b163-a7a6c8e1bb34 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055625 Nov 06 21:18:20.715390 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3673/7457] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:21.158831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:21.159508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:21.166373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.166849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.167656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.168117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.335569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:21.345102 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7c4b5a5-479e-443e-8bd9-d7bf67232408 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.190038 Nov 06 21:18:21.347763 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3785/7458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:21 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:21.434597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0d798d1d-b27b-4a3c-a921-263d5ff37e6c req-4ba887a8-7c94-4e88-893d-f1d50b552e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fc8d98-0232-495c-b045-c07a8a328d7a", "name": "network-vif-plugged", "status": "completed", "tag": "6c24608c-1640-4444-9edd-a9836259cfab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:21.436870 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:21.436870 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:18:21.445871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0d798d1d-b27b-4a3c-a921-263d5ff37e6c req-4ba887a8-7c94-4e88-893d-f1d50b552e1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.446329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0d798d1d-b27b-4a3c-a921-263d5ff37e6c req-4ba887a8-7c94-4e88-893d-f1d50b552e1e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.454315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:21.455043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:21.460457 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0d798d1d-b27b-4a3c-a921-263d5ff37e6c req-4ba887a8-7c94-4e88-893d-f1d50b552e1e service nova] Creating event network-vif-plugged:6c24608c-1640-4444-9edd-a9836259cfab for instance 55fc8d98-0232-495c-b045-c07a8a328d7a on nch1-master-1 Nov 06 21:18:21.463305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.464019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.465021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.465578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.465847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0d798d1d-b27b-4a3c-a921-263d5ff37e6c req-4ba887a8-7c94-4e88-893d-f1d50b552e1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098378 Nov 06 21:18:21.466542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3674/7459] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:18:21.694545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:21.702859 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-863099b9-a312-4b86-ae38-dd2f20a5b38c tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.254679 Nov 06 21:18:21.703434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3786/7460] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:21 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:21.724489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:21.725414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:21.731402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.731860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.733289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:21.733733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:21.775440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5886265-5bb1-4b19-b036-0764f08c1044 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055385 Nov 06 21:18:21.780371 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3675/7461] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:22.364247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:22.364932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:22.371326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.371794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.372690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.373858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.514526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:22.523528 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-690e7760-f777-4ba4-93a1-3149396ca82f tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1691 microversion: 2.1 time: 0.162890 Nov 06 21:18:22.524216 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3787/7462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:22 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:22.721018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:22.721713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:22.729258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.729728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.730494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.730932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.788455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:22.789381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:22.797822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.798528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.799510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:22.800102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:22.849141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-602f0b58-f2a5-42c1-966f-c70073cb23c0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064264 Nov 06 21:18:22.853422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3788/7463] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:22.889171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:22.897718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9228fc30-1025-4bc3-885c-ff11ac4a4a70 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1266 microversion: 2.1 time: 0.180738 Nov 06 21:18:22.900344 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3676/7464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:22 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:23.677494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:23.678282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:23.686569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.687110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:23.687975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.688541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:23.835449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:23.842955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-102a2570-fe46-44be-8976-7cd22aac005b tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1697 microversion: 2.1 time: 0.305302 Nov 06 21:18:23.853137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3789/7465] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:23 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1697 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:23.861105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:23.862130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:23.870043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.870741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:23.871690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.872269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:23.915648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:23.916190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:23.923977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-345e3bcd-74ae-47a3-8025-517fd535bfca tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066651 Nov 06 21:18:23.924675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3677/7466] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:23 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:23.928074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.928566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:23.929561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:23.930009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.066763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:24.074417 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c138701-61a7-4b15-8179-697e3439ac47 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1454 microversion: 2.1 time: 0.162909 Nov 06 21:18:24.074987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3790/7467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:23 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:24.092703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:24.093409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:24.100243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.100748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.101542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.101987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.235150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:24.243375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7b2869a4-7db4-47f3-b53c-9864ecce5987 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1454 microversion: 2.1 time: 0.155301 Nov 06 21:18:24.243953 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3678/7468] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:24 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:24.860435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:24.861756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:24.869079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.870053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.871077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.872233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.936748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:24.938125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:24.946018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.946018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.946955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:24.947412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:24.998559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2cd7110e-8095-4a52-8240-f1059e62a92f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065553 Nov 06 21:18:25.000043 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3679/7469] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:25.491327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:25.500050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-291e6ad7-02b6-43ba-a205-0c8a33375f5e tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1697 microversion: 2.1 time: 0.643535 Nov 06 21:18:25.500692 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3791/7470] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:24 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1697 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:26.011358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:26.012396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:26.021169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:26.023865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:26.024774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:26.025264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:26.072832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c4be1efe-4e2c-485a-9ef4-46b00afe9ea7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065240 Nov 06 21:18:26.073573 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3680/7471] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:26 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:26.449900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-31a261d3-0914-4055-8319-d8a665adef2d req-c3774b02-193d-45e5-9575-9016ffd73988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fc8d98-0232-495c-b045-c07a8a328d7a", "tag": "6c24608c-1640-4444-9edd-a9836259cfab"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:26.451880 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:26.451880 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:18:26.461101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31a261d3-0914-4055-8319-d8a665adef2d req-c3774b02-193d-45e5-9575-9016ffd73988 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:26.461564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-31a261d3-0914-4055-8319-d8a665adef2d req-c3774b02-193d-45e5-9575-9016ffd73988 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:26.474804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-31a261d3-0914-4055-8319-d8a665adef2d req-c3774b02-193d-45e5-9575-9016ffd73988 service nova] Creating event network-changed:6c24608c-1640-4444-9edd-a9836259cfab for instance 55fc8d98-0232-495c-b045-c07a8a328d7a on nch1-master-1 Nov 06 21:18:26.479952 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-31a261d3-0914-4055-8319-d8a665adef2d req-c3774b02-193d-45e5-9575-9016ffd73988 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Nov 06 21:18:26.481349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3792/7472] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:18:26.519342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:26.520359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:26.528556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:26.529517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:26.530915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:26.531702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:26.813042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:26.828659 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3dadca0e-5a0b-48a2-9dea-53e33f6deabc tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1697 microversion: 2.1 time: 0.314366 Nov 06 21:18:26.839500 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3681/7473] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:26 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1697 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:27.086237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:27.087278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:27.093500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:27.094377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:27.095416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:27.095925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:27.150587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa9124ef-d617-4e33-805d-075fbf5fd816 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.068350 Nov 06 21:18:27.151756 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3793/7474] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:27 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:27.663920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f7ec1b65-ac66-478c-a12e-6d54a1f51cb3 req-5136f8a0-444c-4794-907d-8292ff51af46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "name": "network-vif-unplugged", "status": "completed", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:27.666808 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:27.666808 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:18:27.678877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f7ec1b65-ac66-478c-a12e-6d54a1f51cb3 req-5136f8a0-444c-4794-907d-8292ff51af46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:27.680179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f7ec1b65-ac66-478c-a12e-6d54a1f51cb3 req-5136f8a0-444c-4794-907d-8292ff51af46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:27.710614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f7ec1b65-ac66-478c-a12e-6d54a1f51cb3 req-5136f8a0-444c-4794-907d-8292ff51af46 service nova] Creating event network-vif-unplugged:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:18:27.722751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f7ec1b65-ac66-478c-a12e-6d54a1f51cb3 req-5136f8a0-444c-4794-907d-8292ff51af46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064553 Nov 06 21:18:27.724066 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3682/7475] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:18:27.848077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:18:27.848887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:27.864265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:27.865307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:27.866993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:27.868149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:28.023076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:18:28.030667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65601688-4725-4737-b855-c163b0939811 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1682 microversion: 2.1 time: 0.186689 Nov 06 21:18:28.031268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3794/7476] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:18:27 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:18:28.163094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:28.164100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:28.171118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:28.171567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:28.172378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:28.172816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:28.216201 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7559c5e4-0116-49f7-a2a5-a7190e620a28 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057015 Nov 06 21:18:28.217785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3683/7477] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:28 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:29.229298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:29.230232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:29.237911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:29.238611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:29.239536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:29.240216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:29.284526 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c2dc46a2-4580-42df-b508-a796d9f7fdb5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058930 Nov 06 21:18:29.285562 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3795/7478] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:29.738946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-29c350aa-0889-4650-9689-7e320051cd7c req-79e7d552-ffd2-4940-9cce-a13b6b81f774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "name": "network-vif-plugged", "status": "completed", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:29.740547 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:18:29.740547 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:18:29.749420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29c350aa-0889-4650-9689-7e320051cd7c req-79e7d552-ffd2-4940-9cce-a13b6b81f774 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:29.749948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-29c350aa-0889-4650-9689-7e320051cd7c req-79e7d552-ffd2-4940-9cce-a13b6b81f774 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:29.761067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-29c350aa-0889-4650-9689-7e320051cd7c req-79e7d552-ffd2-4940-9cce-a13b6b81f774 service nova] Creating event network-vif-plugged:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:18:29.766401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-29c350aa-0889-4650-9689-7e320051cd7c req-79e7d552-ffd2-4940-9cce-a13b6b81f774 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Nov 06 21:18:29.766990 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3684/7479] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:18:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:18:30.297770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:30.298794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:30.305984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:30.306446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:30.307243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:30.307694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:30.349231 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be1915ef-87b1-4e67-90ad-4d4a53cf2536 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055876 Nov 06 21:18:30.353932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3796/7480] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:30 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:31.362482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:31.363478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:31.369437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:31.369888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:31.370676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:31.371115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:31.415807 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-69f7eab9-48ce-4afa-a6b7-4f9f386a1adc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058151 Nov 06 21:18:31.417236 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3685/7481] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:31 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:32.428795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:32.429903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:32.438518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:32.439020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:32.439825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:32.440275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:32.485336 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e45ddba6-c776-4e2e-97a1-52c067c357f9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060486 Nov 06 21:18:32.486016 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3797/7482] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:33.497395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:33.498426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:33.506841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:33.507316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:33.508124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:33.508605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:33.553485 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6dcf2ef9-8756-42f4-aa04-93d8a20388e2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060017 Nov 06 21:18:33.558023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3686/7483] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:33 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:34.566724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:34.567893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:34.575052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:34.575597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:34.576522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:34.576989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:34.624894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cc3cdffc-2186-4f54-8122-863375d18b0a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061438 Nov 06 21:18:34.625551 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3798/7484] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:35.637729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:35.638350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:35.645482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:35.645947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:35.646738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:35.647175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:35.691139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-61ff6c98-f598-468a-b9c5-133098a0c7ef tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058171 Nov 06 21:18:35.692026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3687/7485] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:35 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:36.704009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:36.705074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:36.712493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:36.712965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:36.713765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:36.714213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:36.765784 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99583ef0-0fec-4aea-9d31-543929edb583 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066212 Nov 06 21:18:36.767182 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3799/7486] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:37.777890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:37.778925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:37.786494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:37.786982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:37.787769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:37.788208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:37.837290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c196e769-d1e8-4c0d-9156-6145f7ea3137 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063412 Nov 06 21:18:37.838202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3688/7487] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:38.850875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:38.851899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:38.859649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:38.860360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:38.861365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:38.861978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:38.909913 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f168751-937f-4b8a-b818-e4f9a9ad0e3b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063169 Nov 06 21:18:38.910747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3800/7488] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:39.924805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:39.926238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:39.933879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:39.934585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:39.935387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:39.936642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:39.997592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1bf7ea2-3a69-4bfc-8da8-789257c703e9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.078587 Nov 06 21:18:39.999014 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3689/7489] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:41.011600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:41.014969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:41.023871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:41.024768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:41.025771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:41.026360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:41.083860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20ef8261-9096-4568-810f-fa2b29178619 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.078127 Nov 06 21:18:41.085516 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3801/7490] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:42.100886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:42.102902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:42.113633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:42.114217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:42.115510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:42.116222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:42.182011 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5fa45c48-f156-41de-aba5-8e4ac00078ac tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.088143 Nov 06 21:18:42.185880 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3690/7491] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:43.195535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:43.196591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:43.204461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:43.204924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:43.205715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:43.206160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:43.249882 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be1ebcf5-c6af-4541-bc0f-9b8fd8fffd43 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058263 Nov 06 21:18:43.250804 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3802/7492] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:44.262653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:44.263684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:44.271765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:44.272219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:44.273213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:44.273653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:44.321386 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ad17b0d-5431-4001-bf7f-c23a10b94aec tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062654 Nov 06 21:18:44.324813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3691/7493] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:45.334025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:45.335227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:45.343989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:45.344486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:45.345304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:45.345760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:45.389376 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2567347-97bd-4020-9094-3d227ec934dd tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059238 Nov 06 21:18:45.390394 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3803/7494] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:45 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:46.403042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:46.404225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:46.411891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:46.412742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:46.413781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:46.414225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:46.487409 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-829ff2fc-2ac0-4098-ad7e-7cc59b963067 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.089127 Nov 06 21:18:46.492629 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3692/7495] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:46 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:47.501325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:47.502449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:47.511461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:47.511917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:47.512914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:47.513501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:47.569144 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f00e06d0-3da4-4958-a56e-3904c0fb5455 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072598 Nov 06 21:18:47.570967 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3804/7496] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:48.583569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:48.584608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:48.600144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:48.600657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:48.601647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:48.602270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:48.651979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4537a0ea-8b92-48eb-a181-c5f308a7b534 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072409 Nov 06 21:18:48.653016 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3693/7497] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:49.666563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:49.668506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:49.675864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:49.676641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:49.677642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:49.678374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:49.733552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2bed90c-dd79-47b8-8bdc-1074d6fa4b9e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072056 Nov 06 21:18:49.737928 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3805/7498] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:50.750385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:50.751712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:50.763062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:50.765647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:50.766543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:50.767238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:50.818051 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a88e6de-c915-44b8-969f-a6cf80c5600f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.075435 Nov 06 21:18:50.823812 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3694/7499] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:50 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:51.832494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:51.835680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:51.844839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:51.845585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:51.846591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:51.847213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:51.919054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0edfca9-d8e7-4bbc-b038-664a404b6d98 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.090311 Nov 06 21:18:51.919797 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3806/7500] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:52.935382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:52.936627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:52.945223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:52.945737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:52.949357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:52.950693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:53.003258 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a711f73e-8217-45df-8774-b4a78546bbf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.073390 Nov 06 21:18:53.004466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3695/7501] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:18:54.016011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:54.017047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:54.024513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:54.024974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:54.025797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:54.026246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:54.067464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7ae3baa-672a-49ff-82ef-36d3ede7d85a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055814 Nov 06 21:18:54.068397 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3807/7502] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:55.082162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:55.083290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:55.090872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:55.091422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:55.092286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:55.092823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:55.135410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a887c32-9a4b-46ce-8cc9-189f222d2fc9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057178 Nov 06 21:18:55.136644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3696/7503] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:56.149732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:56.150782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:56.159106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:56.159594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:56.160549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:56.161004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:56.206937 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89ff765f-56f2-45bf-b275-82fef7b19905 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061360 Nov 06 21:18:56.208555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3808/7504] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:57.220677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:57.222358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:57.230450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:57.231240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:57.232196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:57.232767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:57.278616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94b62810-46e8-4598-a0a5-319b68004b8d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062808 Nov 06 21:18:57.280639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3697/7505] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:58.295910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:58.297799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:58.305756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:58.306226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:58.307123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:58.307772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:58.361761 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e9f44c4-45be-4f38-8243-4232554062fa tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072166 Nov 06 21:18:58.365556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3809/7506] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:58 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:18:59.376975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:18:59.378917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:18:59.386454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:59.386918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:59.387726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:18:59.388722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:18:59.447686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-91f85b66-0ad3-4477-971a-2637bfb4bc46 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.074740 Nov 06 21:18:59.448705 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3698/7507] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:18:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:00.461287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:00.462229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:00.469614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:00.470084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:00.471318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:00.472329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:00.529728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acf329fe-c47d-428f-804b-258fdd0b75cb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072270 Nov 06 21:19:00.530530 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3810/7508] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:00 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:01.542475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:01.543438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:01.551648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:01.552116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:01.552946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:01.553469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:01.596416 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3680024b-fd8c-4648-9fd3-353c197754dc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058281 Nov 06 21:19:01.600689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3699/7509] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:01 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:02.608937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:02.609981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:02.617243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:02.617705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:02.618492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:02.618935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:02.664084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f3b8e3d-f9e3-424d-802b-76b3b3b6644a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059064 Nov 06 21:19:02.665324 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3811/7510] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:02 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:03.676787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:03.677724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:03.685175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:03.685625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:03.686416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:03.686853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:03.729048 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50a01df5-8ddb-4b9c-8718-1907943d9bbb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056276 Nov 06 21:19:03.729954 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3700/7511] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:04.281536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:04.282714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:04.290844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:04.291403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:04.292283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:04.292686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:04.349374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4bf9246-bcd9-4d77-9227-9c3cd97d57a7 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action" status: 200 len: 24573 microversion: 2.1 time: 0.072384 Nov 06 21:19:04.364434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3812/7512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:19:04 2021] POST /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:19:04.742526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:04.744829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:04.754164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:04.754873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:04.756129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:04.756689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:04.812215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3b16fa2-d142-4474-a9da-dcf9e3e1e186 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.073970 Nov 06 21:19:04.813806 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3701/7513] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:05.826226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:05.827628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:05.835769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:05.836325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:05.837198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:05.837653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:05.881863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a91a6250-daa1-4a4f-83cb-af24c1b6a523 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060549 Nov 06 21:19:05.882844 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3813/7514] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:06.902055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:06.904036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:06.913848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:06.914972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:06.916122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:06.916796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:06.976355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e6a3265-8d0b-4ac0-80ea-f695e32162be tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.084167 Nov 06 21:19:06.977125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3702/7515] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:07.990428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:07.991660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:08.001252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:08.001921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:08.002828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:08.003222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:08.048988 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d78045e-6e2e-4ed5-a11b-7073668b1fe2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062409 Nov 06 21:19:08.053396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3814/7516] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:09.062589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:09.064558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:09.072473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:09.072971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:09.073930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:09.074478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:09.120742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cdaf4c13-366a-4596-9842-79ddae963658 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063503 Nov 06 21:19:09.121430 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3703/7517] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:10.135311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:10.138228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:10.148600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:10.151381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:10.153718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:10.155302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:10.215661 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e214b82-dd35-464b-912d-57872b8dc8c6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.085185 Nov 06 21:19:10.217870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3815/7518] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:11.233576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:11.235934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:11.249654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:11.250184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:11.251038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:11.251715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:11.309159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b82d99f0-2e28-4275-a122-fd62311cc8f5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.082036 Nov 06 21:19:11.309866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3704/7519] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:12.324945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:12.327504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:12.336999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:12.337794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:12.338993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:12.339636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:12.407069 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9d11a79-a79f-4436-bf99-168ad33d796c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.086792 Nov 06 21:19:12.412209 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3816/7520] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:12 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:13.422413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:13.423968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:13.433110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:13.433895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:13.434755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:13.435296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:13.493898 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43185f5e-c493-4d8b-b555-24279699be60 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.077501 Nov 06 21:19:13.494860 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3705/7521] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:13 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:14.510134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:14.511523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:14.520952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:14.521433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:14.522253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:14.523674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:14.577978 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a379174-d118-4522-bcfa-969d15af1508 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.073753 Nov 06 21:19:14.578767 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3817/7522] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:14 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:15.591243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:15.592787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:15.608882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:15.610563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:15.612575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:15.613287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:15.664811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8a5727a-fc97-48e2-83a9-b3b7120e1ba3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.077420 Nov 06 21:19:15.670068 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3706/7523] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:15 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:16.677933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:16.679793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:16.692346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:16.704930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:16.706115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:16.706575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:16.757933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68dba2ee-b6ee-4816-8520-1105a290a133 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.083991 Nov 06 21:19:16.763062 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3818/7524] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:16 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:17.777146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:17.793128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:17.813095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:17.813595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:17.814399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:17.814874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:17.882518 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc41eb07-7875-46b9-b59e-4e33ca7363a4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.114709 Nov 06 21:19:17.883273 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3707/7525] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:17 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:18.897211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:18.898902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:18.921390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:18.925083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:18.926177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:18.926643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:18.993874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a0677c53-9a3e-4e95-bab8-27132e3e7e8e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.101478 Nov 06 21:19:18.994806 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3819/7526] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:18 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:20.006181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:20.007241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:20.015676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:20.016528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:20.017343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:20.018039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:20.066805 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f30aef55-9e01-4ccc-8e43-bf7cfe3fedd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064707 Nov 06 21:19:20.073410 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3708/7527] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:20 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:21.081074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:21.082159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:21.090652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:21.091190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:21.091998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:21.092697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:21.138963 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c5cc0b4-7ba9-4150-aa6f-d3908e9caf5a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062246 Nov 06 21:19:21.140009 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3820/7528] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:21 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:22.151648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:22.152682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:22.161017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:22.161783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:22.162575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:22.163166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:22.211052 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9437e82-7c97-4ce5-a7c3-eb5ef64f24a5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063337 Nov 06 21:19:22.212771 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3709/7529] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:22 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:23.224278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:23.225862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:23.235204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:23.236804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:23.239825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:23.240578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:23.295722 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-43d63e17-92a8-4f8a-b69d-b98668ad4352 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.074906 Nov 06 21:19:23.300549 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3821/7530] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:23 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:24.315126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:24.316380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:24.333550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:24.334251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:24.335525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:24.336817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:24.395770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebc55a27-66c7-4353-96cf-ab2f6ee53dc2 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.087446 Nov 06 21:19:24.401975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3710/7531] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:24 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:25.412325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:25.413490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:25.427435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:25.428262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:25.433834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:25.434356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:25.505484 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef9384e9-b5f8-41b8-96a7-2a13c3b440a9 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.098505 Nov 06 21:19:25.506289 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3822/7532] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:25 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:26.519622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:26.521604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:26.534990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:26.537918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:26.539116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:26.540356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:26.591934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bc8331a-2687-42ad-af68-c618dc8c3de3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.076540 Nov 06 21:19:26.593838 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3711/7533] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:26 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:27.608950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:27.610112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:27.620817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:27.621696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:27.627324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:27.630391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:27.700515 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb17778b-4225-42ba-9a61-69b297a64467 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.096549 Nov 06 21:19:27.704398 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3823/7534] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:27 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:28.713737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:28.715929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:28.725042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:28.725599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:28.726860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:28.727445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:28.772541 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a3b1c9d-73ea-48c9-8a0b-729567a4d743 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063453 Nov 06 21:19:28.773175 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3712/7535] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:28 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:29.784806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:29.785936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:29.793808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:29.794341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:29.795209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:29.795727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:29.837380 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47b35c50-27ba-45bb-a8ed-92ac60b27a01 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056617 Nov 06 21:19:29.838082 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3824/7536] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:29 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:30.850827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:30.853174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:30.862122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:30.867380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:30.868390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:30.868802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:30.921203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d701a1f7-9be3-4200-952e-002d370d82ad tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.074632 Nov 06 21:19:30.922482 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3713/7537] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:30 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:31.933782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:31.934820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:31.942707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:31.943249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:31.944018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:31.944500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:31.985545 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6d79193-95e9-48b9-97be-52b74c11ab44 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.055707 Nov 06 21:19:31.989667 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3825/7538] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:31 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:32.998118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:32.999234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:33.007220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:33.007672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:33.008689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:33.009123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:33.054280 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55ab71f9-c444-4149-8f11-49f2677b502c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060513 Nov 06 21:19:33.058652 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3714/7539] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:32 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:34.067568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:34.068739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:34.076918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:34.077390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:34.078201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:34.078662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:34.121198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b6f71a7-adb5-4ad4-8b1d-7c214bf837b3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.057840 Nov 06 21:19:34.122034 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3826/7540] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:34 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:35.134273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:35.135453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:35.144284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:35.144769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:35.145581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:35.146032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:35.191661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d19b2a33-3885-4b4d-b330-1817d3fd53ed tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061163 Nov 06 21:19:35.192417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3715/7541] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:35 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:36.177262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:36.177872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:36.190709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b0f79db9-67eb-4bf8-b6fb-ba9c33ae0d95 req-8c22dae7-90ba-4045-bee3-dce111f2291d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:36.192105 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:19:36.192105 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:19:36.202789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.206586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.207870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.210730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b0f79db9-67eb-4bf8-b6fb-ba9c33ae0d95 req-8c22dae7-90ba-4045-bee3-dce111f2291d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.211420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.215974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b0f79db9-67eb-4bf8-b6fb-ba9c33ae0d95 req-8c22dae7-90ba-4045-bee3-dce111f2291d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.241403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b0f79db9-67eb-4bf8-b6fb-ba9c33ae0d95 req-8c22dae7-90ba-4045-bee3-dce111f2291d service nova] Creating event network-changed:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:19:36.246647 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b0f79db9-67eb-4bf8-b6fb-ba9c33ae0d95 req-8c22dae7-90ba-4045-bee3-dce111f2291d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060161 Nov 06 21:19:36.248463 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3716/7542] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:19:36.255695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:36.257076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:36.264181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.265004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.266027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.266683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.280611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:19:36.318887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cfb85a84-fa7d-4388-a7bc-8c5ce27f5429 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.068651 Nov 06 21:19:36.324765 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3717/7543] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:36 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:36.403224 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d01fb6b2-619d-48c9-b40b-29b9e77c300c tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 204 len: 0 microversion: 2.1 time: 0.229446 Nov 06 21:19:36.408252 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3827/7544] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:19:36 2021] DELETE /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:19:36.413773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:36.414748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:36.424671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.425341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.426444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:36.427146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:36.590703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:19:36.599687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bcb1240f-6b71-43e2-8d1e-d35222bcd6fb tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1688 microversion: 2.1 time: 0.189998 Nov 06 21:19:36.600576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3718/7545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:19:36 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:19:37.333300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:37.334354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:37.341470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:37.341973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:37.342798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:37.343251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:37.393359 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcb78545-fe3b-4dd3-81e5-d57b7f23949e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064853 Nov 06 21:19:37.397601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3828/7546] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:37 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:37.619196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:37.619975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:37.627860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:37.628351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:37.629163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:37.629611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:37.831478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:19:37.840450 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd453400-5fa2-4724-a5cf-70d6dd6587b1 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1570 microversion: 2.1 time: 0.225032 Nov 06 21:19:37.841232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3719/7547] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:19:37 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:19:38.406027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:38.407046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:38.414443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.415430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.416573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.417318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.464236 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-faa937f7-241b-4aa9-a3a4-5940e90edb85 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062162 Nov 06 21:19:38.465056 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3829/7548] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:38 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:19:38.720189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d5aeadee-8745-4019-9f50-881898539984 req-77eea7f5-78a3-492f-96c2-79c927fbbb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e706ea8-3459-47bc-8f69-cbb47b52240b", "name": "network-vif-deleted", "tag": "0a85121f-6ead-4625-bb23-166787188982"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:38.721917 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:19:38.721917 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:19:38.730146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d5aeadee-8745-4019-9f50-881898539984 req-77eea7f5-78a3-492f-96c2-79c927fbbb8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.730605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d5aeadee-8745-4019-9f50-881898539984 req-77eea7f5-78a3-492f-96c2-79c927fbbb8e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.745288 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d5aeadee-8745-4019-9f50-881898539984 req-77eea7f5-78a3-492f-96c2-79c927fbbb8e service nova] Creating event network-vif-deleted:0a85121f-6ead-4625-bb23-166787188982 for instance 9e706ea8-3459-47bc-8f69-cbb47b52240b on nch2-master-1 Nov 06 21:19:38.750306 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d5aeadee-8745-4019-9f50-881898539984 req-77eea7f5-78a3-492f-96c2-79c927fbbb8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201093 Nov 06 21:19:38.750913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3720/7549] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:19:38.859317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:38.860279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:38.867802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.868621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.869627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.870274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.914926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:38.915636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:38.916101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lazy-loading 'fault' on Instance uuid 9e706ea8-3459-47bc-8f69-cbb47b52240b {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:19:39.006826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67902d7d41f547ec9b88ed6832411ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8c001debad4d98b1531db2b7d91349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:19:39.017606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc7bc4cc-0ee1-41f2-bb32-87d3153018ed tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 200 len: 1356 microversion: 2.1 time: 0.163034 Nov 06 21:19:39.018992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3830/7550] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:19:38 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:19:39.479711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:39.480773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:39.488578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:39.489041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:39.489846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:39.490294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:39.538536 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0d945dc-6331-4685-962c-e8e6ec3e8b1f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064805 Nov 06 21:19:39.540022 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3721/7551] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:39 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:40.035246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:40.035873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [instance: 9e706ea8-3459-47bc-8f69-cbb47b52240b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:40.043002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:40.043469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:40.045050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:40.045656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:40.059032 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] HTTP exception thrown: Instance 9e706ea8-3459-47bc-8f69-cbb47b52240b could not be found. Nov 06 21:19:40.059710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Returning 404 to user: Instance 9e706ea8-3459-47bc-8f69-cbb47b52240b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:19:40.060648 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-712460bf-d36f-4376-a030-9fbb20851311 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b" status: 404 len: 111 microversion: 2.1 time: 0.029076 Nov 06 21:19:40.061396 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3831/7552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:19:40 2021] GET /compute/v2.1/servers/9e706ea8-3459-47bc-8f69-cbb47b52240b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:19:40.552045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:40.553775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:40.561283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:40.562050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:40.563033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:40.563722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:40.612024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8842fb7c-7c2b-46ce-a230-5f04d575dee3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.064345 Nov 06 21:19:40.616273 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3722/7553] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:40 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:41.625662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:41.629212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:41.642719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:41.644022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:41.645113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:41.645569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:41.705600 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-12f719aa-158b-4dc5-96a6-9bfe299f2313 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.085370 Nov 06 21:19:41.707231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3832/7554] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:41 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:42.727985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:42.729413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:42.748645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:42.749606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:42.752946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:42.753586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:42.850090 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0d178c0b-d29c-41d7-af9a-422ba69616d7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.133931 Nov 06 21:19:42.851759 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3723/7555] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:42 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:43.868624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:43.871186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:43.890622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:43.893746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:43.894889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:43.898917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:43.975700 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcee6457-4318-4175-ab54-75f3f5fdcd5f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.116345 Nov 06 21:19:43.976427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3833/7556] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:43 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:44.517416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8fc718d8-4397-4bef-8bd3-db4cc67be409 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] Calling method '.version_select at 0x7f671414e550>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:19:44.521853 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8fc718d8-4397-4bef-8bd3-db4cc67be409 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:19:44.989390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:44.990414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:45.002691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:45.003447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:45.004525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:45.005397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:45.084673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e44aa88e-35d4-41e0-a829-0a8eb5f12b1d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.099249 Nov 06 21:19:45.089108 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3834/7557] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:44 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:45.546589 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [None req-8fc718d8-4397-4bef-8bd3-db4cc67be409 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57186. Nov 06 21:19:45.572583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8fc718d8-4397-4bef-8bd3-db4cc67be409 tempest-TestNetworkAdvancedServerOps-1024784625 tempest-TestNetworkAdvancedServerOps-1024784625-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1977052409" status: 202 len: 0 microversion: 2.1 time: 1.059600 Nov 06 21:19:45.590605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3724/7558] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Nov 6 21:19:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1977052409 => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:46.097933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:46.099562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:46.108014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:46.108517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:46.109336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:46.109784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:46.157406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65e29068-5c47-4a85-95b1-8809dc274ae7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063668 Nov 06 21:19:46.159502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3835/7559] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:46 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:47.172032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:47.178129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:47.198256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:47.198795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:47.199661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:47.203095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:47.266850 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d34f236-39b5-44c3-96f0-0dbf0aad8fc0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.100221 Nov 06 21:19:47.267565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3725/7560] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:47 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:48.280123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:48.282187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:48.290847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:48.291783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:48.292789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:48.293247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:48.349430 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-107c196a-f6dd-4176-826a-8c8ef7e3028a tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.073725 Nov 06 21:19:48.355659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3836/7561] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:48 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:49.363116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:49.364144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:49.377780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:49.378238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:49.381813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:49.383406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:49.441780 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee73cab9-ad90-4ffb-8348-46a6f67d0326 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.083069 Nov 06 21:19:49.442974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3726/7562] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:49 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:50.454903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:50.456094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:50.471737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:50.472212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:50.473066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:50.473521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:50.547368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-037cd42c-3ae8-4e16-a269-96f2fbebc901 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.097021 Nov 06 21:19:50.551977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3837/7563] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:50 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:51.563257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:51.564280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:51.571873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:51.572280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:51.573121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:51.573565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:51.620731 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2d695ca-cbda-4ced-b791-a598b08f3b49 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.062023 Nov 06 21:19:51.621403 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3727/7564] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:51 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:52.019998 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:19:52.020599 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:19:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:19:52.633575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:52.635117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:52.642042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:52.642498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:52.643298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:52.643740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:52.686573 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51ea3be0-f035-4f1d-bb09-82145136b4c5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056975 Nov 06 21:19:52.687477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3838/7565] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:52 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:53.702052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:53.706239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:53.714986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:53.715603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:53.716664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:53.717329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:53.765348 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-904ee5b6-e1e9-4d9a-8ad7-10491576838b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.070104 Nov 06 21:19:53.766889 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3728/7566] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:53 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:54.778745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:54.780599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:54.789095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:54.789927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:54.790976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:54.791916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:54.837673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aba325c-5098-490a-9f57-062f4e6904e3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.063554 Nov 06 21:19:54.838755 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3839/7567] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:54 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:55.850890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:55.852663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:55.861683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:55.862359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:55.863301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:55.863900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:55.915978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64b146b8-e439-4dc2-b686-8da21d5cc3eb tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.069103 Nov 06 21:19:55.917224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3729/7568] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:55 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:56.929304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:56.930498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:56.938417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:56.939082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:56.939910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:56.940388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:56.986400 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f29d2852-2615-49c2-be81-a5f6117773fc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061030 Nov 06 21:19:56.987307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3840/7569] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:56 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:57.999174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:58.000150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:58.007480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:58.007943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:58.008757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:58.009199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:58.052777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-000353b8-145f-41cb-b2a4-0714107600b0 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058319 Nov 06 21:19:58.057577 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3730/7570] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:57 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:19:59.066328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:19:59.067349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:19:59.075151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:59.075626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:59.076452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:19:59.076903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:19:59.135194 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c66f604-1908-4ef8-9934-ec3e02939188 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.072734 Nov 06 21:19:59.135901 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3841/7571] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:19:59 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:00.147785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:00.148873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:00.157007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:00.157457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:00.158245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:00.158680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:00.209612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a685822-9cf6-48fc-b8fc-060bd253d375 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.066032 Nov 06 21:20:00.210313 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3731/7572] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:00 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:01.223422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:01.224579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:01.232989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:01.233451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:01.234245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:01.234688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:01.280455 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e78adb6-f39c-40fa-9d3c-a08aeb8ab604 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.061187 Nov 06 21:20:01.281125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3842/7573] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:01 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:02.293242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:02.294340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:02.301990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:02.302540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:02.303670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:02.304108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:02.347241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a762107f-c2b9-478d-a375-f2c8b18381f3 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.058248 Nov 06 21:20:02.347903 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3732/7574] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:02 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:03.359317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:03.360358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:03.367534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:03.368002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:03.368832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:03.369283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:03.411390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b5ff3595-38f2-44b8-ba57-75a9dac56bf7 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.056013 Nov 06 21:20:03.412280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3843/7575] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:03 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:04.425269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:04.426201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:04.433634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:04.434602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:04.435392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:04.435840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:04.488019 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e23be38-457a-4b48-9b4c-508d9f0a720d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067102 Nov 06 21:20:04.488722 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3733/7576] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:04 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:05.500509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:05.502707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:05.515535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:05.517886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:05.520747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:05.523312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:05.577001 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7389dbd9-6e99-437a-8d39-bd31777948a6 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.080802 Nov 06 21:20:05.579022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3844/7577] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:05 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:06.591067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:06.592438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:06.599913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:06.600413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:06.601226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:06.601674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:06.647080 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-29e07959-6280-4ab1-9253-0229afd0e80f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.060236 Nov 06 21:20:06.648447 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3734/7578] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:06 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:06.974142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2092676234", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096105306", "security_groups": [{"name": "tempest-secgroup-smoke-1302622068"}], "block_device_mapping_v2": [{"uuid": "16e09b99-d5aa-455d-ba29-b03c9d5e739b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3f7c65e-ecf0-4c1d-974f-85d78dbec967"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:07.094428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] validate_networks() for [('d3f7c65e-ecf0-4c1d-974f-85d78dbec967', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:20:07.601765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:20:07.602640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:20:07.603141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:20:07.603623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:20:07.604050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:20:07.613168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:07.613623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:07.614443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:07.614887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:07.631511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:20:07.637377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Getting quotas for user c4f7bb1f5db14eafbe62a5cbf95040a7 and project 98ca138427bf46a0bff4b6bfbd378ec6. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:20:07.660873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:07.661996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:07.670013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:07.672521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:07.673467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:07.673930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:07.694968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:20:07.697267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16e09b99-d5aa-455d-ba29-b03c9d5e739b',volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:20:07.727418 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a533f84b-55b5-466f-baf3-613f3c264d3c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.071178 Nov 06 21:20:07.728081 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3735/7579] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:07 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:07.830983 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860928 Nov 06 21:20:07.831771 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3845/7580] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:20:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:20:07.844126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b4024c9-0e45-423b-b300-c8c7715082be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:07.844852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b4024c9-0e45-423b-b300-c8c7715082be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:07.914791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b4024c9-0e45-423b-b300-c8c7715082be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:07.925897 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b4024c9-0e45-423b-b300-c8c7715082be tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1095 microversion: 2.1 time: 0.086350 Nov 06 21:20:07.926471 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3736/7581] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:07 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:08.740181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:08.742016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:08.749726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:08.750456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:08.751570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:08.752180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:08.800829 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04a402b4-9ccd-48a2-ad92-ae46b87fce9f tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.065252 Nov 06 21:20:08.805486 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3846/7582] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:08 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:08.943429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:08.944135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:08.951376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:08.952146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:08.953337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:08.953986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:09.063004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:09.072672 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c99a68b-1da6-4b7c-a436-c34a8fb724fc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1211 microversion: 2.1 time: 0.133311 Nov 06 21:20:09.073588 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3737/7583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:08 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:09.819781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:09.820931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:09.831164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:09.831867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:09.832896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:09.833879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:09.898320 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e36194a-0f45-449e-ad83-ee66feb8b9a8 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.087719 Nov 06 21:20:09.899221 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3847/7584] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:09 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:20:10.091053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:10.091637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:10.098676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:10.099142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:10.099948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:10.100418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:10.365121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:10.377555 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e90d77b-fdd8-4000-9263-d4d59ec469b7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.290624 Nov 06 21:20:10.378378 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3738/7585] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:10 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:20:10.528541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-34a5bf8f-1683-49db-8a00-97689d141dd3 req-391c4265-b105-4708-8ade-e6b06321f7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d64b83-a4ff-4951-bbff-68414c17be9a", "tag": "5f788952-1196-4668-9f00-4a5e96918d04"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:10.531985 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:10.531985 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:10.551590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-34a5bf8f-1683-49db-8a00-97689d141dd3 req-391c4265-b105-4708-8ade-e6b06321f7f6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:10.552448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-34a5bf8f-1683-49db-8a00-97689d141dd3 req-391c4265-b105-4708-8ade-e6b06321f7f6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:10.568759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-34a5bf8f-1683-49db-8a00-97689d141dd3 req-391c4265-b105-4708-8ade-e6b06321f7f6 service nova] Creating event network-changed:5f788952-1196-4668-9f00-4a5e96918d04 for instance d5d64b83-a4ff-4951-bbff-68414c17be9a on nch1-master-1 Nov 06 21:20:10.573553 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-34a5bf8f-1683-49db-8a00-97689d141dd3 req-391c4265-b105-4708-8ade-e6b06321f7f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054811 Nov 06 21:20:10.575345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3848/7586] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:10.912598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:10.914793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:10.923803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:10.924639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:10.925683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:10.926327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:10.974979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90a311f7-53c4-4d60-8073-c058ae552e5e tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.067484 Nov 06 21:20:10.975748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3739/7587] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:10 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:11.066203 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:20:11.066733 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:20:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:20:11.398803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:11.399534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:11.405734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:11.407009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:11.407829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:11.408416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:11.638851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:11.646728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-660b351f-7baf-4af2-ac26-bf057e5c50bc tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.253880 Nov 06 21:20:11.647312 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3849/7588] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:11 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:11.988031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:11.989086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:11.996312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:11.996796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:11.997575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:11.998012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.043656 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eda7ec48-33b0-40d5-8078-522486a75556 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action" status: 200 len: 40753 microversion: 2.32 time: 0.059528 Nov 06 21:20:12.044937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3740/7589] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Nov 6 21:20:11 2021] POST /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/action => generated 40753 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:20:12.055749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:12.056648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:12.064639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.065184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.065898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.066466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.274712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:12.284830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:12.286592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:12.287924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-547baf7c-f0fc-4474-8a4b-38ebea69b699 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2947 microversion: 2.32 time: 0.236777 Nov 06 21:20:12.288564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3850/7590] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:20:12 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2947 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:20:12.319959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:12.320611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:12.328431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.329022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.329945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.330389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.468505 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d32bbd8e-f440-4a3a-8c4e-c650e70d0197 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.152636 Nov 06 21:20:12.469153 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3741/7591] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Nov 6 21:20:12 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b/os-interface => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:20:12.664826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:12.665439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:12.672772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.673233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.674022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:12.674466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:12.823445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:12.831817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57aa500e-7701-4404-bd1b-f5e880ea843b tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.171320 Nov 06 21:20:12.832427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3851/7592] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:12 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:13.849570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:13.850193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:13.859130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:13.859713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:13.860599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:13.861240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:14.007777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:14.026599 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-435d9148-d9cd-4ec2-b3d6-323f8d2eb11a tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.180722 Nov 06 21:20:14.027325 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3742/7593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:13 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:15.043646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:15.044315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:15.051156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:15.051620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:15.052461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:15.052924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:15.190136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:15.197641 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e65d077d-e642-4404-873f-cd0a84ff55f7 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.158001 Nov 06 21:20:15.198202 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3852/7594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:15 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:16.214874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:16.215592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:16.222377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:16.222835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:16.223624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:16.224072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:16.357930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:16.365430 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00fc257f-178a-4c7c-ab02-c8987fb38a4d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.154327 Nov 06 21:20:16.366007 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3743/7595] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:16 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:20:17.382360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:17.382983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:17.390271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:17.390735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:17.391534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:17.391989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:17.528341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:17.535569 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5968ab9d-52ce-4d23-ab95-291d4a06aa0d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.156951 Nov 06 21:20:17.536143 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3853/7596] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:17 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:17.838476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-48db135a-3bac-4db9-864f-85f109d9afa7 req-56192aeb-2235-4850-988b-2ea54ca9710a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d64b83-a4ff-4951-bbff-68414c17be9a", "name": "network-vif-plugged", "status": "completed", "tag": "5f788952-1196-4668-9f00-4a5e96918d04"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:17.840068 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:17.840068 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:17.848187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-48db135a-3bac-4db9-864f-85f109d9afa7 req-56192aeb-2235-4850-988b-2ea54ca9710a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:17.848660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-48db135a-3bac-4db9-864f-85f109d9afa7 req-56192aeb-2235-4850-988b-2ea54ca9710a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:17.859916 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-48db135a-3bac-4db9-864f-85f109d9afa7 req-56192aeb-2235-4850-988b-2ea54ca9710a service nova] Creating event network-vif-plugged:5f788952-1196-4668-9f00-4a5e96918d04 for instance d5d64b83-a4ff-4951-bbff-68414c17be9a on nch1-master-1 Nov 06 21:20:17.864878 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-48db135a-3bac-4db9-864f-85f109d9afa7 req-56192aeb-2235-4850-988b-2ea54ca9710a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 Nov 06 21:20:17.865669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3744/7597] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:20:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:18.552761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:18.553383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:18.560817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:18.561280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:18.562392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:18.562842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:18.698977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:18.706522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72a23518-201f-4eaf-98f5-b021eb31dbb6 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1267 microversion: 2.1 time: 0.157730 Nov 06 21:20:18.707092 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3854/7598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:18 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:19.724738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:19.725561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:19.732465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:19.733021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:19.733906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:19.734629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:19.903666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:19.918168 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df0928cb-c04e-4d9c-bc48-f2069fa8f9f8 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1454 microversion: 2.1 time: 0.198284 Nov 06 21:20:19.929929 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3745/7599] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:19 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:19.944788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:19.945735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:20:19.955233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:19.955782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:19.957247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:19.957868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:20.135607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:20:20.144090 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f84bda58-39cc-4f7c-97e5-f3e8ab744156 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1454 microversion: 2.1 time: 0.212103 Nov 06 21:20:20.144945 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3855/7600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:20:19 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:20:21.786545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-42ec030f-5223-487a-8689-1f47985407a1 req-fe16aaa3-6b24-4a10-9bdd-43003c9fc5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d64b83-a4ff-4951-bbff-68414c17be9a", "tag": "5f788952-1196-4668-9f00-4a5e96918d04"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:21.788042 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:21.788042 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:21.796883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42ec030f-5223-487a-8689-1f47985407a1 req-fe16aaa3-6b24-4a10-9bdd-43003c9fc5b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:21.797134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-42ec030f-5223-487a-8689-1f47985407a1 req-fe16aaa3-6b24-4a10-9bdd-43003c9fc5b8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:21.807912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-42ec030f-5223-487a-8689-1f47985407a1 req-fe16aaa3-6b24-4a10-9bdd-43003c9fc5b8 service nova] Creating event network-changed:5f788952-1196-4668-9f00-4a5e96918d04 for instance d5d64b83-a4ff-4951-bbff-68414c17be9a on nch1-master-1 Nov 06 21:20:21.812918 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-42ec030f-5223-487a-8689-1f47985407a1 req-fe16aaa3-6b24-4a10-9bdd-43003c9fc5b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030332 Nov 06 21:20:21.813510 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3746/7601] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:45.802045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9bac5b1-7984-4cbd-a9ae-a5cc1c0af3ba tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2002448758", "availability_zone": "foo_zone"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:45.804741 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:45.804741 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:45.806464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.aggregate [None req-c9bac5b1-7984-4cbd-a9ae-a5cc1c0af3ba tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Generated uuid e496bf88-4fbb-41f3-a91e-563e266df758 for aggregate {{(pid=134827) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 06 21:20:45.845964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9bac5b1-7984-4cbd-a9ae-a5cc1c0af3ba tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.196499 Nov 06 21:20:45.847164 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3856/7602] 10.222.0.13 () {60 vars in 1163 bytes} [Sat Nov 6 21:20:45 2021] POST /compute/v2.1/os-aggregates => generated 209 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:45.863229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9df66256-8ab6-4351-b116-dc70a5e11b5f tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:45.864702 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:45.864702 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:45.890235 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9df66256-8ab6-4351-b116-dc70a5e11b5f tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] [7da6b4b8-18e6-463a-9bfd-71b1f1d3fb39] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:20:46.915016 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [None req-9df66256-8ab6-4351-b116-dc70a5e11b5f tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] [7da6b4b8-18e6-463a-9bfd-71b1f1d3fb39] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58510. Nov 06 21:20:46.923061 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9df66256-8ab6-4351-b116-dc70a5e11b5f tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 1.067532 Nov 06 21:20:46.923953 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3747/7603] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 21:20:45 2021] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:46.935887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:46.937362 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:46.937362 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:46.939033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:46.939536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:46.940450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:46.940935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:46.972699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-498b04d4-32b4-4648-816d-7b9e9e32be9a tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042175 Nov 06 21:20:46.973315 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3857/7604] 10.222.0.13 () {58 vars in 1175 bytes} [Sat Nov 6 21:20:46 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:20:46.984756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32b29b48-e342-493f-b5af-74b2bf90dc99 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:46.985549 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:46.985549 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:46.992996 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32b29b48-e342-493f-b5af-74b2bf90dc99 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013003 Nov 06 21:20:46.993601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3748/7605] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Nov 6 21:20:46 2021] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:20:47.005032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-092c8f67-fd76-4a00-bb73-b490b2c7190b tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:47.006386 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.006386 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:47.016834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-092c8f67-fd76-4a00-bb73-b490b2c7190b tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:47.017296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-092c8f67-fd76-4a00-bb73-b490b2c7190b tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:47.312089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-092c8f67-fd76-4a00-bb73-b490b2c7190b tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.311138 Nov 06 21:20:47.316350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3858/7606] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 21:20:46 2021] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:47.323386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17c48304-b9fb-4cbf-999a-bd3194962002 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:47.324872 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.324872 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:47.338866 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17c48304-b9fb-4cbf-999a-bd3194962002 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.019269 Nov 06 21:20:47.339511 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3749/7607] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:20:47 2021] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:47.350708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2853873c-f9c1-4e0c-8492-d7c370104fb2 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2071189287", "availability_zone": "foo_zone"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:47.352348 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.352348 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:47.401311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2853873c-f9c1-4e0c-8492-d7c370104fb2 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.054684 Nov 06 21:20:47.407951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3859/7608] 10.222.0.13 () {60 vars in 1172 bytes} [Sat Nov 6 21:20:47 2021] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:20:47.413857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1da4e17-bc2f-44de-89cf-329af12fe47c tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:47.415616 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.415616 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:47.444925 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1da4e17-bc2f-44de-89cf-329af12fe47c tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.035081 Nov 06 21:20:47.452337 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3750/7609] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 21:20:47 2021] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:47.459752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58a39c0b-74df-4759-844b-07cb587bc7cb tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:47.460664 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.460664 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:47.472111 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58a39c0b-74df-4759-844b-07cb587bc7cb tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.018465 Nov 06 21:20:47.472761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3860/7610] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Nov 6 21:20:47 2021] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:20:47.484094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d28f40db-0546-4688-a90a-64cc257b4581 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:20:47.486211 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.486211 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:20:47.501332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d28f40db-0546-4688-a90a-64cc257b4581 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:20:47.501802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d28f40db-0546-4688-a90a-64cc257b4581 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:20:47.722495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d28f40db-0546-4688-a90a-64cc257b4581 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.242536 Nov 06 21:20:47.723246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3751/7611] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Nov 6 21:20:47 2021] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:20:47.734103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-efb771a9-2239-4efa-a2f4-78075bc862b6 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:20:47.734911 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:20:47.734911 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:20:47.758461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-efb771a9-2239-4efa-a2f4-78075bc862b6 tempest-TestAggregatesBasicOps-489924553 tempest-TestAggregatesBasicOps-489924553-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.028336 Nov 06 21:20:47.759655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3861/7612] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Nov 6 21:20:47 2021] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 06 21:21:23.410451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Action: 'create', calling method: .version_select at 0x7f671ad281f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1678372078"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:23.431979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for project 5673884ca4974d97b139bf3200b87b43. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:21:23.438556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for user 2b265dc9a43f4bbabed4a948e80f449d and project 5673884ca4974d97b139bf3200b87b43. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:21:23.741530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for project 5673884ca4974d97b139bf3200b87b43. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:21:23.746310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for user 2b265dc9a43f4bbabed4a948e80f449d and project 5673884ca4974d97b139bf3200b87b43. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:21:23.760382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc5dd41d-6af0-4dbc-ad4d-ee184feb3cdb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.355281 Nov 06 21:21:23.760942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3752/7613] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:21:23 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:24.767202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-7786304", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ecc8927f-ce43-4e60-90d6-a786d9aee3e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1678372078", "security_groups": [{"name": "tempest-secgroup-smoke-1515524473"}], "networks": [{"uuid": "ec8261be-0c55-45d8-a956-fd67c266d61a"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:24.874777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] validate_networks() for [('ec8261be-0c55-45d8-a956-fd67c266d61a', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:21:25.235586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:21:25.236033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:21:25.236569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:21:25.236999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:21:25.237431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:21:25.246574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:25.247038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:25.247867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:25.248340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:25.265456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for project 5673884ca4974d97b139bf3200b87b43. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:21:25.270483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Getting quotas for user 2b265dc9a43f4bbabed4a948e80f449d and project 5673884ca4974d97b139bf3200b87b43. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:21:25.325769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:21:25.327928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecc8927f-ce43-4e60-90d6-a786d9aee3e5',volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:21:25.445039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61d2e347-067b-4229-82dd-c7934073f6c7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683391 Nov 06 21:21:25.445678 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3862/7614] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:21:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:21:25.455897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ecafb5c5-a1f1-4d38-8225-dec1e5c227d1 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:25.456668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ecafb5c5-a1f1-4d38-8225-dec1e5c227d1 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:25.509976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ecafb5c5-a1f1-4d38-8225-dec1e5c227d1 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:25.517824 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ecafb5c5-a1f1-4d38-8225-dec1e5c227d1 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1096 microversion: 2.1 time: 0.065605 Nov 06 21:21:25.518490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3753/7615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:25 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1096 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:21:26.536761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:26.538053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:26.548908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:26.550342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:26.551345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:26.552649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:26.624422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:26.632211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f98e0759-ef9f-4da1-a4e6-6d45bfdd818f tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1212 microversion: 2.1 time: 0.101144 Nov 06 21:21:26.633122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3863/7616] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:26 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:27.650091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:27.650786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:27.658285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:27.658777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:27.659565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:27.660005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:27.701795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f61ec43c-2b8a-40ad-ac5f-3199680d92c7 req-9c75b1d4-33dc-40af-8e57-8b3100f4640a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:27.706635 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:21:27.706635 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:21:27.725052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f61ec43c-2b8a-40ad-ac5f-3199680d92c7 req-9c75b1d4-33dc-40af-8e57-8b3100f4640a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:27.725531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f61ec43c-2b8a-40ad-ac5f-3199680d92c7 req-9c75b1d4-33dc-40af-8e57-8b3100f4640a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:27.740147 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f61ec43c-2b8a-40ad-ac5f-3199680d92c7 req-9c75b1d4-33dc-40af-8e57-8b3100f4640a service nova] Creating event network-changed:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:21:27.747490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f61ec43c-2b8a-40ad-ac5f-3199680d92c7 req-9c75b1d4-33dc-40af-8e57-8b3100f4640a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049475 Nov 06 21:21:27.748100 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3864/7617] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:21:27.827993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:27.836535 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52b2b5f0-5743-4f22-8321-391e29fff6a3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.190524 Nov 06 21:21:27.837120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3754/7618] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:27 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:21:28.855845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:28.856515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:28.862978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:28.863452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:28.864258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:28.864745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:29.000019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:29.007425 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20b96cf1-3dc5-48ec-9d6b-14691ec118fb tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.157002 Nov 06 21:21:29.008005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3865/7619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:28 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:30.025788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:30.026556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:30.034176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:30.034638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:30.035524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:30.035903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:30.198863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:30.206163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2f36b21-8dde-4129-a12e-2a3c88502fb6 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.185098 Nov 06 21:21:30.206760 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3755/7620] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:30 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:21:31.223341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:31.223873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:31.230622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:31.231083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:31.231925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:31.232975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:31.364564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:31.371994 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-929e88e6-bd3d-47c3-b908-898a8a4d66a7 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.152466 Nov 06 21:21:31.372612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3866/7621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:31 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:32.388836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:32.389865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:32.397084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:32.397566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:32.398444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:32.398960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:32.555759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:32.564653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-323b04aa-61bc-4da5-8ecf-3ce025d99659 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.179422 Nov 06 21:21:32.565240 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3756/7622] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:32 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:33.581896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:33.582534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:33.589970 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:33.590505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:33.591334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:33.591802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:33.738311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:33.746548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4835aaea-e2ae-467e-aa47-2b08d003dd34 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.168601 Nov 06 21:21:33.747197 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3867/7623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:33 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:34.526170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c57488a2-fb0e-4f83-a286-48cc495df523 req-222cb2a6-27dc-40c7-9fbc-2153a177708a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "name": "network-vif-plugged", "status": "completed", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:34.527983 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:21:34.527983 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:21:34.537832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c57488a2-fb0e-4f83-a286-48cc495df523 req-222cb2a6-27dc-40c7-9fbc-2153a177708a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:34.538282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c57488a2-fb0e-4f83-a286-48cc495df523 req-222cb2a6-27dc-40c7-9fbc-2153a177708a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:34.552123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c57488a2-fb0e-4f83-a286-48cc495df523 req-222cb2a6-27dc-40c7-9fbc-2153a177708a service nova] Creating event network-vif-plugged:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:21:34.558136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c57488a2-fb0e-4f83-a286-48cc495df523 req-222cb2a6-27dc-40c7-9fbc-2153a177708a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Nov 06 21:21:34.558840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3757/7624] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:21:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:21:34.765637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:34.766335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:34.773084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:34.773556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:34.774358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:34.774830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:34.919683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:34.927668 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9a819db-f754-4682-baff-96a8cb646584 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.166445 Nov 06 21:21:34.928314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3868/7625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:34 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:21:35.946970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:35.947662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:35.953946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:35.954399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:35.955181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:35.955613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:36.101287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:36.109244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5eb5605-d2fb-4c86-9768-75e93e335c6b tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1268 microversion: 2.1 time: 0.167100 Nov 06 21:21:36.109820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3758/7626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:35 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:37.126590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:37.127233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:37.134041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:37.134450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:37.135247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:37.135704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:37.265764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:37.273171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a17a830-6d80-4b4d-9c45-3f78a5701fe8 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1457 microversion: 2.1 time: 0.150825 Nov 06 21:21:37.273745 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3869/7627] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:37 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1457 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:37.289379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:21:37.290018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:21:37.297129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:37.297579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:37.298361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:37.298798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:37.431467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:21:37.439441 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a10a38a-8713-4259-81c1-a36567554293 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1457 microversion: 2.1 time: 0.154020 Nov 06 21:21:37.440012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3759/7628] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:21:37 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1457 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:21:39.399609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ecf32fec-38c5-49de-a07d-896d2fc437d6 req-29520b59-b72b-4e5a-b58e-f71c01433f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:39.401139 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:21:39.401139 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:21:39.409168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ecf32fec-38c5-49de-a07d-896d2fc437d6 req-29520b59-b72b-4e5a-b58e-f71c01433f46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:39.409634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ecf32fec-38c5-49de-a07d-896d2fc437d6 req-29520b59-b72b-4e5a-b58e-f71c01433f46 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:39.421692 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ecf32fec-38c5-49de-a07d-896d2fc437d6 req-29520b59-b72b-4e5a-b58e-f71c01433f46 service nova] Creating event network-changed:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:21:39.426846 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ecf32fec-38c5-49de-a07d-896d2fc437d6 req-29520b59-b72b-4e5a-b58e-f71c01433f46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030851 Nov 06 21:21:39.427441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3870/7629] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:21:40.700340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c297583a-dc4e-4822-a886-6ea0ca0d4d23 req-fef8cd28-460c-42fa-b6a1-b964bcd1564a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:40.704930 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:21:40.704930 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:21:40.716080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c297583a-dc4e-4822-a886-6ea0ca0d4d23 req-fef8cd28-460c-42fa-b6a1-b964bcd1564a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:40.716591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c297583a-dc4e-4822-a886-6ea0ca0d4d23 req-fef8cd28-460c-42fa-b6a1-b964bcd1564a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:40.731805 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c297583a-dc4e-4822-a886-6ea0ca0d4d23 req-fef8cd28-460c-42fa-b6a1-b964bcd1564a service nova] Creating event network-changed:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:21:40.736896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c297583a-dc4e-4822-a886-6ea0ca0d4d23 req-fef8cd28-460c-42fa-b6a1-b964bcd1564a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Nov 06 21:21:40.737518 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3760/7630] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:21:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:21:42.753589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1c33f030-66f9-43db-b38b-5fa0d78252e4 req-6fcd4c62-1879-47a7-8bb8-ba12dd6ff34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:21:42.754981 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:21:42.754981 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:21:42.762030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1c33f030-66f9-43db-b38b-5fa0d78252e4 req-6fcd4c62-1879-47a7-8bb8-ba12dd6ff34b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:21:42.762488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1c33f030-66f9-43db-b38b-5fa0d78252e4 req-6fcd4c62-1879-47a7-8bb8-ba12dd6ff34b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:21:42.772844 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1c33f030-66f9-43db-b38b-5fa0d78252e4 req-6fcd4c62-1879-47a7-8bb8-ba12dd6ff34b service nova] Creating event network-changed:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:21:42.777554 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1c33f030-66f9-43db-b38b-5fa0d78252e4 req-6fcd4c62-1879-47a7-8bb8-ba12dd6ff34b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029467 Nov 06 21:21:42.778184 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3871/7631] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:12.288769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:12.290565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:12.293211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e2b6bf68-084e-4d26-b4f7-915a56483cef req-1d62d9a7-d70d-4900-bbd9-2d5f4006077f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d64b83-a4ff-4951-bbff-68414c17be9a", "tag": "5f788952-1196-4668-9f00-4a5e96918d04"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:12.294989 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:12.294989 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:12.298268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:12.299066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:12.299822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:12.300528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:12.309941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2b6bf68-084e-4d26-b4f7-915a56483cef req-1d62d9a7-d70d-4900-bbd9-2d5f4006077f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:12.310542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e2b6bf68-084e-4d26-b4f7-915a56483cef req-1d62d9a7-d70d-4900-bbd9-2d5f4006077f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:12.325383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e2b6bf68-084e-4d26-b4f7-915a56483cef req-1d62d9a7-d70d-4900-bbd9-2d5f4006077f service nova] Creating event network-changed:5f788952-1196-4668-9f00-4a5e96918d04 for instance d5d64b83-a4ff-4951-bbff-68414c17be9a on nch1-master-1 Nov 06 21:22:12.331758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:22:12.331961 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e2b6bf68-084e-4d26-b4f7-915a56483cef req-1d62d9a7-d70d-4900-bbd9-2d5f4006077f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045233 Nov 06 21:22:12.334073 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3872/7632] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:12.441368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-356280a9-8a20-4083-8c8c-bdc7be47067d tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 204 len: 0 microversion: 2.1 time: 0.157309 Nov 06 21:22:12.447599 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3761/7633] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:12 2021] DELETE /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:22:12.454225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:12.455413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:12.463374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:12.464205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:12.465344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:12.466040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:12.855020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:12.864354 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c4281fd-863b-4e27-b2f9-142342ce2a0f tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1579 microversion: 2.1 time: 0.414991 Nov 06 21:22:12.870423 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3873/7634] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:12 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1579 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:22:13.883283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:13.884219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:13.892169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:13.892657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:13.893503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:13.894165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:14.112125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:14.120514 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08a5a5d5-b906-42b8-8443-dc8d71be4230 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1460 microversion: 2.1 time: 0.242289 Nov 06 21:22:14.121091 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3762/7635] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:13 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1460 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:14.621511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c37e1e4e-9032-4306-b7bc-4cb616eb0624 req-089292e4-d984-4d6c-944d-fd280b1f77cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d64b83-a4ff-4951-bbff-68414c17be9a", "name": "network-vif-deleted", "tag": "5f788952-1196-4668-9f00-4a5e96918d04"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:14.623240 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:14.623240 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:14.635413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c37e1e4e-9032-4306-b7bc-4cb616eb0624 req-089292e4-d984-4d6c-944d-fd280b1f77cf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:14.636132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c37e1e4e-9032-4306-b7bc-4cb616eb0624 req-089292e4-d984-4d6c-944d-fd280b1f77cf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:14.650287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c37e1e4e-9032-4306-b7bc-4cb616eb0624 req-089292e4-d984-4d6c-944d-fd280b1f77cf service nova] Creating event network-vif-deleted:5f788952-1196-4668-9f00-4a5e96918d04 for instance d5d64b83-a4ff-4951-bbff-68414c17be9a on nch1-master-1 Nov 06 21:22:14.655476 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c37e1e4e-9032-4306-b7bc-4cb616eb0624 req-089292e4-d984-4d6c-944d-fd280b1f77cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037955 Nov 06 21:22:14.656058 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3874/7636] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:15.138405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:15.139015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:15.146100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.146584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.147436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.147879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.180921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.181379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.181893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lazy-loading 'fault' on Instance uuid d5d64b83-a4ff-4951-bbff-68414c17be9a {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:22:15.224823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:15.231662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c25cf25-3267-4549-8265-3f2f09a3a854 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 200 len: 1185 microversion: 2.1 time: 0.097206 Nov 06 21:22:15.232228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3763/7637] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:15 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:15.860148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:15.860800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:15.867869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.868348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.869143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.869592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.895754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:22:15.971431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbd70a98-cd89-490c-898d-e0a998f90a6c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 204 len: 0 microversion: 2.32 time: 0.115290 Nov 06 21:22:15.972016 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3875/7638] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 21:22:15 2021] DELETE /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:22:15.980243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:15.980967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:15.986672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.987123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:15.987906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:15.988420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:16.180864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:16.189970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:16.192067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:16.193347 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7bde84f8-72ba-4884-8409-2ec8eb6c6071 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2953 microversion: 2.32 time: 0.217096 Nov 06 21:22:16.193920 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3764/7639] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:15 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2953 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:22:16.249555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:16.250264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: d5d64b83-a4ff-4951-bbff-68414c17be9a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:16.256715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:16.257178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:16.257966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:16.258407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:16.271373 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance d5d64b83-a4ff-4951-bbff-68414c17be9a could not be found. Nov 06 21:22:16.271960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance d5d64b83-a4ff-4951-bbff-68414c17be9a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:16.272806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7317ed0d-a1ff-405a-bcc4-0a5b0c9826ec tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a" status: 404 len: 111 microversion: 2.1 time: 0.027323 Nov 06 21:22:16.273314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3876/7640] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:16 2021] GET /compute/v2.1/servers/d5d64b83-a4ff-4951-bbff-68414c17be9a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:17.213618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:17.214233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:17.220890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:17.221340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:17.222130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:17.223167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:17.433917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:17.443722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:17.445282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:17.446565 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31bb8b5e-f795-4fae-a30e-e56c7fe63c1b tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2953 microversion: 2.32 time: 0.236642 Nov 06 21:22:17.447159 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3765/7641] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:17 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2953 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:18.465636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:18.466429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:18.473743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:18.474288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:18.475179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:18.475701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:18.667033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:18.688776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:18.690302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:18.691561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c081d0a8-3e09-4bdd-9de6-30d802c2e1b1 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2932 microversion: 2.32 time: 0.229687 Nov 06 21:22:18.692115 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3877/7642] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:18 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2932 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 06 21:22:19.131986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cd590f42-8b10-4ec3-8531-d27a59ada5bf req-9160f261-d12c-45e9-86e8-31d58acee1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-deleted", "tag": "c1811b60-ace5-4089-a26b-30b8d0069c32"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:19.134130 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:19.134130 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:19.142631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cd590f42-8b10-4ec3-8531-d27a59ada5bf req-9160f261-d12c-45e9-86e8-31d58acee1d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:19.143149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cd590f42-8b10-4ec3-8531-d27a59ada5bf req-9160f261-d12c-45e9-86e8-31d58acee1d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:19.155217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cd590f42-8b10-4ec3-8531-d27a59ada5bf req-9160f261-d12c-45e9-86e8-31d58acee1d6 service nova] Creating event network-vif-deleted:c1811b60-ace5-4089-a26b-30b8d0069c32 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:19.161199 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cd590f42-8b10-4ec3-8531-d27a59ada5bf req-9160f261-d12c-45e9-86e8-31d58acee1d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033920 Nov 06 21:22:19.162090 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3766/7643] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:19.711611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:19.712566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:19.719480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:19.720030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:19.720947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:19.721471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:19.896918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:19.907800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:19.910736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:19.912206 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3969e6f-eff4-4912-979f-ff7aa7328eba tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2705 microversion: 2.32 time: 0.204460 Nov 06 21:22:19.912804 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3878/7644] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:19 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2705 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:20.833747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d186a60b-aa9a-491e-98eb-2f12b3ad5e1d req-e6731024-ffad-48f5-b2fc-fcbb1d9935e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f331138-9e82-4582-82e6-5987fc8432ec"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:20.835901 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:20.835901 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:20.846546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d186a60b-aa9a-491e-98eb-2f12b3ad5e1d req-e6731024-ffad-48f5-b2fc-fcbb1d9935e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:20.847222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d186a60b-aa9a-491e-98eb-2f12b3ad5e1d req-e6731024-ffad-48f5-b2fc-fcbb1d9935e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:20.870616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d186a60b-aa9a-491e-98eb-2f12b3ad5e1d req-e6731024-ffad-48f5-b2fc-fcbb1d9935e3 service nova] Creating event network-vif-unplugged:5f331138-9e82-4582-82e6-5987fc8432ec for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:20.879510 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d186a60b-aa9a-491e-98eb-2f12b3ad5e1d req-e6731024-ffad-48f5-b2fc-fcbb1d9935e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050281 Nov 06 21:22:20.881855 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3767/7645] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:20.938286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:20.939909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:20.953065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:20.956704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:20.964490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:20.965203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:21.219553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-deleted", "tag": "89e5b536-ea65-4af4-a7d6-a983f8c270b9"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-deleted", "tag": "f7d05032-4b91-4c3e-8527-9398846f0081"}, {"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-deleted", "tag": "caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:21.223141 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:21.223141 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:21.244846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:21.245502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:21.259293 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Creating event network-vif-deleted:89e5b536-ea65-4af4-a7d6-a983f8c270b9 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:21.260021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Creating event network-vif-deleted:f7d05032-4b91-4c3e-8527-9398846f0081 for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:21.261231 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] Creating event network-vif-deleted:caa6e353-c53c-43ca-ad7a-fbcc1bc3bf5a for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:21.269748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-896ab714-5599-47c6-b412-02d55852cafe req-c638a34c-02b0-499a-af20-775048ec4553 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055174 Nov 06 21:22:21.270972 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3768/7646] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:21.383502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:21.397341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:21.400363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:21.402606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77b4a6b8-d0b8-47d0-93fa-8fc2cc83fc84 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 2613 microversion: 2.32 time: 0.473867 Nov 06 21:22:21.405097 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3879/7647] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:20 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 2613 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:22.298764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-439b8a6a-599f-44af-b830-5fc06c47a3f8 req-fd715c73-7ea2-46ea-a9a3-e18fb987d8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:22.300978 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:22.300978 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:22.305168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:22.305766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:22.317616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.318098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.318486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-439b8a6a-599f-44af-b830-5fc06c47a3f8 req-fd715c73-7ea2-46ea-a9a3-e18fb987d8f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.319263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-439b8a6a-599f-44af-b830-5fc06c47a3f8 req-fd715c73-7ea2-46ea-a9a3-e18fb987d8f5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.320170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.320682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.335158 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-439b8a6a-599f-44af-b830-5fc06c47a3f8 req-fd715c73-7ea2-46ea-a9a3-e18fb987d8f5 service nova] Creating event network-changed:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:22:22.340911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-439b8a6a-599f-44af-b830-5fc06c47a3f8 req-fd715c73-7ea2-46ea-a9a3-e18fb987d8f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047676 Nov 06 21:22:22.345345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3880/7648] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:22.352373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:22:22.428694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:22.430027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:22.439215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.440162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.442103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.443233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.498023 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c83b47ca-7ab9-4617-8c75-32a1585280ee tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 204 len: 0 microversion: 2.1 time: 0.206288 Nov 06 21:22:22.501385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3769/7649] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:22 2021] DELETE /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:22:22.512985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.513844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.514375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lazy-loading 'fault' on Instance uuid 0e49eff2-a230-4882-9861-ee8b7963820b {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:22:22.520873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:22.523357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:22.532125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.532902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.534362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:22.535713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:22.642852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:22.653212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:22.656709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba94a4d3b5f43c1991b1c155b3c2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2091e07dbaca4b439d38b56488c3048f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:22.657936 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcc009f3-ad60-4e6c-99e3-0646a265933d tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 200 len: 1371 microversion: 2.32 time: 0.236397 Nov 06 21:22:22.664910 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3881/7650] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:22 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:22.778428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:22.788460 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c84bfda-7034-431e-85e2-3509e1404693 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1580 microversion: 2.1 time: 0.281351 Nov 06 21:22:22.800122 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3770/7651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:22 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1580 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:23.294600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d85f0e56-0701-43a5-af78-7949ca94126c req-71ce5ff5-dbce-43d9-9a63-915536e0499e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e49eff2-a230-4882-9861-ee8b7963820b", "name": "network-vif-deleted", "tag": "5f331138-9e82-4582-82e6-5987fc8432ec"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:23.296569 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:23.296569 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:23.306328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d85f0e56-0701-43a5-af78-7949ca94126c req-71ce5ff5-dbce-43d9-9a63-915536e0499e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:23.307042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d85f0e56-0701-43a5-af78-7949ca94126c req-71ce5ff5-dbce-43d9-9a63-915536e0499e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:23.320282 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d85f0e56-0701-43a5-af78-7949ca94126c req-71ce5ff5-dbce-43d9-9a63-915536e0499e service nova] Creating event network-vif-deleted:5f331138-9e82-4582-82e6-5987fc8432ec for instance 0e49eff2-a230-4882-9861-ee8b7963820b on nch2-master-1 Nov 06 21:22:23.326708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d85f0e56-0701-43a5-af78-7949ca94126c req-71ce5ff5-dbce-43d9-9a63-915536e0499e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036996 Nov 06 21:22:23.327793 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3882/7652] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:23.680550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:23.681177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:23.687675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:23.688123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:23.689037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:23.689411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:23.702913 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] HTTP exception thrown: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. Nov 06 21:22:23.703548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Returning 404 to user: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:23.704403 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aee51cff-f9df-402c-b287-24fe1f15ddb4 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 404 len: 111 microversion: 2.32 time: 0.027467 Nov 06 21:22:23.704932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3771/7653] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:23 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:22:23.714070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-617cf4f8-1339-402e-a939-e9546dea4fd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '.version_select at 0x7f6714045dc0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:23.732680 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-617cf4f8-1339-402e-a939-e9546dea4fd5 tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482404392" status: 204 len: 0 microversion: 2.32 time: 0.022507 Nov 06 21:22:23.733264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3883/7654] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Nov 6 21:22:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482404392 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 06 21:22:23.806926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:23.807546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:23.813561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:23.814040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:23.814837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:23.815513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:23.980392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:23.988585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39ce528a-64b0-45d5-a87f-c9a85b6bcb99 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1463 microversion: 2.1 time: 0.185254 Nov 06 21:22:23.989165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3772/7655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:23 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1463 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:25.005244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:25.006019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:25.014685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:25.015153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:25.016118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:25.016740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:25.051410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:25.052163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:25.052880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lazy-loading 'fault' on Instance uuid e7b22806-2655-41b7-b23c-8b74856ab89d {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:22:25.127046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b265dc9a43f4bbabed4a948e80f449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5673884ca4974d97b139bf3200b87b43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:25.135352 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-977421b8-3cda-4c95-8b09-bdc513075ea5 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 200 len: 1232 microversion: 2.1 time: 0.133676 Nov 06 21:22:25.136019 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3884/7656] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:25 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 1232 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:25.342600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-fef66af1-2af2-42fa-b570-f06317be4dd7 req-ff550ac0-1aae-43e4-8188-eae901f615f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b22806-2655-41b7-b23c-8b74856ab89d", "name": "network-vif-deleted", "tag": "f7e8b01a-a1d8-46e6-a436-e608a8aa3f73"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:25.344401 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:25.344401 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:25.353949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fef66af1-2af2-42fa-b570-f06317be4dd7 req-ff550ac0-1aae-43e4-8188-eae901f615f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:25.354740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fef66af1-2af2-42fa-b570-f06317be4dd7 req-ff550ac0-1aae-43e4-8188-eae901f615f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:25.367702 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fef66af1-2af2-42fa-b570-f06317be4dd7 req-ff550ac0-1aae-43e4-8188-eae901f615f7 service nova] Creating event network-vif-deleted:f7e8b01a-a1d8-46e6-a436-e608a8aa3f73 for instance e7b22806-2655-41b7-b23c-8b74856ab89d on nch2-master-1 Nov 06 21:22:25.373543 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-fef66af1-2af2-42fa-b570-f06317be4dd7 req-ff550ac0-1aae-43e4-8188-eae901f615f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035131 Nov 06 21:22:25.374224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3773/7657] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:26.153654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:26.155120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] [instance: e7b22806-2655-41b7-b23c-8b74856ab89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:26.162301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:26.163043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:26.164232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:26.164821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:26.187149 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] HTTP exception thrown: Instance e7b22806-2655-41b7-b23c-8b74856ab89d could not be found. Nov 06 21:22:26.187947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Returning 404 to user: Instance e7b22806-2655-41b7-b23c-8b74856ab89d could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:26.189010 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-202a65ac-3b2d-4a55-877c-086a444ab8d3 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d" status: 404 len: 111 microversion: 2.1 time: 0.039632 Nov 06 21:22:26.195480 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3885/7658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:26 2021] GET /compute/v2.1/servers/e7b22806-2655-41b7-b23c-8b74856ab89d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:26.385988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94acbb72-220d-40a4-a18b-34438d966085 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] Calling method '.version_select at 0x7f6714c090d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:26.412195 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94acbb72-220d-40a4-a18b-34438d966085 tempest-TestVolumeBackupRestore-1683798703 tempest-TestVolumeBackupRestore-1683798703-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1678372078" status: 202 len: 0 microversion: 2.1 time: 0.030266 Nov 06 21:22:26.414792 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3774/7659] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 21:22:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1678372078 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:22:27.653865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:27.654393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:27.661399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:27.661858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:27.662646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:27.663089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:27.676726 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] HTTP exception thrown: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. Nov 06 21:22:27.677320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Returning 404 to user: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:27.678141 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aeacaa17-9a7d-4022-9a44-12746f43797c tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 404 len: 111 microversion: 2.1 time: 0.028069 Nov 06 21:22:27.678655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3886/7660] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:27 2021] DELETE /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:27.686529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:27.687276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] [instance: 0e49eff2-a230-4882-9861-ee8b7963820b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:27.695503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:27.696032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:27.696859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:27.697306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:27.710172 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] HTTP exception thrown: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. Nov 06 21:22:27.710768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] Returning 404 to user: Instance 0e49eff2-a230-4882-9861-ee8b7963820b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:27.711594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f101d8f-a0ab-473e-b93c-2022143dd4cc tempest-TaggedBootDevicesTest-1306124712 tempest-TaggedBootDevicesTest-1306124712-project] 10.222.0.13 "GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b" status: 404 len: 111 microversion: 2.1 time: 0.028862 Nov 06 21:22:27.712117 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3775/7661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:27 2021] GET /compute/v2.1/servers/0e49eff2-a230-4882-9861-ee8b7963820b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:39.130102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-801302000", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "83b9df86-5427-4633-8d25-33ebc9d62d6b"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:39.188117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] validate_networks() for [('83b9df86-5427-4633-8d25-33ebc9d62d6b', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:22:39.546861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:22:39.547319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:22:39.547828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:22:39.548247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:22:39.548697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:22:39.557765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:39.558220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:39.559029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:39.559471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:39.575993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Getting quotas for project 85dc06b0604c4693b83bb030dd6af32f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:22:39.580984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Getting quotas for user 44d004b9ba1843e48df560403efd127c and project 85dc06b0604c4693b83bb030dd6af32f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:22:39.592512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:22:39.594798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:22:39.638563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-936cd280-341d-45d4-9dae-4b34874304e7 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.770342 Nov 06 21:22:39.639167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3887/7662] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Nov 6 21:22:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 06 21:22:39.649129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:39.649741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:39.704514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:39.711520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:39.713083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:39.714242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db7b5e4f-1d5e-4ac3-9e11-fb1e8f7cce1a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1258 microversion: 2.21 time: 0.068818 Nov 06 21:22:39.714735 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3776/7663] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:39 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:40.733006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:40.733627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:40.740310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:40.740791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:40.741591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:40.742048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:40.799765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:40.807472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:40.809033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:40.810146 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-567fa809-dabc-43d8-96e7-5508464cf09a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1262 microversion: 2.21 time: 0.081782 Nov 06 21:22:40.810712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3888/7664] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:40 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:41.828634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:41.829278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:41.839450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:41.839918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:41.840855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:41.841277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:41.907008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:41.915847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:41.917403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:41.918530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5bb6badd-d33e-4a83-b390-bb1920e36414 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1316 microversion: 2.21 time: 0.093729 Nov 06 21:22:41.919100 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3777/7665] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:41 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1316 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:42.782719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c2b147ab-9800-4f14-aea1-6817d1549c72 req-16024295-a55b-4f1c-8a3c-af2a212282e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4", "tag": "e7e082eb-2ed2-4e8d-ad7e-a8758617bb49"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:42.785374 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:42.785374 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:42.794326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c2b147ab-9800-4f14-aea1-6817d1549c72 req-16024295-a55b-4f1c-8a3c-af2a212282e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:42.794945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c2b147ab-9800-4f14-aea1-6817d1549c72 req-16024295-a55b-4f1c-8a3c-af2a212282e3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:42.810235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c2b147ab-9800-4f14-aea1-6817d1549c72 req-16024295-a55b-4f1c-8a3c-af2a212282e3 service nova] Creating event network-changed:e7e082eb-2ed2-4e8d-ad7e-a8758617bb49 for instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 on nch2-master-1 Nov 06 21:22:42.815669 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c2b147ab-9800-4f14-aea1-6817d1549c72 req-16024295-a55b-4f1c-8a3c-af2a212282e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037577 Nov 06 21:22:42.816501 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3889/7666] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:42.936678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:42.937292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:42.944555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:42.945023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:42.945827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:42.946270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:43.100309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:43.108639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:43.110134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:43.111250 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2103c90-0b70-417c-b7c1-0dfe1e0ae22b tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.178463 Nov 06 21:22:43.111811 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3778/7667] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:42 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:44.131050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:44.131673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:44.138539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:44.138998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:44.139802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:44.140228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:44.270687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:44.278573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:44.280216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:44.281378 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54124a7c-23dc-465c-b4e1-6b2129c6164c tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.155109 Nov 06 21:22:44.281944 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3890/7668] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:44 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:45.300048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:45.300684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:45.307324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:45.307784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:45.308604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:45.309045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:45.441152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:45.448877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:45.450384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:45.451490 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3d1f4ce-35a3-46cd-8257-2bc3fecaa1f3 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.155347 Nov 06 21:22:45.452049 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3779/7669] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:45 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:46.468271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:46.468934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:46.476265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:46.476760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:46.477541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:46.477989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:46.608180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:46.616224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:46.617874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:46.619034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-870095b3-c615-4b5a-a626-fc49e5f8d2d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.154523 Nov 06 21:22:46.619784 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3891/7670] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:46 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:47.637955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:47.638589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:47.646302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:47.646758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:47.647544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:47.648010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:47.785310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:47.793146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:47.794645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:47.795731 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c26faf5c-5911-4094-a911-8bab0d02fc22 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.162155 Nov 06 21:22:47.796312 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3780/7671] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:47 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:48.808664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-f18b9e3f-7829-4186-8ef8-0595c53ee85d req-f71dbf42-69ef-4a2b-aed6-6b8f81e6ca65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4", "name": "network-vif-plugged", "status": "completed", "tag": "e7e082eb-2ed2-4e8d-ad7e-a8758617bb49"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:48.811292 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:48.811292 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:48.817608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:48.818822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:48.822009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f18b9e3f-7829-4186-8ef8-0595c53ee85d req-f71dbf42-69ef-4a2b-aed6-6b8f81e6ca65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:48.822711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-f18b9e3f-7829-4186-8ef8-0595c53ee85d req-f71dbf42-69ef-4a2b-aed6-6b8f81e6ca65 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:48.828245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:48.829193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:48.830098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:48.831281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:48.839610 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-f18b9e3f-7829-4186-8ef8-0595c53ee85d req-f71dbf42-69ef-4a2b-aed6-6b8f81e6ca65 service nova] Creating event network-vif-plugged:e7e082eb-2ed2-4e8d-ad7e-a8758617bb49 for instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 on nch2-master-1 Nov 06 21:22:48.849286 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-f18b9e3f-7829-4186-8ef8-0595c53ee85d req-f71dbf42-69ef-4a2b-aed6-6b8f81e6ca65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044108 Nov 06 21:22:48.850349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3892/7672] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:49.366837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:49.374816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:49.376474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:49.378565 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f79ff28-d4ab-49f2-beb0-1d17834371f2 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1358 microversion: 2.21 time: 0.566753 Nov 06 21:22:49.379315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3781/7673] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:48 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1358 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:49.581251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:49.581836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:49.583089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-59ec248b-cff4-4e3d-aa48-281c5cae5a6e req-5c00baf1-c1a4-4f48-b331-96435faca436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fc8d98-0232-495c-b045-c07a8a328d7a", "tag": "6c24608c-1640-4444-9edd-a9836259cfab"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:49.584904 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:49.584904 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:49.588224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:49.588733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:49.589514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:49.589954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:49.591694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59ec248b-cff4-4e3d-aa48-281c5cae5a6e req-5c00baf1-c1a4-4f48-b331-96435faca436 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:49.592350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59ec248b-cff4-4e3d-aa48-281c5cae5a6e req-5c00baf1-c1a4-4f48-b331-96435faca436 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:49.603686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-59ec248b-cff4-4e3d-aa48-281c5cae5a6e req-5c00baf1-c1a4-4f48-b331-96435faca436 service nova] Creating event network-changed:6c24608c-1640-4444-9edd-a9836259cfab for instance 55fc8d98-0232-495c-b045-c07a8a328d7a on nch1-master-1 Nov 06 21:22:49.608867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-59ec248b-cff4-4e3d-aa48-281c5cae5a6e req-5c00baf1-c1a4-4f48-b331-96435faca436 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029276 Nov 06 21:22:49.610124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3782/7674] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:22:49.616982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:22:49.714800 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 204 len: 0 microversion: 2.1 time: 0.137316 Nov 06 21:22:49.715594 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3893/7675] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:49 2021] DELETE /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:22:49.726970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:49.727675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:49.734099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:49.734889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:49.735344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:49.735781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:49.960631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:49.968621 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-52536624-e3ad-4478-8f5b-8bdde6a92836 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1579 microversion: 2.1 time: 0.247164 Nov 06 21:22:49.969186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3783/7676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:49 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1579 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:50.400787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:50.401433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:50.408206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.408706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.409513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.409966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.557989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.570826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.572476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.573655 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47a11fea-b7c7-4a60-b03c-ab899230e078 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1550 microversion: 2.21 time: 0.177215 Nov 06 21:22:50.574442 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3894/7677] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:50 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:50.591105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:50.591610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:50.598370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.598831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.599624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.600072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.625761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:22:50.701154 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88033fab-fdf7-4215-9ec3-aa887362a8d6 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "DELETE /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 204 len: 0 microversion: 2.21 time: 0.113434 Nov 06 21:22:50.701876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3784/7678] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Nov 6 21:22:50 2021] DELETE /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 06 21:22:50.710328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:50.710987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:50.716844 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.717309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.718104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.718554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.847786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.857742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.859265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:50.860498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a672d613-2c85-4a1c-b0a3-30e7981782d0 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1556 microversion: 2.21 time: 0.153883 Nov 06 21:22:50.870017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3895/7679] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:50 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:50.987441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:50.988053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:50.994843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.995298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:50.996088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:50.996569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:51.128820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:51.136153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92dbd2e5-f6e8-4593-a0c0-3a1df915ed01 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1460 microversion: 2.1 time: 0.152911 Nov 06 21:22:51.136936 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3785/7680] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:50 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:51.778051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-143b26b7-7f68-4fe4-a3ef-045ca1c707f6 req-a71f935b-f44c-49af-9f57-14f36a2b96a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fc8d98-0232-495c-b045-c07a8a328d7a", "name": "network-vif-deleted", "tag": "6c24608c-1640-4444-9edd-a9836259cfab"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:51.779879 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:51.779879 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:51.791455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-143b26b7-7f68-4fe4-a3ef-045ca1c707f6 req-a71f935b-f44c-49af-9f57-14f36a2b96a1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:51.792068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-143b26b7-7f68-4fe4-a3ef-045ca1c707f6 req-a71f935b-f44c-49af-9f57-14f36a2b96a1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:51.803643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-143b26b7-7f68-4fe4-a3ef-045ca1c707f6 req-a71f935b-f44c-49af-9f57-14f36a2b96a1 service nova] Creating event network-vif-deleted:6c24608c-1640-4444-9edd-a9836259cfab for instance 55fc8d98-0232-495c-b045-c07a8a328d7a on nch1-master-1 Nov 06 21:22:51.808527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-143b26b7-7f68-4fe4-a3ef-045ca1c707f6 req-a71f935b-f44c-49af-9f57-14f36a2b96a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034940 Nov 06 21:22:51.809105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3896/7681] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:22:51.879966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:51.880274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:51.887132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:51.887593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:51.888467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:51.889098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:52.034715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:52.043710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:52.045377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44d004b9ba1843e48df560403efd127c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dc06b0604c4693b83bb030dd6af32f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:52.046631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbfb73c2-7502-4b25-b6ad-c571863f872a tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 200 len: 1556 microversion: 2.21 time: 0.171383 Nov 06 21:22:52.047567 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3786/7682] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:51 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 06 21:22:52.154501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:52.155304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:52.164735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:52.165503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:52.166507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:52.167039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:52.202293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:52.203027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:52.203569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lazy-loading 'fault' on Instance uuid 55fc8d98-0232-495c-b045-c07a8a328d7a {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:22:52.246448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7bb1f5db14eafbe62a5cbf95040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca138427bf46a0bff4b6bfbd378ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:52.255259 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e813a851-9401-4856-879a-4a178c66910e tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 200 len: 1230 microversion: 2.1 time: 0.104793 Nov 06 21:22:52.255840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3897/7683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:52 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:52.536122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2e4d7c0e-b508-4d7c-b800-df0bd74a63c0 req-6440a8d0-1a43-4a84-98a0-f90affde40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4", "name": "network-vif-deleted", "tag": "e7e082eb-2ed2-4e8d-ad7e-a8758617bb49"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:52.537736 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:52.537736 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:22:52.545242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2e4d7c0e-b508-4d7c-b800-df0bd74a63c0 req-6440a8d0-1a43-4a84-98a0-f90affde40d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:52.545697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2e4d7c0e-b508-4d7c-b800-df0bd74a63c0 req-6440a8d0-1a43-4a84-98a0-f90affde40d1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:52.558085 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2e4d7c0e-b508-4d7c-b800-df0bd74a63c0 req-6440a8d0-1a43-4a84-98a0-f90affde40d1 service nova] Creating event network-vif-deleted:e7e082eb-2ed2-4e8d-ad7e-a8758617bb49 for instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 on nch2-master-1 Nov 06 21:22:52.563022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2e4d7c0e-b508-4d7c-b800-df0bd74a63c0 req-6440a8d0-1a43-4a84-98a0-f90affde40d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Nov 06 21:22:52.563620 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3787/7684] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:22:53.065467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.066088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.072804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.073294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.074072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.074512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.088075 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] HTTP exception thrown: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. Nov 06 21:22:53.088719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Returning 404 to user: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:53.089534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-910bdbfb-c77d-4a00-b69a-2b5124c95109 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 404 len: 111 microversion: 2.21 time: 0.027976 Nov 06 21:22:53.090041 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3898/7685] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Nov 6 21:22:53 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:22:53.100074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '.version_select at 0x7f6714c02dc0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.100815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.106943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.107426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.108211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.108683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.175410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d29b3c80-3575-491d-a3d5-0c1b4b6bf662 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.080883 Nov 06 21:22:53.175884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3788/7686] 10.222.0.13 () {60 vars in 1336 bytes} [Sat Nov 6 21:22:53 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4/os-instance-actions => generated 611 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:22:53.187256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.187795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.194204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.194670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.195464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.195911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.209380 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] HTTP exception thrown: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. Nov 06 21:22:53.209969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Returning 404 to user: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:53.210787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3800314-83da-42f9-a81c-20754964bae9 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "DELETE /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 404 len: 111 microversion: 2.1 time: 0.027177 Nov 06 21:22:53.211297 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3899/7687] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:53 2021] DELETE /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:53.218767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.219389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] [instance: 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.225169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.225627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.226407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.226849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.241627 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] HTTP exception thrown: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. Nov 06 21:22:53.242236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] Returning 404 to user: Instance 45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:53.243151 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5cdcd46e-cc2e-4afa-939e-b795042049d4 tempest-InstanceActionsV221TestJSON-771034143 tempest-InstanceActionsV221TestJSON-771034143-project] 10.222.0.13 "GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4" status: 404 len: 111 microversion: 2.1 time: 0.027933 Nov 06 21:22:53.243896 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3789/7688] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:53 2021] GET /compute/v2.1/servers/45dcc9ed-a794-4d53-9c8f-35cd4bfba5e4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:53.272671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.273298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: 55fc8d98-0232-495c-b045-c07a8a328d7a] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.279250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.279717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.280537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.280990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.294956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance 55fc8d98-0232-495c-b045-c07a8a328d7a could not be found. Nov 06 21:22:53.295573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance 55fc8d98-0232-495c-b045-c07a8a328d7a could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:53.296550 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27999ed9-738b-48fb-9de8-91eda9357078 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a" status: 404 len: 111 microversion: 2.1 time: 0.028233 Nov 06 21:22:53.300575 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3900/7689] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:53 2021] GET /compute/v2.1/servers/55fc8d98-0232-495c-b045-c07a8a328d7a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:53.985170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:53.985671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:53.992033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.992524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:53.993306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:53.993745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:54.011024 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. Nov 06 21:22:54.011702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:54.012796 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6539684e-9110-432d-99c8-0ac3fb40eed2 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 404 len: 111 microversion: 2.1 time: 0.031201 Nov 06 21:22:54.013418 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3790/7690] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:22:53 2021] DELETE /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:54.021771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:54.022674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] [instance: e65f8275-232c-4352-b2dc-d80a46ce45e8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:54.029742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:54.030221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:54.031035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:54.031493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:54.045538 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] HTTP exception thrown: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. Nov 06 21:22:54.046181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Returning 404 to user: Instance e65f8275-232c-4352-b2dc-d80a46ce45e8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:22:54.047026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-adcfbc62-3c07-43cb-9ca6-6b576af2dd18 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8" status: 404 len: 111 microversion: 2.1 time: 0.029249 Nov 06 21:22:54.047567 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3901/7691] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:54 2021] GET /compute/v2.1/servers/e65f8275-232c-4352-b2dc-d80a46ce45e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:22:55.355159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa8464f7-f740-4819-a2a1-4e2d9b35e7e9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] Calling method '.version_select at 0x7f671524b9d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:55.385692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa8464f7-f740-4819-a2a1-4e2d9b35e7e9 tempest-TestVolumeBootPattern-1370352342 tempest-TestVolumeBootPattern-1370352342-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096105306" status: 202 len: 0 microversion: 2.1 time: 0.034084 Nov 06 21:22:55.389969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3791/7692] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Nov 6 21:22:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096105306 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:22:55.995171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-488121893", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "0d761397-e682-422e-af85-a93032aefb10"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:56.046767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] validate_networks() for [('0d761397-e682-422e-af85-a93032aefb10', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:22:56.597469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:22:56.598518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:22:56.599009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:22:56.599435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:22:56.599859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:22:56.608578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:56.609042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:56.609863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:56.610372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:56.626435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Getting quotas for project cb686062472f4c988aa8ac1ef80ce3d2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:22:56.631476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Getting quotas for user eb51983f7a534f8f90231b501182c48e and project cb686062472f4c988aa8ac1ef80ce3d2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:22:56.643343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:22:56.646310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:22:56.691943 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-accbda53-4c48-447a-8b01-8ee079c31f19 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826734 Nov 06 21:22:56.692637 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3902/7693] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:22:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:22:56.703541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b71ad442-2fe8-424f-ab24-8c4921afbf04 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:56.704355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b71ad442-2fe8-424f-ab24-8c4921afbf04 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:56.775302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b71ad442-2fe8-424f-ab24-8c4921afbf04 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:56.782162 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b71ad442-2fe8-424f-ab24-8c4921afbf04 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1224 microversion: 2.1 time: 0.083315 Nov 06 21:22:56.783938 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3792/7694] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:56 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:22:57.802325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:57.803040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:57.811434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:57.812071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:57.813083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:57.814023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:57.934349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:57.942527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8f76f27-9f2d-4dea-a13c-ef79606878b0 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1282 microversion: 2.1 time: 0.145241 Nov 06 21:22:57.943495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3903/7695] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:57 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:58.960256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:22:58.961804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:22:58.976749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:58.977645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:58.978738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:58.979400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:59.266882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:22:59.293332 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbffad72-45c7-4832-8205-0533359fa20c tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.336687 Nov 06 21:22:59.298157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3793/7696] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:22:58 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:22:59.720962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-36b2111f-c3ba-4a5f-87f0-c4ad20e2327c req-392b7a6e-650b-42cf-a177-14153c594433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f37d3e2-ff8e-4c35-896c-95c982666808", "tag": "5c62bad1-f9ba-4314-a571-37676ce88750"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:22:59.725784 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:22:59.725784 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:22:59.742382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-36b2111f-c3ba-4a5f-87f0-c4ad20e2327c req-392b7a6e-650b-42cf-a177-14153c594433 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:22:59.743086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-36b2111f-c3ba-4a5f-87f0-c4ad20e2327c req-392b7a6e-650b-42cf-a177-14153c594433 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:22:59.755348 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-36b2111f-c3ba-4a5f-87f0-c4ad20e2327c req-392b7a6e-650b-42cf-a177-14153c594433 service nova] Creating event network-changed:5c62bad1-f9ba-4314-a571-37676ce88750 for instance 3f37d3e2-ff8e-4c35-896c-95c982666808 on nch1-master-1 Nov 06 21:22:59.761343 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-36b2111f-c3ba-4a5f-87f0-c4ad20e2327c req-392b7a6e-650b-42cf-a177-14153c594433 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046904 Nov 06 21:22:59.762165 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3904/7697] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:22:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:23:00.314695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:00.315936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:00.323731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:00.324189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:00.325630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:00.326089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:00.598613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:00.606261 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f31afe22-bc51-4cb5-b3fd-6fe92fd5b278 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.295414 Nov 06 21:23:00.606831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3794/7698] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:00 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:01.624906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:01.625768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:01.632480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:01.633015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:01.634007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:01.634484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:01.939475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:01.947866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd4917c4-5f85-4dfb-ad7b-ade1c1c6979e tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.327843 Nov 06 21:23:01.948477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3905/7699] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:01 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:02.964704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:02.965310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:02.971934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:02.972426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:02.973914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:02.974409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:03.149779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:03.158204 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f145d459-2ab2-47db-9d70-a80ca392884d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.197072 Nov 06 21:23:03.158748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3795/7700] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:02 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:04.176195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:04.176947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:04.183524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:04.184005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:04.184849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:04.185301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:04.320605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:04.328096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d05b314-43c3-4fe8-b0a9-6f0aa1a349f9 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.155790 Nov 06 21:23:04.328691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3906/7701] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:04 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:05.345363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:05.345901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:05.353080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:05.353536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:05.354346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:05.354774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:05.485892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:05.493401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7308a5d6-04e7-4a9e-afd9-610beddadc28 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.151811 Nov 06 21:23:05.493971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3796/7702] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:05 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:06.510019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:06.510632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:06.517343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:06.517803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:06.518595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:06.519040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:06.653400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9add6106-533c-4878-b205-8315203a1f57 req-d1a1ec60-3d6e-449e-8848-92557bbd5b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f37d3e2-ff8e-4c35-896c-95c982666808", "name": "network-vif-plugged", "status": "completed", "tag": "5c62bad1-f9ba-4314-a571-37676ce88750"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:06.655011 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:23:06.655011 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:23:06.656815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:06.663610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9add6106-533c-4878-b205-8315203a1f57 req-d1a1ec60-3d6e-449e-8848-92557bbd5b63 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:06.664516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9add6106-533c-4878-b205-8315203a1f57 req-d1a1ec60-3d6e-449e-8848-92557bbd5b63 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:06.666648 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85feb52d-77a6-47d4-b71c-a2f7e07d841f tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.160362 Nov 06 21:23:06.667719 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3907/7703] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:06 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:06.677137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9add6106-533c-4878-b205-8315203a1f57 req-d1a1ec60-3d6e-449e-8848-92557bbd5b63 service nova] Creating event network-vif-plugged:5c62bad1-f9ba-4314-a571-37676ce88750 for instance 3f37d3e2-ff8e-4c35-896c-95c982666808 on nch1-master-1 Nov 06 21:23:06.682141 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9add6106-533c-4878-b205-8315203a1f57 req-d1a1ec60-3d6e-449e-8848-92557bbd5b63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Nov 06 21:23:06.682728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3797/7704] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:23:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:23:07.682976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:07.683622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:07.690302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:07.690761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:07.691553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:07.691996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:07.828524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:07.836558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f12aa197-d0e7-4f9e-855f-5be11d5a220d tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1324 microversion: 2.1 time: 0.157038 Nov 06 21:23:07.837121 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3908/7705] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:07 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:08.853937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:08.854647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:08.860838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:08.861300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:08.862086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:08.862532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:08.996628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:09.003941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b298eca-6e7e-4578-89af-d5a85d8baa35 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1520 microversion: 2.1 time: 0.155004 Nov 06 21:23:09.004558 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3798/7706] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:08 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:09.021906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:09.022448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:09.029145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.029607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.030423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.030872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.054306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] HTTP exception thrown: Instance is not a member of specified network Nov 06 21:23:09.054907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Returning 404 to user: Instance is not a member of specified network {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:23:09.055735 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99e55a77-ca09-45d4-b665-406b77cb1d44 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.037562 Nov 06 21:23:09.056257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3909/7707] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Nov 6 21:23:09 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808/ips/invalid => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 06 21:23:09.065189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f960d75-d938-47f6-8dd2-979e8253beaa tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:09.065781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f960d75-d938-47f6-8dd2-979e8253beaa tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Failed to fetch instance by id 999 {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 06 21:23:09.066311 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-2f960d75-d938-47f6-8dd2-979e8253beaa tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] HTTP exception thrown: Instance 999 could not be found. Nov 06 21:23:09.066849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f960d75-d938-47f6-8dd2-979e8253beaa tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Returning 404 to user: Instance 999 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:23:09.067706 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f960d75-d938-47f6-8dd2-979e8253beaa tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.006119 Nov 06 21:23:09.068187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3799/7708] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Nov 6 21:23:09 2021] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 06 21:23:09.075752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:09.076244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:09.081960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.082420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.083270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.083675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.107779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:23:09.179629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8caed8a3-9fa2-4c3b-94bd-f8946a22d4b3 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 204 len: 0 microversion: 2.1 time: 0.107003 Nov 06 21:23:09.180405 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3910/7709] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:23:09 2021] DELETE /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:23:09.187985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:09.188625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:09.194490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.194941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.195718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:09.196150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:09.326830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:09.334705 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e099f2d-c4a6-48c6-a0d4-3352fb106b37 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1526 microversion: 2.1 time: 0.150308 Nov 06 21:23:09.335277 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3800/7710] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:09 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:10.351634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:10.352392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:10.359047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:10.359521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:10.360356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:10.360813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:10.494703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb51983f7a534f8f90231b501182c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb686062472f4c988aa8ac1ef80ce3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:10.502382 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b6f0151-17b5-436a-85b0-5a14094b9715 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 200 len: 1526 microversion: 2.1 time: 0.154760 Nov 06 21:23:10.502896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3911/7711] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:10 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:11.047650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d9bec81d-c50c-403e-8b9d-18fd7268695f req-d180560c-890f-4027-92b5-ba4650140605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f37d3e2-ff8e-4c35-896c-95c982666808", "name": "network-vif-deleted", "tag": "5c62bad1-f9ba-4314-a571-37676ce88750"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:11.049284 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:23:11.049284 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:23:11.059334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9bec81d-c50c-403e-8b9d-18fd7268695f req-d180560c-890f-4027-92b5-ba4650140605 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:11.059788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d9bec81d-c50c-403e-8b9d-18fd7268695f req-d180560c-890f-4027-92b5-ba4650140605 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:11.072867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d9bec81d-c50c-403e-8b9d-18fd7268695f req-d180560c-890f-4027-92b5-ba4650140605 service nova] Creating event network-vif-deleted:5c62bad1-f9ba-4314-a571-37676ce88750 for instance 3f37d3e2-ff8e-4c35-896c-95c982666808 on nch1-master-1 Nov 06 21:23:11.077749 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d9bec81d-c50c-403e-8b9d-18fd7268695f req-d180560c-890f-4027-92b5-ba4650140605 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Nov 06 21:23:11.078343 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3801/7712] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:23:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:23:11.519945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:11.521209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] [instance: 3f37d3e2-ff8e-4c35-896c-95c982666808] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:11.527939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:11.528439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:11.529235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:11.529690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:11.543342 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] HTTP exception thrown: Instance 3f37d3e2-ff8e-4c35-896c-95c982666808 could not be found. Nov 06 21:23:11.543946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] Returning 404 to user: Instance 3f37d3e2-ff8e-4c35-896c-95c982666808 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:23:11.544830 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37482a33-3cc9-4ef0-9625-db3773b20c74 tempest-ServerAddressesNegativeTestJSON-143495748 tempest-ServerAddressesNegativeTestJSON-143495748-project] 10.222.0.13 "GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808" status: 404 len: 111 microversion: 2.1 time: 0.028629 Nov 06 21:23:11.545371 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3912/7713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:11 2021] GET /compute/v2.1/servers/3f37d3e2-ff8e-4c35-896c-95c982666808 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:23:17.210526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-229659920", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7f07e3c-fd02-49b4-b622-894a1eb4a7ab"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:17.262117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] validate_networks() for [('c7f07e3c-fd02-49b4-b622-894a1eb4a7ab', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:23:17.725627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:23:17.726061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:23:17.726601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:23:17.727028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:23:17.727451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:23:17.736835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:17.737295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:17.738116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:17.738591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:17.757031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Getting quotas for project c3ae473cf6a7407cb9cc41714c72be92. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:23:17.762367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Getting quotas for user 8e64e0c9efdf475e8b17269a0f4ed50e and project c3ae473cf6a7407cb9cc41714c72be92. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:23:17.775603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:23:17.778111 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:23:17.828910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e6e6f3f-63a7-4873-95d1-da9aafae830a tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.741457 Nov 06 21:23:17.829848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3802/7714] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:23:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:23:17.840356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b89ef4df-679a-44b6-81da-f3c3eb0fec1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:17.841823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b89ef4df-679a-44b6-81da-f3c3eb0fec1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:17.903329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b89ef4df-679a-44b6-81da-f3c3eb0fec1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:17.911630 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b89ef4df-679a-44b6-81da-f3c3eb0fec1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1213 microversion: 2.1 time: 0.075452 Nov 06 21:23:17.912222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3913/7715] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:17 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:18.930725 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:18.932126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:18.942204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:18.944348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:18.945380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:18.947793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:19.057365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:19.065644 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-370bb70c-64db-4b8b-a19a-883d5df0fc7e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1283 microversion: 2.1 time: 0.140781 Nov 06 21:23:19.069614 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3803/7716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:18 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1283 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:20.084695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:20.085890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:20.095683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:20.104187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:20.105295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:20.105761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:20.316144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:20.324619 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1762416f-ee10-4b06-ace5-4d22c25fa7b7 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.244199 Nov 06 21:23:20.325620 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3914/7717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:20 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:20.500420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4c95e046-d1e0-42ed-a45c-47dcdff726ef req-2941dd1a-7086-47de-bdf6-d71c227d4c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfc6a85-70af-4718-8dab-dd6ea47213e1", "tag": "6eddb517-73c6-4324-92ea-332159520559"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:20.502056 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:23:20.502056 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:23:20.511684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c95e046-d1e0-42ed-a45c-47dcdff726ef req-2941dd1a-7086-47de-bdf6-d71c227d4c0d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:20.512158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c95e046-d1e0-42ed-a45c-47dcdff726ef req-2941dd1a-7086-47de-bdf6-d71c227d4c0d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:20.527159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4c95e046-d1e0-42ed-a45c-47dcdff726ef req-2941dd1a-7086-47de-bdf6-d71c227d4c0d service nova] Creating event network-changed:6eddb517-73c6-4324-92ea-332159520559 for instance acfc6a85-70af-4718-8dab-dd6ea47213e1 on nch1-master-1 Nov 06 21:23:20.532364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4c95e046-d1e0-42ed-a45c-47dcdff726ef req-2941dd1a-7086-47de-bdf6-d71c227d4c0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130388 Nov 06 21:23:20.533504 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3804/7718] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:23:21.341897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:21.342673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:21.349444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:21.349912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:21.350728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:21.351174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:21.490282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:21.497768 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fcbc0da4-257e-45e8-b720-b346e6c438a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.159681 Nov 06 21:23:21.498343 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3915/7719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:21 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:22.516610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:22.517377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:22.523981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:22.524476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:22.525299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:22.525743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:22.659875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:22.668133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63db9798-44cb-45c7-99c1-52e5aceaa814 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.156404 Nov 06 21:23:22.668727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3805/7720] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:22 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:23.685088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:23.685633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:23.692031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:23.692530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:23.693315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:23.693764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:23.825660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:23.833178 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9d31f48-22db-411a-a86c-b525609a5af5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.151873 Nov 06 21:23:23.833747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3916/7721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:23 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:24.849571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:24.850185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:24.857006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:24.857463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:24.858249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:24.858689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:24.989495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:24.996916 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81ab3c5d-c901-4476-876a-6efce5b35be4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.151042 Nov 06 21:23:24.997487 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3806/7722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:24 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:26.014167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:26.014825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:26.021476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:26.021946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:26.022745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:26.023195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:26.153113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:26.160271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4759729a-9bff-4dbb-939e-4f6d67557a13 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.149824 Nov 06 21:23:26.161413 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3917/7723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:26 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:26.761199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9d5249b6-6d47-4868-a354-989b0dd44af4 req-567a0b60-4519-41d8-9bfc-94542e398005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc6a85-70af-4718-8dab-dd6ea47213e1", "name": "network-vif-plugged", "status": "completed", "tag": "6eddb517-73c6-4324-92ea-332159520559"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:26.762910 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:23:26.762910 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:23:26.769876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9d5249b6-6d47-4868-a354-989b0dd44af4 req-567a0b60-4519-41d8-9bfc-94542e398005 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:26.770972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9d5249b6-6d47-4868-a354-989b0dd44af4 req-567a0b60-4519-41d8-9bfc-94542e398005 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:26.783792 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9d5249b6-6d47-4868-a354-989b0dd44af4 req-567a0b60-4519-41d8-9bfc-94542e398005 service nova] Creating event network-vif-plugged:6eddb517-73c6-4324-92ea-332159520559 for instance acfc6a85-70af-4718-8dab-dd6ea47213e1 on nch1-master-1 Nov 06 21:23:26.788845 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9d5249b6-6d47-4868-a354-989b0dd44af4 req-567a0b60-4519-41d8-9bfc-94542e398005 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093466 Nov 06 21:23:26.789430 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3807/7724] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:23:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:23:27.177920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:27.178536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:27.185265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:27.185674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:27.186465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:27.186909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:27.313070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:27.320881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7f6a396-65db-4860-838e-94d00ce4f6e0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1313 microversion: 2.1 time: 0.147133 Nov 06 21:23:27.321452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3918/7725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:27 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:28.339152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:28.339884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:28.346087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.346591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.347369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.347818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.480593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:28.487986 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8acdf76-f872-40ed-a0d7-dcd8368c969c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1498 microversion: 2.1 time: 0.153939 Nov 06 21:23:28.488592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3808/7726] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:28 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:28.505307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:28.506371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:28.513316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.513775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.514640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.515085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.538287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lazy-loading 'flavor' on Instance uuid acfc6a85-70af-4718-8dab-dd6ea47213e1 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:23:28.611771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5cbff453-b88d-4099-9ecf-af1992c835cf tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "POST /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1/action" status: 200 len: 32 microversion: 2.1 time: 0.110341 Nov 06 21:23:28.612526 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3919/7727] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:23:28 2021] POST /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:23:28.620991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:28.621681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:28.627515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.628032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.628896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:28.629370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:28.831992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:28.840264 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c20e3bb-9316-4537-a05f-b2ded434d30c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.222908 Nov 06 21:23:28.840868 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3809/7728] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:28 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:29.858468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:29.859215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:29.866955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:29.867427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:29.868238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:29.868722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:29.999236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:30.006766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c3a755f-b211-4d91-8433-f953474609d2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152421 Nov 06 21:23:30.007345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3920/7729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:29 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:31.024421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:31.025030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:31.031338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:31.031788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:31.032586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:31.033022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:31.164446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:31.171740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ecb691f-adc4-45e2-89cc-2a79ec3b8da8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.151810 Nov 06 21:23:31.172329 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3810/7730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:31 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:32.188927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:32.189483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:32.196635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:32.197097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:32.197888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:32.198337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:32.325925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:32.333287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84593f8f-e50f-4727-a03b-472c6f9b680c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.148112 Nov 06 21:23:32.333859 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3921/7731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:32 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:33.350514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:33.351169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:33.357860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:33.358353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:33.359144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:33.359590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:33.489483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:33.496750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90ed5d79-12c0-47cc-87a1-21d2ea4c6ed1 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.150555 Nov 06 21:23:33.497327 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3811/7732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:33 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:34.513489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:34.514113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:34.521482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:34.521950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:34.522742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:34.523194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:34.653750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:34.661007 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d7dc63c-f8c9-4b6f-b013-c0cc81a32423 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.151290 Nov 06 21:23:34.661577 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3922/7733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:34 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:35.677755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:35.678375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:35.685166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:35.685626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:35.686414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:35.686865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:35.821396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:35.828810 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-350adebe-eaa3-4436-8b70-d187412c5c4f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.155416 Nov 06 21:23:35.829393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3812/7734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:35 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:36.845552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:36.846202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:36.852882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:36.853352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:36.854213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:36.854670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:36.987722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:36.995501 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-187e999e-5261-4408-9925-ba37f9019842 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153705 Nov 06 21:23:36.996060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3923/7735] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:36 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:38.012502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:38.013116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:38.020431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:38.020892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:38.021820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:38.022117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:38.151022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:38.158354 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d2121ee-196b-40f5-bc0b-3d363067ec63 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.149531 Nov 06 21:23:38.158920 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3813/7736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:38 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:39.175124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:39.176203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:39.183711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:39.184169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:39.184991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:39.185438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:39.317457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:39.325150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7913b554-4898-4aeb-ac7d-5110630aacde tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153785 Nov 06 21:23:39.325716 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3924/7737] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:39 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:40.342122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:40.342835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:40.349369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:40.349847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:40.350633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:40.351075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:40.483132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:40.490502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84d71f4e-d824-4f6f-8576-aae8b4768f8e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152270 Nov 06 21:23:40.491071 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3814/7738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:40 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:41.507361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:41.507979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:41.514626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:41.515090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:41.515883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:41.516354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:41.649983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:41.657383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88b4b00c-1372-4e88-8b10-636c18c7b913 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153719 Nov 06 21:23:41.657957 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3925/7739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:41 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:42.674864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:42.675471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:42.682733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:42.683269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:42.684051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:42.684518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:42.816371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:42.823805 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6a7400d-ccf9-46f1-b10b-8c0e5574e900 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152652 Nov 06 21:23:42.824391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3815/7740] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:42 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:43.840973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:43.841773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:43.848519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:43.848985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:43.849780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:43.850229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:43.983176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:43.990536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7f79d07f-9304-4eaf-8908-1a682df81d07 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153214 Nov 06 21:23:43.991094 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3926/7741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:43 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:45.007166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:45.007780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:45.014462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:45.014916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:45.015692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:45.016134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:45.149426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:45.156692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88c62588-7f97-4785-a879-d2233b6a684d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153292 Nov 06 21:23:45.157261 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3816/7742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:45 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:46.174329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:46.174902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:46.182461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:46.182923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:46.183834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:46.184403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:46.315054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:46.322478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a5fdb27-6aaa-49aa-b703-84bef572da1d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.151965 Nov 06 21:23:46.323055 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3927/7743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:46 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:47.339032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:47.339639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:47.346286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:47.346763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:47.347537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:47.348010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:47.478155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:47.485494 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7007d998-28a2-4969-8238-2f0ddbde04d8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.150164 Nov 06 21:23:47.486063 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3817/7744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:47 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:48.502761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:48.503386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:48.510142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:48.510612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:48.511414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:48.511869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:48.644323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:48.651536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a97ea9c-f22f-42fd-a2df-0e7a795c9cc9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152509 Nov 06 21:23:48.652098 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3928/7745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:48 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:49.668989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:49.669629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:49.676506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:49.676991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:49.677777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:49.678219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:49.808259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:49.815564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edec7e7d-e936-4327-b359-1c0df3911f91 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.150288 Nov 06 21:23:49.816137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3818/7746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:49 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:50.834056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:50.834685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:50.841380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:50.841850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:50.842679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:50.843131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:50.977491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:50.984843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a909798e-f34b-4cf4-8f05-b8fb7f598708 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.155082 Nov 06 21:23:50.985415 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3929/7747] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:50 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:52.001691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:52.002446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:52.009796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:52.010259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:52.011046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:52.011493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:52.140286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:52.147777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7994003c-6b60-475e-a8d4-e0a657d64347 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.149786 Nov 06 21:23:52.148383 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3819/7748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:51 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:53.165835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:53.166352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:53.172484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:53.172947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:53.173728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:53.174172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:53.306518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:53.313931 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b361329d-5676-4386-b066-73c49bb85bba tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.153100 Nov 06 21:23:53.314496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3930/7749] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:53 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:54.331149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:54.331766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:54.338467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:54.338922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:54.339704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:54.340148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:54.481430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:54.489257 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a6c9064-0be8-4524-b5c1-eb5ea8ee6302 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.161181 Nov 06 21:23:54.489834 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3820/7750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:54 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:55.506257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:55.506872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:55.513580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:55.514041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:55.514841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:55.515288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:55.647647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:55.654891 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-30eddabf-5064-4b57-b566-c9b8dedaa556 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152862 Nov 06 21:23:55.655455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3931/7751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:55 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:56.670962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:56.671571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:56.678821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:56.679278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:56.680060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:56.680531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:56.812034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:56.819401 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f3b66f9d-07fb-4c6a-a31a-a439600e9dae tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1504 microversion: 2.1 time: 0.152123 Nov 06 21:23:56.819905 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3821/7752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:56 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:57.835426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:57.836036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:57.842396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:57.842854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:57.843637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:57.844084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:57.973668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:57.980982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-77467ee3-c923-4309-96eb-892799910e46 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1484 microversion: 2.1 time: 0.149433 Nov 06 21:23:57.981555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3932/7753] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:57 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1484 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:58.037264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2114383508", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7f07e3c-fd02-49b4-b622-894a1eb4a7ab"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:23:58.089509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] validate_networks() for [('c7f07e3c-fd02-49b4-b622-894a1eb4a7ab', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:23:58.447187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:23:58.447613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:23:58.448091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:23:58.448555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:23:58.448973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:23:58.457641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:58.458092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:58.458934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:58.459374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:58.475903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Getting quotas for project c3ae473cf6a7407cb9cc41714c72be92. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:23:58.480967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Getting quotas for user 8e64e0c9efdf475e8b17269a0f4ed50e and project c3ae473cf6a7407cb9cc41714c72be92. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:23:58.493540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:23:58.495837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:23:58.540637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5a13f81-1da6-4a82-a5d5-721aec1f09de tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.507510 Nov 06 21:23:58.541301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3822/7754] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:23:58 2021] POST /compute/v2.1/servers => generated 383 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:23:58.551096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2703559-0e69-49ac-bf33-a0b48d54d212 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:58.551964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2703559-0e69-49ac-bf33-a0b48d54d212 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:58.604248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2703559-0e69-49ac-bf33-a0b48d54d212 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:58.610717 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2703559-0e69-49ac-bf33-a0b48d54d212 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1214 microversion: 2.1 time: 0.063371 Nov 06 21:23:58.611281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3933/7755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:58 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:23:59.627645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:23:59.628266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:23:59.636328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:59.636832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:59.637629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:23:59.638075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:23:59.700200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:23:59.707654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64b2ab1f-8802-4ded-b1c3-55795a1d02c9 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1272 microversion: 2.1 time: 0.083786 Nov 06 21:23:59.708235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3823/7756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:23:59 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:00.724451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:00.725081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:00.733636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:00.734300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:00.735379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:00.735585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:00.875262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:00.883917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f098a68-a663-467d-9f13-4bb7d03f2530 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.163460 Nov 06 21:24:00.884514 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3934/7757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:00 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:00.952561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-275369c0-e3d1-408a-9fe1-6279fac7b190 req-d0d2acd0-2055-4149-b30d-6b08d5bb416f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3cf790-e207-40bf-bf7e-6d18f5fac6db", "tag": "39e78de1-9ada-4998-be00-eafffeff919a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:00.954372 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:24:00.954372 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:24:00.962171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-275369c0-e3d1-408a-9fe1-6279fac7b190 req-d0d2acd0-2055-4149-b30d-6b08d5bb416f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:00.962630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-275369c0-e3d1-408a-9fe1-6279fac7b190 req-d0d2acd0-2055-4149-b30d-6b08d5bb416f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:00.980155 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-275369c0-e3d1-408a-9fe1-6279fac7b190 req-d0d2acd0-2055-4149-b30d-6b08d5bb416f service nova] Creating event network-changed:39e78de1-9ada-4998-be00-eafffeff919a for instance 8f3cf790-e207-40bf-bf7e-6d18f5fac6db on nch2-master-1 Nov 06 21:24:00.984949 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-275369c0-e3d1-408a-9fe1-6279fac7b190 req-d0d2acd0-2055-4149-b30d-6b08d5bb416f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038588 Nov 06 21:24:00.985550 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3824/7758] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:24:01.901077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:01.901759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:01.908548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:01.909023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:01.909828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:01.911399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:02.047265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:02.054532 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96ab9e00-33f1-4847-ad7e-7de265581f31 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.157191 Nov 06 21:24:02.055099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3935/7759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:01 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:03.072982 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:03.073677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:03.079849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:03.080319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:03.081090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:03.081528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:03.213829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:03.221119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70c758b6-7a20-414a-bcf3-33ac25ed188e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.153013 Nov 06 21:24:03.221676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3825/7760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:03 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:04.238782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:04.239629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:04.248805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:04.249276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:04.250656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:04.250656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:04.384716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:04.391926 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f38d5389-8665-49b7-a6ac-86d258c93684 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.157613 Nov 06 21:24:04.392528 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3936/7761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:04 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:05.408346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:05.409002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:05.416059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:05.416558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:05.417351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:05.417800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:05.548341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:05.556197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-97b84648-c682-4d50-9f86-e9e65225e8c0 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.151578 Nov 06 21:24:05.557043 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3826/7762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:05 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:06.572826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:06.573525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:06.580278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:06.580779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:06.581579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:06.582667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:06.713638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:06.720969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f61192f2-4762-4d81-b231-9bee702a51a4 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.151807 Nov 06 21:24:06.721540 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3937/7763] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:06 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:07.265318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0a7160a9-0b0e-463b-af24-397410815bfa req-659b9ef2-1e73-49a8-973b-794b82a85f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3cf790-e207-40bf-bf7e-6d18f5fac6db", "name": "network-vif-plugged", "status": "completed", "tag": "39e78de1-9ada-4998-be00-eafffeff919a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:07.266840 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:24:07.266840 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:24:07.275289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0a7160a9-0b0e-463b-af24-397410815bfa req-659b9ef2-1e73-49a8-973b-794b82a85f84 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:07.275751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0a7160a9-0b0e-463b-af24-397410815bfa req-659b9ef2-1e73-49a8-973b-794b82a85f84 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:07.286970 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0a7160a9-0b0e-463b-af24-397410815bfa req-659b9ef2-1e73-49a8-973b-794b82a85f84 service nova] Creating event network-vif-plugged:39e78de1-9ada-4998-be00-eafffeff919a for instance 8f3cf790-e207-40bf-bf7e-6d18f5fac6db on nch2-master-1 Nov 06 21:24:07.291960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0a7160a9-0b0e-463b-af24-397410815bfa req-659b9ef2-1e73-49a8-973b-794b82a85f84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030758 Nov 06 21:24:07.292584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3827/7764] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:24:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:07.737697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:07.738759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:07.745312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:07.745769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:07.746552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:07.746998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:07.876799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:07.884790 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c6fb753e-fb1c-48e2-89c1-712391a0871d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1314 microversion: 2.1 time: 0.150798 Nov 06 21:24:07.885360 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3938/7765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:07 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:08.902542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:08.903243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:08.909566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:08.910049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:08.910828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:08.911262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:09.046572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:09.055035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b336e799-dd97-4386-a9b5-624bd138c7ca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1499 microversion: 2.1 time: 0.157401 Nov 06 21:24:09.060872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3828/7766] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:08 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:09.072433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:09.073373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:09.079955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:09.080453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:09.081237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:09.081682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:09.109981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lazy-loading 'flavor' on Instance uuid 8f3cf790-e207-40bf-bf7e-6d18f5fac6db {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:24:09.453005 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1dc79c85-15ff-49d5-b8d3-3016b1d3645f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "POST /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db/action" status: 200 len: 32 microversion: 2.1 time: 0.384207 Nov 06 21:24:09.453604 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3939/7767] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:24:09 2021] POST /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:24:09.462466 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:09.463084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:09.469054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:09.469453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:09.470349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:09.470867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:09.603285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:09.610778 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a2ab208-3af6-4584-a1db-81009cdfa7ec tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.152015 Nov 06 21:24:09.611357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3829/7768] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:09 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:10.629833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:10.630544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:10.636737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:10.637204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:10.637993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:10.638444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:10.770704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:10.778016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3155511f-26c4-46ae-99a1-10c4fdbc6796 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153676 Nov 06 21:24:10.778572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3940/7769] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:10 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:11.795206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:11.795820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:11.803228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:11.803690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:11.804533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:11.804972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:11.935220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:11.942549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58349839-58bd-42b3-8235-e55cb7861942 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.151126 Nov 06 21:24:11.943120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3830/7770] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:11 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:12.958820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:12.959432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:12.966141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:12.966642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:12.967439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:12.967885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:13.098041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:13.105406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b6f291a-d84b-4459-947d-9f928eb7d6a2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.150388 Nov 06 21:24:13.105962 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3941/7771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:12 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:14.123705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:14.124475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:14.131759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:14.132161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:14.132986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:14.133462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:14.265810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:14.273742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0dbd0869-cc98-43bd-bc1b-775d1677d04b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.154588 Nov 06 21:24:14.274316 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3831/7772] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:14 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:15.291476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:15.292010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:15.298687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:15.299156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:15.299955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:15.300489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:15.429254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:15.436507 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c3ee4cd-f17f-4c70-a878-ab82c659f5af tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.149103 Nov 06 21:24:15.437063 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3942/7773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:15 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:16.453730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:16.454337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:16.461255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:16.461718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:16.462541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:16.462980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:16.606374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:16.613672 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8a2acc51-cf91-40b6-a341-43fe174b412d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.163632 Nov 06 21:24:16.614244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3832/7774] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:16 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:17.631207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:17.631837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:17.638557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:17.639025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:17.639824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:17.640280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:17.767467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:17.774794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6158dd1e-5ec1-49dc-95fe-3bbe73dfca04 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.147938 Nov 06 21:24:17.775348 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3943/7775] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:17 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:18.790876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:18.791483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:18.798189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:18.798668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:18.799438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:18.800376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:18.928828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:18.936046 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fefb675e-b0e1-43be-a5a7-87c9860aadac tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.149041 Nov 06 21:24:18.936638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3833/7776] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:18 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:19.953348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:19.953943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:19.961290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:19.961753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:19.962589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:19.963041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:20.097571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:20.104945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22af8732-1e95-45ce-ad47-323ba226b3dc tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.155517 Nov 06 21:24:20.105513 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3944/7777] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:19 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:21.122672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:21.123286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:21.130115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:21.130518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:21.131304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:21.131745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:21.260706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:21.268192 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d9dd0e2-5467-4253-99cf-740ed0ba7bb6 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.150010 Nov 06 21:24:21.269314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3834/7778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:21 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:22.285826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:22.286356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:22.293139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:22.293606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:22.294400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:22.294855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:22.427701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:22.435020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8e35bac-acca-46e4-a0ca-8b3df628e348 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153512 Nov 06 21:24:22.435580 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3945/7779] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:22 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:23.451509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:23.452114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:23.458820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:23.459273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:23.460047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:23.460526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:23.587232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:23.594542 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-816ea045-2bec-4c6a-ab83-4a1595c4d243 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.146713 Nov 06 21:24:23.595120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3835/7780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:23 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:24.611293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:24.611919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:24.618620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:24.619088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:24.619892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:24.620372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:24.753613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:24.760874 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7bb12781-35f1-4419-9ffb-0f43a4393384 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153327 Nov 06 21:24:24.761430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3946/7781] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:24 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:25.778632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:25.779472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:25.787032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:25.787501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:25.788569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:25.789015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:25.917336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:25.924673 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7de72d91-7586-42aa-a840-af1091615505 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.150047 Nov 06 21:24:25.925247 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3836/7782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:25 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:26.941488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:26.942113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:26.948874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:26.949422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:26.950145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:26.950594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:27.081304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:27.088549 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18052d8d-6223-43e4-8d39-64b59a997a26 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.150756 Nov 06 21:24:27.089116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3947/7783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:26 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:28.105902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:28.106505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:28.113808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:28.114259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:28.115037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:28.115472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:28.247986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:28.255296 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-457a8430-c7de-4530-89a1-40e66d043a74 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153118 Nov 06 21:24:28.255868 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3837/7784] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:28 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:29.272186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:29.272753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:29.279448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:29.279921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:29.280763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:29.281224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:29.414414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:29.421728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f62f3776-9e1d-431a-abdb-ee97b7509ce2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153966 Nov 06 21:24:29.422290 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3948/7785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:29 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:30.438688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:30.439414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:30.446492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:30.446947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:30.447774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:30.448259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:30.580505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:30.588424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e5cb897-8f70-4773-aa34-5e61b5ffb14e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153415 Nov 06 21:24:30.588985 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3838/7786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:30 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:31.605251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:31.605871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:31.612996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:31.613465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:31.614250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:31.614721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:31.742406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:31.749688 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d06bd557-7d39-4cd0-be79-3666fef7c293 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.148148 Nov 06 21:24:31.750252 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3949/7787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:31 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:24:32.766968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:32.767625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:32.775268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:32.775729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:32.776554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:32.777007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:32.904615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:32.911974 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b16335ff-f67f-4709-bf6c-20fd33a2179d tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.148789 Nov 06 21:24:32.912579 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3839/7788] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:32 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:33.929011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:33.929639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:33.936637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:33.937223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:33.938157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:33.938664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:34.072744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:34.079956 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61244929-6fd7-4a1e-ad12-34b90f8459a5 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.154670 Nov 06 21:24:34.081027 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3950/7789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:33 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:35.097779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:35.098368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:35.105229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:35.105679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:35.106452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:35.106890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:35.239693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:35.246998 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34034e1c-1404-4d62-8ad9-902ebceac52b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153356 Nov 06 21:24:35.247567 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3840/7790] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:35 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:36.262906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:36.263447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:36.270152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:36.270624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:36.271414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:36.271865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:36.404357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:36.412389 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e40804d-4a4f-4ee2-ace8-e44805dd6fdd tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153224 Nov 06 21:24:36.412966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3951/7791] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:36 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:37.428345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:37.428958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:37.435674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:37.436126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:37.436931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:37.437376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:37.571681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:37.578945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e545a438-323b-4875-973c-a4ee2504215c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.154302 Nov 06 21:24:37.579514 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3841/7792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:37 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:38.595916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:38.596598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:38.603415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.603882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.604732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.605182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.737982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:38.745301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a78dd8c-067d-4701-b3c2-cd41b118afe2 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1485 microversion: 2.1 time: 0.153186 Nov 06 21:24:38.745879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3952/7793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:38 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1485 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:38.761391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:38.761919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:38.768206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.768695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.769471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.769907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.832543 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7889bd46-c8a9-4b7e-a06e-3549d8d0e304 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "POST /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db/action" status: 202 len: 0 microversion: 2.1 time: 0.074755 Nov 06 21:24:38.833158 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3842/7794] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:24:38 2021] POST /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:24:38.841226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:38.841805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:38.848173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.848677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.849480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:38.849973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:38.982044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:38.989859 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17a051c1-822c-4918-80da-22943da26160 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1493 microversion: 2.1 time: 0.152452 Nov 06 21:24:38.990425 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3953/7795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:38 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:40.008286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:40.009036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:40.015197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:40.015663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:40.016483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:40.016932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:40.148441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:40.155827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1906e613-b159-4c0f-9093-1bda4e1da145 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1493 microversion: 2.1 time: 0.152424 Nov 06 21:24:40.156420 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3843/7796] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:40 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:41.175600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:41.176358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:41.183002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.183472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.184363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.184901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.319496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:41.326864 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e59bacac-9d09-40d2-b246-58c1fdf0f55b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1499 microversion: 2.1 time: 0.155203 Nov 06 21:24:41.327425 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3954/7797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:41 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:41.348613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:41.349151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:41.355897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.356391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.357222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.357662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.382631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:24:41.454106 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df4ac223-4b3a-496b-83b5-c31d17cc81c8 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 204 len: 0 microversion: 2.1 time: 0.108785 Nov 06 21:24:41.454789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3844/7798] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:24:41 2021] DELETE /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:24:41.464226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:41.464882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:41.470869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.471339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.472131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:41.472605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:41.601814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:41.609214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fe6275a3-8589-4364-9c5c-03d0b62dfbad tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.150441 Nov 06 21:24:41.609784 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3955/7799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:41 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:42.626952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:42.628180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:42.634935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:42.635392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:42.636181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:42.636651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:42.769389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:42.776787 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-97da2411-48f9-4585-9e23-e8742e94f726 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.153833 Nov 06 21:24:42.777356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3845/7800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:42 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:43.793633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:43.794257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:43.801169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:43.801640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:43.802437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:43.802890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:43.932104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:43.941429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0fe36fcb-dab8-4534-9dfc-ea71440b2a7f tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1505 microversion: 2.1 time: 0.149918 Nov 06 21:24:43.942096 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3956/7801] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:43 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:44.941019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d4f11b9c-6179-4ed4-ad73-f20e1767d2e0 req-31807a42-f5c2-4864-8bb7-078feff04fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3cf790-e207-40bf-bf7e-6d18f5fac6db", "name": "network-vif-deleted", "tag": "39e78de1-9ada-4998-be00-eafffeff919a"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:44.943485 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:24:44.943485 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:24:44.952761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d4f11b9c-6179-4ed4-ad73-f20e1767d2e0 req-31807a42-f5c2-4864-8bb7-078feff04fe9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:44.953773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d4f11b9c-6179-4ed4-ad73-f20e1767d2e0 req-31807a42-f5c2-4864-8bb7-078feff04fe9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:44.958700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:44.959428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:44.966078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:44.966554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:44.967383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:44.967845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:44.973050 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d4f11b9c-6179-4ed4-ad73-f20e1767d2e0 req-31807a42-f5c2-4864-8bb7-078feff04fe9 service nova] Creating event network-vif-deleted:39e78de1-9ada-4998-be00-eafffeff919a for instance 8f3cf790-e207-40bf-bf7e-6d18f5fac6db on nch2-master-1 Nov 06 21:24:44.986571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d4f11b9c-6179-4ed4-ad73-f20e1767d2e0 req-31807a42-f5c2-4864-8bb7-078feff04fe9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122396 Nov 06 21:24:44.988839 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3846/7802] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:24:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:24:45.002588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:45.002982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:45.003453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lazy-loading 'fault' on Instance uuid 8f3cf790-e207-40bf-bf7e-6d18f5fac6db {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:24:45.047351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:45.056106 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-afe49c8a-7cca-4808-8a61-81ba0b32069e tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 200 len: 1304 microversion: 2.1 time: 0.101307 Nov 06 21:24:45.057204 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3957/7803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:44 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:24:46.074611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:46.075305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: 8f3cf790-e207-40bf-bf7e-6d18f5fac6db] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:46.081435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.081883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.082658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.083090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.098076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] HTTP exception thrown: Instance 8f3cf790-e207-40bf-bf7e-6d18f5fac6db could not be found. Nov 06 21:24:46.098651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Returning 404 to user: Instance 8f3cf790-e207-40bf-bf7e-6d18f5fac6db could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:24:46.099462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-643aea0f-77fe-4080-bd3f-bbb02cd1fbca tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db" status: 404 len: 111 microversion: 2.1 time: 0.029696 Nov 06 21:24:46.099974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3847/7804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:46 2021] GET /compute/v2.1/servers/8f3cf790-e207-40bf-bf7e-6d18f5fac6db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:24:46.107807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:46.108381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:46.115503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.115963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.117115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.117565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.148518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:24:46.219754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5b9c1f7-0d14-4d8d-aa6c-97d2583c481b tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "DELETE /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 204 len: 0 microversion: 2.1 time: 0.115256 Nov 06 21:24:46.220499 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3958/7805] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:24:46 2021] DELETE /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:24:46.230736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:46.231342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:46.237782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.238234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.239009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:46.239442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:46.371656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:46.378913 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4db112a8-9ce0-4919-89d2-2ebdd985925c tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1490 microversion: 2.1 time: 0.151923 Nov 06 21:24:46.379504 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3848/7806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:46 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1490 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:47.396465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:47.397183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:47.403857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:47.404356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:47.405157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:47.405607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:47.536950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:47.544589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72bd218b-d529-401d-8c6a-d591190eaa08 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1490 microversion: 2.1 time: 0.152248 Nov 06 21:24:47.545156 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3959/7807] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:47 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1490 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:48.561667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:48.562263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:48.569538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:48.569991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:48.570771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:48.571204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:48.739122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e64e0c9efdf475e8b17269a0f4ed50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ae473cf6a7407cb9cc41714c72be92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:24:48.746688 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-525fe33a-fc1c-421d-8627-a6f2845f0428 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 200 len: 1490 microversion: 2.1 time: 0.188702 Nov 06 21:24:48.747263 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3849/7808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:48 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 1490 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:24:49.150415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0375bc76-4f41-4a6a-9310-b0d41d5f7fb2 req-db58cf44-968b-4429-aad7-fc6ba39dac7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc6a85-70af-4718-8dab-dd6ea47213e1", "name": "network-vif-deleted", "tag": "6eddb517-73c6-4324-92ea-332159520559"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:24:49.151912 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:24:49.151912 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:24:49.160396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0375bc76-4f41-4a6a-9310-b0d41d5f7fb2 req-db58cf44-968b-4429-aad7-fc6ba39dac7f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:49.160860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0375bc76-4f41-4a6a-9310-b0d41d5f7fb2 req-db58cf44-968b-4429-aad7-fc6ba39dac7f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:49.172266 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0375bc76-4f41-4a6a-9310-b0d41d5f7fb2 req-db58cf44-968b-4429-aad7-fc6ba39dac7f service nova] Creating event network-vif-deleted:6eddb517-73c6-4324-92ea-332159520559 for instance acfc6a85-70af-4718-8dab-dd6ea47213e1 on nch1-master-1 Nov 06 21:24:49.177667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0375bc76-4f41-4a6a-9310-b0d41d5f7fb2 req-db58cf44-968b-4429-aad7-fc6ba39dac7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 Nov 06 21:24:49.178263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3960/7809] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:49.763654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:49.764198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] [instance: acfc6a85-70af-4718-8dab-dd6ea47213e1] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:24:49.771455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:49.771904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:49.772724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:24:49.773161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:24:49.786924 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] HTTP exception thrown: Instance acfc6a85-70af-4718-8dab-dd6ea47213e1 could not be found. Nov 06 21:24:49.787513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] Returning 404 to user: Instance acfc6a85-70af-4718-8dab-dd6ea47213e1 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:24:49.788622 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fdd5e2b3-e70c-430a-8a17-c2008c954db3 tempest-ServerRescueTestJSON-172379137 tempest-ServerRescueTestJSON-172379137-project] 10.222.0.13 "GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1" status: 404 len: 111 microversion: 2.1 time: 0.028628 Nov 06 21:24:49.789140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3850/7810] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:24:49 2021] GET /compute/v2.1/servers/acfc6a85-70af-4718-8dab-dd6ea47213e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:24:53.814069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-65c87deb-5b19-47fa-877e-8e51e837deca tempest-ExtensionsTest-1556860993 tempest-ExtensionsTest-1556860993-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:53.815749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-65c87deb-5b19-47fa-877e-8e51e837deca tempest-ExtensionsTest-1556860993 tempest-ExtensionsTest-1556860993-project] 10.222.0.13 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.119420 Nov 06 21:24:53.816279 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3961/7811] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Nov 6 21:24:53 2021] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:53.824810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d7436df-bc4f-4b48-9c77-59c49b270f27 tempest-ExtensionsTest-1556860993 tempest-ExtensionsTest-1556860993-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:53.826987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d7436df-bc4f-4b48-9c77-59c49b270f27 tempest-ExtensionsTest-1556860993 tempest-ExtensionsTest-1556860993-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005654 Nov 06 21:24:53.827499 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3851/7812] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Nov 6 21:24:53 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:24:55.153850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c694b2b6-8943-49f8-9a91-8573265a311e tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] Calling method '.version_select at 0x7f6707f0d310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:55.209442 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c694b2b6-8943-49f8-9a91-8573265a311e tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814/defaults" status: 200 len: 371 microversion: 2.1 time: 0.167315 Nov 06 21:24:55.210010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3962/7813] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 21:24:55 2021] GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814/defaults => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:55.221063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ebdbcac4-fc8e-4031-9d41-c3f2f43c00ea tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] Calling method '.version_select at 0x7f67156f2940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:55.292980 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ebdbcac4-fc8e-4031-9d41-c3f2f43c00ea tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814" status: 200 len: 371 microversion: 2.1 time: 0.076380 Nov 06 21:24:55.293539 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3852/7814] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 21:24:55 2021] GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:55.306032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4b8a2fc-946c-4675-8a79-3c62ca3c5b85 tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] Calling method '.version_select at 0x7f6707f0d550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:55.360940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4b8a2fc-946c-4675-8a79-3c62ca3c5b85 tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814/defaults" status: 200 len: 371 microversion: 2.1 time: 0.058525 Nov 06 21:24:55.361506 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3963/7815] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 21:24:55 2021] GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814/defaults => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:55.373764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9fda453f-c438-4120-93f8-2a212911a7cb tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] Calling method '.version_select at 0x7f671524b790>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:55.439349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9fda453f-c438-4120-93f8-2a212911a7cb tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814" status: 200 len: 371 microversion: 2.1 time: 0.069250 Nov 06 21:24:55.439913 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3853/7816] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 21:24:55 2021] GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:24:55.450124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e16441a-9ed9-4361-88c5-6618793b0167 tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] Calling method '.version_select at 0x7f6707ed30d0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:24:55.521758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e16441a-9ed9-4361-88c5-6618793b0167 tempest-QuotasTestJSON-798768031 tempest-QuotasTestJSON-798768031-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814?user_id=4c5f510754c74ca694449f21356095d2" status: 200 len: 371 microversion: 2.1 time: 0.075304 Nov 06 21:24:55.522484 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3964/7817] 10.222.0.13 () {58 vars in 1322 bytes} [Sat Nov 6 21:24:55 2021] GET /compute/v2.1/os-quota-sets/6509211843534f6e955b3f4719ad4814?user_id=4c5f510754c74ca694449f21356095d2 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:25:11.090547 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:25:11.091237 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:25:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:25:59.954757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-934042796", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0bb3679-3644-4583-b0b6-f38c5e54fc9f"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:00.006455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] validate_networks() for [('c0bb3679-3644-4583-b0b6-f38c5e54fc9f', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:26:00.343402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:26:00.343838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:26:00.344348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:26:00.344762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:26:00.345212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:26:00.354122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:00.354580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:00.355407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:00.355848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:00.373358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Getting quotas for project 701e70fcea614c108e0c7149f5614f14. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:26:00.379058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Getting quotas for user 74051e71cc8d4930a33609c7573801fa and project 701e70fcea614c108e0c7149f5614f14. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:26:00.391194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:26:00.393521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:26:00.438278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47580a9c-4518-402a-9488-c07235ab75de tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489037 Nov 06 21:26:00.438923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3854/7818] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:25:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:26:00.450147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51ba943c-dc84-476a-bbed-6c2cc41485bf tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:00.450900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51ba943c-dc84-476a-bbed-6c2cc41485bf tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:00.505340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51ba943c-dc84-476a-bbed-6c2cc41485bf tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:00.511918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51ba943c-dc84-476a-bbed-6c2cc41485bf tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1213 microversion: 2.1 time: 0.066953 Nov 06 21:26:00.512534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3965/7819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:00 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:01.530265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8da43fb5-07d6-4cbf-a881-e800229d2f43 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:01.530878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8da43fb5-07d6-4cbf-a881-e800229d2f43 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:01.586983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8da43fb5-07d6-4cbf-a881-e800229d2f43 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:01.593456 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8da43fb5-07d6-4cbf-a881-e800229d2f43 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1213 microversion: 2.1 time: 0.068556 Nov 06 21:26:01.594336 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3855/7820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:01 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:02.611633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1037119c-f0fb-4c3e-80fd-6571212f4b66 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:02.612411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1037119c-f0fb-4c3e-80fd-6571212f4b66 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:02.670597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1037119c-f0fb-4c3e-80fd-6571212f4b66 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:02.677699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1037119c-f0fb-4c3e-80fd-6571212f4b66 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1213 microversion: 2.1 time: 0.070796 Nov 06 21:26:02.678261 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3966/7821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:02 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:26:03.695358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64837a4c-377a-448d-9728-4c5df4d651af tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:03.695965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64837a4c-377a-448d-9728-4c5df4d651af tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:03.754101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64837a4c-377a-448d-9728-4c5df4d651af tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:03.761056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64837a4c-377a-448d-9728-4c5df4d651af tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1213 microversion: 2.1 time: 0.069397 Nov 06 21:26:03.761895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3856/7822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:03 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:04.778729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:04.779379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:04.786399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:04.786867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:04.787662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:04.788395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:04.846639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:04.853829 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78bfc1b2-5c14-455b-8de4-255802fda280 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1217 microversion: 2.1 time: 0.078773 Nov 06 21:26:04.854391 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3967/7823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:04 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:05.871703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:05.872431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:05.880009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:05.880812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:05.881314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:05.881839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:06.114522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:06.121882 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4732e1cd-5484-46a0-98e4-871a05666bbd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.254673 Nov 06 21:26:06.122439 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3857/7824] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:05 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:06.700965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-126a0fe5-2780-43ad-b973-0fafb32a5859 req-7b914603-9afa-4468-a62a-13561b744f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee22fffa-08da-4446-864e-a05ed7f73f03", "tag": "391cdadb-2e23-400b-b9e7-bfcc4174e0e2"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:06.702795 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:06.702795 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:26:06.711026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-126a0fe5-2780-43ad-b973-0fafb32a5859 req-7b914603-9afa-4468-a62a-13561b744f25 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:06.711526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-126a0fe5-2780-43ad-b973-0fafb32a5859 req-7b914603-9afa-4468-a62a-13561b744f25 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:06.723328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-126a0fe5-2780-43ad-b973-0fafb32a5859 req-7b914603-9afa-4468-a62a-13561b744f25 service nova] Creating event network-changed:391cdadb-2e23-400b-b9e7-bfcc4174e0e2 for instance ee22fffa-08da-4446-864e-a05ed7f73f03 on nch1-master-1 Nov 06 21:26:06.728194 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-126a0fe5-2780-43ad-b973-0fafb32a5859 req-7b914603-9afa-4468-a62a-13561b744f25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031149 Nov 06 21:26:06.728906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3968/7825] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:26:07.139265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:07.139942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:07.147703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:07.148160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:07.149000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:07.149438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:07.696487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:07.703688 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-599913a7-2369-4091-b6ec-6f0cde839c52 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.568506 Nov 06 21:26:07.704260 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3858/7826] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:07 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:08.721453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:08.722162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:08.728278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:08.728757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:08.729545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:08.729992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:08.862258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:08.869654 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-efed0f6d-e7a9-499c-8853-73eedd3d8c9b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.153157 Nov 06 21:26:08.870217 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3969/7827] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:08 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:09.887046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:09.887650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:09.894486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:09.894936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:09.895712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:09.896149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:10.032425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:10.040789 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-804126a7-b9ed-4098-acae-e3f9f1abead3 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.157665 Nov 06 21:26:10.041370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3859/7828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:09 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:11.057447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:11.058070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:11.065315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:11.065780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:11.066575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:11.067032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:11.203699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:11.211021 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15c03fae-60f6-4587-8704-835c96225c7b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.157343 Nov 06 21:26:11.211601 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3970/7829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:11 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:12.227425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:12.227964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:12.234610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:12.235067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:12.235850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:12.236321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:12.363975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:12.371342 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f07f332d-4b6e-4b26-8109-22a62b437427 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.147640 Nov 06 21:26:12.371906 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3860/7830] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:12 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:13.388720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:13.389340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:13.396114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:13.396639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:13.397441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:13.397892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:13.530129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:13.538925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e4efb5d-b0fa-45f7-a2d9-d8a479ebdd59 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.153894 Nov 06 21:26:13.539509 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3971/7831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:13 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:13.778609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-cab8067c-61e4-417a-ab3f-a5c648dd275c req-b685b095-a272-4668-8b17-ff574a83cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee22fffa-08da-4446-864e-a05ed7f73f03", "name": "network-vif-plugged", "status": "completed", "tag": "391cdadb-2e23-400b-b9e7-bfcc4174e0e2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:13.780224 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:13.780224 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:26:13.788896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cab8067c-61e4-417a-ab3f-a5c648dd275c req-b685b095-a272-4668-8b17-ff574a83cd31 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:13.789426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-cab8067c-61e4-417a-ab3f-a5c648dd275c req-b685b095-a272-4668-8b17-ff574a83cd31 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:13.800496 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-cab8067c-61e4-417a-ab3f-a5c648dd275c req-b685b095-a272-4668-8b17-ff574a83cd31 service nova] Creating event network-vif-plugged:391cdadb-2e23-400b-b9e7-bfcc4174e0e2 for instance ee22fffa-08da-4446-864e-a05ed7f73f03 on nch1-master-1 Nov 06 21:26:13.805483 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-cab8067c-61e4-417a-ab3f-a5c648dd275c req-b685b095-a272-4668-8b17-ff574a83cd31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Nov 06 21:26:13.806075 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3861/7832] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:26:14.555596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:14.556222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:14.562922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:14.563384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:14.564869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:14.565326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:14.699931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:14.707502 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4eb65e5c-2b6e-4f83-8e03-a4bc3b16636c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1313 microversion: 2.1 time: 0.155548 Nov 06 21:26:14.708074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3972/7833] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:14 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:15.725257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:15.725967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:15.732090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:15.732595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:15.733379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:15.733824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:15.866346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:15.873781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-abce48d6-3abf-45fc-86b8-dbe5bd0b835b tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1496 microversion: 2.1 time: 0.153434 Nov 06 21:26:15.874352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3862/7834] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:15 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:16.210151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:16.210666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:16.217297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:16.217761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:16.218555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:16.219000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:16.244353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:26:16.316904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6dbc3244-255f-4dd4-bb52-45d4482d97dc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 204 len: 0 microversion: 2.1 time: 0.109900 Nov 06 21:26:16.317648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3973/7835] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:26:16 2021] DELETE /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:26:16.325712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:16.326325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:16.332299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:16.332780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:16.333560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:16.333998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:16.463178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:16.471213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e748642-d919-48ea-90b2-85b7ab3dab1c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1502 microversion: 2.1 time: 0.148474 Nov 06 21:26:16.471778 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3863/7836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:16 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:17.489455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:17.490226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:17.496802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:17.497264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:17.498057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:17.498511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:17.635135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:17.642621 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0850339-d702-4c81-9636-504c25cd9572 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 200 len: 1502 microversion: 2.1 time: 0.157830 Nov 06 21:26:17.643183 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3974/7837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:17 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:18.166779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-10b9f502-cf8c-4e71-9883-355d208f2003 req-40f96bbd-80d8-46f5-98cd-c77d0919e862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee22fffa-08da-4446-864e-a05ed7f73f03", "name": "network-vif-deleted", "tag": "391cdadb-2e23-400b-b9e7-bfcc4174e0e2"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:18.169226 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:18.169226 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:26:18.179831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-10b9f502-cf8c-4e71-9883-355d208f2003 req-40f96bbd-80d8-46f5-98cd-c77d0919e862 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:18.180701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-10b9f502-cf8c-4e71-9883-355d208f2003 req-40f96bbd-80d8-46f5-98cd-c77d0919e862 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:18.193675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-10b9f502-cf8c-4e71-9883-355d208f2003 req-40f96bbd-80d8-46f5-98cd-c77d0919e862 service nova] Creating event network-vif-deleted:391cdadb-2e23-400b-b9e7-bfcc4174e0e2 for instance ee22fffa-08da-4446-864e-a05ed7f73f03 on nch1-master-1 Nov 06 21:26:18.199345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-10b9f502-cf8c-4e71-9883-355d208f2003 req-40f96bbd-80d8-46f5-98cd-c77d0919e862 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036837 Nov 06 21:26:18.200225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3864/7838] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:26:18.658920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:18.659547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: ee22fffa-08da-4446-864e-a05ed7f73f03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:18.666535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:18.667005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:18.667803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:18.668257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:18.681791 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] HTTP exception thrown: Instance ee22fffa-08da-4446-864e-a05ed7f73f03 could not be found. Nov 06 21:26:18.682400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Returning 404 to user: Instance ee22fffa-08da-4446-864e-a05ed7f73f03 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:26:18.683232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-17b7e6f1-f63e-4d96-a3c5-8cae3728e439 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03" status: 404 len: 111 microversion: 2.1 time: 0.028140 Nov 06 21:26:18.683759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3975/7839] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:18 2021] GET /compute/v2.1/servers/ee22fffa-08da-4446-864e-a05ed7f73f03 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:26:18.731353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-805596029", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "c0bb3679-3644-4583-b0b6-f38c5e54fc9f"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:18.780442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] validate_networks() for [('c0bb3679-3644-4583-b0b6-f38c5e54fc9f', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:26:19.124125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:26:19.124583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:26:19.125058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:26:19.125469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:26:19.125883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:26:19.134986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:19.135503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:19.136405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:19.136902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:19.153629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Getting quotas for project 701e70fcea614c108e0c7149f5614f14. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:26:19.159351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Getting quotas for user 74051e71cc8d4930a33609c7573801fa and project 701e70fcea614c108e0c7149f5614f14. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:26:19.171646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:26:19.175372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:26:19.221343 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8d2da56-0a4c-4d5d-9f3f-c7048f3eadde tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493556 Nov 06 21:26:19.221993 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3865/7840] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:26:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:26:19.233029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a81c3424-9a20-4d9e-b299-f35ea6d33671 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:19.233686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a81c3424-9a20-4d9e-b299-f35ea6d33671 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:19.295602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a81c3424-9a20-4d9e-b299-f35ea6d33671 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:19.303311 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a81c3424-9a20-4d9e-b299-f35ea6d33671 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1213 microversion: 2.1 time: 0.075192 Nov 06 21:26:19.303987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3976/7841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:19 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:20.320812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:20.321428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:20.328412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:20.328868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:20.329659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:20.330164 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:20.401587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:20.409109 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71cfd17a-db97-49e2-96f5-f7b7eb4d4a32 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1271 microversion: 2.1 time: 0.092950 Nov 06 21:26:20.409685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3866/7842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:20 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:21.357776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-be797e20-8348-430d-93dc-5aa6162454d8 req-e27bcba4-d87e-4a4d-875d-42c7fa6b9f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cc5d23-80ba-4f9c-9266-00cf653178b8", "tag": "6f9b7a8c-a5d5-4a69-83e8-08fcd724704f"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:21.359613 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:21.359613 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:26:21.373670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be797e20-8348-430d-93dc-5aa6162454d8 req-e27bcba4-d87e-4a4d-875d-42c7fa6b9f99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:21.374279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be797e20-8348-430d-93dc-5aa6162454d8 req-e27bcba4-d87e-4a4d-875d-42c7fa6b9f99 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:21.387365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-be797e20-8348-430d-93dc-5aa6162454d8 req-e27bcba4-d87e-4a4d-875d-42c7fa6b9f99 service nova] Creating event network-changed:6f9b7a8c-a5d5-4a69-83e8-08fcd724704f for instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 on nch1-master-1 Nov 06 21:26:21.393007 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-be797e20-8348-430d-93dc-5aa6162454d8 req-e27bcba4-d87e-4a4d-875d-42c7fa6b9f99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039376 Nov 06 21:26:21.393479 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3977/7843] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:26:21.426207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:21.426875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:21.433468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:21.433920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:21.434701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:21.435283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:21.676272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:21.684167 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0443fcd1-59a8-4b29-9c42-8dca8b6168cd tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.261682 Nov 06 21:26:21.684782 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3867/7844] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:21 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:22.702288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:22.703026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:22.710158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:22.710618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:22.711404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:22.711847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:22.841064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:22.848307 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-486abf00-1939-47e4-b8d0-24213499152f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.150079 Nov 06 21:26:22.848866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3978/7845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:22 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:23.866181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:23.866828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:23.873834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:23.874399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:23.875248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:23.875775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:24.005478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:24.012711 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9a23e4f-cb37-4db1-9e85-eeedaaea280c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.150442 Nov 06 21:26:24.013276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3868/7846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:23 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:25.030341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:25.030870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:25.037686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:25.038154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:25.039212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:25.039661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:25.172222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:25.180595 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1cf21a9e-352e-4410-a75d-5f5b6d695bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.154639 Nov 06 21:26:25.181157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3979/7847] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:25 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:26.197172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:26.197717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:26.204629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:26.205087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:26.205907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:26.206348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:26.333118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:26.340328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d511f77-a60c-41b8-9b0a-f209cc9b941d tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.146898 Nov 06 21:26:26.340898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3869/7848] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:26 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:27.356228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:27.356901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:27.363416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:27.363888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:27.364719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:27.365176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:27.498157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:27.505899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8167d738-04e8-4264-9159-dd7d78080bbc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.153419 Nov 06 21:26:27.506442 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3980/7849] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:27 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:27.685657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-45ff6fe3-a70b-47f6-b8e2-d7e3236629d3 req-8042599a-1557-44bb-a6db-4708740544a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc5d23-80ba-4f9c-9266-00cf653178b8", "name": "network-vif-plugged", "status": "completed", "tag": "6f9b7a8c-a5d5-4a69-83e8-08fcd724704f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:27.687217 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:27.687217 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:26:27.696125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-45ff6fe3-a70b-47f6-b8e2-d7e3236629d3 req-8042599a-1557-44bb-a6db-4708740544a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:27.696750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-45ff6fe3-a70b-47f6-b8e2-d7e3236629d3 req-8042599a-1557-44bb-a6db-4708740544a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:27.708601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-45ff6fe3-a70b-47f6-b8e2-d7e3236629d3 req-8042599a-1557-44bb-a6db-4708740544a8 service nova] Creating event network-vif-plugged:6f9b7a8c-a5d5-4a69-83e8-08fcd724704f for instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 on nch1-master-1 Nov 06 21:26:27.713639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-45ff6fe3-a70b-47f6-b8e2-d7e3236629d3 req-8042599a-1557-44bb-a6db-4708740544a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Nov 06 21:26:27.714389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3870/7850] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:26:28.522981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:28.523626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:28.530447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:28.530919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:28.531723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:28.532176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:28.668600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:28.675788 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-00c41658-df69-48ff-920c-bc9bea566922 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1313 microversion: 2.1 time: 0.156537 Nov 06 21:26:28.676362 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3981/7851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:28 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:29.693950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:29.694674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:29.700774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:29.701223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:29.701993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:29.702426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:29.830401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:29.837698 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-944998cc-c9b5-496f-ba8f-efa3da6572ac tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1497 microversion: 2.1 time: 0.149126 Nov 06 21:26:29.838265 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3871/7852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:29 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:26:30.215051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:30.215617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:30.222291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:30.222766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:30.223576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:30.224035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:30.248838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:26:30.321390 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc78a0a2-e374-45f9-be72-8595d5439af8 tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 204 len: 0 microversion: 2.1 time: 0.109645 Nov 06 21:26:30.322013 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3982/7853] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:26:30 2021] DELETE /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:26:30.330278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:30.330988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:30.336800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:30.337249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:30.338025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:30.338460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:30.470025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:30.477863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c440fa3b-bac8-4d9e-b694-bae586ba417c tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1503 microversion: 2.1 time: 0.151410 Nov 06 21:26:30.478470 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3872/7854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:30 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:31.495937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:31.496672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:31.503909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:31.504402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:31.505193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:31.505637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:31.644882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74051e71cc8d4930a33609c7573801fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701e70fcea614c108e0c7149f5614f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:26:31.652269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3b13ee3-215a-4cfb-9fb4-31da353d161f tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 200 len: 1503 microversion: 2.1 time: 0.160505 Nov 06 21:26:31.652852 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3983/7855] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:31 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:26:32.190352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-65deab81-6863-49c6-a148-fa72b3cbc1b1 req-1012802a-aa5a-4921-8f17-cd18ace72f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc5d23-80ba-4f9c-9266-00cf653178b8", "name": "network-vif-deleted", "tag": "6f9b7a8c-a5d5-4a69-83e8-08fcd724704f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:26:32.192057 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:26:32.192057 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:26:32.200012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-65deab81-6863-49c6-a148-fa72b3cbc1b1 req-1012802a-aa5a-4921-8f17-cd18ace72f0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:32.200496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-65deab81-6863-49c6-a148-fa72b3cbc1b1 req-1012802a-aa5a-4921-8f17-cd18ace72f0e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:32.212769 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-65deab81-6863-49c6-a148-fa72b3cbc1b1 req-1012802a-aa5a-4921-8f17-cd18ace72f0e service nova] Creating event network-vif-deleted:6f9b7a8c-a5d5-4a69-83e8-08fcd724704f for instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 on nch1-master-1 Nov 06 21:26:32.217516 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-65deab81-6863-49c6-a148-fa72b3cbc1b1 req-1012802a-aa5a-4921-8f17-cd18ace72f0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Nov 06 21:26:32.218498 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3873/7856] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:26:32.669712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:26:32.670335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] [instance: 93cc5d23-80ba-4f9c-9266-00cf653178b8] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:26:32.677011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:32.677481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:32.678277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:26:32.678727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:26:32.692490 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] HTTP exception thrown: Instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 could not be found. Nov 06 21:26:32.693090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] Returning 404 to user: Instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:26:32.693995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fdfe6993-250d-4e81-b9e5-f60d2ccdb6fc tempest-VolumesActionsTest-1861903148 tempest-VolumesActionsTest-1861903148-project] 10.222.0.13 "GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8" status: 404 len: 111 microversion: 2.1 time: 0.028074 Nov 06 21:26:32.694520 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3984/7857] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:26:32 2021] GET /compute/v2.1/servers/93cc5d23-80ba-4f9c-9266-00cf653178b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:27:06.823492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-843395010", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "55da79f3-a81e-4226-8c6c-86fd653ef800"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:27:06.874062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] validate_networks() for [('55da79f3-a81e-4226-8c6c-86fd653ef800', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:27:07.219635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:27:07.220057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:27:07.220563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:27:07.221034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:27:07.221444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:27:07.230067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:07.230511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:07.231315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:07.231746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:07.247536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Getting quotas for project b2f1edabb529405dbb79f70a83da7904. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:27:07.252908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Getting quotas for user 8b89904b266f4acbbd99e238cad011d9 and project b2f1edabb529405dbb79f70a83da7904. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:27:07.264739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:27:07.267136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:27:07.310840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-499e8e5b-d6a9-40a8-97b8-a2be83eec51f tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492467 Nov 06 21:27:07.311483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3874/7858] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:27:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:27:07.322044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a5840efb-ffe6-4e5b-8415-1496e5f72f53 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:07.322700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a5840efb-ffe6-4e5b-8415-1496e5f72f53 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:07.378243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a5840efb-ffe6-4e5b-8415-1496e5f72f53 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:07.385031 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a5840efb-ffe6-4e5b-8415-1496e5f72f53 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1218 microversion: 2.1 time: 0.066712 Nov 06 21:27:07.385936 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3985/7859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:07 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:08.402719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:08.403331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:08.410626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:08.411088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:08.411885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:08.412355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:08.801499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:08.808826 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edca9d12-ad6d-4973-b203-0a12b9e50354 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1276 microversion: 2.1 time: 0.410638 Nov 06 21:27:08.809502 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3875/7860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:08 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:09.745371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ed025273-bea2-4b54-931e-832117ecd603 req-25fed0a5-0168-4f76-a837-faa894acd7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40a325e-11ea-4af6-a632-87000fa80ad3", "tag": "77439774-b9b9-4de2-b8b4-2dfa5a812f6d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:27:09.747282 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:27:09.747282 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:27:09.757048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed025273-bea2-4b54-931e-832117ecd603 req-25fed0a5-0168-4f76-a837-faa894acd7c9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:09.757602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ed025273-bea2-4b54-931e-832117ecd603 req-25fed0a5-0168-4f76-a837-faa894acd7c9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:09.770072 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ed025273-bea2-4b54-931e-832117ecd603 req-25fed0a5-0168-4f76-a837-faa894acd7c9 service nova] Creating event network-changed:77439774-b9b9-4de2-b8b4-2dfa5a812f6d for instance e40a325e-11ea-4af6-a632-87000fa80ad3 on nch1-master-1 Nov 06 21:27:09.775040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ed025273-bea2-4b54-931e-832117ecd603 req-25fed0a5-0168-4f76-a837-faa894acd7c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036064 Nov 06 21:27:09.775638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3986/7861] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:27:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:27:09.825991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:09.826750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:09.833937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:09.834391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:09.835178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:09.835618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:10.067144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:10.074604 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a8526394-3311-409c-ae3b-96b15c73f727 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.252256 Nov 06 21:27:10.075518 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3876/7862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:09 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:11.092302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:11.093074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:11.100550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:11.101023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:11.101832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:11.102291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:11.235171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:11.242955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6aa58a28-814b-4836-971e-fde000018c64 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.154686 Nov 06 21:27:11.243543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3987/7863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:11 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:12.259566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:12.260086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:12.266839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:12.267295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:12.268147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:12.268620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:12.403904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:12.411760 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bc1ed14-73d9-4a85-9096-71b876c5f7dc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.155981 Nov 06 21:27:12.412342 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3877/7864] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:12 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:13.430815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:13.431442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:13.438108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:13.438579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:13.439467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:13.440485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:13.681068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:13.688226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84108e95-b8b0-4213-9082-7a89ee4c438c tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.261169 Nov 06 21:27:13.688813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3988/7865] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:13 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:14.704930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:14.705669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:14.713771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:14.714045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:14.714843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:14.715287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:14.904089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:14.912020 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ccbc147e-2a2d-4171-a542-2fc5cd0c4bdc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.210805 Nov 06 21:27:14.912638 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3878/7866] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:14 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:15.888609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-6987890b-e536-457f-b9c0-5906b46f277c req-34980831-e32a-4e8c-ba29-a80f63030bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40a325e-11ea-4af6-a632-87000fa80ad3", "name": "network-vif-plugged", "status": "completed", "tag": "77439774-b9b9-4de2-b8b4-2dfa5a812f6d"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:27:15.890123 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:27:15.890123 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:27:15.898657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6987890b-e536-457f-b9c0-5906b46f277c req-34980831-e32a-4e8c-ba29-a80f63030bf0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:15.899188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-6987890b-e536-457f-b9c0-5906b46f277c req-34980831-e32a-4e8c-ba29-a80f63030bf0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:15.911692 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-6987890b-e536-457f-b9c0-5906b46f277c req-34980831-e32a-4e8c-ba29-a80f63030bf0 service nova] Creating event network-vif-plugged:77439774-b9b9-4de2-b8b4-2dfa5a812f6d for instance e40a325e-11ea-4af6-a632-87000fa80ad3 on nch1-master-1 Nov 06 21:27:15.916903 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-6987890b-e536-457f-b9c0-5906b46f277c req-34980831-e32a-4e8c-ba29-a80f63030bf0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Nov 06 21:27:15.917482 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3989/7867] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:27:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:27:15.929682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:15.930291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:15.937378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:15.937822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:15.938607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:15.939675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:16.134106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:16.141732 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bfc1047-b100-4a15-9409-c3896b3b80f2 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.216452 Nov 06 21:27:16.142314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3879/7868] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:15 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:17.159771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:17.160543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:17.167668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:17.168137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:17.169086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:17.169535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:17.304115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:17.311622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1304654-d057-47c6-9861-b775b1ea4d07 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1318 microversion: 2.1 time: 0.156388 Nov 06 21:27:17.312191 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3990/7869] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:17 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:18.328743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:27:18.329346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:18.335950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:18.336438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:18.337212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:18.337645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:18.466086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:27:18.473580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8258656a-91d9-49d1-8b6e-ed2634ff0215 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1506 microversion: 2.1 time: 0.148508 Nov 06 21:27:18.474151 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3880/7870] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:27:18 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:27:19.920065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90ca2f79-836b-4c1a-a651-e0a3518fcfe7", "device": "/dev/sdb"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:27:19.921198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:27:19.928444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:19.928921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:19.929697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:27:19.930139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:27:20.159911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7a26c75-7a2e-4406-8500-edab9c0553c8 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "POST /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242792 Nov 06 21:27:20.160577 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3991/7871] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:27:19 2021] POST /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:28:08.273440 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:28:08.274006 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:28:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:28:12.043513 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:28:12.044000 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:28:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:28:31.108385 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:28:31.109049 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:28:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:28:59.429855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:28:59.430356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:28:59.436133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:28:59.436614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:28:59.437389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:28:59.437819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:28:59.516702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lazy-loading 'services' on Instance uuid e40a325e-11ea-4af6-a632-87000fa80ad3 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:28:59.582888 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a11d3cf7-a22c-403d-979d-084a783b44b6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3/os-volume_attachments/90ca2f79-836b-4c1a-a651-e0a3518fcfe7" status: 202 len: 0 microversion: 2.1 time: 0.158325 Nov 06 21:28:59.583644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3881/7872] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:28:59 2021] DELETE /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3/os-volume_attachments/90ca2f79-836b-4c1a-a651-e0a3518fcfe7 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:29:00.694283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:00.694932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:00.702431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:00.702892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:00.704084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:00.704567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:00.731415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:29:00.804651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-667b5dca-3d75-4ffa-a3b3-a18dd0f79214 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 204 len: 0 microversion: 2.1 time: 0.115452 Nov 06 21:29:00.805231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3992/7873] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:29:00 2021] DELETE /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:29:00.813953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:00.814661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:00.821501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:00.821958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:00.822747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:00.823190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:00.956063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:00.963371 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95b3f37d-b5a6-4086-820e-59db2c9a2170 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1512 microversion: 2.1 time: 0.153547 Nov 06 21:29:00.963932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3882/7874] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:00 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:01.981612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:01.982325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:01.989604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:01.990064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:01.990851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:01.991295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:02.123331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:02.131273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07d00e4d-0301-4b6e-8a77-2137ce03d83a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1512 microversion: 2.1 time: 0.153692 Nov 06 21:29:02.131773 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3993/7875] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:01 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:02.996472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-686693b9-c91b-4067-90e1-a5c1a8d07383 req-379a0396-ae3b-4a77-a77e-9dac6392e33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40a325e-11ea-4af6-a632-87000fa80ad3", "name": "network-vif-deleted", "tag": "77439774-b9b9-4de2-b8b4-2dfa5a812f6d"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:29:02.998117 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:29:02.998117 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:29:03.005581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-686693b9-c91b-4067-90e1-a5c1a8d07383 req-379a0396-ae3b-4a77-a77e-9dac6392e33e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:03.006035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-686693b9-c91b-4067-90e1-a5c1a8d07383 req-379a0396-ae3b-4a77-a77e-9dac6392e33e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:03.016605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-686693b9-c91b-4067-90e1-a5c1a8d07383 req-379a0396-ae3b-4a77-a77e-9dac6392e33e service nova] Creating event network-vif-deleted:77439774-b9b9-4de2-b8b4-2dfa5a812f6d for instance e40a325e-11ea-4af6-a632-87000fa80ad3 on nch1-master-1 Nov 06 21:29:03.021995 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-686693b9-c91b-4067-90e1-a5c1a8d07383 req-379a0396-ae3b-4a77-a77e-9dac6392e33e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164833 Nov 06 21:29:03.022559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3883/7876] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:29:03.148650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:03.149285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:03.155934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:03.156436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:03.157233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:03.157679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:03.189732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:03.190186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:03.190647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lazy-loading 'fault' on Instance uuid e40a325e-11ea-4af6-a632-87000fa80ad3 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:29:03.233776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:03.242027 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a422602-730c-4d4b-9a9b-326a4e615c72 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 200 len: 1308 microversion: 2.1 time: 0.097812 Nov 06 21:29:03.242597 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3994/7877] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:03 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:04.260166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:04.260826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: e40a325e-11ea-4af6-a632-87000fa80ad3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:04.266904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:04.267363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:04.268143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:04.268611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:04.281823 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] HTTP exception thrown: Instance e40a325e-11ea-4af6-a632-87000fa80ad3 could not be found. Nov 06 21:29:04.282411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Returning 404 to user: Instance e40a325e-11ea-4af6-a632-87000fa80ad3 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:29:04.283228 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bc1e4d13-0c34-4777-b5a8-ad33d350053b tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3" status: 404 len: 111 microversion: 2.1 time: 0.028066 Nov 06 21:29:04.283744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3884/7878] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:04 2021] GET /compute/v2.1/servers/e40a325e-11ea-4af6-a632-87000fa80ad3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:29:07.881129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-801168072", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "55da79f3-a81e-4226-8c6c-86fd653ef800"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:29:07.932160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] validate_networks() for [('55da79f3-a81e-4226-8c6c-86fd653ef800', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:29:08.324700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:29:08.325140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:29:08.325627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:29:08.326048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:29:08.326471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:29:08.335084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:08.335540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:08.336386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:08.336838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:08.353293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Getting quotas for project b2f1edabb529405dbb79f70a83da7904. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:29:08.358160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Getting quotas for user 8b89904b266f4acbbd99e238cad011d9 and project b2f1edabb529405dbb79f70a83da7904. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:29:08.370448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:29:08.372779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:29:08.416318 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea4443fb-edfd-40a0-865c-74d8cb305086 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539564 Nov 06 21:29:08.417239 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3995/7879] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:29:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:29:08.427556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c3b4f69-f7e8-4688-81c2-025c17e2d32a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:08.428171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c3b4f69-f7e8-4688-81c2-025c17e2d32a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:08.480647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c3b4f69-f7e8-4688-81c2-025c17e2d32a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:08.487159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c3b4f69-f7e8-4688-81c2-025c17e2d32a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1218 microversion: 2.1 time: 0.063838 Nov 06 21:29:08.495176 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3885/7880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:08 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:09.506529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:09.507334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:09.514098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:09.514644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:09.515529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:09.515988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:09.582850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:09.590157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7bba496-76b3-4f11-9559-8bcf59e6e00e tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1276 microversion: 2.1 time: 0.088880 Nov 06 21:29:09.590720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3996/7881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:09 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:10.607530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:10.608355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:10.616016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:10.616579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:10.617430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:10.617873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:10.655809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1ad47773-6209-4150-a7e2-33c617825b83 req-a3b7ed15-019f-4c83-a5cf-540b3a6713be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7e7680-bb27-4a8d-a104-8d6ad422cd50", "tag": "cf6fffe4-36a7-4dc5-abaa-60d4ece19859"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:29:10.657794 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:29:10.657794 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:29:10.665938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1ad47773-6209-4150-a7e2-33c617825b83 req-a3b7ed15-019f-4c83-a5cf-540b3a6713be service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:10.666409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1ad47773-6209-4150-a7e2-33c617825b83 req-a3b7ed15-019f-4c83-a5cf-540b3a6713be service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:10.678419 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1ad47773-6209-4150-a7e2-33c617825b83 req-a3b7ed15-019f-4c83-a5cf-540b3a6713be service nova] Creating event network-changed:cf6fffe4-36a7-4dc5-abaa-60d4ece19859 for instance af7e7680-bb27-4a8d-a104-8d6ad422cd50 on nch1-master-1 Nov 06 21:29:10.683157 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1ad47773-6209-4150-a7e2-33c617825b83 req-a3b7ed15-019f-4c83-a5cf-540b3a6713be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031040 Nov 06 21:29:10.683770 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3997/7882] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:29:10.870838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:10.879585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1223a63-f7e7-450c-8f4c-a4af527ae4c9 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.276104 Nov 06 21:29:10.880277 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3886/7883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:10 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:11.897736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:11.898448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:11.904675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:11.905145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:11.905934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:11.906386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:12.043175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:12.050644 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87a817d3-b6d4-4ab7-8320-bcb674bba796 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.158465 Nov 06 21:29:12.051231 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3998/7884] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:11 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:13.067438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:13.068054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:13.074697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:13.075150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:13.075924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:13.076387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:13.205489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:13.213402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-65012fde-162d-46b7-be2e-8726205d52dd tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.149827 Nov 06 21:29:13.213957 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3887/7885] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:13 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:14.230622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:14.231344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:14.238508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:14.238973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:14.239777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:14.240221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:14.375905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:14.383314 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b02d68cc-0ca6-44cd-9f5c-ee76918bcba3 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.156395 Nov 06 21:29:14.383882 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 3999/7886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:14 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:15.400222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:15.400878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:15.407508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:15.407966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:15.408780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:15.409220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:15.537188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:15.545592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0666a8b5-ef82-40c6-bc66-efa5197505b0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.148954 Nov 06 21:29:15.546372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3888/7887] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:15 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:16.428183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-b240983d-1aa1-4af5-9f11-5c57dae01386 req-415ff3ea-97a5-48b9-bc84-5fbb3143f803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7e7680-bb27-4a8d-a104-8d6ad422cd50", "name": "network-vif-plugged", "status": "completed", "tag": "cf6fffe4-36a7-4dc5-abaa-60d4ece19859"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:29:16.429875 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:29:16.429875 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:29:16.437637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b240983d-1aa1-4af5-9f11-5c57dae01386 req-415ff3ea-97a5-48b9-bc84-5fbb3143f803 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:16.438094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-b240983d-1aa1-4af5-9f11-5c57dae01386 req-415ff3ea-97a5-48b9-bc84-5fbb3143f803 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:16.449170 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-b240983d-1aa1-4af5-9f11-5c57dae01386 req-415ff3ea-97a5-48b9-bc84-5fbb3143f803 service nova] Creating event network-vif-plugged:cf6fffe4-36a7-4dc5-abaa-60d4ece19859 for instance af7e7680-bb27-4a8d-a104-8d6ad422cd50 on nch1-master-1 Nov 06 21:29:16.454028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-b240983d-1aa1-4af5-9f11-5c57dae01386 req-415ff3ea-97a5-48b9-bc84-5fbb3143f803 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098453 Nov 06 21:29:16.454589 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4000/7888] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:29:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:29:16.562872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:16.563592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:16.570708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:16.571159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:16.571935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:16.572396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:16.701780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:16.709655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4649745c-b6e4-419f-a8cf-90558d89d295 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.150561 Nov 06 21:29:16.710246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3889/7889] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:16 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:17.727635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:17.728370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:17.735200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:17.735662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:17.736477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:17.737000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:17.867586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:17.876762 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ea78f69-b480-42dd-bfb7-0bb75d745276 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1318 microversion: 2.1 time: 0.153167 Nov 06 21:29:17.878564 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4001/7890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:17 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:18.894181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:29:18.894823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:18.901507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:18.901956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:18.902735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:18.903174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:19.036226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:29:19.043799 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12e71a4d-1fbe-41b9-875f-9927035fe706 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1507 microversion: 2.1 time: 0.153312 Nov 06 21:29:19.044384 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3890/7891] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:29:18 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:29:19.059974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ec0a7db-df57-43d7-aeab-fb28d412a109", "device": "/dev/sdb"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:29:19.061128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:29:19.067745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:19.068217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:19.069053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:29:19.069509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:29:19.292898 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "POST /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236055 Nov 06 21:29:19.293525 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4002/7892] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:29:19 2021] POST /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50/os-volume_attachments => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:29:48.323796 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:29:48.324400 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:29:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:30:56.280333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:30:56.280947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:30:56.287337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:56.287788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:56.288588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:56.289020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:56.364721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lazy-loading 'services' on Instance uuid af7e7680-bb27-4a8d-a104-8d6ad422cd50 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:30:56.431159 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24dc60ea-9715-4165-a0b2-b32b6066e644 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50/os-volume_attachments/0ec0a7db-df57-43d7-aeab-fb28d412a109" status: 202 len: 0 microversion: 2.1 time: 0.155711 Nov 06 21:30:56.431736 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3891/7893] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:30:56 2021] DELETE /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50/os-volume_attachments/0ec0a7db-df57-43d7-aeab-fb28d412a109 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:30:57.537474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:30:57.538079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:30:57.544528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:57.544999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:57.545800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:57.546254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:57.574535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:30:57.647016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d474bf3f-ec13-4c9a-b2d4-7b279adb987a tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 204 len: 0 microversion: 2.1 time: 0.114432 Nov 06 21:30:57.647625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4003/7894] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:30:57 2021] DELETE /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:30:57.657739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:30:57.658570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:30:57.665297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:57.665750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:57.666534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:57.666975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:57.796436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:30:57.803954 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-89621398-3d95-48d0-9550-f5fafe84b345 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1513 microversion: 2.1 time: 0.151458 Nov 06 21:30:57.804546 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3892/7895] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:30:57 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:30:58.821723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:30:58.822440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:30:58.829321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:58.829788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:58.830585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:30:58.831034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:30:58.963057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:30:58.970552 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13685241-70c5-4fd8-9ca0-54680da6afcc tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1513 microversion: 2.1 time: 0.153005 Nov 06 21:30:58.971114 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4004/7896] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:30:58 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:30:59.989191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:30:59.990339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:00.003145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8b378fa7-60ba-450c-8572-c04e5bdf0c8f req-ec19ce86-7c25-480a-9478-84d9eeb8c129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7e7680-bb27-4a8d-a104-8d6ad422cd50", "name": "network-vif-deleted", "tag": "cf6fffe4-36a7-4dc5-abaa-60d4ece19859"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:00.004729 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:31:00.004729 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:31:00.005930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:00.006505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:00.007409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:00.007757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:00.013445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b378fa7-60ba-450c-8572-c04e5bdf0c8f req-ec19ce86-7c25-480a-9478-84d9eeb8c129 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:00.013909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8b378fa7-60ba-450c-8572-c04e5bdf0c8f req-ec19ce86-7c25-480a-9478-84d9eeb8c129 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:00.025499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8b378fa7-60ba-450c-8572-c04e5bdf0c8f req-ec19ce86-7c25-480a-9478-84d9eeb8c129 service nova] Creating event network-vif-deleted:cf6fffe4-36a7-4dc5-abaa-60d4ece19859 for instance af7e7680-bb27-4a8d-a104-8d6ad422cd50 on nch1-master-1 Nov 06 21:31:00.030785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8b378fa7-60ba-450c-8572-c04e5bdf0c8f req-ec19ce86-7c25-480a-9478-84d9eeb8c129 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 Nov 06 21:31:00.032107 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4005/7897] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:31:00.073276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b89904b266f4acbbd99e238cad011d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1edabb529405dbb79f70a83da7904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:00.080585 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-730bfa9f-3a23-4e5f-9271-294cd41f0fc6 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 200 len: 1471 microversion: 2.1 time: 0.096342 Nov 06 21:31:00.081394 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3893/7898] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:30:59 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:01.098788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:01.099504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] [instance: af7e7680-bb27-4a8d-a104-8d6ad422cd50] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:01.105720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:01.106181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:01.106978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:01.107427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:01.120283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] HTTP exception thrown: Instance af7e7680-bb27-4a8d-a104-8d6ad422cd50 could not be found. Nov 06 21:31:01.120901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] Returning 404 to user: Instance af7e7680-bb27-4a8d-a104-8d6ad422cd50 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:31:01.121728 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9a05f88-1d24-4731-b1a6-df0469755880 tempest-VolumesSnapshotTestJSON-340105368 tempest-VolumesSnapshotTestJSON-340105368-project] 10.222.0.13 "GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50" status: 404 len: 111 microversion: 2.1 time: 0.027941 Nov 06 21:31:01.122250 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4006/7899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:01 2021] GET /compute/v2.1/servers/af7e7680-bb27-4a8d-a104-8d6ad422cd50 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:31:27.331077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: .version_select at 0x7f6714c02820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-825681438"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:27.350356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:31:27.356159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:31:27.369262 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:31:28.386491 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35468. Nov 06 21:31:28.517783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:31:28.522788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:31:28.537770 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2c3658de-b7b3-49e2-b830-cc2bee4088e6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.210479 Nov 06 21:31:28.538374 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3894/7900] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:31:27 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:29.648539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1096769760", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "1a6bd64b-813a-4ccc-93b8-5dbb1e1fa70f"}], "key_name": "tempest-TestNetworkBasicOps-825681438", "security_groups": [{"name": "tempest-secgroup-smoke-1422410611"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:29.773886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] validate_networks() for [('1a6bd64b-813a-4ccc-93b8-5dbb1e1fa70f', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:31:30.531654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:31:30.532098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:31:30.532636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:31:30.533068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:31:30.533520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:31:30.542724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:30.543185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:30.544261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:30.544747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:30.560688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:31:30.565653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:31:30.577364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:31:30.579689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:31:30.623272 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:31:31.639057 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35500. Nov 06 21:31:31.643631 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae785ccb-c83a-44bb-814e-842a06834abd tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.999340 Nov 06 21:31:31.644352 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4007/7901] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:31:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:31:31.656333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8642f0c-10ac-450a-9acb-2cf1f1101f2b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:31.656956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f8642f0c-10ac-450a-9acb-2cf1f1101f2b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:31.714618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f8642f0c-10ac-450a-9acb-2cf1f1101f2b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:31.721458 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8642f0c-10ac-450a-9acb-2cf1f1101f2b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1248 microversion: 2.1 time: 0.071185 Nov 06 21:31:31.722121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3895/7902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:31 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:32.739802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:32.740462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:32.747761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:32.748235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:32.749109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:32.749567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:32.819341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:32.827432 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-673717cd-01f9-429c-9ee6-ec551df376a1 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1306 microversion: 2.1 time: 0.092240 Nov 06 21:31:32.828012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4008/7903] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:32 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:33.844444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:33.845692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:33.853058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:33.853672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:33.854487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:33.855104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:33.911295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-680f624c-bbbc-432a-8ee9-1b2a89d75df3 req-2ed22c19-09d9-4e58-99c3-69cbbbd7b3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857258ee-3282-4de0-80ac-e8cdf2efd741", "tag": "e346ad0e-b3bd-49c6-a7dd-7114c259df6b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:33.914476 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:31:33.914476 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:31:33.924850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-680f624c-bbbc-432a-8ee9-1b2a89d75df3 req-2ed22c19-09d9-4e58-99c3-69cbbbd7b3a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:33.925756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-680f624c-bbbc-432a-8ee9-1b2a89d75df3 req-2ed22c19-09d9-4e58-99c3-69cbbbd7b3a8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:33.940255 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-680f624c-bbbc-432a-8ee9-1b2a89d75df3 req-2ed22c19-09d9-4e58-99c3-69cbbbd7b3a8 service nova] Creating event network-changed:e346ad0e-b3bd-49c6-a7dd-7114c259df6b for instance 857258ee-3282-4de0-80ac-e8cdf2efd741 on nch1-master-1 Nov 06 21:31:33.947535 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-680f624c-bbbc-432a-8ee9-1b2a89d75df3 req-2ed22c19-09d9-4e58-99c3-69cbbbd7b3a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041761 Nov 06 21:31:33.948651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4009/7904] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:31:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:31:34.131550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:34.139515 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60b0448f-ee08-47ce-a587-b40492bc4836 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.299446 Nov 06 21:31:34.140168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3896/7905] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:33 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:35.157620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:35.158415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:35.165307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:35.165769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:35.166551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:35.166997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:35.299018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:35.306243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-474b3d97-b66e-4fcf-b9ad-0aeecf30ed7e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.153867 Nov 06 21:31:35.306803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4010/7906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:35 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:36.322968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:36.323592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:36.330257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:36.330712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:36.331497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:36.331948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:36.467285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:36.474465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8dc2579d-0a8d-49f4-bebd-bd597af0908c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.155279 Nov 06 21:31:36.475026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3897/7907] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:36 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:37.491933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:37.493140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:37.499830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:37.500308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:37.501225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:37.501673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:37.632686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:37.640155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61a0a87c-8e71-477a-9d96-3f1eaccb7387 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.152024 Nov 06 21:31:37.640754 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4011/7908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:37 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:38.655859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:38.656559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:38.663016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:38.663474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:38.664255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:38.664718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:38.798809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:38.806641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e89cad01-1063-4827-94db-78320bf5d796 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.154457 Nov 06 21:31:38.807205 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3898/7909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:38 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:38.957114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-770ed67f-8e60-4c8f-8d90-90031b040956 req-3a92c3e0-d1a8-4641-be59-482b04781fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857258ee-3282-4de0-80ac-e8cdf2efd741", "name": "network-vif-plugged", "status": "completed", "tag": "e346ad0e-b3bd-49c6-a7dd-7114c259df6b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:38.958827 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:31:38.958827 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:31:38.968380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-770ed67f-8e60-4c8f-8d90-90031b040956 req-3a92c3e0-d1a8-4641-be59-482b04781fa6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:38.968847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-770ed67f-8e60-4c8f-8d90-90031b040956 req-3a92c3e0-d1a8-4641-be59-482b04781fa6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:38.982198 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-770ed67f-8e60-4c8f-8d90-90031b040956 req-3a92c3e0-d1a8-4641-be59-482b04781fa6 service nova] Creating event network-vif-plugged:e346ad0e-b3bd-49c6-a7dd-7114c259df6b for instance 857258ee-3282-4de0-80ac-e8cdf2efd741 on nch1-master-1 Nov 06 21:31:38.987481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-770ed67f-8e60-4c8f-8d90-90031b040956 req-3a92c3e0-d1a8-4641-be59-482b04781fa6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Nov 06 21:31:38.988456 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4012/7910] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:31:39.823140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:39.823757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:39.830544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:39.831006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:39.831795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:39.832241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:39.965759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:39.973238 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eed97bf3-5dc3-444c-90ac-167638f844cb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1374 microversion: 2.1 time: 0.154233 Nov 06 21:31:39.973814 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3899/7911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:39 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:40.990707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:40.991356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:40.998324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:40.998797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:40.999592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:41.000048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:41.133029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:41.140560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d09d63ad-0d2a-4e8b-8cbd-f772f0c2e2d6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1545 microversion: 2.1 time: 0.154094 Nov 06 21:31:41.141129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4013/7912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:40 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:41.156812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:31:41.157431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:31:41.165169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:41.165630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:41.166412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:41.166855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:41.298737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:31:41.305973 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08c9db89-e399-493d-85da-b40bc760a8ff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1545 microversion: 2.1 time: 0.152741 Nov 06 21:31:41.306531 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3900/7913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:31:41 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:31:43.309937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-643a6287-d073-4248-a494-582943da0592 req-e88a1ff1-1ef2-4cee-9be4-934b413577f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857258ee-3282-4de0-80ac-e8cdf2efd741", "tag": "e346ad0e-b3bd-49c6-a7dd-7114c259df6b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:31:43.311490 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:31:43.311490 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:31:43.321455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-643a6287-d073-4248-a494-582943da0592 req-e88a1ff1-1ef2-4cee-9be4-934b413577f4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:31:43.322132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-643a6287-d073-4248-a494-582943da0592 req-e88a1ff1-1ef2-4cee-9be4-934b413577f4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:31:43.333982 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-643a6287-d073-4248-a494-582943da0592 req-e88a1ff1-1ef2-4cee-9be4-934b413577f4 service nova] Creating event network-changed:e346ad0e-b3bd-49c6-a7dd-7114c259df6b for instance 857258ee-3282-4de0-80ac-e8cdf2efd741 on nch1-master-1 Nov 06 21:31:43.339261 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-643a6287-d073-4248-a494-582943da0592 req-e88a1ff1-1ef2-4cee-9be4-934b413577f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033058 Nov 06 21:31:43.339951 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4014/7914] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:31:51.125736 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:31:51.126353 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:31:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:32:13.700163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:32:13.701222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:13.707263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:13.707719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:13.708523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:13.708972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:13.761620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6198bca1-0ea2-4805-81f5-4bde48783cb8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741/action" status: 200 len: 24573 microversion: 2.1 time: 0.065367 Nov 06 21:32:13.762453 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3901/7915] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:32:13 2021] POST /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741/action => generated 24573 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:32:48.483766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: .version_select at 0x7f6714b1c700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-501456847"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:32:48.503570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:32:48.508584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:32:48.715613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:32:48.720470 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:32:48.735020 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08d01998-d705-4db2-9728-8baf9a1df967 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.257542 Nov 06 21:32:48.735634 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4015/7916] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:32:48 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:49.727904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-37322962", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "480635b8-68fe-4fd9-a179-445c037a685c"}], "key_name": "tempest-TestNetworkBasicOps-501456847", "security_groups": [{"name": "tempest-secgroup-smoke-652914836"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:32:50.043779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] validate_networks() for [('480635b8-68fe-4fd9-a179-445c037a685c', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:32:50.487977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:32:50.488437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:32:50.488951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:32:50.489367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:32:50.489812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:32:50.499426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:50.499880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:50.500748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:50.501190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:50.517830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:32:50.522840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:32:50.534675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:32:50.537121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:32:50.581453 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [7da6b4b8-18e6-463a-9bfd-71b1f1d3fb39] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:32:51.598288 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [7da6b4b8-18e6-463a-9bfd-71b1f1d3fb39] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35660. Nov 06 21:32:51.602693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e09b4ef-a689-426e-8c77-7561549a2f85 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.878922 Nov 06 21:32:51.603901 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3902/7917] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:32:49 2021] POST /compute/v2.1/servers => generated 405 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:32:51.614517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-342e8b26-d8ec-4c6b-8a04-9ff494bdb5ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:51.615265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-342e8b26-d8ec-4c6b-8a04-9ff494bdb5ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:51.727756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-342e8b26-d8ec-4c6b-8a04-9ff494bdb5ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:51.735467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-342e8b26-d8ec-4c6b-8a04-9ff494bdb5ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1246 microversion: 2.1 time: 0.125500 Nov 06 21:32:51.742193 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4016/7918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:51 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:52.752670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:52.753448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:52.761171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:52.761600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:52.762378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:52.762815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:52.825198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:52.832820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e3f0e49-1333-4de2-bb69-533e313ca09b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1304 microversion: 2.1 time: 0.083831 Nov 06 21:32:52.833407 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3903/7919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:52 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:53.850467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:53.851117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:53.859876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:53.861014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:53.862295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:53.863760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:53.973002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4c9585e8-51c5-4162-a112-fb7ea2b771d0 req-b9d00dba-18ed-44b6-ac43-2038ac80792d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011ebc6d-0c3c-4158-a043-78ad05ccb89d", "tag": "d2f4d650-9453-48b8-a5a5-f8997762e236"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:32:53.975309 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:32:53.975309 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:32:53.984758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c9585e8-51c5-4162-a112-fb7ea2b771d0 req-b9d00dba-18ed-44b6-ac43-2038ac80792d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:53.986038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4c9585e8-51c5-4162-a112-fb7ea2b771d0 req-b9d00dba-18ed-44b6-ac43-2038ac80792d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:53.999283 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4c9585e8-51c5-4162-a112-fb7ea2b771d0 req-b9d00dba-18ed-44b6-ac43-2038ac80792d service nova] Creating event network-changed:d2f4d650-9453-48b8-a5a5-f8997762e236 for instance 011ebc6d-0c3c-4158-a043-78ad05ccb89d on nch2-master-1 Nov 06 21:32:54.004995 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4c9585e8-51c5-4162-a112-fb7ea2b771d0 req-b9d00dba-18ed-44b6-ac43-2038ac80792d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152746 Nov 06 21:32:54.006122 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3904/7920] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:32:54.047094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:54.055463 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b484895-03c5-45fb-bb7c-a4e1d4ad0042 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.209279 Nov 06 21:32:54.065625 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4017/7921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:53 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:55.073529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:55.074346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:55.081214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:55.081662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:55.082464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:55.082900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:55.221391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:55.228662 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf5e869f-a4b6-4467-a5e2-67cd07c1a2b4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.159617 Nov 06 21:32:55.229225 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3905/7922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:55 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:56.246456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:56.247110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:56.253591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:56.254066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:56.254869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:56.255326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:56.388435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:56.395705 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-470f7488-67f1-4994-a96d-1abd107d522c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.153922 Nov 06 21:32:56.396272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4018/7923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:56 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:57.412920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:57.413529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:57.421088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:57.421539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:57.422310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:57.422758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:57.555161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:57.562356 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-31f37251-fc2e-4954-964e-47bec186d373 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.153102 Nov 06 21:32:57.562916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3906/7924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:57 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:58.579145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:58.579767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:58.586512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:58.586976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:58.587766 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:58.588214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:58.718513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:58.725737 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9b1e380-86ba-4c7e-a1d0-f699643c30ce tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.150349 Nov 06 21:32:58.726295 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4019/7925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:58 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:32:59.742747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:32:59.743403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:32:59.750883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:59.751739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:59.753137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:59.753942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:59.849349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-268a8f48-5e33-4900-bfee-521b1c845ab5 req-813e1114-209e-406d-8307-dee3a6d38c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ebc6d-0c3c-4158-a043-78ad05ccb89d", "name": "network-vif-plugged", "status": "completed", "tag": "d2f4d650-9453-48b8-a5a5-f8997762e236"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:32:59.851423 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:32:59.851423 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:32:59.859129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-268a8f48-5e33-4900-bfee-521b1c845ab5 req-813e1114-209e-406d-8307-dee3a6d38c2e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:32:59.859508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-268a8f48-5e33-4900-bfee-521b1c845ab5 req-813e1114-209e-406d-8307-dee3a6d38c2e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:32:59.871442 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-268a8f48-5e33-4900-bfee-521b1c845ab5 req-813e1114-209e-406d-8307-dee3a6d38c2e service nova] Creating event network-vif-plugged:d2f4d650-9453-48b8-a5a5-f8997762e236 for instance 011ebc6d-0c3c-4158-a043-78ad05ccb89d on nch2-master-1 Nov 06 21:32:59.877805 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-268a8f48-5e33-4900-bfee-521b1c845ab5 req-813e1114-209e-406d-8307-dee3a6d38c2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Nov 06 21:32:59.878427 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4020/7926] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:32:59.897549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:32:59.905448 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c17fac5-2a31-4a5d-9e25-9c54f181e89c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.166341 Nov 06 21:32:59.906374 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3907/7927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:32:59 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:00.924387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:00.925098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:00.931266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:00.931737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:00.932553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:00.933012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:01.069340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:01.077429 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87c3e47c-78ff-43c9-bb45-bd15d8dbee3f tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1371 microversion: 2.1 time: 0.158200 Nov 06 21:33:01.078010 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4021/7928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:00 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:02.094633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:02.095276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:02.101657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:02.102087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:02.102863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:02.103960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:02.235625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:02.242889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-105cc58c-31f1-4cb4-9036-a17fa4a6fdbb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1543 microversion: 2.1 time: 0.152099 Nov 06 21:33:02.243459 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3908/7929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:02 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1543 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:02.258947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:02.260120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:02.266831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:02.267322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:02.268111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:02.268581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:02.664332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:02.671989 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55c0632a-f86b-4000-b303-aa2f81b31fd2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1543 microversion: 2.1 time: 0.416789 Nov 06 21:33:02.672588 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4022/7930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:02 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1543 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:39.362493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:39.362983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:39.368854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:39.369302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:39.370083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:39.370561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:39.394712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:33:39.471031 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98d723ec-025a-4cba-8695-8f4f4ee862cf tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 204 len: 0 microversion: 2.1 time: 0.112157 Nov 06 21:33:39.471607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3909/7931] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:33:39 2021] DELETE /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:33:39.480899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:39.481555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:39.487654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:39.488122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:39.488963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:39.489416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:39.628816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:39.636695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2ebbaab7-d2a5-4a74-b7d1-f24015205410 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1549 microversion: 2.1 time: 0.160297 Nov 06 21:33:39.637449 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4023/7932] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:39 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:40.653780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:40.655132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:40.662273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:40.662726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:40.663666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:40.663968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:40.799589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:40.807582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e002ce80-9a46-4f9f-8adc-c4a946fd05f8 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 200 len: 1549 microversion: 2.1 time: 0.157895 Nov 06 21:33:40.808135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3910/7933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:40 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:41.369758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-539ea4f7-4cec-4e77-aa3d-f2d56348b203 req-e6527adf-8b93-4aae-84ea-12561832b280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ebc6d-0c3c-4158-a043-78ad05ccb89d", "name": "network-vif-deleted", "tag": "d2f4d650-9453-48b8-a5a5-f8997762e236"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:33:41.371216 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:33:41.371216 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:33:41.379299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-539ea4f7-4cec-4e77-aa3d-f2d56348b203 req-e6527adf-8b93-4aae-84ea-12561832b280 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:41.379759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-539ea4f7-4cec-4e77-aa3d-f2d56348b203 req-e6527adf-8b93-4aae-84ea-12561832b280 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:41.391865 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-539ea4f7-4cec-4e77-aa3d-f2d56348b203 req-e6527adf-8b93-4aae-84ea-12561832b280 service nova] Creating event network-vif-deleted:d2f4d650-9453-48b8-a5a5-f8997762e236 for instance 011ebc6d-0c3c-4158-a043-78ad05ccb89d on nch2-master-1 Nov 06 21:33:41.396915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-539ea4f7-4cec-4e77-aa3d-f2d56348b203 req-e6527adf-8b93-4aae-84ea-12561832b280 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031000 Nov 06 21:33:41.397496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4024/7934] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:33:41.824754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:41.825365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 011ebc6d-0c3c-4158-a043-78ad05ccb89d] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:41.831908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:41.832389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:41.833170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:41.833608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:41.846411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] HTTP exception thrown: Instance 011ebc6d-0c3c-4158-a043-78ad05ccb89d could not be found. Nov 06 21:33:41.847000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Returning 404 to user: Instance 011ebc6d-0c3c-4158-a043-78ad05ccb89d could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:33:41.847809 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a15698c8-0a44-464b-8d8c-4ab360a77716 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d" status: 404 len: 111 microversion: 2.1 time: 0.028028 Nov 06 21:33:41.848353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3911/7935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:41 2021] GET /compute/v2.1/servers/011ebc6d-0c3c-4158-a043-78ad05ccb89d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:33:42.003479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2c442ad7-9cd8-4dc6-9def-d451811c839a tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '.version_select at 0x7f6714a72dc0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:42.022920 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2c442ad7-9cd8-4dc6-9def-d451811c839a tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-501456847" status: 202 len: 0 microversion: 2.1 time: 0.023443 Nov 06 21:33:42.023544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4025/7936] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 21:33:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-501456847 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:33:43.771208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:43.772283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:43.776006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3345d377-1fcd-483e-aab2-36bad033db26 req-0286a550-facd-46e8-9aa8-e8394996c608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857258ee-3282-4de0-80ac-e8cdf2efd741", "tag": "e346ad0e-b3bd-49c6-a7dd-7114c259df6b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:33:43.777603 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:33:43.777603 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:33:43.779035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:43.779503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:43.780328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:43.781190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:43.785913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3345d377-1fcd-483e-aab2-36bad033db26 req-0286a550-facd-46e8-9aa8-e8394996c608 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:43.786628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3345d377-1fcd-483e-aab2-36bad033db26 req-0286a550-facd-46e8-9aa8-e8394996c608 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:43.798135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3345d377-1fcd-483e-aab2-36bad033db26 req-0286a550-facd-46e8-9aa8-e8394996c608 service nova] Creating event network-changed:e346ad0e-b3bd-49c6-a7dd-7114c259df6b for instance 857258ee-3282-4de0-80ac-e8cdf2efd741 on nch1-master-1 Nov 06 21:33:43.803329 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3345d377-1fcd-483e-aab2-36bad033db26 req-0286a550-facd-46e8-9aa8-e8394996c608 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032809 Nov 06 21:33:43.804337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4026/7937] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:33:43.807574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:33:43.888857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6c78fa6c-1e54-474d-86e3-10fd4a93e2e4 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 204 len: 0 microversion: 2.1 time: 0.121028 Nov 06 21:33:43.889872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3912/7938] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:33:43 2021] DELETE /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:33:43.900401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:43.901223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:43.908118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:43.908725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:43.909737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:43.910194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:44.148421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:44.159666 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-96cce45b-325c-4678-89b2-a6971795941b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1669 microversion: 2.1 time: 0.265057 Nov 06 21:33:44.160556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4027/7939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:43 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1669 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:45.179053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:45.179810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:45.187021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:45.187475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:45.188253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:45.188717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:45.325611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:45.332897 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0fc789a-1d1e-4091-8d89-0cdfb0c16a32 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1551 microversion: 2.1 time: 0.158421 Nov 06 21:33:45.333458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3913/7940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:45 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:46.057573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3f3b3c60-5690-4788-a139-53bc5fdb377e req-2b93c965-07c9-4c1f-8950-f3f6c30dffb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857258ee-3282-4de0-80ac-e8cdf2efd741", "name": "network-vif-deleted", "tag": "e346ad0e-b3bd-49c6-a7dd-7114c259df6b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:33:46.059088 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:33:46.059088 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:33:46.067785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3f3b3c60-5690-4788-a139-53bc5fdb377e req-2b93c965-07c9-4c1f-8950-f3f6c30dffb6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:46.068276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3f3b3c60-5690-4788-a139-53bc5fdb377e req-2b93c965-07c9-4c1f-8950-f3f6c30dffb6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:46.080907 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3f3b3c60-5690-4788-a139-53bc5fdb377e req-2b93c965-07c9-4c1f-8950-f3f6c30dffb6 service nova] Creating event network-vif-deleted:e346ad0e-b3bd-49c6-a7dd-7114c259df6b for instance 857258ee-3282-4de0-80ac-e8cdf2efd741 on nch1-master-1 Nov 06 21:33:46.085828 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3f3b3c60-5690-4788-a139-53bc5fdb377e req-2b93c965-07c9-4c1f-8950-f3f6c30dffb6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Nov 06 21:33:46.086416 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4028/7941] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:33:46.350827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:46.351441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:46.358542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:46.359001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:46.359833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:46.360275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:46.392537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:46.393001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:46.393463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lazy-loading 'fault' on Instance uuid 857258ee-3282-4de0-80ac-e8cdf2efd741 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:33:46.436730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:46.444964 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-96e8059e-c607-462c-8c65-a64fa5f4c065 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 200 len: 1338 microversion: 2.1 time: 0.097745 Nov 06 21:33:46.445540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3914/7942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:46 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:47.464914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:47.465629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 857258ee-3282-4de0-80ac-e8cdf2efd741] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:47.471793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:47.472375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:47.473214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:47.473668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:47.486660 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] HTTP exception thrown: Instance 857258ee-3282-4de0-80ac-e8cdf2efd741 could not be found. Nov 06 21:33:47.487270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Returning 404 to user: Instance 857258ee-3282-4de0-80ac-e8cdf2efd741 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:33:47.488187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5e2ead5-f27b-4d50-96bc-819bdbada937 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741" status: 404 len: 111 microversion: 2.1 time: 0.028859 Nov 06 21:33:47.488744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4029/7943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:47 2021] GET /compute/v2.1/servers/857258ee-3282-4de0-80ac-e8cdf2efd741 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:33:47.640941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e883249b-08da-4da8-a945-b8c37f036b6a tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '.version_select at 0x7f67142870d0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:47.660037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e883249b-08da-4da8-a945-b8c37f036b6a tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-825681438" status: 202 len: 0 microversion: 2.1 time: 0.022725 Nov 06 21:33:47.660647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3915/7944] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 21:33:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-825681438 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:33:56.344193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: .version_select at 0x7f671513a0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-156992168"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:33:56.364685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:33:56.370675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:33:56.593866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:33:56.598638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:33:56.613333 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8923384e-ed5d-4422-a253-da24b05ef707 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.272875 Nov 06 21:33:56.613935 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4030/7945] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:33:56 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:57.722260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1846781865", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "326183d2-958e-472c-9f17-6c422503826d"}], "key_name": "tempest-TestNetworkBasicOps-156992168", "security_groups": [{"name": "tempest-secgroup-smoke-523905516"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:33:57.842135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] validate_networks() for [('326183d2-958e-472c-9f17-6c422503826d', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:33:58.251703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:33:58.252131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:33:58.252683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:33:58.253104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:33:58.253680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:33:58.263464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:58.263920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:58.264777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:58.265216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:58.284968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:33:58.290080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Getting quotas for user da54eaaf1db04b53871b25ec599a6d7c and project a62a0319c0f84abdbea38fb5923b63e2. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:33:58.302872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:33:58.305264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:33:58.356531 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-63ba0fcd-5e36-4e21-b003-e29e6d2e4018 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.638824 Nov 06 21:33:58.357190 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3916/7946] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:33:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:33:58.366918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f77aa81-0c88-46a9-b044-a989a097aab6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:58.367551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f77aa81-0c88-46a9-b044-a989a097aab6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:58.436276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2f77aa81-0c88-46a9-b044-a989a097aab6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:58.443598 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f77aa81-0c88-46a9-b044-a989a097aab6 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1248 microversion: 2.1 time: 0.080409 Nov 06 21:33:58.448464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4031/7947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:58 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:33:59.460560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:33:59.461174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:33:59.467965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:59.468469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:59.469256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:33:59.469706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:33:59.538225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:33:59.546206 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d926d8ba-e25b-4aea-8667-8b2ba92ff70c tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1306 microversion: 2.1 time: 0.089371 Nov 06 21:33:59.546985 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3917/7948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:33:59 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1306 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:00.564667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:00.565544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:00.573009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:00.573480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:00.574300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:00.574757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:00.731983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4b0403b0-c3c5-4ef1-ac06-d724c430eae9 req-a801a4b7-70ae-4b56-a82b-215c0d395deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c772b68-5fbb-445e-9b19-648f9096f0b6", "tag": "502da7c9-17ca-4ff0-8ca2-bbe14c839c72"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:34:00.734765 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:34:00.734765 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:34:00.757369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4b0403b0-c3c5-4ef1-ac06-d724c430eae9 req-a801a4b7-70ae-4b56-a82b-215c0d395deb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:00.757819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4b0403b0-c3c5-4ef1-ac06-d724c430eae9 req-a801a4b7-70ae-4b56-a82b-215c0d395deb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:00.772113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4b0403b0-c3c5-4ef1-ac06-d724c430eae9 req-a801a4b7-70ae-4b56-a82b-215c0d395deb service nova] Creating event network-changed:502da7c9-17ca-4ff0-8ca2-bbe14c839c72 for instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 on nch1-master-1 Nov 06 21:34:00.779008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4b0403b0-c3c5-4ef1-ac06-d724c430eae9 req-a801a4b7-70ae-4b56-a82b-215c0d395deb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051205 Nov 06 21:34:00.779962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3918/7949] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:34:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:34:00.839999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:00.848933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-835c64dd-8dde-40fb-a677-d146c0e74cfe tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.288262 Nov 06 21:34:00.849680 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4032/7950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:00 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:01.866793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:01.867492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:01.875124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:01.875574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:01.876379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:01.876828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:02.014152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:02.021318 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-642a98a7-e7b2-4985-900b-84bcf1a5e6fa tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.158573 Nov 06 21:34:02.021878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3919/7951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:01 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:03.037996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:03.038620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:03.045647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:03.046146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:03.046972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:03.047424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:03.178832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:03.186746 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d573f23-9f58-4bad-a717-81d1379bfdff tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.152550 Nov 06 21:34:03.187311 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4033/7952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:03 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:34:04.204047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:04.204623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:04.211237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:04.212229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:04.213041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:04.213479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:04.341659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:04.348893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7982808c-d033-40da-90d4-d43793639d08 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.148595 Nov 06 21:34:04.349457 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3920/7953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:04 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:34:05.366065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:05.366684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:05.374057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:05.374518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:05.375310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:05.375757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:05.514656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:05.522604 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42478b83-9402-4e66-b220-61fe57cddee2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.160107 Nov 06 21:34:05.523192 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4034/7954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:05 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:06.538817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:06.539359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:06.546648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:06.547107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:06.547900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:06.548408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:06.679048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:06.686839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6f5df0c9-fefd-44b1-8ee7-8ac9027f764e tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.151755 Nov 06 21:34:06.687417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3921/7955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:06 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:07.593858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-60a9ee09-9004-4292-a539-4e099618bb8b req-b93d8a5d-a572-4b97-b153-a8165a85baaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c772b68-5fbb-445e-9b19-648f9096f0b6", "name": "network-vif-plugged", "status": "completed", "tag": "502da7c9-17ca-4ff0-8ca2-bbe14c839c72"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:34:07.595565 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:34:07.595565 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:34:07.603834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-60a9ee09-9004-4292-a539-4e099618bb8b req-b93d8a5d-a572-4b97-b153-a8165a85baaf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:07.604449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-60a9ee09-9004-4292-a539-4e099618bb8b req-b93d8a5d-a572-4b97-b153-a8165a85baaf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:07.615488 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-60a9ee09-9004-4292-a539-4e099618bb8b req-b93d8a5d-a572-4b97-b153-a8165a85baaf service nova] Creating event network-vif-plugged:502da7c9-17ca-4ff0-8ca2-bbe14c839c72 for instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 on nch1-master-1 Nov 06 21:34:07.621742 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-60a9ee09-9004-4292-a539-4e099618bb8b req-b93d8a5d-a572-4b97-b153-a8165a85baaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Nov 06 21:34:07.622337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4035/7956] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:34:07.704148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:07.704785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:07.712154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:07.712671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:07.713464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:07.713906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:07.870707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:07.878559 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14f39c72-492d-47a5-831a-5c26d429f633 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.177615 Nov 06 21:34:07.878559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3922/7957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:07 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:08.896314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:08.897039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:08.903742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:08.904206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:08.905031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:08.905483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:09.045298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:09.053315 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-540aa6f8-1679-4af6-9e08-031e88e93362 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1373 microversion: 2.1 time: 0.161798 Nov 06 21:34:09.053830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4036/7958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:08 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:10.070472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:10.071125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:10.077628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:10.078079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:10.078855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:10.079291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:10.215440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:10.222682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8462905d-e76f-49ba-8bb4-80ec52a153b7 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1545 microversion: 2.1 time: 0.155950 Nov 06 21:34:10.223263 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3923/7959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:10 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:10.239039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:34:10.239658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:10.246448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:10.246910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:10.247700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:10.248148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:10.385607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:34:10.395467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d8edaf6-c376-4abd-bae3-c7f37d2795fb tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1545 microversion: 2.1 time: 0.159626 Nov 06 21:34:10.396347 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4037/7960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:34:10 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:34:12.377561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-479511fd-0791-4bf8-9054-be2ca2e0c30b req-7356213f-c31c-4bc3-8574-927374ec1971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c772b68-5fbb-445e-9b19-648f9096f0b6", "tag": "502da7c9-17ca-4ff0-8ca2-bbe14c839c72"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:34:12.379078 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:34:12.379078 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:34:12.389620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-479511fd-0791-4bf8-9054-be2ca2e0c30b req-7356213f-c31c-4bc3-8574-927374ec1971 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:12.390073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-479511fd-0791-4bf8-9054-be2ca2e0c30b req-7356213f-c31c-4bc3-8574-927374ec1971 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:12.402500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-479511fd-0791-4bf8-9054-be2ca2e0c30b req-7356213f-c31c-4bc3-8574-927374ec1971 service nova] Creating event network-changed:502da7c9-17ca-4ff0-8ca2-bbe14c839c72 for instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 on nch1-master-1 Nov 06 21:34:12.407763 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-479511fd-0791-4bf8-9054-be2ca2e0c30b req-7356213f-c31c-4bc3-8574-927374ec1971 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105690 Nov 06 21:34:12.408381 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3924/7961] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:34:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:34:45.573931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:34:45.574905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:34:45.580981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:45.581451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:45.582250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:34:45.582699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:34:45.635494 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-849af8f4-db5c-4588-93ee-5ef94248c9b3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6/action" status: 200 len: 24577 microversion: 2.1 time: 0.066436 Nov 06 21:34:45.636159 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4038/7962] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:34:45 2021] POST /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:35:16.101483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:16.102476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:16.108762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:16.109222 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:16.110005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:16.110447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:16.164028 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-026b782d-b94d-4ca0-b270-74e74a74e8c2 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "POST /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6/action" status: 200 len: 32642 microversion: 2.1 time: 0.068346 Nov 06 21:35:16.164586 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3925/7963] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:35:16 2021] POST /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:35:17.171929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-24c3fbeb-56c0-474a-b265-23c9c84a8986 req-6f49680e-680e-4fa9-ba15-683de6758782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c772b68-5fbb-445e-9b19-648f9096f0b6", "tag": "502da7c9-17ca-4ff0-8ca2-bbe14c839c72"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:17.173457 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:17.173457 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:35:17.178341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:17.178950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:17.186369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:17.187078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:17.187585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-24c3fbeb-56c0-474a-b265-23c9c84a8986 req-6f49680e-680e-4fa9-ba15-683de6758782 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:17.187904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:17.188221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-24c3fbeb-56c0-474a-b265-23c9c84a8986 req-6f49680e-680e-4fa9-ba15-683de6758782 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:17.188388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:17.199489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-24c3fbeb-56c0-474a-b265-23c9c84a8986 req-6f49680e-680e-4fa9-ba15-683de6758782 service nova] Creating event network-changed:502da7c9-17ca-4ff0-8ca2-bbe14c839c72 for instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 on nch1-master-1 Nov 06 21:35:17.204681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-24c3fbeb-56c0-474a-b265-23c9c84a8986 req-6f49680e-680e-4fa9-ba15-683de6758782 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036807 Nov 06 21:35:17.205600 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3926/7964] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:35:17.219271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:35:17.301522 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d92b324d-0333-4b68-b209-4f9fe919dac3 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 204 len: 0 microversion: 2.1 time: 0.137425 Nov 06 21:35:17.302334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4039/7965] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:35:17 2021] DELETE /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:35:17.311963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:17.312685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:17.318718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:17.319171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:17.319949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:17.320464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:17.546878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:17.554962 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-02c67a89-35ba-4dbe-9acb-755caf2fb9da tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1670 microversion: 2.1 time: 0.247903 Nov 06 21:35:17.555681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3927/7966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:17 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:35:18.573822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:18.574542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:18.582143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:18.582606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:18.583388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:18.583836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:18.717655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:18.725094 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-decd77ec-64f7-4f0c-a659-276cf08e5024 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1551 microversion: 2.1 time: 0.155939 Nov 06 21:35:18.725657 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4040/7967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:18 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:19.363855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f2beda4f-7ed9-4053-852a-6533770d06d4 req-32039d76-6e8d-464e-a0a9-10d0e866b917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c772b68-5fbb-445e-9b19-648f9096f0b6", "name": "network-vif-deleted", "tag": "502da7c9-17ca-4ff0-8ca2-bbe14c839c72"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:19.365726 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:19.365726 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:35:19.374611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f2beda4f-7ed9-4053-852a-6533770d06d4 req-32039d76-6e8d-464e-a0a9-10d0e866b917 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:19.375057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f2beda4f-7ed9-4053-852a-6533770d06d4 req-32039d76-6e8d-464e-a0a9-10d0e866b917 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:19.386440 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f2beda4f-7ed9-4053-852a-6533770d06d4 req-32039d76-6e8d-464e-a0a9-10d0e866b917 service nova] Creating event network-vif-deleted:502da7c9-17ca-4ff0-8ca2-bbe14c839c72 for instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 on nch1-master-1 Nov 06 21:35:19.391291 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f2beda4f-7ed9-4053-852a-6533770d06d4 req-32039d76-6e8d-464e-a0a9-10d0e866b917 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Nov 06 21:35:19.391876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3928/7968] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:19.744228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:19.745540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:19.752904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:19.758217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:19.759151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:19.759611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:19.795227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:19.795763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:19.796638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lazy-loading 'fault' on Instance uuid 7c772b68-5fbb-445e-9b19-648f9096f0b6 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:35:19.837924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54eaaf1db04b53871b25ec599a6d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a62a0319c0f84abdbea38fb5923b63e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:19.844725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-40d2bf12-6416-49a9-9818-f8e49b5a3b1b tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 200 len: 1338 microversion: 2.1 time: 0.105748 Nov 06 21:35:19.845288 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4041/7969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:19 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:35:20.863786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:20.864535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] [instance: 7c772b68-5fbb-445e-9b19-648f9096f0b6] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:20.870880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:20.871336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:20.872127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:20.872596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:20.887120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] HTTP exception thrown: Instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 could not be found. Nov 06 21:35:20.887722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Returning 404 to user: Instance 7c772b68-5fbb-445e-9b19-648f9096f0b6 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:35:20.888589 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0f80c5a5-c5d8-46fc-bde7-9fc2174ffab0 tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6" status: 404 len: 111 microversion: 2.1 time: 0.029707 Nov 06 21:35:20.889126 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3929/7970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:20 2021] GET /compute/v2.1/servers/7c772b68-5fbb-445e-9b19-648f9096f0b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:35:21.052919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d85f01c0-2192-4e3a-9468-d1be4825458d tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] Calling method '.version_select at 0x7f6714b1c700>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:21.072703 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d85f01c0-2192-4e3a-9468-d1be4825458d tempest-TestNetworkBasicOps-1221194828 tempest-TestNetworkBasicOps-1221194828-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-156992168" status: 202 len: 0 microversion: 2.1 time: 0.022746 Nov 06 21:35:21.073293 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4042/7971] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 21:35:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-156992168 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:35:36.039946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-383452467", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:36.091988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] validate_networks() for None {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:35:36.358853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:35:36.359280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:35:36.359758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:35:36.360173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:35:36.360631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:35:36.369754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:36.370203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:36.371048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:36.371489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:36.388049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Getting quotas for project 25c6423970ff458d9c9e32860ba4831d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:35:36.393027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Getting quotas for user 297f6730ba884073b758a45ef1c16753 and project 25c6423970ff458d9c9e32860ba4831d. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:35:36.405166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:35:36.407455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:35:36.449756 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad00c9f4-7b12-4171-9d4e-21e45d619500 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521876 Nov 06 21:35:36.450393 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3930/7972] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:35:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:35:36.461306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ace4322a-383f-4519-b3ba-08e170c50688 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:36.461953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ace4322a-383f-4519-b3ba-08e170c50688 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:36.515250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ace4322a-383f-4519-b3ba-08e170c50688 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:36.521935 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ace4322a-383f-4519-b3ba-08e170c50688 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1221 microversion: 2.1 time: 0.065282 Nov 06 21:35:36.522507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4043/7973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:36 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:37.539867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:37.540714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:37.547908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:37.549658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:37.549825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:37.550624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:37.635840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:37.643227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f082e95e-142d-4e28-a4bd-a66f6798b51b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1291 microversion: 2.1 time: 0.107928 Nov 06 21:35:37.643786 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3931/7974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:37 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1291 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:35:38.660882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:38.661593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:38.669029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:38.669570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:38.670440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:38.670978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:38.918771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:38.926555 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c34b5cb0-d0ca-4958-8a5c-e555f99d1167 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.269347 Nov 06 21:35:38.927146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4044/7975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:38 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:39.282154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6cbf8460-3586-4ab1-b3c5-093d6276e9d6 req-117e85b3-b924-43bd-9298-47ee5c2216b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0eca0e0-7019-4a96-9884-ba19985d9f21", "tag": "f9905440-4d6d-41ff-9aea-3a122a1ac75b"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:39.284546 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:39.284546 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:35:39.294393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6cbf8460-3586-4ab1-b3c5-093d6276e9d6 req-117e85b3-b924-43bd-9298-47ee5c2216b7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:39.294974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6cbf8460-3586-4ab1-b3c5-093d6276e9d6 req-117e85b3-b924-43bd-9298-47ee5c2216b7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:39.309241 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6cbf8460-3586-4ab1-b3c5-093d6276e9d6 req-117e85b3-b924-43bd-9298-47ee5c2216b7 service nova] Creating event network-changed:f9905440-4d6d-41ff-9aea-3a122a1ac75b for instance d0eca0e0-7019-4a96-9884-ba19985d9f21 on nch1-master-1 Nov 06 21:35:39.315129 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6cbf8460-3586-4ab1-b3c5-093d6276e9d6 req-117e85b3-b924-43bd-9298-47ee5c2216b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038391 Nov 06 21:35:39.315754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3932/7976] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:39.942928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:39.943679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:39.950902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:39.951367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:39.952163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:39.952656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:40.164854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:40.173246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb213abe-e40a-4ee0-ab44-a5179d93ac08 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.234130 Nov 06 21:35:40.173817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4045/7977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:39 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:41.191286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:41.191902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:41.198189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:41.198635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:41.199417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:41.199850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:41.328769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:41.336742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-528e7000-753a-4efa-ad02-bc0a6f4b33aa tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.150328 Nov 06 21:35:41.337301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3933/7978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:41 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:42.354021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:42.354646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:42.361345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:42.361805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:42.362590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:42.363036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:42.497609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:42.504915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-670618c3-2a8b-4043-ad7e-196e0424864c tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.155258 Nov 06 21:35:42.505508 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4046/7979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:42 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:43.521647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:43.522260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:43.529116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:43.529573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:43.530359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:43.530798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:43.661787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:43.669594 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-246b1701-bc72-4863-87ba-ef1f9aa3f5ff tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.151622 Nov 06 21:35:43.670417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3934/7980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:43 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:44.686707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:44.687325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:44.694037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:44.694499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:44.695287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:44.695730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:44.831515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:44.839691 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-50d8be11-1a15-4121-8e06-1266884137f6 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.156672 Nov 06 21:35:44.840262 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4047/7981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:44 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:45.856605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:45.857246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:45.864023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:45.864526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:45.865332 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:45.865777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:45.996715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:46.004690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1126a40-6100-4f31-9897-09f39dd04711 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.152299 Nov 06 21:35:46.005262 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3935/7982] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:45 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:46.186354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9ee4e930-c690-45f8-afc6-0d532c4dc086 req-6d1bb848-b05c-4fce-833a-9c5e94c69323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eca0e0-7019-4a96-9884-ba19985d9f21", "name": "network-vif-plugged", "status": "completed", "tag": "f9905440-4d6d-41ff-9aea-3a122a1ac75b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:46.187916 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:46.187916 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:35:46.194917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9ee4e930-c690-45f8-afc6-0d532c4dc086 req-6d1bb848-b05c-4fce-833a-9c5e94c69323 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:46.195380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9ee4e930-c690-45f8-afc6-0d532c4dc086 req-6d1bb848-b05c-4fce-833a-9c5e94c69323 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:46.205997 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9ee4e930-c690-45f8-afc6-0d532c4dc086 req-6d1bb848-b05c-4fce-833a-9c5e94c69323 service nova] Creating event network-vif-plugged:f9905440-4d6d-41ff-9aea-3a122a1ac75b for instance d0eca0e0-7019-4a96-9884-ba19985d9f21 on nch1-master-1 Nov 06 21:35:46.210889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9ee4e930-c690-45f8-afc6-0d532c4dc086 req-6d1bb848-b05c-4fce-833a-9c5e94c69323 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100245 Nov 06 21:35:46.211455 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4048/7983] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:47.021633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:47.022267 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:47.029428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:47.029889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:47.030656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:47.031092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:47.165869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:47.173387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-daf25af4-3031-4e05-9610-978dbb8aa40e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1321 microversion: 2.1 time: 0.155458 Nov 06 21:35:47.173953 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3936/7984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:47 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:48.191581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:48.192216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:48.198940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.199414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.200212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.200691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.330570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:48.337923 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-69c470d3-4027-4da5-b6bb-ddee0b7d6c27 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1470 microversion: 2.1 time: 0.151344 Nov 06 21:35:48.338487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4049/7985] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:48 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:48.405508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ba80851-2d9f-48b8-9fb1-7be8d27b9fb8 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '.version_select at 0x7f6714287e50>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:48.470740 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ba80851-2d9f-48b8-9fb1-7be8d27b9fb8 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/9c2c2f0fa4fb4ff2987a4b887e217f3b" status: 200 len: 371 microversion: 2.1 time: 0.118546 Nov 06 21:35:48.471295 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3937/7986] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 21:35:48 2021] GET /compute/v2.1/os-quota-sets/9c2c2f0fa4fb4ff2987a4b887e217f3b => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:48.481549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f6d797a5-08c5-46cf-9a52-1d77050bf5d6 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1690974865", "id": 1942468238, "os-flavor-access:is_public": "True"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:48.483280 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:48.483280 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:35:48.498539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f6d797a5-08c5-46cf-9a52-1d77050bf5d6 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.020735 Nov 06 21:35:48.499101 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4050/7987] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:35:48 2021] POST /compute/v2.1/flavors => generated 438 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:48.509971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1942468238"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:48.510972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:48.516853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.517305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.518079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.518516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.603646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'da38e0a28e54401594cdeaee81cd8bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2c2f0fa4fb4ff2987a4b887e217f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:48.609677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1690974865 {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:35:48.610728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.611169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.611970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.612450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.632541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Getting quotas for project 25c6423970ff458d9c9e32860ba4831d. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:35:48.637922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Getting quotas for user 297f6730ba884073b758a45ef1c16753 and project 25c6423970ff458d9c9e32860ba4831d. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:35:48.649439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.compute.api [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] ram quota exceeded for 9c2c2f0fa4fb4ff2987a4b887e217f3b, tried to resize instance. Nov 06 21:35:48.650006 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 06 21:35:48.650587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:35:48.651433 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d04c2dbc-0e85-4417-9a20-179e74565484 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21/action" status: 403 len: 118 microversion: 2.1 time: 0.145802 Nov 06 21:35:48.652005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3938/7988] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:35:48 2021] POST /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21/action => generated 118 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:35:48.660314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-796425e6-ad7b-41a1-b9b4-16492460bc05 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:48.661071 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:48.661071 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:35:48.677711 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-796425e6-ad7b-41a1-b9b4-16492460bc05 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1942468238" status: 202 len: 0 microversion: 2.1 time: 0.021065 Nov 06 21:35:48.678270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4051/7989] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 21:35:48 2021] DELETE /compute/v2.1/flavors/1942468238 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:35:48.686549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60113938-36f3-499c-90ea-bbdb0b66eba7 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:48.705068 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60113938-36f3-499c-90ea-bbdb0b66eba7 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021943 Nov 06 21:35:48.705544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3939/7990] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:35:48 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:35:48.721777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4c969b0-48b2-473e-a8cf-7da40e5e2755 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '.version_select at 0x7f67045d0940>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:48.788764 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4c969b0-48b2-473e-a8cf-7da40e5e2755 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/9c2c2f0fa4fb4ff2987a4b887e217f3b" status: 200 len: 371 microversion: 2.1 time: 0.070524 Nov 06 21:35:48.789330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4052/7991] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Nov 6 21:35:48 2021] GET /compute/v2.1/os-quota-sets/9c2c2f0fa4fb4ff2987a4b887e217f3b => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:48.801438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8f2eb11-e08f-40bf-896c-7873a6d81f4e tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-737136448", "id": 1154326761, "os-flavor-access:is_public": "True"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:48.803008 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:48.803008 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:35:48.819329 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8f2eb11-e08f-40bf-896c-7873a6d81f4e tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021982 Nov 06 21:35:48.819908 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3940/7992] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:35:48 2021] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:48.830500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1154326761"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:48.831519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:48.837618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.838078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:48.838868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:48.839310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.021608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'da38e0a28e54401594cdeaee81cd8bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2c2f0fa4fb4ff2987a4b887e217f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:49.027862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-737136448 {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:35:49.029000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.029451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.030264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.030708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.050680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Getting quotas for project 25c6423970ff458d9c9e32860ba4831d. Resources: {'ram', 'cores'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:35:49.055996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Getting quotas for user 297f6730ba884073b758a45ef1c16753 and project 25c6423970ff458d9c9e32860ba4831d. Resources: {'ram', 'cores'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:35:49.067449 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] cores quota exceeded for 9c2c2f0fa4fb4ff2987a4b887e217f3b, tried to resize instance. Nov 06 21:35:49.068000 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 06 21:35:49.068660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:35:49.069509 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-251e5b57-b9e6-4435-be54-c2b1f6438c0a tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21/action" status: 403 len: 113 microversion: 2.1 time: 0.242966 Nov 06 21:35:49.070073 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4053/7993] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:35:48 2021] POST /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21/action => generated 113 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:35:49.078112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae7379b0-98de-47f0-a455-126033cb135d tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:49.078863 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:49.078863 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:35:49.095294 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae7379b0-98de-47f0-a455-126033cb135d tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1154326761" status: 202 len: 0 microversion: 2.1 time: 0.020814 Nov 06 21:35:49.095855 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3941/7994] 10.222.0.13 () {58 vars in 1160 bytes} [Sat Nov 6 21:35:49 2021] DELETE /compute/v2.1/flavors/1154326761 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:35:49.104208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-451cfe5c-be1e-46f9-b2d5-68379aae4310 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:49.122991 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-451cfe5c-be1e-46f9-b2d5-68379aae4310 tempest-ServersAdminNegativeTestJSON-2109942081 tempest-ServersAdminNegativeTestJSON-2109942081-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023062 Nov 06 21:35:49.123534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4054/7995] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Nov 6 21:35:49 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:49.140340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:49.140854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:49.146723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.147186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.147973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.148459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.172641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:35:49.248369 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c719d72-3aad-4f28-8e20-feffda3b2959 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 204 len: 0 microversion: 2.1 time: 0.111143 Nov 06 21:35:49.248969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3942/7996] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:35:49 2021] DELETE /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:35:49.259252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:49.260354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:49.267646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.268111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.268944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:49.269392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:49.406532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:49.413895 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f9ce259f-d685-4163-ae92-0aa893fce80b tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1476 microversion: 2.1 time: 0.160698 Nov 06 21:35:49.414487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4055/7997] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:49 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:50.431649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:50.432370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:50.438890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:50.439339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:50.440124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:50.440585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:50.574389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297f6730ba884073b758a45ef1c16753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c6423970ff458d9c9e32860ba4831d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:50.581671 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cbbcac14-36e4-44ff-89ea-d62bd0e1880e tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 200 len: 1476 microversion: 2.1 time: 0.154113 Nov 06 21:35:50.582233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3943/7998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:50 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:51.140751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0350be92-17ba-4cca-8195-1dec7e8f9a65 req-778230ee-6a27-49d9-a12c-78b3d68a4f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0eca0e0-7019-4a96-9884-ba19985d9f21", "name": "network-vif-deleted", "tag": "f9905440-4d6d-41ff-9aea-3a122a1ac75b"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:51.142338 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:51.142338 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:35:51.151532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0350be92-17ba-4cca-8195-1dec7e8f9a65 req-778230ee-6a27-49d9-a12c-78b3d68a4f4b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:51.152017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0350be92-17ba-4cca-8195-1dec7e8f9a65 req-778230ee-6a27-49d9-a12c-78b3d68a4f4b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:51.169254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0350be92-17ba-4cca-8195-1dec7e8f9a65 req-778230ee-6a27-49d9-a12c-78b3d68a4f4b service nova] Creating event network-vif-deleted:f9905440-4d6d-41ff-9aea-3a122a1ac75b for instance d0eca0e0-7019-4a96-9884-ba19985d9f21 on nch1-master-1 Nov 06 21:35:51.174912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0350be92-17ba-4cca-8195-1dec7e8f9a65 req-778230ee-6a27-49d9-a12c-78b3d68a4f4b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043712 Nov 06 21:35:51.175586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4056/7999] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:51.599594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:51.600197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] [instance: d0eca0e0-7019-4a96-9884-ba19985d9f21] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:51.607054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:51.607539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:51.608352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:51.608887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:51.622571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] HTTP exception thrown: Instance d0eca0e0-7019-4a96-9884-ba19985d9f21 could not be found. Nov 06 21:35:51.623173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] Returning 404 to user: Instance d0eca0e0-7019-4a96-9884-ba19985d9f21 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:35:51.624008 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-59aa43f3-c5bc-4404-89c7-8f605ff0f633 tempest-ServersAdminNegativeTestJSON-4398854 tempest-ServersAdminNegativeTestJSON-4398854-project] 10.222.0.13 "GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21" status: 404 len: 111 microversion: 2.1 time: 0.029017 Nov 06 21:35:51.624580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3944/8000] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:51 2021] GET /compute/v2.1/servers/d0eca0e0-7019-4a96-9884-ba19985d9f21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:35:54.330942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1963140873", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "17a0dacd-f6cd-4221-af36-0a84eca5069d"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:54.380995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] validate_networks() for [('17a0dacd-f6cd-4221-af36-0a84eca5069d', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:35:54.718446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:35:54.718884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:35:54.719378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:35:54.719804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:35:54.720231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:35:54.729019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:54.729485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:54.730309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:54.730760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:54.747518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Getting quotas for project 0fcf1f84938e40b689fd09313120fcfd. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:35:54.752507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Getting quotas for user 27fb712f0c2e46f59378c7cfda409712 and project 0fcf1f84938e40b689fd09313120fcfd. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:35:54.765063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:35:54.767513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:35:54.809327 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:35:55.825582 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 36218. Nov 06 21:35:55.829520 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-39a363a9-2db7-40a6-b131-9b4b72ac3577 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616249 Nov 06 21:35:55.830167 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4057/8001] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:35:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:35:55.840427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-76b4ff6d-9ef2-47ef-99ad-1315968fa786 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:55.841030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-76b4ff6d-9ef2-47ef-99ad-1315968fa786 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:55.900773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-76b4ff6d-9ef2-47ef-99ad-1315968fa786 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:55.907184 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-76b4ff6d-9ef2-47ef-99ad-1315968fa786 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1215 microversion: 2.1 time: 0.070976 Nov 06 21:35:55.907741 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3945/8002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:55 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:56.924873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:56.925743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:56.932866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:56.933337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:56.934138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:56.934594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:57.042695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:57.050572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-894ca8ec-8ad4-4058-93b5-ce76e7059c12 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1285 microversion: 2.1 time: 0.130765 Nov 06 21:35:57.051245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4058/8003] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:56 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:58.066734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:58.067367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:58.075341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:58.075795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:58.076603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:58.077046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:58.153107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5ada0e4b-85e2-488d-adeb-477b8c49d728 req-79b8cfed-89e7-4ff6-8613-f32651afad6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:35:58.155447 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:35:58.155447 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:35:58.163471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5ada0e4b-85e2-488d-adeb-477b8c49d728 req-79b8cfed-89e7-4ff6-8613-f32651afad6c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:58.164906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5ada0e4b-85e2-488d-adeb-477b8c49d728 req-79b8cfed-89e7-4ff6-8613-f32651afad6c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:58.176687 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5ada0e4b-85e2-488d-adeb-477b8c49d728 req-79b8cfed-89e7-4ff6-8613-f32651afad6c service nova] Creating event network-changed:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch1-master-1 Nov 06 21:35:58.182725 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5ada0e4b-85e2-488d-adeb-477b8c49d728 req-79b8cfed-89e7-4ff6-8613-f32651afad6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034726 Nov 06 21:35:58.183339 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4059/8004] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:35:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:35:58.291350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:58.298969 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2aebd292-315d-47d9-beee-88667f6c8272 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.235899 Nov 06 21:35:58.299529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3946/8005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:58 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:35:59.318007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:35:59.318747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:35:59.325534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:59.326004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:59.326795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:35:59.327245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:35:59.462297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:35:59.469539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b87e93fb-6329-47e1-8f4f-74e6e95505bb tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.156491 Nov 06 21:35:59.470106 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4060/8006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:35:59 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:00.486160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:00.486773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:00.493257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:00.493716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:00.494500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:00.494942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:00.627691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:00.635736 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b87b0720-e948-4394-8769-c5c0b2696026 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.153282 Nov 06 21:36:00.636328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3947/8007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:00 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:01.652747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:01.653567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:01.660888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:01.661362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:01.662176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:01.662633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:01.800697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:01.808277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-24882878-da1c-4e00-89d4-c4291842c281 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.159332 Nov 06 21:36:01.808938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4061/8008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:01 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:02.825141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:02.825782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:02.832711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:02.833165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:02.833941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:02.834379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:02.966717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:02.973965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-976173c7-f70f-461d-a369-7bdcff671939 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.152488 Nov 06 21:36:02.974526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3948/8009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:02 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:03.989818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:03.990438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:03.997166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:03.997637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:03.998438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:03.998889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:04.141449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:04.149410 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-054e81c6-0bfb-4617-8e5d-75672074fab6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.162674 Nov 06 21:36:04.150215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4062/8010] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:03 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:04.186373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a3c2d249-61e6-4664-bff1-2e10dc895b5d req-c73d6e1d-ec7b-4e02-bbdf-71cbdc991cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "name": "network-vif-plugged", "status": "completed", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:04.187958 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:04.187958 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:36:04.196711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a3c2d249-61e6-4664-bff1-2e10dc895b5d req-c73d6e1d-ec7b-4e02-bbdf-71cbdc991cde service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:04.197167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a3c2d249-61e6-4664-bff1-2e10dc895b5d req-c73d6e1d-ec7b-4e02-bbdf-71cbdc991cde service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:04.208016 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a3c2d249-61e6-4664-bff1-2e10dc895b5d req-c73d6e1d-ec7b-4e02-bbdf-71cbdc991cde service nova] Creating event network-vif-plugged:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch1-master-1 Nov 06 21:36:04.213525 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a3c2d249-61e6-4664-bff1-2e10dc895b5d req-c73d6e1d-ec7b-4e02-bbdf-71cbdc991cde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031016 Nov 06 21:36:04.214107 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3949/8011] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:36:05.165519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:05.166125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:05.174978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:05.175826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:05.177140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:05.177591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:05.314347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:05.322235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-348350c9-b002-45dd-88a0-e9c57dfeec81 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1315 microversion: 2.1 time: 0.160548 Nov 06 21:36:05.322827 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4063/8012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:05 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:06.339936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:06.340708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:06.346820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.347278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.348065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.348543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.480793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:06.488107 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d910f91a-93c6-4cbc-85bb-3f18b7f85bac tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1501 microversion: 2.1 time: 0.152966 Nov 06 21:36:06.488710 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3950/8013] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:06 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:06.504614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:06.505641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:06.512389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.512807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.513609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.514064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.541094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:06.546947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:36:06.553011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:36:06.553449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:36:06.553942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:36:06.554368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:36:06.554796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:36:06.614955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc4d063e-da0d-4a0f-a56d-73cfe2a42477 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "POST /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045/action" status: 202 len: 0 microversion: 2.1 time: 0.113898 Nov 06 21:36:06.615496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4064/8014] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:36:06 2021] POST /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:36:06.624176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:06.624829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:06.630734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.631592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.631988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:06.632464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:06.797145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:06.804523 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9817b3b7-e60c-4622-a8c6-45f75aa31ea5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1510 microversion: 2.1 time: 0.184094 Nov 06 21:36:06.805093 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3951/8015] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:06 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:07.824324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:07.825589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:07.834491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:07.835528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:07.836636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:07.838656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:08.066426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:08.073933 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-945751c8-ef13-47a9-b4e9-4eb3e55719ec tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1510 microversion: 2.1 time: 0.255183 Nov 06 21:36:08.080836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4065/8016] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:07 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:09.091550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:09.092171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:09.098676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:09.099143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:09.099939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:09.100414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:09.238238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:09.245562 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95d6dcbe-a502-46dc-a31e-248255591f83 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.158012 Nov 06 21:36:09.246125 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3952/8017] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:09 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:10.262855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:10.263475 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:10.270194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:10.270656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:10.271441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:10.271915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:10.400317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:10.407637 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21e0aa9c-2f7e-45de-ac82-a71d9cbd477c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.148561 Nov 06 21:36:10.408201 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4066/8018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:10 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:11.425568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:11.426192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:11.433020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:11.433477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:11.434265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:11.434705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:11.565025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:11.574101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be3a73dd-ba85-445c-89e8-32c3dd17168b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.152538 Nov 06 21:36:11.574667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3953/8019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:11 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:12.591353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:12.591997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:12.598678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:12.599143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:12.599935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:12.600407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:12.734827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:12.742127 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dbf79cb8-acee-45c2-b690-99ea172dec9a tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.154982 Nov 06 21:36:12.742687 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4067/8020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:12 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:13.759560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:13.760157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:13.767256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:13.767712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:13.768521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:13.768964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:13.902881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:13.910501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-421655c9-76f3-4af7-8996-b7de723bcbc5 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.155500 Nov 06 21:36:13.911064 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3954/8021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:13 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:14.926959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:14.927614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:14.934823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:14.935280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:14.936057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:14.936524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:15.069244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:15.077513 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74caa50c-86ba-4adf-b5b3-ced0c7464d1b tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.154175 Nov 06 21:36:15.078020 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4068/8022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:14 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:16.094508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:16.095112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:16.101808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:16.102260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:16.103041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:16.103479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:16.232205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:16.241101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-036a42e0-29a8-4c37-8444-3942ae420b06 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.150233 Nov 06 21:36:16.241818 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3955/8023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:16 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:17.257882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:17.259116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:17.265955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:17.266418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:17.267204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:17.267652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:17.397209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:17.404505 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-31be9a09-5bd6-4516-ae69-47e220c9698c tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.150310 Nov 06 21:36:17.405106 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4069/8024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:17 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:18.420468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:18.421085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:18.429733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:18.430194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:18.430989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:18.431433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:18.563698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:18.571489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d60b5784-6c48-4a48-9777-a783566bf080 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.154181 Nov 06 21:36:18.572063 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3956/8025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:18 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:19.589044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:19.589673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:19.596418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:19.596892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:19.597713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:19.598193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:19.729926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:19.737307 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7525c869-037e-47d7-ba3c-be421edf2a13 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.152062 Nov 06 21:36:19.737876 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4070/8026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:19 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:20.754522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:20.755130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:20.762273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:20.762723 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:20.763500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:20.763932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:20.901988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:20.912677 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a975dc1-b1e8-42f4-84d0-a7be842edbc2 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.161733 Nov 06 21:36:20.913251 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3957/8027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:20 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:21.930601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:21.931226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:21.937618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:21.938084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:21.938879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:21.939332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:22.072330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:22.082412 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-43a77c61-5a15-4158-9aa5-cb6cb9d7bc4e tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.155618 Nov 06 21:36:22.083021 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4071/8028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:21 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:23.100641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:23.101250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:23.109607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:23.110291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:23.111180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:23.111839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:23.247724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:23.254956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35af544b-17f3-4409-80b9-03adf2c836e4 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.157931 Nov 06 21:36:23.255519 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3958/8029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:23 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:24.271385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:24.272038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:24.279601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:24.280070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:24.280907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:24.281362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:24.412708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:24.420947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8892892a-81b0-49cc-aa57-d1b7e4aa3722 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.153283 Nov 06 21:36:24.421769 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4072/8030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:24 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:25.437385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:25.437993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:25.444754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:25.445203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:25.446599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:25.447032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:25.573582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:25.581583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9522d90-d5b2-47a7-a1f5-c62a20a075d9 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.147800 Nov 06 21:36:25.582168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3959/8031] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:25 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:26.598378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:26.599006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:26.605453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:26.605911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:26.606694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:26.607139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:26.744650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:26.751855 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a975ab9-17bd-49a8-b3b0-65596a94f80f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.157382 Nov 06 21:36:26.752460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4073/8032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:26 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:27.769333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:27.769935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:27.776784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:27.777244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:27.778023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:27.778460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:27.911184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:27.919093 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16877859-a675-4bee-a865-f3ef65ac4dcf tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.153484 Nov 06 21:36:27.919669 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3960/8033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:27 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:28.398318 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:36:28.398562 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:36:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:36:28.939027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:28.939651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:28.946555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:28.947018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:28.947812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:28.948264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:29.081405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:29.088651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab730fdf-76ac-4f42-82cd-0ef43cb49522 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.154757 Nov 06 21:36:29.089226 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4074/8034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:28 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:30.105289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:30.105926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:30.112816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:30.113269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:30.114073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:30.114511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:30.244062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:30.251272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c586defb-b353-43f4-a435-8ff8e8b95a26 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.149616 Nov 06 21:36:30.251850 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3961/8035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:30 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:31.268769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:31.269317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:31.276745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:31.277207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:31.278028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:31.278477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:31.409658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:31.417138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf8219ea-9083-4359-8693-08148a4ab58f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.152164 Nov 06 21:36:31.417706 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4075/8036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:31 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:32.434702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:32.435310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:32.441757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:32.442212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:32.442997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:32.443440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:32.577055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:32.584634 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4d9cc491-f3c1-4b6c-af8e-9df4f85221b3 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.153562 Nov 06 21:36:32.585199 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3962/8037] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:32 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:33.601276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:33.601914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:33.608603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:33.609067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:33.609853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:33.610299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:33.743783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:33.751257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccbc23aa-eb0e-42b6-8de5-6d4954af39a6 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.153752 Nov 06 21:36:33.751830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4076/8038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:33 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:34.768371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:34.768983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:34.776138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:34.776625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:34.777409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:34.777851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:34.912092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:34.920222 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1eaf121a-4042-43ed-a287-5a41bfc12615 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1515 microversion: 2.1 time: 0.155603 Nov 06 21:36:34.920859 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3963/8039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:34 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:35.933943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "name": "network-vif-unplugged", "status": "completed", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:35.935844 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:35.935844 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:36:35.938057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:35.938893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:35.945295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:35.946385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:35.946846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:35.946962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:35.947638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:35.948080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:35.959249 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] Creating event network-vif-unplugged:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch2-master-1 Nov 06 21:36:35.964730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] Instance d21c9162-41f8-4879-9ed6-8131a14f3045 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:36:35.976481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-47a6afd0-d618-4071-96c5-a48afe5331ce req-be9d43aa-6e61-4412-994e-8387251793f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046997 Nov 06 21:36:35.977129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4077/8040] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:36:36.094745 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:36.102237 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c74f774-15b2-4ed4-88a6-d4fb394947be tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1514 microversion: 2.1 time: 0.167830 Nov 06 21:36:36.102885 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3964/8041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:35 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:37.120491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:37.121199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:37.129115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:37.129837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:37.130665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:37.131113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:37.268580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:37.276035 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-499ebce9-5e66-4a0d-9099-28c3f8763204 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1512 microversion: 2.1 time: 0.159682 Nov 06 21:36:37.276644 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4078/8042] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:37 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:37.993289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:37.994777 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:37.994777 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:36:38.002462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:38.002903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:38.014576 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] Creating event network-changed:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch2-master-1 Nov 06 21:36:38.020016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] Instance d21c9162-41f8-4879-9ed6-8131a14f3045 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:36:38.031395 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c0034e7e-3fe1-4209-b2ad-bd6d29287f8e req-5c3b4b95-8652-4643-8922-2bde310bb8ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041703 Nov 06 21:36:38.031977 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3965/8043] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:36:38.294137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:38.294735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:38.301910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:38.302375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:38.303179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:38.303625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:38.554913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:38.562246 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8daeae0b-8b40-4350-9275-eae133cfebba tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1512 microversion: 2.1 time: 0.271944 Nov 06 21:36:38.562817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4079/8044] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:38 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:39.580091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:39.580830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:39.586950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:39.587401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:39.588175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:39.588653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:39.727437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:39.734949 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-99fd75e8-184b-496a-ad3f-2b085303102f tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1509 microversion: 2.1 time: 0.159760 Nov 06 21:36:39.735516 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3966/8045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:39 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:39.750749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:39.751297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:39.757990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:39.758460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:39.759257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:39.759709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:39.787852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:36:39.836518 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Found an unconfirmed migration during delete, id: 16, status: finished Nov 06 21:36:41.131939 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-753667b9-964f-4604-bd83-fd20acf8adfc tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 204 len: 0 microversion: 2.1 time: 1.384559 Nov 06 21:36:41.133576 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4080/8046] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:36:39 2021] DELETE /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 0 bytes in 1387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:36:41.141706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:41.142326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:41.149935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:41.150423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:41.151425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:41.151865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:41.287441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:41.295614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2fefbed8-e2e5-4956-bc97-935ae8535829 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1501 microversion: 2.1 time: 0.157602 Nov 06 21:36:41.296244 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3967/8047] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:41 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:36:42.313421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:42.314046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:42.320851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:42.321321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:42.322120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:42.322572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:42.462073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fb712f0c2e46f59378c7cfda409712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcf1f84938e40b689fd09313120fcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:42.469454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db6694f3-d8be-4f76-ab4e-2c4622db9304 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 200 len: 1501 microversion: 2.1 time: 0.160239 Nov 06 21:36:42.470022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4081/8048] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:42 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:42.816902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-32e8ff99-15b9-4928-8e5d-148be7c7da30 req-57a1e455-efd9-4651-9e87-95ef0bd48122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "name": "network-vif-plugged", "status": "completed", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:42.818658 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:42.818658 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:36:42.828076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-32e8ff99-15b9-4928-8e5d-148be7c7da30 req-57a1e455-efd9-4651-9e87-95ef0bd48122 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:42.828959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-32e8ff99-15b9-4928-8e5d-148be7c7da30 req-57a1e455-efd9-4651-9e87-95ef0bd48122 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:42.841567 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-32e8ff99-15b9-4928-8e5d-148be7c7da30 req-57a1e455-efd9-4651-9e87-95ef0bd48122 service nova] Creating event network-vif-plugged:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch2-master-1 Nov 06 21:36:42.846912 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-32e8ff99-15b9-4928-8e5d-148be7c7da30 req-57a1e455-efd9-4651-9e87-95ef0bd48122 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Nov 06 21:36:42.847896 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3968/8049] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:36:42.975078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-152dbc33-5f0b-423b-a745-24c2a5b4fd53 req-0732a296-82cf-48c5-b2f6-7bcd9f8f6475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21c9162-41f8-4879-9ed6-8131a14f3045", "name": "network-vif-deleted", "tag": "ec88002d-bd22-47ee-a001-0bda69a360d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:42.977280 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:42.977280 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:36:42.985889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-152dbc33-5f0b-423b-a745-24c2a5b4fd53 req-0732a296-82cf-48c5-b2f6-7bcd9f8f6475 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:42.986353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-152dbc33-5f0b-423b-a745-24c2a5b4fd53 req-0732a296-82cf-48c5-b2f6-7bcd9f8f6475 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:42.997906 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-152dbc33-5f0b-423b-a745-24c2a5b4fd53 req-0732a296-82cf-48c5-b2f6-7bcd9f8f6475 service nova] Creating event network-vif-deleted:ec88002d-bd22-47ee-a001-0bda69a360d0 for instance d21c9162-41f8-4879-9ed6-8131a14f3045 on nch2-master-1 Nov 06 21:36:43.003386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-152dbc33-5f0b-423b-a745-24c2a5b4fd53 req-0732a296-82cf-48c5-b2f6-7bcd9f8f6475 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Nov 06 21:36:43.004038 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4082/8050] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:36:43.487295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:43.487913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:43.494625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.495087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.495871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.496338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.509613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] HTTP exception thrown: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. Nov 06 21:36:43.510199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Returning 404 to user: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:36:43.511023 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a0ec857-602d-4d03-b8f6-d2a6177079b7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 404 len: 111 microversion: 2.1 time: 0.027892 Nov 06 21:36:43.511545 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3969/8051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:43 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:36:43.527432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:43.528024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:43.534497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.534977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.535784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.536236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.549538 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] HTTP exception thrown: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. Nov 06 21:36:43.550142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Returning 404 to user: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:36:43.550975 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d0f00b3-8de3-4d71-a53e-3f529ed61fc7 tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 404 len: 111 microversion: 2.1 time: 0.028472 Nov 06 21:36:43.551502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4083/8052] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:36:43 2021] DELETE /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:36:43.559618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:43.560226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] [instance: d21c9162-41f8-4879-9ed6-8131a14f3045] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:43.566026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.566482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.567258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:43.567692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:43.581063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] HTTP exception thrown: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. Nov 06 21:36:43.581647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] Returning 404 to user: Instance d21c9162-41f8-4879-9ed6-8131a14f3045 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:36:43.582453 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88052e5f-06e4-41fe-8290-03bb1a8d0f1d tempest-DeleteServersTestJSON-713300365 tempest-DeleteServersTestJSON-713300365-project] 10.222.0.13 "GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045" status: 404 len: 111 microversion: 2.1 time: 0.026512 Nov 06 21:36:43.582962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3970/8053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:43 2021] GET /compute/v2.1/servers/d21c9162-41f8-4879-9ed6-8131a14f3045 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:36:45.947540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-274376007", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "ad812036-379d-4125-afa5-846cd5b89405"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:45.997447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] validate_networks() for [('ad812036-379d-4125-afa5-846cd5b89405', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:36:46.335224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:36:46.336260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:36:46.336785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:36:46.337215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:36:46.337670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:36:46.346302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:46.346767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:46.347596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:46.348051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:46.364569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Getting quotas for project 09cb2a9f42fa4db88f8a4b4e67334216. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:36:46.369510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Getting quotas for user 4e074533f11043ceb905195419f58851 and project 09cb2a9f42fa4db88f8a4b4e67334216. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:36:46.381602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:36:46.384449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:36:46.428323 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ef42810-39b9-451e-b85d-2056af96a4a1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605231 Nov 06 21:36:46.429266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4084/8054] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:36:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:36:46.439520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-167206e3-f37a-43d5-a15c-700005da22eb tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:46.440127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-167206e3-f37a-43d5-a15c-700005da22eb tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:46.495970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-167206e3-f37a-43d5-a15c-700005da22eb tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:46.502528 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-167206e3-f37a-43d5-a15c-700005da22eb tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1217 microversion: 2.1 time: 0.066699 Nov 06 21:36:46.503090 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3971/8055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:46 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:47.520255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:47.521060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:47.529371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:47.529842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:47.530649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:47.531105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:47.620681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:47.628044 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d6dfdf56-e4f8-497c-8542-e674c278f902 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1275 microversion: 2.1 time: 0.111849 Nov 06 21:36:47.628651 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4085/8056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:47 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:48.568785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8cd83ed2-1974-4ddb-a9a4-c45609695703 req-c43fb74a-9abd-4dbb-bec9-a76cf68820d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:48.571955 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:48.571955 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:36:48.590489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8cd83ed2-1974-4ddb-a9a4-c45609695703 req-c43fb74a-9abd-4dbb-bec9-a76cf68820d4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:48.590946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8cd83ed2-1974-4ddb-a9a4-c45609695703 req-c43fb74a-9abd-4dbb-bec9-a76cf68820d4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:48.602161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8cd83ed2-1974-4ddb-a9a4-c45609695703 req-c43fb74a-9abd-4dbb-bec9-a76cf68820d4 service nova] Creating event network-changed:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch1-master-1 Nov 06 21:36:48.607029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8cd83ed2-1974-4ddb-a9a4-c45609695703 req-c43fb74a-9abd-4dbb-bec9-a76cf68820d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042066 Nov 06 21:36:48.607624 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3972/8057] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:36:48.645126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:48.645754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:48.652667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:48.653135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:48.653933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:48.654383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:48.892259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:48.900113 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b680629-bac6-413e-8a1a-0dffa34a2535 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.258711 Nov 06 21:36:48.900726 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4086/8058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:48 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:49.918041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:49.918737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:49.925040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:49.925486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:49.926258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:49.926688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:50.056673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:50.064022 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17883ca8-b55b-40aa-b262-7aa50228daa7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.150828 Nov 06 21:36:50.064702 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3973/8059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:49 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:51.080463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:51.081097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:51.087897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:51.088400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:51.089205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:51.089658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:51.226023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:51.233315 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ac1d44f-8c0f-4bb3-8526-cec5304f8f61 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.156553 Nov 06 21:36:51.233813 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4087/8060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:51 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:52.250403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:52.250974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:52.258032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:52.258482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:52.259257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:52.259692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:52.386503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:52.393681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a32d9775-3aa3-4cdd-8f71-21fef1ef08de tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.147047 Nov 06 21:36:52.394224 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3974/8061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:52 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:53.410518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:53.411151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:53.418686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:53.419157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:53.419972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:53.420467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:53.549836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:53.557403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61227087-564b-42f3-a9ed-04aa2f8e8fac tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.150668 Nov 06 21:36:53.557979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4088/8062] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:53 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:54.574593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:54.575201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:54.581862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:54.582389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:54.583169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:54.583616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:54.718843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:54.726067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3e4cb34-1bb3-4f11-a3c2-d8e695b58c5c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.155123 Nov 06 21:36:54.726632 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3975/8063] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:54 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:55.742904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:55.743530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:55.750308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:55.750783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:55.751576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:55.752030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:55.882127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:55.889702 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd559ce2-488b-41c8-8c73-ea7e79fba34d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.151115 Nov 06 21:36:55.890280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4089/8064] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:55 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:56.389046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c6bd21e9-b395-465d-8c3e-334f9c45bdf9 req-424aefa7-0fa6-48f8-a57f-efbc76d81129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "name": "network-vif-plugged", "status": "completed", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:56.390570 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:36:56.390570 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:36:56.399304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c6bd21e9-b395-465d-8c3e-334f9c45bdf9 req-424aefa7-0fa6-48f8-a57f-efbc76d81129 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:56.399753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c6bd21e9-b395-465d-8c3e-334f9c45bdf9 req-424aefa7-0fa6-48f8-a57f-efbc76d81129 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:56.412373 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c6bd21e9-b395-465d-8c3e-334f9c45bdf9 req-424aefa7-0fa6-48f8-a57f-efbc76d81129 service nova] Creating event network-vif-plugged:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch1-master-1 Nov 06 21:36:56.417914 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c6bd21e9-b395-465d-8c3e-334f9c45bdf9 req-424aefa7-0fa6-48f8-a57f-efbc76d81129 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Nov 06 21:36:56.418544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3976/8065] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:36:56.906424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:56.907049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:56.914591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:56.915059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:56.915855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:56.916343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:57.049469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:57.056955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-139cb41a-cfd7-4e45-bc45-a3e0b09ea0be tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1317 microversion: 2.1 time: 0.154263 Nov 06 21:36:57.057524 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4090/8066] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:56 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.075130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:58.075827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.081924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.082376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.083153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.083588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.211630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:58.218975 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a84a2b76-0ee4-4dc4-be80-443516035741 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1506 microversion: 2.1 time: 0.148743 Nov 06 21:36:58.219541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3977/8067] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:58 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.235297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:58.235950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.243301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.243767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.244617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.245055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.377220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:58.385058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ed62205-7007-48f1-8bff-df8c855a1f95 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1506 microversion: 2.1 time: 0.153481 Nov 06 21:36:58.385633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4091/8068] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:58 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.401286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:58.402435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.408241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.408743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.409525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.409974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.469652 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-452a793a-1668-4b19-b20f-790341c38cfa tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "PUT /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1078 microversion: 2.1 time: 0.072606 Nov 06 21:36:58.470193 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3978/8069] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Nov 6 21:36:58 2021] PUT /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1078 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.483469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:58.484159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.490106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.490592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.491400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.492395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.624257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:58.631665 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f3a9e381-f1e7-482e-ae4e-ea71ee0635e6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1504 microversion: 2.1 time: 0.151878 Nov 06 21:36:58.632866 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4092/8070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:58 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.648147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:58.648825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.654695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.655150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.655939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.656412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.790145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:58.797690 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b85c6a43-e6af-44a7-8960-da1277082bf8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1504 microversion: 2.1 time: 0.153229 Nov 06 21:36:58.798254 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3979/8071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:58 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:36:58.813541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:36:58.814582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.820916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.821381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.822167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.822615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.849534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:58.855191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:36:58.861213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:36:58.861647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:36:58.862133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:36:58.862559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:36:58.862991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:36:58.926563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6bae8c87-361f-43e7-af6a-22ce6c518727 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615/action" status: 202 len: 0 microversion: 2.1 time: 0.116842 Nov 06 21:36:58.927171 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4093/8072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:36:58 2021] POST /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:36:58.935497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:36:58.936104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:36:58.941947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.942399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:58.943177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:36:58.943608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:36:59.100694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:36:59.109021 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bcc7569-d9ee-4395-a41f-5a1af57403b8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1515 microversion: 2.1 time: 0.177041 Nov 06 21:36:59.109675 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3980/8073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:36:58 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:00.127587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:00.128931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:00.134931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:00.135398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:00.136209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:00.136720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:00.340665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:00.347999 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-07537569-4dd8-4c03-8c95-f874f55249f1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1515 microversion: 2.1 time: 0.225011 Nov 06 21:37:00.348600 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4094/8074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:00 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:01.365673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:01.366292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:01.373382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:01.373841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:01.374629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:01.375067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:01.506357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:01.513741 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac1f3f24-d66e-4a63-be4d-39fce213b80c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.151950 Nov 06 21:37:01.514302 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3981/8075] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:01 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:02.530771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:02.531379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:02.538148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:02.538613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:02.539408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:02.539859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:02.669714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:02.677320 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1ec41ee-ad86-4680-9cbf-309bfe3ff383 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.150287 Nov 06 21:37:02.677893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4095/8076] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:02 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:03.694574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:03.695177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:03.702456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:03.702900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:03.703672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:03.704099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:03.835616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:03.842801 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8529f54c-52e9-4a13-809c-4383da20d458 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.151934 Nov 06 21:37:03.843357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3982/8077] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:03 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:04.859618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:04.860226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:04.867116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:04.867587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:04.868501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:04.868962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:04.997227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:05.004568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-769248d0-66f0-4e3c-9085-3019728d34e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.148661 Nov 06 21:37:05.005146 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4096/8078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:04 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:06.021327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:06.021962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:06.029128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:06.029589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:06.030369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:06.030806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:06.164210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:06.172331 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f114bf5b-27dc-473c-8aea-f9f865e38953 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.154416 Nov 06 21:37:06.172906 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3983/8079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:06 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:07.189983 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:07.190643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:07.197978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:07.198447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:07.199250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:07.199710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:07.328696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:07.336112 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d83c006f-d493-41e9-bfbc-e775180f29d8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.150392 Nov 06 21:37:07.336720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4097/8080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:07 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:08.354296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:08.354903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:08.362028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:08.362671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:08.363454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:08.363890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:08.563054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:08.570268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b5a7d6eb-1aec-4a5b-bbce-6fe6e6752cf6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.220352 Nov 06 21:37:08.570822 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3984/8081] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:08 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:09.587834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:09.588489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:09.595142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:09.595607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:09.596433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:09.596883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:09.739456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:09.747228 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68b4fa9b-cb21-4272-a4f5-72b70e5eae9f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.163718 Nov 06 21:37:09.747798 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4098/8082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:09 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:10.764465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:10.765101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:10.771724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:10.772185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:10.772992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:10.773433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:10.902023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:10.909506 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2e8e1a5a-9c0b-49b5-8a6d-fb7a0b7cb1c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.148746 Nov 06 21:37:10.910073 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3985/8083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:10 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:11.926805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:11.927425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:11.934225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:11.934698 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:11.935498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:11.935952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:12.066623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:12.074018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f36861d6-6cfd-4644-8472-462c622e90e1 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.150981 Nov 06 21:37:12.074591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4099/8084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:11 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:13.090648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:13.091260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:13.097886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:13.098333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:13.099132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:13.099566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:13.234445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:13.241730 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f0c0b653-f700-44ac-9ae7-09a7a833963f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.154725 Nov 06 21:37:13.242296 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3986/8085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:13 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:14.258317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:14.258880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:14.265638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:14.266104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:14.266894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:14.267339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:14.395530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:14.403517 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-359124ef-6e0a-4643-8b87-aa8b917d1df8 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.149016 Nov 06 21:37:14.404085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4100/8086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:14 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:37:15.420379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:15.420922 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:15.427672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:15.428119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:15.428928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:15.429364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:15.562411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:15.569642 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf145f02-9927-482b-8ae8-e6fad0ef0e45 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.153074 Nov 06 21:37:15.570202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3987/8087] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:15 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:16.586815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:16.587440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:16.594347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:16.594813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:16.595606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:16.596056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:16.728031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:16.735380 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c7fff94-82d1-4019-b053-d15a9de14a1d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.152284 Nov 06 21:37:16.735948 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4101/8088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:16 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:17.752808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:17.753440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:17.760591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:17.761040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:17.761815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:17.762253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:17.896230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:17.903551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2064e55d-780f-4067-af63-6e77b8de361b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.154482 Nov 06 21:37:17.904119 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3988/8089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:17 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:18.920653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:18.921268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:18.928240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:18.928745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:18.929524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:18.929971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:19.058560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:19.066066 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82747b4d-964d-4f6b-b411-8a116ea1f091 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.149071 Nov 06 21:37:19.066641 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4102/8090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:18 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:20.083318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:20.083919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:20.091439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:20.091895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:20.092711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:20.093150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:20.224416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:20.231571 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-04fe6a18-0209-435a-a2b5-ef34708998cd tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.152007 Nov 06 21:37:20.232130 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3989/8091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:20 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:37:21.247996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:21.248635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:21.255373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:21.255837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:21.256646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:21.257094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:21.387746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:21.395028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0dbff22c-1238-4c25-8563-0650ca2d845f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.150750 Nov 06 21:37:21.395591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4103/8092] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:21 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:22.412498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:22.413096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:22.420646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:22.421100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:22.422135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:22.422573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:22.550947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:22.558447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f4c70e3b-dd3c-4093-8593-23acf2082dd6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.149725 Nov 06 21:37:22.559017 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3990/8093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:22 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:23.574939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:23.575563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:23.581916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:23.582381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:23.583174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:23.583626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:23.727947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:23.735403 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a066c623-8fdf-448b-aa23-e6aac67bfd93 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.164398 Nov 06 21:37:23.735999 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4104/8094] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:23 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:24.752869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:24.753455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:24.760058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:24.760543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:24.761328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:24.761761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:24.892228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:24.899901 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07eb9f0d-3bf4-420b-bc3a-c9002ff5436f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.150709 Nov 06 21:37:24.900485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3991/8095] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:24 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:25.917254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:25.917900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:25.924540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:25.925001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:25.925795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:25.926240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:26.061133 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:26.071298 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2bcf635-a2a4-4ee1-8081-a4f1aa24062f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.158382 Nov 06 21:37:26.071876 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4105/8096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:25 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:27.088532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:27.089175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:27.095841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:27.096315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:27.097258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:27.097708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:27.230521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:27.237800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0e334008-fd4a-4ef5-9d73-bc7675c57746 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1520 microversion: 2.1 time: 0.153300 Nov 06 21:37:27.238384 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3992/8097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:27 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:28.141318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "name": "network-vif-unplugged", "status": "completed", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:28.143197 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:28.143197 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:37:28.152493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:28.152999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:28.164923 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] Creating event network-vif-unplugged:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch2-master-1 Nov 06 21:37:28.170161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:37:28.182391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-3e55598a-2f7d-478a-970f-f54c480ca3c4 req-d28472e8-5019-40e2-a3cc-4955f3bd3307 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045143 Nov 06 21:37:28.183005 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4106/8098] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:37:28.255017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:28.255630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:28.263026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:28.263449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:28.264344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:28.264818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:28.407869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:28.415205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0943c7c7-0fb3-4aca-b09a-4eb09b1ac715 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1519 microversion: 2.1 time: 0.164080 Nov 06 21:37:28.415886 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3993/8099] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:28 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:29.433198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:29.433907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:29.440767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:29.441227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:29.442019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:29.442461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:29.571473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:29.579453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a09a6b29-7e78-4882-9f6f-420f57ffb4df tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1517 microversion: 2.1 time: 0.150321 Nov 06 21:37:29.580036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4107/8100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:29 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:30.200899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:30.203024 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:30.203024 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:37:30.211297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:30.211752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:30.222974 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] Creating event network-changed:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch2-master-1 Nov 06 21:37:30.228706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:37:30.239190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-18079f5a-cfef-4c08-9dff-930bc4d63df6 req-cd2651d8-15ca-4519-be62-a9c303008e76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041885 Nov 06 21:37:30.239762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3994/8101] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:37:30.597154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:30.597780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:30.605098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:30.605569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:30.606368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:30.606808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:30.801371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:30.809089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b897f3ad-927a-43f3-86a8-96e2c9258e2b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1517 microversion: 2.1 time: 0.215694 Nov 06 21:37:30.809660 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4108/8102] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:30 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:31.827396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:31.828076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:31.834241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:31.834705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:31.835478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:31.835912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:31.971101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:31.978884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-50b5a1e0-5ead-4d24-a5bb-38b573aabee3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1514 microversion: 2.1 time: 0.156435 Nov 06 21:37:31.979449 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3995/8103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:31 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:31.995972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:31.996523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:32.003118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:32.003583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:32.004397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:32.004845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:32.062210 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38d2522a-cb19-46a7-89ba-ce84b1cd1be0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615/action" status: 204 len: 0 microversion: 2.1 time: 0.070297 Nov 06 21:37:32.062862 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4109/8104] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:37:31 2021] POST /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:37:32.071504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:32.072190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:32.078368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:32.078833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:32.079678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:32.080161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:32.293336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:32.301340 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0488d117-3bf5-45cc-a63a-0ef68b44528a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1514 microversion: 2.1 time: 0.234217 Nov 06 21:37:32.301916 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3996/8105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:32 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:33.320651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:33.321371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:33.327979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.328483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.329289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.329748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.461228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:33.469464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e16e3e2-1903-43a6-8e06-0eba2374271b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1506 microversion: 2.1 time: 0.153852 Nov 06 21:37:33.470039 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4110/8106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:33 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:33.485979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:33.486496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:33.492943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.493395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.494173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.494607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.626690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:33.634788 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6658fd4-dfbc-46ac-a93a-3035b209027b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1506 microversion: 2.1 time: 0.152241 Nov 06 21:37:33.635362 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3997/8107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:33 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:33.650335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:33.650957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:33.656775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.657260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.658047 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.658493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.796068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:33.803693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0123534-f773-4f98-ae2c-29f16a0e3ec7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 200 len: 1506 microversion: 2.1 time: 0.157057 Nov 06 21:37:33.804270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4111/8108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:33 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:33.819657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:33.820148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:33.826481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.826933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.827707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:33.828138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:33.851191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:37:33.923863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f13973b-c166-4ae5-8176-7c70f8d26c74 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 204 len: 0 microversion: 2.1 time: 0.107302 Nov 06 21:37:33.924649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3998/8109] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:37:33 2021] DELETE /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:37:33.980089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1826584443", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "ad812036-379d-4125-afa5-846cd5b89405"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:34.029076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] validate_networks() for [('ad812036-379d-4125-afa5-846cd5b89405', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:37:34.385979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:37:34.386624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:37:34.386919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:37:34.387342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:37:34.387800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:37:34.396623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:34.397086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:34.397915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:34.398364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:34.415195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Getting quotas for project 09cb2a9f42fa4db88f8a4b4e67334216. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:37:34.420872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Getting quotas for user 4e074533f11043ceb905195419f58851 and project 09cb2a9f42fa4db88f8a4b4e67334216. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:37:34.432962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:37:34.435321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:37:34.479487 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9550639-46f5-4b97-aa25-60172266921a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503419 Nov 06 21:37:34.480366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4112/8110] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:37:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:37:34.490338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a044a07e-b4f9-4ec2-a38d-8ae7b282035c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:34.491042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a044a07e-b4f9-4ec2-a38d-8ae7b282035c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:34.545679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a044a07e-b4f9-4ec2-a38d-8ae7b282035c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:34.552495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a044a07e-b4f9-4ec2-a38d-8ae7b282035c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1218 microversion: 2.1 time: 0.065992 Nov 06 21:37:34.552964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 3999/8111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:34 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:35.209161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-665e268e-41b8-4888-acfa-6002ad187221 req-e3da36e0-f882-4201-b828-6b4a3607447c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "name": "network-vif-plugged", "status": "completed", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:35.210719 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:35.210719 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:37:35.217985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-665e268e-41b8-4888-acfa-6002ad187221 req-e3da36e0-f882-4201-b828-6b4a3607447c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:35.218441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-665e268e-41b8-4888-acfa-6002ad187221 req-e3da36e0-f882-4201-b828-6b4a3607447c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:35.229532 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-665e268e-41b8-4888-acfa-6002ad187221 req-e3da36e0-f882-4201-b828-6b4a3607447c service nova] Creating event network-vif-plugged:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch2-master-1 Nov 06 21:37:35.234391 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-665e268e-41b8-4888-acfa-6002ad187221 req-e3da36e0-f882-4201-b828-6b4a3607447c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029072 Nov 06 21:37:35.235058 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4113/8112] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:37:35.569282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:35.569882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:35.583865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:35.584570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:35.585421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:35.585895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:35.659566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:35.667691 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6d6e7ebe-a539-4a6b-ae6b-05516436d2d4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1276 microversion: 2.1 time: 0.102117 Nov 06 21:37:35.668339 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4000/8113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:35 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:37:35.828348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-dcc9a594-2999-4b90-8e06-17f71f43f09a req-1b14ba3f-7fb8-43bd-8a9e-c883001c620e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf80c64-805f-45fd-b7c6-6dcc640cb615", "name": "network-vif-deleted", "tag": "e40c9a25-eed7-4ace-bb6b-4b545ccfcac4"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:35.829845 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:35.829845 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:37:35.838429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-dcc9a594-2999-4b90-8e06-17f71f43f09a req-1b14ba3f-7fb8-43bd-8a9e-c883001c620e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:35.839208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-dcc9a594-2999-4b90-8e06-17f71f43f09a req-1b14ba3f-7fb8-43bd-8a9e-c883001c620e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:35.850967 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-dcc9a594-2999-4b90-8e06-17f71f43f09a req-1b14ba3f-7fb8-43bd-8a9e-c883001c620e service nova] Creating event network-vif-deleted:e40c9a25-eed7-4ace-bb6b-4b545ccfcac4 for instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 on nch2-master-1 Nov 06 21:37:35.856984 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-dcc9a594-2999-4b90-8e06-17f71f43f09a req-1b14ba3f-7fb8-43bd-8a9e-c883001c620e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Nov 06 21:37:35.857985 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4114/8114] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:37:36.685212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:36.685807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:36.692626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:36.693075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:36.693852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:36.694288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:36.922842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:36.930126 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9195121-fde9-4fb7-b17c-f67efcb94b1a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.248594 Nov 06 21:37:36.930736 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4001/8115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:36 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:37.063095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7428a541-c0b2-486d-b5bb-29cd0d811746 req-cadb0061-9c75-4dd7-887f-687c9ba68a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:37.065588 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:37.065588 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:37:37.073825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7428a541-c0b2-486d-b5bb-29cd0d811746 req-cadb0061-9c75-4dd7-887f-687c9ba68a88 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:37.074278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7428a541-c0b2-486d-b5bb-29cd0d811746 req-cadb0061-9c75-4dd7-887f-687c9ba68a88 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:37.085934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7428a541-c0b2-486d-b5bb-29cd0d811746 req-cadb0061-9c75-4dd7-887f-687c9ba68a88 service nova] Creating event network-changed:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch2-master-1 Nov 06 21:37:37.091498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7428a541-c0b2-486d-b5bb-29cd0d811746 req-cadb0061-9c75-4dd7-887f-687c9ba68a88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033966 Nov 06 21:37:37.092534 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4115/8116] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:37:37.947802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:37.948459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:37.955093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:37.955554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:37.956831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:37.957278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:38.086635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:38.093957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c17e6ebb-2155-4606-a861-0a66881dfa31 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.151049 Nov 06 21:37:38.094530 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4002/8117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:37 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:39.112451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:39.113163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:39.119362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:39.120387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:39.121177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:39.121629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:39.257394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:39.264742 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-937592b2-b50e-40a2-87a0-c66a976b5c78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.157186 Nov 06 21:37:39.265311 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4116/8118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:39 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:40.281896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:40.282417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:40.288850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:40.289312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:40.290096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:40.290541 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:40.430654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:40.438596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3927b8bd-e911-4c19-a13c-ce654286c503 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.160645 Nov 06 21:37:40.439167 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4003/8119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:40 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:37:41.456152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:41.456804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:41.464403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:41.465050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:41.465825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:41.466151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:41.595601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:41.603209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea33bfd9-4d1f-4b21-8159-22ee0962ea9b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.150890 Nov 06 21:37:41.603772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4117/8120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:41 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:42.619958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:42.620971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:42.627321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:42.627768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:42.628592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:42.629025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:42.760000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:42.767438 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1a730d9-97ed-477f-9ef0-c05c11bed46e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.151161 Nov 06 21:37:42.768012 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4004/8121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:42 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:43.059260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-8c932ce9-faf5-4665-bd85-15bb2468b274 req-22e1b3e5-654f-4232-a9a8-434d45e00130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "name": "network-vif-plugged", "status": "completed", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:43.060892 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:37:43.060892 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:37:43.068712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8c932ce9-faf5-4665-bd85-15bb2468b274 req-22e1b3e5-654f-4232-a9a8-434d45e00130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:43.069144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-8c932ce9-faf5-4665-bd85-15bb2468b274 req-22e1b3e5-654f-4232-a9a8-434d45e00130 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:43.080855 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-8c932ce9-faf5-4665-bd85-15bb2468b274 req-22e1b3e5-654f-4232-a9a8-434d45e00130 service nova] Creating event network-vif-plugged:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch2-master-1 Nov 06 21:37:43.085779 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-8c932ce9-faf5-4665-bd85-15bb2468b274 req-22e1b3e5-654f-4232-a9a8-434d45e00130 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030341 Nov 06 21:37:43.086377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4118/8122] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:37:43.784641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:43.785272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:43.792710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:43.793279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:43.794095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:43.794528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:43.935872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:43.943641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39e70d0f-0fee-4a81-b431-d26834d0102a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1318 microversion: 2.1 time: 0.162693 Nov 06 21:37:43.944243 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4005/8123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:43 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:44.961962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:44.962686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:44.969194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:44.969730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:44.970548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:44.971009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.117307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:45.125202 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-472708c6-03be-4fd5-8e4e-ffe790ffd6e7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1507 microversion: 2.1 time: 0.168185 Nov 06 21:37:45.125809 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4119/8124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:44 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:45.141574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:45.142184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:45.149118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.149578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.150363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.150837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.281024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:45.288145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eed6f540-f346-4039-ab12-7353fd94c8b4 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1507 microversion: 2.1 time: 0.150259 Nov 06 21:37:45.288737 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4006/8125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:45 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:45.304673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:37:45.305665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:45.312065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.312570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.313358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.313803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.343157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:45.349126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:37:45.355600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:37:45.356038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:37:45.356547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:37:45.356966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:37:45.357390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:37:45.416804 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a2bcd2e-4dc9-4b55-af86-03b139a8323f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03/action" status: 202 len: 0 microversion: 2.1 time: 0.115114 Nov 06 21:37:45.417488 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4120/8126] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:37:45 2021] POST /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:37:45.427038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:45.427737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:45.434826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.435381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.436196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:45.436885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:45.592533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:45.600288 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cfbf04b8-0075-4bc5-a24c-b071397158c6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1514 microversion: 2.1 time: 0.176882 Nov 06 21:37:45.601136 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4007/8127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:45 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:46.618397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:46.619036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:46.626290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:46.626763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:46.627575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:46.628040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:46.852330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:46.860226 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8096b0e7-ae10-43ee-be78-22a8e78e0180 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1514 microversion: 2.1 time: 0.245642 Nov 06 21:37:46.861056 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4121/8128] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:46 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:47.877039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:47.877641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:47.884350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:47.884798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:47.886139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:47.886571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:48.022912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:48.030200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d769c916-3563-4932-a0f6-d7dff7b0ceff tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.156816 Nov 06 21:37:48.030772 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4008/8129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:47 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:49.047873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:49.048544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:49.055252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:49.055719 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:49.056549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:49.057001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:49.186175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:49.193965 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-47543d57-6667-4631-b244-97c96c8ba21d tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150098 Nov 06 21:37:49.194543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4122/8130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:49 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:50.211261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:50.211829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:50.218967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:50.219417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:50.220192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:50.220657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:50.435353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:50.442588 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07259b4b-5e63-4fd7-8ef2-6199e022da77 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.235120 Nov 06 21:37:50.443157 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4009/8131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:50 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:51.459974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:51.460552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:51.467954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:51.468471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:51.469267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:51.469720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:51.602650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:51.610103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-675df763-ca65-4633-9d27-487bba583831 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.153997 Nov 06 21:37:51.610672 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4123/8132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:51 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:52.626637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:52.627241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:52.633863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:52.634314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:52.635088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:52.635518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:52.766596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:52.773728 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c9847a86-5703-492e-86bc-ced1d77d24c9 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150758 Nov 06 21:37:52.774292 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4010/8133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:52 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:53.790765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:53.791456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:53.798754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:53.799220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:53.800020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:53.800506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:53.993106 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:54.000554 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d3e804a-0bbf-40de-b08d-ce86ec2e0d4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.213490 Nov 06 21:37:54.001141 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4124/8134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:53 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:55.017353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:55.017967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:55.024877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:55.025353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:55.026134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:55.026567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:55.156944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:55.164316 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48eb5668-abf5-4423-9042-50fa882a7822 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150691 Nov 06 21:37:55.164881 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4011/8135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:55 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:56.182250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:56.182792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:56.189717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:56.190204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:56.191378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:56.191963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:56.325088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:56.332427 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3bbbd75f-6b34-4383-a694-3f750ba40c36 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.154114 Nov 06 21:37:56.333003 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4125/8136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:56 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:57.349177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:57.349793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:57.356442 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:57.356899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:57.357684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:57.358143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:57.493975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:57.501360 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8977de1-ffcd-4330-8545-f528414554d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.155921 Nov 06 21:37:57.501932 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4012/8137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:57 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:58.518189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:58.518818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:58.525665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:58.526137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:58.527426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:58.527880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:58.656947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:58.664459 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a3044b7a-bb34-4555-9436-622b6a91a187 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150009 Nov 06 21:37:58.665040 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4126/8138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:58 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:37:59.681917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:37:59.682566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:37:59.689246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:59.689696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:59.690471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:37:59.690905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:37:59.824542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:37:59.831687 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b09f143-519f-498f-8184-f0bd1920cd4e tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.153492 Nov 06 21:37:59.832260 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4013/8139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:37:59 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:00.847638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:00.848341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:00.855624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:00.856644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:00.857465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:00.857925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:00.990869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:00.998238 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2facc618-4d71-4483-8fe4-43c823a9e45f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.154377 Nov 06 21:38:00.998811 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4127/8140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:00 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:02.015237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:02.015842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:02.022383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:02.022830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:02.023603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:02.024036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:02.156056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:02.163275 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7f25888-ea47-4b1f-b1e5-63d84ae30a78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.151709 Nov 06 21:38:02.163864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4014/8141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:02 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:03.180992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:03.181617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:03.189028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:03.189536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:03.190588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:03.191091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:03.322408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:03.329780 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e37dab10-5da3-4005-a567-f3f7b7372b6b tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.152503 Nov 06 21:38:03.330350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4128/8142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:03 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:04.345762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:04.346374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:04.353060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:04.353517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:04.354299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:04.354737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:04.485107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:04.492504 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62ceaa4e-f243-4d74-809e-9f1da6417eb0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150393 Nov 06 21:38:04.493065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4015/8143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:04 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:05.509861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:05.510491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:05.517739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:05.518206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:05.519007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:05.519456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:05.653315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:05.660629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7109ece-8f50-4e43-9722-0ec00e5b602f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.154552 Nov 06 21:38:05.661198 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4129/8144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:05 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:06.678039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:06.678782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:06.685395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:06.686006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:06.686627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:06.687065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:06.823283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:06.830606 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28ea2419-ced3-4a71-9b32-0fffa8bf30fe tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.156167 Nov 06 21:38:06.831181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4016/8145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:06 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:07.848026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:07.848672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:07.855914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:07.856417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:07.857217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:07.857672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:07.999265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:08.006615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f69e2939-f76b-4cfe-8988-e1999cfd2e04 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.162345 Nov 06 21:38:08.007178 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4130/8146] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:07 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:08.345362 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:38:08.345941 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:38:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:38:09.022943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:09.023551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:09.029884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:09.030339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:09.031121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:09.031558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:09.165349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:09.173587 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a6dfc1b8-2216-46bb-9133-3a9401fa9173 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.154543 Nov 06 21:38:09.174149 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4017/8147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:09 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:10.189361 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:10.189991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:10.197654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:10.198151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:10.199508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:10.199976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:10.328894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:10.336253 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac4fcf7e-e572-4cfb-86a8-177b723d1100 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150584 Nov 06 21:38:10.336869 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4131/8148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:10 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:11.357118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:11.357677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:11.364323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:11.364782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:11.365559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:11.365994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:11.494407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:11.502332 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58aff775-54b3-46fc-b6ac-2b2b76f4fd9c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150662 Nov 06 21:38:11.502899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4018/8149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:11 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:12.519296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:12.519918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:12.526638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:12.527742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:12.528577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:12.529024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:12.662862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:12.670386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b20d861-6cf7-4d92-becd-391a6f3c3216 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.154737 Nov 06 21:38:12.670986 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4132/8150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:12 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:13.686722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:13.687310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:13.694046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:13.694494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:13.695266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:13.695704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:13.826741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:13.834012 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-34148e3b-32ff-4a24-85c5-d0d936c45468 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1519 microversion: 2.1 time: 0.150950 Nov 06 21:38:13.834573 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4019/8151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:13 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:14.520759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "name": "network-vif-unplugged", "status": "completed", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:14.522356 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:14.522356 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:38:14.530746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:14.531297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:14.547370 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] Creating event network-vif-unplugged:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch1-master-1 Nov 06 21:38:14.554079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] Instance 16522606-4928-4e1a-9576-8625846d9a03 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:38:14.567050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-583fd6ab-c569-4853-ab1e-0658578e62ff req-406924ca-6bb1-434c-8bc0-5613119cce6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050544 Nov 06 21:38:14.567654 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4133/8152] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:14.851779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:14.852407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:14.859764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:14.860217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:14.861031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:14.861653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:15.090697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:15.098190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5b6f6bf0-6156-4709-b694-9b07fa85c0b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1518 microversion: 2.1 time: 0.250317 Nov 06 21:38:15.098754 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4020/8153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:14 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:16.116001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:16.116746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:16.123583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:16.124043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:16.124856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:16.125308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:16.259452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:16.267362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f155e49-5b4c-4aa8-8405-bf2761a2f7c7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1516 microversion: 2.1 time: 0.155504 Nov 06 21:38:16.267939 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4134/8154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:16 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:16.582258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:16.583845 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:16.583845 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:38:16.591680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:16.592132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:16.603206 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] Creating event network-changed:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch1-master-1 Nov 06 21:38:16.608426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] Instance 16522606-4928-4e1a-9576-8625846d9a03 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:38:16.619057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8a20048a-e232-4187-aae0-ab09072498c3 req-078750fc-e7d5-4367-b414-c84aec4eea3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040415 Nov 06 21:38:16.619644 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4021/8155] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:17.284419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:17.285049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:17.292051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:17.293177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:17.293999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:17.294488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:17.655321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:17.663574 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-973ea0fe-acba-4428-9f4c-c222d95c2d59 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1516 microversion: 2.1 time: 0.382981 Nov 06 21:38:17.664194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4135/8156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:17 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1516 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:18.681124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:18.681851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:18.688731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.689200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:18.689968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.690402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:18.829785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:18.837718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd69bbcf-f6eb-4aa5-9562-0fa8c7fe9c96 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1513 microversion: 2.1 time: 0.160592 Nov 06 21:38:18.838306 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4022/8157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:18 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:18.854360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:18.855031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:18.862300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.862767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:18.863565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.864010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:18.924324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89d7dd92-d976-4045-af68-011ddc514e42 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "POST /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03/action" status: 204 len: 0 microversion: 2.1 time: 0.073491 Nov 06 21:38:18.925215 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4136/8158] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:18 2021] POST /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:38:18.933200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:18.934313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:18.940625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.941082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:18.941869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:18.942363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:19.114618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:19.123421 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-add02c6a-1101-4756-8b1f-655606fefa85 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1513 microversion: 2.1 time: 0.193051 Nov 06 21:38:19.125144 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4023/8159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:18 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:20.144154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.144815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.151322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.151791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.152832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.153294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.293024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:20.300701 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f27cf0dd-d73f-4cea-8ee9-6d4b6bce76b0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1505 microversion: 2.1 time: 0.161842 Nov 06 21:38:20.301268 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4137/8160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:20 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:38:20.317138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.317769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.324948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.325398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.326173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.326605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.458839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:20.466201 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd10355c-8dfb-4c44-9c43-87822a241dc6 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1505 microversion: 2.1 time: 0.152609 Nov 06 21:38:20.466767 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4024/8161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:20 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:20.482303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.482933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.489028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.489545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.490330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.490785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.624779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:20.632073 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e0f4566e-5fa6-4ecb-a405-680a9ec2f1a0 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1505 microversion: 2.1 time: 0.154064 Nov 06 21:38:20.632669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4138/8162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:20 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:20.647716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.648214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.654108 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.654506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.655281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.655720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.680913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:38:20.759821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6985bff5-fdef-476e-aeda-25ed9af5bc5a tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 204 len: 0 microversion: 2.1 time: 0.115254 Nov 06 21:38:20.760758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4025/8163] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:38:20 2021] DELETE /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:38:20.776082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.776692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.783298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.783765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.784656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.785104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.814038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:38:20.849807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-94c6d0b4-6e72-4208-855a-44a4faea411b req-ab6d22c0-1145-4297-be41-166a0174d656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "name": "network-vif-plugged", "status": "completed", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:20.852003 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:20.852003 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:38:20.859374 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.compute.api [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Instance is already in deleting state, ignoring this request Nov 06 21:38:20.860262 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dfe2abd4-eb0b-4413-bb8c-de2c91158a1f tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 204 len: 0 microversion: 2.1 time: 0.087853 Nov 06 21:38:20.860894 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4139/8164] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:38:20 2021] DELETE /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:38:20.861400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-94c6d0b4-6e72-4208-855a-44a4faea411b req-ab6d22c0-1145-4297-be41-166a0174d656 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.865976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-94c6d0b4-6e72-4208-855a-44a4faea411b req-ab6d22c0-1145-4297-be41-166a0174d656 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.869524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:20.870150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:20.876457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.876924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.877728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:20.878598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:20.878700 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-94c6d0b4-6e72-4208-855a-44a4faea411b req-ab6d22c0-1145-4297-be41-166a0174d656 service nova] Creating event network-vif-plugged:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch1-master-1 Nov 06 21:38:20.883683 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-94c6d0b4-6e72-4208-855a-44a4faea411b req-ab6d22c0-1145-4297-be41-166a0174d656 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Nov 06 21:38:20.884813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4026/8165] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:21.011538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:21.018869 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0aea0d5-3cbf-4029-ad85-8b58f2bd477c tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1511 microversion: 2.1 time: 0.153811 Nov 06 21:38:21.019432 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4140/8166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:20 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:38:22.036482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:22.037281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:22.043355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:22.043813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:22.044617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:22.045057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:22.208764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e074533f11043ceb905195419f58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cb2a9f42fa4db88f8a4b4e67334216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:22.216035 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-130c3a9f-120c-4439-8db1-a62effc161d7 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 200 len: 1511 microversion: 2.1 time: 0.184476 Nov 06 21:38:22.216639 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4027/8167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:22 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:22.624630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e8fdb66e-de2f-48d9-a3cf-746b1a55f84f req-b1123d94-6a75-4fc8-86e9-7ce59caa4180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16522606-4928-4e1a-9576-8625846d9a03", "name": "network-vif-deleted", "tag": "632e4be7-b582-41d0-b59a-1e4f1b7a2462"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:22.626127 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:22.626127 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:38:22.633852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e8fdb66e-de2f-48d9-a3cf-746b1a55f84f req-b1123d94-6a75-4fc8-86e9-7ce59caa4180 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:22.634319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e8fdb66e-de2f-48d9-a3cf-746b1a55f84f req-b1123d94-6a75-4fc8-86e9-7ce59caa4180 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:22.646833 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e8fdb66e-de2f-48d9-a3cf-746b1a55f84f req-b1123d94-6a75-4fc8-86e9-7ce59caa4180 service nova] Creating event network-vif-deleted:632e4be7-b582-41d0-b59a-1e4f1b7a2462 for instance 16522606-4928-4e1a-9576-8625846d9a03 on nch1-master-1 Nov 06 21:38:22.652676 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e8fdb66e-de2f-48d9-a3cf-746b1a55f84f req-b1123d94-6a75-4fc8-86e9-7ce59caa4180 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031023 Nov 06 21:38:22.653272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4141/8168] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:23.232964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:23.233572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 16522606-4928-4e1a-9576-8625846d9a03] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:23.240210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.240696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.241468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.241904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.255626 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] HTTP exception thrown: Instance 16522606-4928-4e1a-9576-8625846d9a03 could not be found. Nov 06 21:38:23.256218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Returning 404 to user: Instance 16522606-4928-4e1a-9576-8625846d9a03 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:38:23.257565 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55bdb4ce-baed-4879-a884-b0ebbef14001 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03" status: 404 len: 111 microversion: 2.1 time: 0.028344 Nov 06 21:38:23.258101 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4028/8169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:23 2021] GET /compute/v2.1/servers/16522606-4928-4e1a-9576-8625846d9a03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:38:23.267403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:23.268006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:23.274331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.274801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.275598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.276051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.289414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] HTTP exception thrown: Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 could not be found. Nov 06 21:38:23.290014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Returning 404 to user: Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:38:23.290869 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2bc59c14-b013-499f-981c-8ad5dd382d78 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 404 len: 111 microversion: 2.1 time: 0.027587 Nov 06 21:38:23.291399 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4142/8170] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:38:23 2021] DELETE /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:38:23.299422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:23.300026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] [instance: 1cf80c64-805f-45fd-b7c6-6dcc640cb615] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:23.305789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.306240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.307004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:23.307438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:23.320910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] HTTP exception thrown: Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 could not be found. Nov 06 21:38:23.321518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] Returning 404 to user: Instance 1cf80c64-805f-45fd-b7c6-6dcc640cb615 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:38:23.322322 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-faf8810b-026c-4fb1-817b-fbbee46c76f3 tempest-ServerDiskConfigTestJSON-839516141 tempest-ServerDiskConfigTestJSON-839516141-project] 10.222.0.13 "GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615" status: 404 len: 111 microversion: 2.1 time: 0.026788 Nov 06 21:38:23.322830 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4029/8171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:23 2021] GET /compute/v2.1/servers/1cf80c64-805f-45fd-b7c6-6dcc640cb615 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:38:29.534561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: .version_select at 0x7f6716521550>, body: {"keypair": {"name": "tempest-keypair-1399394096"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:29.553471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:38:29.559011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:38:29.572088 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [717f2430-5619-44aa-82c7-359b96de74d0] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 21:38:30.590692 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [717f2430-5619-44aa-82c7-359b96de74d0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 36858. Nov 06 21:38:30.761153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:38:30.766411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:38:30.782016 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd888293-9d8e-41d5-9871-1a3eb64d95ce tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.371435 Nov 06 21:38:30.782632 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4143/8172] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:38:29 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:38:32.182106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1673794955", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22a42440-0ea7-49db-af06-da6aaccfe1f8"}], "security_groups": [{"name": "tempest-securitygroup--617496060"}], "key_name": "tempest-keypair-1399394096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:32.291248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] validate_networks() for [('22a42440-0ea7-49db-af06-da6aaccfe1f8', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:38:32.733697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:38:32.734126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:38:32.734598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:38:32.735088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:38:32.735499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:38:32.744129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:32.744618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:32.746066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:32.746503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:32.763021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:38:32.768175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:38:32.780601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:38:32.782961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:38:32.830091 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d1d12fe-8056-4819-ab2c-ed7dfc5ae42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.652240 Nov 06 21:38:32.830787 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4030/8173] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:38:32 2021] POST /compute/v2.1/servers => generated 408 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:38:32.841786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55f99717-0786-40a9-b090-c3f7fd694558 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:32.842410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55f99717-0786-40a9-b090-c3f7fd694558 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:32.896660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-55f99717-0786-40a9-b090-c3f7fd694558 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:32.903820 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55f99717-0786-40a9-b090-c3f7fd694558 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1239 microversion: 2.1 time: 0.067124 Nov 06 21:38:32.904591 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4144/8174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:32 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:33.920851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:33.921461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:33.931109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:33.931558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:33.932375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:33.933362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:34.007031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:34.014290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd338b6b-d864-4c34-9b06-635dc6c31fa8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1297 microversion: 2.1 time: 0.097686 Nov 06 21:38:34.014858 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4031/8175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:33 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:35.031480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:35.032089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:35.040053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:35.040569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:35.041360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:35.041915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:35.127644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d7187618-897d-47ee-8dd0-9794de1b34f5 req-418395c7-1ed5-4d64-8519-b53c89f12e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:35.129393 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:35.129393 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:38:35.144278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d7187618-897d-47ee-8dd0-9794de1b34f5 req-418395c7-1ed5-4d64-8519-b53c89f12e7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:35.144785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d7187618-897d-47ee-8dd0-9794de1b34f5 req-418395c7-1ed5-4d64-8519-b53c89f12e7d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:35.157071 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d7187618-897d-47ee-8dd0-9794de1b34f5 req-418395c7-1ed5-4d64-8519-b53c89f12e7d service nova] Creating event network-changed:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch1-master-1 Nov 06 21:38:35.163599 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d7187618-897d-47ee-8dd0-9794de1b34f5 req-418395c7-1ed5-4d64-8519-b53c89f12e7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045517 Nov 06 21:38:35.164764 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4032/8176] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:38:35.293652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:35.301650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aadfa3ae-aaf7-4c2b-810b-0be5905908e8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.273917 Nov 06 21:38:35.302232 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4145/8177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:35 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:36.318606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:36.319308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:36.326101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:36.326554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:36.327328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:36.327755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:36.457039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:36.464392 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d458e6be-d536-4c45-b7f0-8ca67c762cb0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.149725 Nov 06 21:38:36.464970 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4033/8178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:36 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:37.481313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:37.481870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:37.489524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:37.489989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:37.490856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:37.491306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:37.625541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:37.632772 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c7c46541-3580-459d-93e1-0de4a1ae519a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.155417 Nov 06 21:38:37.633336 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4146/8179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:37 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:38.649751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:38.650348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:38.657314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:38.657767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:38.658543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:38.658988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:38.790495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:38.798106 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-40761b53-ef9b-4bcd-8df0-34dd3e1c099e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.152192 Nov 06 21:38:38.798687 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4034/8180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:38 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:39.814734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:39.815382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:39.822131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:39.822590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:39.823377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:39.823822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:39.953882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:39.961150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54fdcb58-ddd8-4e0f-8c84-b4d819ba4f34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.150167 Nov 06 21:38:39.961712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4147/8181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:39 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:40.887259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-8a328448-688b-466f-b8b9-705163fdb4d9 req-735a48aa-0b3c-45c8-8780-caf21012633d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "name": "network-vif-plugged", "status": "completed", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:40.888986 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:40.888986 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:38:40.897022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a328448-688b-466f-b8b9-705163fdb4d9 req-735a48aa-0b3c-45c8-8780-caf21012633d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:40.897478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-8a328448-688b-466f-b8b9-705163fdb4d9 req-735a48aa-0b3c-45c8-8780-caf21012633d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:40.908639 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-8a328448-688b-466f-b8b9-705163fdb4d9 req-735a48aa-0b3c-45c8-8780-caf21012633d service nova] Creating event network-vif-plugged:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch1-master-1 Nov 06 21:38:40.913579 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-8a328448-688b-466f-b8b9-705163fdb4d9 req-735a48aa-0b3c-45c8-8780-caf21012633d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Nov 06 21:38:40.914168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4035/8182] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:40.977948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:40.978474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:40.985866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:40.986349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:40.987169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:40.987629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:41.150927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:41.159078 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-252a4e05-87b0-455d-b970-e441471390b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.184958 Nov 06 21:38:41.159669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4148/8183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:40 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:42.177536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:42.178235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:42.184497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:42.184954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:42.185740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:42.186178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:42.319671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:42.327431 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fa0854a1-e913-47cb-83da-b143c7b7c948 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1364 microversion: 2.1 time: 0.155101 Nov 06 21:38:42.327994 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4036/8184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:42 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:43.344171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:43.344826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:43.351699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:43.352175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:43.353012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:43.353496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:43.481690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:38:43.489173 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46a63bab-d656-4976-af7c-433493d7cf07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1551 microversion: 2.1 time: 0.148762 Nov 06 21:38:43.489746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4149/8185] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:38:43 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:43.510242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:38:43.511352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:43.517949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:43.518411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:43.519170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:43.519603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:43.596635 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00a49cf3-496d-417f-8e05-3d9e53133adb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090023 Nov 06 21:38:43.597234 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4037/8186] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:38:43 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:44.845191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:44.846255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:44.850511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ac4ea22f-1de2-4d00-bd1a-3436447214e2 req-1aeac424-92e7-494d-b6f9-11f7a3e36c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:44.852452 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:38:44.852452 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:38:44.853817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:44.855091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:44.855910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:44.856599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:44.861969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ac4ea22f-1de2-4d00-bd1a-3436447214e2 req-1aeac424-92e7-494d-b6f9-11f7a3e36c22 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:44.862480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ac4ea22f-1de2-4d00-bd1a-3436447214e2 req-1aeac424-92e7-494d-b6f9-11f7a3e36c22 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:44.877309 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ac4ea22f-1de2-4d00-bd1a-3436447214e2 req-1aeac424-92e7-494d-b6f9-11f7a3e36c22 service nova] Creating event network-changed:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch1-master-1 Nov 06 21:38:44.882345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ac4ea22f-1de2-4d00-bd1a-3436447214e2 req-1aeac424-92e7-494d-b6f9-11f7a3e36c22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038280 Nov 06 21:38:44.883023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4038/8187] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:38:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:38:44.906356 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d6431b3-a4bf-4cad-88f0-dee9a0f0a36d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.064840 Nov 06 21:38:44.907502 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4150/8188] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:44 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:45.918649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:45.919717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:45.926091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:45.926553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:45.927343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:45.927975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:45.967272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-572af728-ba01-4da4-adaa-d62c4190407c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.053850 Nov 06 21:38:45.968660 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4039/8189] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:45 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:46.979182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:46.980196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:46.987474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:46.987933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:46.988748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:46.989193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:47.024634 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc5384d5-96f0-4d4f-9d2a-4c988a2bfac5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.049382 Nov 06 21:38:47.025826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4151/8190] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:46 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:48.036599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:48.037630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:48.045612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:48.046067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:48.046876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:48.047564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:48.083201 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25715084-06e0-4849-979a-7f72b08055c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.050474 Nov 06 21:38:48.083719 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4040/8191] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:48 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:49.094928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:49.095945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:49.103210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:49.103672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:49.104558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:49.104985 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:49.141683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53140f1d-2a5f-4461-8add-eed1926510db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.050697 Nov 06 21:38:49.142296 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4152/8192] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:49 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:50.153331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:50.154255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:50.161486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:50.161937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:50.162720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:50.163153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:50.200315 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6b97401-6028-4928-9d43-a36d10ecef6d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.051019 Nov 06 21:38:50.200918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4041/8193] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:50 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:51.211786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:51.212835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:51.220989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:51.221446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:51.222241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:51.222693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:51.265911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0dbce24-3a1a-411b-89ca-66814c0fd378 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.058071 Nov 06 21:38:51.266550 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4153/8194] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:51 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:52.277904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:52.278834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:52.286116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:52.286578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:52.287363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:52.287801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:52.325074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-009bb8f5-e025-4b17-b6ba-606a4454866a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.051710 Nov 06 21:38:52.325689 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4042/8195] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:52 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:53.336265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:53.337300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:53.344386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:53.344853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:53.345633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:53.346074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:53.385254 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1be0ac8-9d72-4364-8b90-ab338e7034e6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 14 microversion: 2.1 time: 0.052820 Nov 06 21:38:53.386421 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4154/8196] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:53 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:38:54.396613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:54.397609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:54.405394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:54.405849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:54.406614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:54.407051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:54.453896 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-808c2422-bed3-4270-82d4-d933c63f6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 8204 microversion: 2.1 time: 0.061212 Nov 06 21:38:54.454496 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4043/8197] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:54 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 8204 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:38:55.466035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:55.466988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:55.474189 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:55.474648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:55.475434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:55.475878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:55.525023 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-618c6447-aca1-42fa-a5e0-d103980350c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 16376 microversion: 2.1 time: 0.063574 Nov 06 21:38:55.526157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4155/8198] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:55 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 16376 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:38:56.536424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:56.537425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:56.545245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:56.545700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:56.546472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:56.546900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:56.585318 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b6aeb36e-3059-410d-849a-9cf71a635066 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 16376 microversion: 2.1 time: 0.052860 Nov 06 21:38:56.585952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4044/8199] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:56 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 16376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:38:57.597202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:57.598257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:57.605584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:57.606055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:57.606856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:57.607314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:57.645107 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e84aa8df-3021-488d-b885-e7b785c7145e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 16376 microversion: 2.1 time: 0.051870 Nov 06 21:38:57.645744 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4156/8200] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:57 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 16376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:38:58.657141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:58.658154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:58.665389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:58.665898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:58.666681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:58.667117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:58.707058 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f92e041-f1b4-4fc9-9dc4-70eb8cba0de2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 16376 microversion: 2.1 time: 0.053988 Nov 06 21:38:58.707878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4045/8201] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:58 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 16376 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:38:59.718748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:38:59.719825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:38:59.727196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:59.727661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:59.728486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:38:59.729592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:38:59.768054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f189cd1-d326-4d0c-a6ef-3bc4eb9d2bd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 16376 microversion: 2.1 time: 0.053311 Nov 06 21:38:59.768710 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4157/8202] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:38:59 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 16376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:00.780269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:00.781448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:00.788749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:00.789206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:00.789995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:00.790458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:00.839352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-95e41af7-37f8-4bd7-a4f0-87a36ca4418c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.063647 Nov 06 21:39:00.840011 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4046/8203] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:00 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:01.851352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:01.852403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:01.860234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:01.860734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:01.861571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:01.862019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:01.902433 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f214a2e9-7930-4beb-958c-7a84230635ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055092 Nov 06 21:39:01.903064 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4158/8204] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:01 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:02.914350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:02.915375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:02.923470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:02.923921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:02.924720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:02.925158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:02.963556 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a2578816-d68e-452e-a97a-0e1fad0a5150 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052686 Nov 06 21:39:02.964446 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4047/8205] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:02 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:03.975645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:03.976627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:03.984489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:03.984972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:03.985748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:03.986199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:04.024958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bcf7f679-fb55-4331-a2d5-8bc05f832ad2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053387 Nov 06 21:39:04.025589 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4159/8206] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:03 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:05.036531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:05.037578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:05.044847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:05.045303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:05.046082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:05.046519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:05.085635 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7061afd-f7ff-47be-8635-b65e5626774a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053076 Nov 06 21:39:05.086261 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4048/8207] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:05 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:06.097830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:06.098910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:06.106825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:06.107325 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:06.108119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:06.108595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:06.150517 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-156703dd-9283-4422-8c72-34b78a776344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.056478 Nov 06 21:39:06.151618 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4160/8208] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:06 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:07.162835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:07.163834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:07.171810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:07.172287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:07.173341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:07.173775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:07.213352 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d38c2690-dd65-4522-9c54-f06556ea011e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.054364 Nov 06 21:39:07.214042 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4049/8209] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:07 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:08.225379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:08.226304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:08.235031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:08.235490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:08.236272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:08.236738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:08.276614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-19c9f67e-8998-422a-9261-503bfc61db18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055227 Nov 06 21:39:08.277240 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4161/8210] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:08 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:09.287543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:09.288571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:09.295624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:09.296081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:09.296956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:09.297641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:09.340013 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de9dad8d-1524-4e47-bbfd-b77bdfa19530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.056428 Nov 06 21:39:09.340923 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4050/8211] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:09 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:10.351623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:10.352831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:10.361072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:10.361543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:10.362332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:10.362778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:10.402189 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6da87f77-9430-44db-96db-f2c183874af9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.054373 Nov 06 21:39:10.403037 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4162/8212] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:10 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:11.414165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:11.415086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:11.423210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:11.423693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:11.424534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:11.424970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:11.465641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4509c74d-b312-44fe-af53-ce5e9e7a6665 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055591 Nov 06 21:39:11.466261 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4051/8213] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:11 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:12.477700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:12.478900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:12.486340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:12.486804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:12.487613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:12.488063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:12.533839 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1402d74b-0f76-4246-8e47-7caf93ae95e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.060226 Nov 06 21:39:12.534477 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4163/8214] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:12 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:13.546446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:13.547404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:13.555025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:13.555480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:13.556262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:13.557273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:13.595680 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e6108e57-3378-490d-a66f-d34630fdb758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053245 Nov 06 21:39:13.596559 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4052/8215] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:13 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:14.607755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:14.608802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:14.616071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:14.616562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:14.617362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:14.617809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:14.656760 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7188898b-c8d6-4b57-a22c-9254ee82bb75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052953 Nov 06 21:39:14.657390 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4164/8216] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:14 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:15.669477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:15.670485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:15.677897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:15.678350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:15.679118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:15.679553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:15.717500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7794ece-bceb-4d77-b4c5-7bd87aa798a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052732 Nov 06 21:39:15.718327 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4053/8217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:15 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:16.730120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:16.731142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:16.738769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:16.739236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:16.740038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:16.740521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:16.779529 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2fee0272-3411-4960-a69d-27be0ff76c68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053845 Nov 06 21:39:16.780175 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4165/8218] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:16 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:17.791749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:17.792770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:17.800178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:17.800654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:17.801453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:17.801886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:17.840905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-26e4dd6f-198f-4f16-ba12-fcbea6509772 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053007 Nov 06 21:39:17.841626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4054/8219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:17 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:18.852909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:18.854647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:18.861930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:18.862392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:18.863188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:18.863796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:18.907535 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04c81b92-a91d-4c31-9cc0-4b4654aeb37b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.058623 Nov 06 21:39:18.908204 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4166/8220] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:18 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:19.919531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:19.920585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:19.928165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:19.928654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:19.929440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:19.929883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:19.967990 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b8db99dc-947f-4a58-99dd-e37aac540cd6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052581 Nov 06 21:39:19.968681 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4055/8221] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:19 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:20.980165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:20.981241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:20.988709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:20.989175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:20.989982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:20.990434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:21.028840 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49a9bac9-c04d-4df9-a579-beb856e55be8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053115 Nov 06 21:39:21.029392 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4167/8222] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:20 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:22.041209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:22.042213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:22.049914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:22.050369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:22.051136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:22.051572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:22.090405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21d77b32-5b76-496a-a8d1-2e85ae26102b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053747 Nov 06 21:39:22.091241 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4056/8223] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:22 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:23.102445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:23.103956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:23.111149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:23.111618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:23.112442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:23.112896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:23.150900 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fc5e6ef0-6d09-41a1-8bd2-a9ee951aa248 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052437 Nov 06 21:39:23.151741 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4168/8224] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:23 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:24.162165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:24.163097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:24.170400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:24.170851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:24.171614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:24.172046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:24.213904 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08592c60-68a6-4403-8afc-f67d84c2164e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055732 Nov 06 21:39:24.214529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4057/8225] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:24 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:39:25.226155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:25.227256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:25.235032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:25.235484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:25.236280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:25.236748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:25.275747 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9ffd72f-b9a8-4327-9491-a0cb49363cb4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053174 Nov 06 21:39:25.276407 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4169/8226] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:25 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:26.287022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:26.287967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:26.295685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:26.296140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:26.296950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:26.297396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:26.336088 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2a27f687-0919-4b76-8be2-640ae854cc06 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053053 Nov 06 21:39:26.336762 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4058/8227] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:26 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:27.348034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:27.349065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:27.357165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:27.357867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:27.359089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:27.359767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:27.410534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-35dacfcd-9d43-4553-8d6a-4e4e301f987c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.066347 Nov 06 21:39:27.411090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4170/8228] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:27 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:28.422058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:28.423343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:28.430528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:28.430975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:28.431781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:28.432239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:28.473933 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c4b70f5-4b2c-4186-9063-29bad29af4b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055821 Nov 06 21:39:28.474563 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4059/8229] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:28 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:29.486505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:29.487463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:29.494842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:29.495308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:29.496101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:29.496579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:29.536123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e2ea3eaa-8641-4eaa-865b-3f2b9343bc0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053637 Nov 06 21:39:29.536781 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4171/8230] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:29 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:39:30.548180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:30.549218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:30.557040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:30.557536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:30.558307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:30.558741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:30.598645 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cff1571b-1d94-4c7a-b32a-a304ae623a17 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.054581 Nov 06 21:39:30.599288 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4060/8231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:30 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:31.611168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:31.612200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:31.620071 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:31.620559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:31.621373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:31.621812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:31.663330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0f3cd6b-339f-43be-8ab8-29ec23de89a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.056117 Nov 06 21:39:31.663967 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4172/8232] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:31 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:32.676221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:32.677240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:32.684964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:32.685687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:32.686920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:32.687680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:32.727735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc559ece-d785-4a9f-8c28-37570911df40 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055738 Nov 06 21:39:32.728386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4061/8233] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:32 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:33.740072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:33.741113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:33.748778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:33.749243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:33.750037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:33.750483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:33.789796 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-44e8f5e8-1c12-4121-a9ad-cb1c341be1f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053717 Nov 06 21:39:33.790444 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4173/8234] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:33 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:39:34.802018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:34.803018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:34.810414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:34.810864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:34.811628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:34.812057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:34.848620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7fb0eecd-8390-49ef-85ed-fce7b98bf5b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.050795 Nov 06 21:39:34.849228 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4062/8235] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:34 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:35.860149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:35.861198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:35.868525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:35.868987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:35.870394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:35.870841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:35.910235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e209ed3-e4a8-4d14-a069-79d2174a0f15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.054119 Nov 06 21:39:35.910892 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4174/8236] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:35 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:36.922925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:36.923931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:36.931131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:36.932115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:36.932929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:36.933369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:36.973952 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-705e5e5f-f5d9-4d15-b79a-537b9f30b2fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055146 Nov 06 21:39:36.974609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4063/8237] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:36 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:37.986180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:37.987206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:37.994587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:37.995050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:37.995841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:37.996305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:38.035730 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e38ba21-5bf9-44d5-9437-b0ee299641c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053525 Nov 06 21:39:38.036387 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4175/8238] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:37 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:39.048330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:39.049321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:39.056470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:39.057378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:39.058145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:39.058575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:39.099219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a81f0168-57c0-4e97-aa9f-35da9d55adc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.055050 Nov 06 21:39:39.099987 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4064/8239] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:39 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:40.111127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:40.112149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:40.120028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:40.120523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:40.121311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:40.121758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:40.160338 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d56af4c8-8c70-4375-8da3-7f00eecef3e9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.053071 Nov 06 21:39:40.160891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4176/8240] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:40 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:41.172027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:41.173343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:41.180639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:41.181097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:41.181899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:41.182340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:41.221079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7855a2ac-efe4-46c6-8ab3-cff34b22d43a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052953 Nov 06 21:39:41.221697 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4065/8241] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:41 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:42.233579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:42.234518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:42.241841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:42.242301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:42.243086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:42.243529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:42.282131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a440cfa0-b260-42e3-b0e2-a82b43bf3f9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052598 Nov 06 21:39:42.282753 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4177/8242] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:42 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:43.293927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:43.294955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:43.302399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:43.302849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:43.303620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:43.304054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:43.342060 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1bdd003-3afd-45b0-bf4e-a23072df8c23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 24536 microversion: 2.1 time: 0.052062 Nov 06 21:39:43.342899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4066/8243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:43 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 24536 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:44.354730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:44.355751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:44.363140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:44.363605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:44.364424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:44.364877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:44.421610 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df7feeb3-aecd-45ff-b0c7-74d7e38e5199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.071401 Nov 06 21:39:44.422269 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4178/8244] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:44 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:45.434833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:45.435764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:45.443076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:45.443590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:45.444341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:45.444784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:45.483654 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4380871c-385f-4203-b3c4-2092a2f98e31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053503 Nov 06 21:39:45.484630 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4067/8245] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:45 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:46.496174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:46.497230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:46.504502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:46.504966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:46.505757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:46.506206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:46.551995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-237a4696-dcad-4c23-8b20-c48d372fa963 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.060259 Nov 06 21:39:46.552880 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4179/8246] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:46 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:47.563995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:47.564951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:47.573029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:47.573477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:47.574247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:47.574682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:47.613357 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba3de15c-36ce-464b-b8a0-1bc56d9dec6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053362 Nov 06 21:39:47.614007 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4068/8247] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:47 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:48.416235 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:39:48.416517 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:39:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:39:48.625913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:48.626935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:48.634351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:48.635448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:48.636269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:48.636747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:48.676341 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1e8d20b-2554-4947-a616-95af55e5d991 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054276 Nov 06 21:39:48.676884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4180/8248] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:48 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:49.687880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:49.688961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:49.696858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:49.697317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:49.698130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:49.698571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:49.739682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ad3722c-0449-463d-a374-91341252edf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055705 Nov 06 21:39:49.740352 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4069/8249] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:49 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:50.752409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:50.753519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:50.760829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:50.761287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:50.762076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:50.762519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:50.802177 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9440efc-409f-462b-ba73-7a47e641674a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054588 Nov 06 21:39:50.802805 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4181/8250] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:50 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:51.814711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:51.815709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:51.823558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:51.824013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:51.824823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:51.825259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:51.863502 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-579c1284-c459-4824-8b30-62896e6701de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052756 Nov 06 21:39:51.864126 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4070/8251] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:51 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:52.875889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:52.876927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:52.883755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:52.884218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:52.885519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:52.885966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:52.926045 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-251e5050-7838-4b5f-b21d-34c64d78afda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054363 Nov 06 21:39:52.926696 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4182/8252] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:52 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:53.938031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:53.939036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:53.946318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:53.946775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:53.947569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:53.948025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:53.986402 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22cddcd4-f9df-4c81-949c-8440c57f8ea2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052497 Nov 06 21:39:53.987029 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4071/8253] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:53 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:54.999409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:55.000473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:55.007768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:55.008264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:55.009080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:55.009531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:55.048026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-013ab372-0165-4207-bda7-caf205968ebe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052975 Nov 06 21:39:55.048721 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4183/8254] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:54 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:56.060183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:56.061302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:56.068816 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:56.069298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:56.070106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:56.070540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:56.108658 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-38ce600b-3ab8-4471-ae62-d8b253b0d91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052948 Nov 06 21:39:56.109284 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4072/8255] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:56 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:57.120863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:57.121881 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:57.129401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:57.129811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:57.130608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:57.131059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:57.172898 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-498c2314-4779-4958-b4e2-11898f6e9ac9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055768 Nov 06 21:39:57.173574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4184/8256] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:57 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:58.185638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:58.186583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:58.193778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:58.194229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:58.195027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:58.195530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:58.240387 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-30bf0e6e-0520-42fb-b3ff-b8459de72d31 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.059228 Nov 06 21:39:58.241251 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4073/8257] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:58 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:39:59.252377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:39:59.253454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:39:59.260746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:59.261206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:59.262548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:39:59.262994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:39:59.304546 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a7286a5e-e3dc-4548-befd-bbbfda1026fa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056024 Nov 06 21:39:59.305197 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4185/8258] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:39:59 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:00.317800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:00.318805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:00.326779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:00.327245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:00.328065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:00.328553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:00.366962 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2faa13a0-4ed1-4a6b-9e9e-2aa4bbc21031 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053147 Nov 06 21:40:00.367828 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4074/8259] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:00 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:01.379117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:01.380143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:01.387506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:01.387974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:01.388803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:01.389257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:01.428248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b679a001-7408-4663-9bb9-9303f24b0746 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053004 Nov 06 21:40:01.428838 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4186/8260] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:01 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:02.440091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:02.441129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:02.448471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:02.448932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:02.449712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:02.450156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:02.490605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ae4d883d-7c48-42b5-85ae-d3da9facf0ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054462 Nov 06 21:40:02.491304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4075/8261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:02 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:03.503388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:03.504331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:03.511644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:03.512099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:03.512911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:03.513358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:03.567012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9bbb24f4-1041-4be7-8074-e1b752a8dd9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.067718 Nov 06 21:40:03.567883 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4187/8262] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:03 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:04.579089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:04.580092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:04.587328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:04.587783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:04.588581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:04.589020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:04.627507 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1785d8a5-49ed-4c96-821c-c85bb47c1a3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052349 Nov 06 21:40:04.628146 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4076/8263] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:04 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:05.639305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:05.640356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:05.647709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:05.648180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:05.649070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:05.649522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:05.690887 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-71819b04-73a9-4c74-b3af-e316d8107641 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056050 Nov 06 21:40:05.691797 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4188/8264] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:05 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:06.703577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:06.704690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:06.711857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:06.712327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:06.713139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:06.713578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:06.750858 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-892b9240-84cf-49da-bf3a-c7f3799a045a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.051843 Nov 06 21:40:06.751504 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4077/8265] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:06 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:07.763601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:07.764644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:07.772023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:07.772515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:07.773301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:07.773750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:07.813793 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7216c013-d84b-430f-9c2c-3ec7a5099a4e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054711 Nov 06 21:40:07.814460 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4189/8266] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:07 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:08.826154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:08.827176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:08.834079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:08.834565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:08.835373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:08.835796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:08.876013 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4721cc3b-8788-4d3a-a316-7a3aaef1488a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053860 Nov 06 21:40:08.877210 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4078/8267] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:08 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:09.888166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:09.889208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:09.896526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:09.896984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:09.897795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:09.898237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:09.940145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48baa954-bfdc-462b-b458-c9153b086e85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056580 Nov 06 21:40:09.941054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4190/8268] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:09 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:10.951688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:10.952738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:10.961607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:10.962181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:10.963174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:10.963620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:11.003010 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98d7534b-2c65-46bd-b681-57ff5f1b16a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055363 Nov 06 21:40:11.003631 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4079/8269] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:10 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:12.015515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:12.016567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:12.023822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:12.024321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:12.025109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:12.025550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:12.064792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-10e8e53c-e050-4f81-b161-670b552358ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053633 Nov 06 21:40:12.065422 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4191/8270] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:12 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:13.076884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:13.077937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:13.085211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:13.085696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:13.086472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:13.086914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:13.126789 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f490154f-f44a-483f-b83e-3186b4cec955 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053921 Nov 06 21:40:13.127461 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4080/8271] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:13 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:14.139368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:14.140305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:14.147650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:14.148107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:14.148923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:14.149364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:14.189959 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a08b67b2-651d-4b10-8965-9ebef074fcaa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055068 Nov 06 21:40:14.190901 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4192/8272] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:14 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:15.202687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:15.203694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:15.210923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:15.211380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:15.212159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:15.212629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:15.255832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8efb9713-914d-47a6-8fc0-27bf4bf753b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.057659 Nov 06 21:40:15.256490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4081/8273] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:15 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:16.267305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:16.268261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:16.275568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:16.276038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:16.278628 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:16.279165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:16.320070 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f3cddf5-d579-4c0f-b474-aea38f79ff9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056730 Nov 06 21:40:16.320752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4193/8274] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:16 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:17.332169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:17.333192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:17.340709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:17.341167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:17.341950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:17.342394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:17.644914 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aca5376f-f081-4176-976b-84c53ad42653 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.316633 Nov 06 21:40:17.646367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4082/8275] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:17 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:18.657516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:18.658533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:18.665912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:18.666374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:18.667161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:18.668248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:18.707463 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5145e600-f067-43d5-b3b3-84cd3ffa59ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053933 Nov 06 21:40:18.708095 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4194/8276] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:18 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:19.719843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:19.720894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:19.728093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:19.728573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:19.729352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:19.729792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:19.767847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5ff4795-79db-47a4-9143-874deb072e9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.051942 Nov 06 21:40:19.768466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4083/8277] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:19 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:20.779457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:20.780535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:20.787808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:20.788272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:20.789091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:20.789539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:20.830066 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bc8f6ab4-e5aa-424e-b7cd-b907fa86f628 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054546 Nov 06 21:40:20.830705 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4195/8278] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:20 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:21.842608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:21.843616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:21.850846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:21.851307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:21.852086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:21.852550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:21.901990 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a54f367e-1f1a-4b8d-bda1-fc37e093a07a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.063355 Nov 06 21:40:21.902634 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4084/8279] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:21 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:22.914052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:22.915064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:22.922605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:22.923338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:22.924119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:22.924593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:22.970142 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb3bb14b-5e9e-4281-a2d1-d2b252a44677 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.060026 Nov 06 21:40:22.970776 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4196/8280] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:22 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:23.982591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:23.983595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:23.990785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:23.991235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:23.992003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:23.992480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:24.032880 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20027a62-42ac-46e5-a81d-0016ae51063e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054160 Nov 06 21:40:24.033476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4085/8281] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:23 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:25.045014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:25.046028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:25.053540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:25.053999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:25.054778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:25.055224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:25.093461 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-780bee51-a7dc-4f4d-875f-1d579f028cc9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052442 Nov 06 21:40:25.094081 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4197/8282] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:25 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:26.106041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:26.107039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:26.114595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:26.115055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:26.115862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:26.116313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:26.155227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1e9c7d41-00a9-4f12-b18c-06c238f67a8d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053573 Nov 06 21:40:26.155763 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4086/8283] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:26 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:27.167781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:27.168774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:27.176281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:27.176770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:27.177574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:27.178023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:27.216893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d0e09f4b-3c3f-4b78-ab24-ffecf0937b80 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053599 Nov 06 21:40:27.217518 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4198/8284] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:27 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:28.229052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:28.230473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:28.237735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:28.238188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:28.238972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:28.239410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:28.280633 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a3e093d7-15b2-4d34-894d-1c2a624d0d5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055556 Nov 06 21:40:28.281249 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4087/8285] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:28 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:29.292718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:29.293760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:29.301657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:29.302118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:29.302915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:29.303362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:29.344139 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2b2ab33-3168-4b30-a96f-14ffce8a089b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055446 Nov 06 21:40:29.344832 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4199/8286] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:29 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:30.356075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:30.357096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:30.364250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:30.364726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:30.365498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:30.365934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:30.405333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db67373e-2179-4996-891d-24ddb214e2f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053184 Nov 06 21:40:30.406309 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4088/8287] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:30 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:31.417966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:31.419020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:31.426618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:31.427086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:31.427947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:31.428427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:31.469324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2027836c-63b8-433f-8c3f-597782f224f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055237 Nov 06 21:40:31.469878 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4200/8288] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:31 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:32.481550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:32.482567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:32.489833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:32.490291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:32.491082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:32.491530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:32.530975 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9d8d35a-7539-4537-9042-719b24573d49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053391 Nov 06 21:40:32.531856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4089/8289] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:32 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:33.543373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:33.544346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:33.551883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:33.552372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:33.553178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:33.553623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:33.593912 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-742a7cb8-004e-402f-9ab4-b6448773aeb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054768 Nov 06 21:40:33.594799 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4201/8290] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:33 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:34.606728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:34.607736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:34.615101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:34.615559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:34.616362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:34.616812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:34.658284 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b3e64bb4-e643-4713-bb53-e87d79883111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056133 Nov 06 21:40:34.659161 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4090/8291] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:34 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:35.671168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:35.672185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:35.679707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:35.680165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:35.680978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:35.681424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:35.723252 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7b61e61-ee4b-444e-b0c4-ed5ef32234ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056540 Nov 06 21:40:35.723884 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4202/8292] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:35 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:36.735553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:36.736586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:36.743855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:36.744333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:36.745117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:36.745561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:36.785500 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1d8a7e8-dea8-4f1e-b074-21098f7fc139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053885 Nov 06 21:40:36.786121 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4091/8293] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:36 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:37.797578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:37.798882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:37.806224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:37.806689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:37.807482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:37.807928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:37.846496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aa49c26-2918-4037-9993-d0a3b607ffda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052891 Nov 06 21:40:37.847116 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4203/8294] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:37 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:38.859347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:38.860385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:38.867609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:38.868073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:38.868895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:38.869340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:38.909155 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c7a68a9-9cd2-4f05-926c-83c06427f69f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054525 Nov 06 21:40:38.909898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4092/8295] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:38 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:39.921396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:39.922425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:39.930038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:39.930509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:39.931307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:39.931759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:39.971558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d30d3d15-851d-494e-b417-6c6ae7a0e4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054112 Nov 06 21:40:39.972214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4204/8296] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:39 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:40.984265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:40.985319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:40.992637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:40.993093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:40.993870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:40.994311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:41.035027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-989900db-0ee6-4e2a-85e2-a35422401b1d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055363 Nov 06 21:40:41.035949 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4093/8297] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:40 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:42.048122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:42.049164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:42.056427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:42.056888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:42.057673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:42.058118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:42.096515 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2d1029c0-4b63-4c3c-9bbd-a8b059bc92c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053311 Nov 06 21:40:42.097132 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4205/8298] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:42 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:43.109273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:43.110273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:43.117487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:43.117938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:43.118708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:43.119142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:43.157608 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ca9fdc35-01bd-456e-b0bb-c5e33368239b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052722 Nov 06 21:40:43.158137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4094/8299] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:43 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:44.170093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:44.171024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:44.178653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:44.179119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:44.179912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:44.180395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:44.222057 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d66367b-04a8-4589-a485-3b781b30f686 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056543 Nov 06 21:40:44.222708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4206/8300] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:44 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:45.234207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:45.235207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:45.242884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:45.243337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:45.244114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:45.244602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:45.283743 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d105f92-2ea7-4dfa-934c-4f5881e08624 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053501 Nov 06 21:40:45.284386 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4095/8301] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:45 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:46.296400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:46.297338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:46.304948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:46.305417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:46.306211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:46.306659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:46.346214 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4ddfd4d3-8f96-450d-b3da-861f63411104 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054445 Nov 06 21:40:46.346848 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4207/8302] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:46 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:47.358618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:47.359679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:47.366989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:47.367448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:47.368230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:47.368692 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:47.406772 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-221d0534-9b24-4990-b647-b61639cb6bef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052660 Nov 06 21:40:47.407379 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4096/8303] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:47 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:48.420700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:48.422320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:48.430135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:48.430602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:48.431398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:48.431843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:48.473109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f16ce2e-202f-45f4-9777-d077e3159759 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.057586 Nov 06 21:40:48.473753 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4208/8304] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:48 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:49.485403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:49.486341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:49.493707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:49.494166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:49.494943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:49.495382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:49.534787 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-92eb67d3-baba-4bf1-af93-e6673aac15c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054134 Nov 06 21:40:49.535396 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4097/8305] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:49 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:50.546751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:50.547755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:50.555228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:50.555690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:50.556511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:50.556958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:50.596497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-848e240f-4539-460e-bc7c-d20cf78a03bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053707 Nov 06 21:40:50.597123 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4209/8306] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:50 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:51.608069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:51.609104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:51.616258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:51.616744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:51.617516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:51.617950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:51.657847 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41f06160-b199-479b-a95a-c87cdc384530 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053838 Nov 06 21:40:51.658491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4098/8307] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:51 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:52.669898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:52.670913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:52.678021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:52.678482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:52.679264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:52.679709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:52.718479 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13045f22-6a40-4f2d-9465-b7a8e37bde7f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052833 Nov 06 21:40:52.719103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4210/8308] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:52 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:53.730557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:53.731557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:53.739408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:53.739859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:53.740669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:53.741102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:53.783296 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3498c76-e72a-40be-956a-efeee7cb4bbf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056669 Nov 06 21:40:53.783918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4099/8309] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:53 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:54.795388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:54.796450 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:54.804181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:54.804683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:54.805522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:54.805978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:54.845895 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f911c0f3-42c3-43a6-afd6-f78f39be6bb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054476 Nov 06 21:40:54.846532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4211/8310] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:54 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:55.858177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:55.859209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:55.866754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:55.867242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:55.868025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:55.868497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:55.909437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ec205edc-dc2b-4973-878c-84dd69447169 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055272 Nov 06 21:40:55.910354 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4100/8311] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:55 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:40:56.922295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:56.923562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:56.930845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:56.931304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:56.932088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:56.932560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:56.971996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6fe25f95-2a4a-452f-a50c-a50c2a30af4b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054272 Nov 06 21:40:56.972683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4212/8312] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:56 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:57.983950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:57.985015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:57.992140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:57.992628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:57.993409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:57.993849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:58.032874 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f1b4f9b5-e1ff-44da-a5f6-2de96503005c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053244 Nov 06 21:40:58.033488 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4101/8313] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:57 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:40:59.044100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:40:59.049019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:40:59.057157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:59.057620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:59.058419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:40:59.059062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:40:59.099414 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cd968377-001e-41ca-8c5e-421cab4670aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.059384 Nov 06 21:40:59.100286 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4213/8314] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:40:59 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:00.111986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:00.113017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:00.120218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:00.120684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:00.121459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:00.121894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:00.160131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de5c74ba-faba-4bb0-9439-f3f6272c681a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.051918 Nov 06 21:41:00.160753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4102/8315] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:00 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:01.172630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:01.173819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:01.181139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:01.181602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:01.182388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:01.182859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:01.225084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73302b64-e23a-4cad-b01a-5b7a3e605ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.056984 Nov 06 21:41:01.225987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4214/8316] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:01 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:02.236880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:02.237801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:02.245119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:02.245576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:02.246355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:02.246795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:02.286780 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d69b508e-ecef-4917-8a0e-c6a8d5a2854f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053935 Nov 06 21:41:02.287402 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4103/8317] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:02 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:03.299254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:03.300279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:03.307658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:03.308130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:03.308958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:03.309412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:03.350283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8889f9c8-3a9d-4dce-abe0-26b8a0c08fbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.055280 Nov 06 21:41:03.350926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4215/8318] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:03 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:04.362618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:04.363617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:04.370866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:04.371322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:04.372636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:04.373081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:04.411958 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb9309dd-691b-4ef1-bb04-2d6b0a6ab804 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.053357 Nov 06 21:41:04.412609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4104/8319] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:04 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:05.423841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:05.424905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:05.432221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:05.432713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:05.433513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:05.433964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:05.472060 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1f093ccc-0546-4fda-b09f-85bbbac81fc3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052402 Nov 06 21:41:05.472661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4216/8320] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:05 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:06.484177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:06.485210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:06.492489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:06.492951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:06.493730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:06.494172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:06.542597 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fb374eb6-c34f-426c-9809-2fa4671d81f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.063092 Nov 06 21:41:06.543534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4105/8321] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:06 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:41:07.555591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:07.556610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:07.564592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:07.565060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:07.565854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:07.566307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:07.604146 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-424fbff6-3b77-47b2-bfe4-eee16e2208cb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052686 Nov 06 21:41:07.604801 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4217/8322] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:07 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:08.616869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:08.617882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:08.624991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:08.625447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:08.626228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:08.626667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:08.665069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f82933a8-0f9e-4b17-92ef-3780ddf94ee5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052222 Nov 06 21:41:08.665938 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4106/8323] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:08 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:09.678118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:09.679145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:09.686437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:09.686905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:09.687701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:09.688152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:09.728594 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7bc99c75-2aaa-4a56-b35e-0dd15f26a7f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.054485 Nov 06 21:41:09.729211 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4218/8324] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:09 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:10.741763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:10.742798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:10.750273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:10.750730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:10.751545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:10.751983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:10.790758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee1bfbaa-dec8-45f0-8d4a-25233f963e26 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 32611 microversion: 2.1 time: 0.052898 Nov 06 21:41:10.794720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4107/8325] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:10 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 32611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:11.803685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:11.804665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:11.811898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:11.812654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:11.813467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:11.813914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:11.865466 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-89702858-380c-4a38-8820-cb0aa351a63f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 200 len: 40768 microversion: 2.1 time: 0.065921 Nov 06 21:41:11.866132 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4219/8326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:11 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 40768 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:41:11.877183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:11.877937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:11.885209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:11.885681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:11.886475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:11.886924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:12.025302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:12.033615 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9bd8a5f7-24cc-439d-ada6-7f63b593a70b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1670 microversion: 2.1 time: 0.160505 Nov 06 21:41:12.034180 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4108/8327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:11 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:12.050990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:12.052079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:12.059069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:12.059474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:12.060273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:12.060804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:12.089841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:12.096565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:41:12.102774 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:41:12.103212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:41:12.103811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:41:12.104174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:41:12.104632 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:41:12.173619 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8882fecb-82a3-4017-ae77-ee9c1417626f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 202 len: 0 microversion: 2.1 time: 0.126629 Nov 06 21:41:12.174557 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4220/8328] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:12 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:41:12.182124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:12.182990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:12.189995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:12.190459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:12.191264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:12.191710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:12.369495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:12.377290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e1d0edb0-c85e-4819-9ee5-62dd8cc273b2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1679 microversion: 2.1 time: 0.198714 Nov 06 21:41:12.377975 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4109/8329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:12 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:41:13.401818 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:13.403430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:13.414775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:13.415466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:13.416794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:13.417562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:13.633839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:13.641185 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1fc1b932-4dfa-46d2-9a52-50d9c58c31fb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1679 microversion: 2.1 time: 0.245997 Nov 06 21:41:13.641850 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4221/8330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:13 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:14.658701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:14.659316 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:14.666021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:14.666479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:14.667273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:14.667705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:14.802906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:14.810248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c17ea1e-7761-4fb8-b0bb-94515893b545 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.155924 Nov 06 21:41:14.810816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4110/8331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:14 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:15.828700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:15.829299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:15.835944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:15.836441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:15.837232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:15.837674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:15.966892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:15.974946 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4df2cf45-402f-4cbd-bad4-ae10d0991cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.150539 Nov 06 21:41:15.975519 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4222/8332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:15 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:16.990958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:16.991581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:16.998349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:16.998809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:16.999649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:17.000097 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:17.131722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:17.139095 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e24e2a9-0895-4a6c-aa2c-8b5ca2095b18 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.151858 Nov 06 21:41:17.139670 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4111/8333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:16 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:18.155388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:18.156512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:18.163376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:18.163840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:18.164689 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:18.165115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:18.299372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:18.306758 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c4304fa-0635-4895-9665-8380e9b4a1e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.155175 Nov 06 21:41:18.307330 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4223/8334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:18 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:19.323319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:19.323932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:19.331321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:19.331776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:19.332587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:19.333026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:19.463002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:19.471453 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47caaf47-ce84-4690-973c-2dc63369652a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.151959 Nov 06 21:41:19.471940 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4112/8335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:19 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:20.488049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:20.488716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:20.495370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:20.495836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:20.496662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:20.497114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:20.630411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:20.637914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1407a9e9-cec9-4456-9ad9-56e435cab7c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.154099 Nov 06 21:41:20.638495 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4224/8336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:20 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:21.658663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:21.659308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:21.666101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:21.666562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:21.667413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:21.667859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:21.798827 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:21.806118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd4f0d64-4a8e-4e22-bf8e-ab2450fe9610 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.151152 Nov 06 21:41:21.806688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4113/8337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:21 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:22.823008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:22.823626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:22.830521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:22.830987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:22.831798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:22.832251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:22.964904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:22.972240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-543f9dab-4645-442e-b03a-e7f97585dc75 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.153167 Nov 06 21:41:22.972834 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4225/8338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:22 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:23.990295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:23.990910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:23.997924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:23.998376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:23.999151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:23.999584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:24.128434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:24.135926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-846609de-c91a-4dea-ab11-9c31c36910d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.149324 Nov 06 21:41:24.136513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4114/8339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:23 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:25.152851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:25.153424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:25.160685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:25.161153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:25.161946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:25.162396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:25.295862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:25.304149 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0afc1664-d959-40b6-82a6-dc6594113f28 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1684 microversion: 2.1 time: 0.155079 Nov 06 21:41:25.304760 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4226/8340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:25 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:26.320910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:26.321527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:26.328652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:26.329117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:26.329906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:26.330342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:26.535721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:26.543530 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf62652d-88bc-4a8e-b669-66bf0cb92db0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1683 microversion: 2.1 time: 0.226228 Nov 06 21:41:26.544462 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4115/8341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:26 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:26.650113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "name": "network-vif-unplugged", "status": "completed", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:26.651811 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:26.651811 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:41:26.661464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:26.662264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:26.677558 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] Creating event network-vif-unplugged:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch2-master-1 Nov 06 21:41:26.683950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:41:26.695421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-bfebd0ec-d365-4ab2-abb5-16897fca834a req-e735154e-95ee-4b0e-b848-4f3a93c62648 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143204 Nov 06 21:41:26.696346 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4227/8342] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:41:27.562066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:27.562688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:27.569430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:27.569885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:27.570665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:27.571102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:27.704786 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:27.712139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf70ad89-964a-489c-8441-d650176555c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1683 microversion: 2.1 time: 0.153823 Nov 06 21:41:27.712724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4116/8343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:27 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:28.363693 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:41:28.363941 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:41:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:41:28.720078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:28.721671 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:28.721671 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:41:28.728830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:28.729289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:28.729396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:28.729993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:28.737259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:28.737719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:28.738508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:28.738946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:28.741155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] Creating event network-changed:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch2-master-1 Nov 06 21:41:28.746386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:41:28.757383 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c3b0daf0-f776-4da6-bb48-f989ec8e6b75 req-e9bc1395-a0fc-4f6a-a41b-d0acb0a8e46d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042144 Nov 06 21:41:28.757987 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4228/8344] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:41:29.036792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:29.044214 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-97813692-dcab-471a-8582-6c0c90327850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1681 microversion: 2.1 time: 0.318494 Nov 06 21:41:29.044829 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4117/8345] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:28 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:41:30.064476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:30.065191 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:30.071676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:30.072138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:30.072960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:30.073408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:30.210084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:30.218166 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7a6bbef2-3535-4f12-86c1-ef205ac6ee1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1681 microversion: 2.1 time: 0.159262 Nov 06 21:41:30.218738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4229/8346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:30 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:31.234687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:31.235297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:31.241946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.242398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.243207 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.243669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.379439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:31.386714 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6ad675be-bf00-411c-8061-29ff89853e68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1678 microversion: 2.1 time: 0.155733 Nov 06 21:41:31.387271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4118/8347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:31 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:31.403404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:31.403944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:31.410648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.411109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.411897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.412364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.469686 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-608f18fa-b169-40b0-8a29-61d200135694 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action" status: 204 len: 0 microversion: 2.1 time: 0.069734 Nov 06 21:41:31.470303 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4230/8348] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:31 2021] POST /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:41:31.479102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:31.479654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:31.485978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.486440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.487415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:31.487978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:31.702132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:31.709929 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13d78920-9d18-4272-adbb-dc292fb28cc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1678 microversion: 2.1 time: 0.235268 Nov 06 21:41:31.710603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4119/8349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:31 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:32.728156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:32.728899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:32.735162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:32.735630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:32.736566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:32.736994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:32.870930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:32.879339 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0487a3e-c992-4c15-84df-fee723ff9c88 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1670 microversion: 2.1 time: 0.156066 Nov 06 21:41:32.879917 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4231/8350] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:32 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:32.896132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:32.896778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:32.903467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:32.903929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:32.904749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:32.905200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.038631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:33.045951 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe52c03b-65cb-4261-ac5d-7bc2dcababda tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1670 microversion: 2.1 time: 0.153526 Nov 06 21:41:33.046545 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4120/8351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:32 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:33.062516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:33.063731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:33.069639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.070049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.070842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.071296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.199010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:33.206674 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d71ea47c-55c1-46bb-8bea-44187b1c383d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1670 microversion: 2.1 time: 0.147694 Nov 06 21:41:33.207442 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4232/8352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:33 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:33.222913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:33.223419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:33.229565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.229915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.230716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.231183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.256647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:41:33.329822 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ee114a9-3181-48e0-91f7-a8744d4c1366 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 204 len: 0 microversion: 2.1 time: 0.110351 Nov 06 21:41:33.330486 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4121/8353] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:41:33 2021] DELETE /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:41:33.339135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:33.339767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:33.345744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.346210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.347034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:33.347480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:33.479238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:33.487287 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66cffe35-0fc9-4203-9ecc-68b2c6cf8b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1676 microversion: 2.1 time: 0.151855 Nov 06 21:41:33.487859 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4233/8354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:33 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:34.209915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6a9501e6-0c8c-4008-99e9-34e6c859e91f req-c514f4b0-f2aa-40b9-a84c-ce87a502c482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "name": "network-vif-plugged", "status": "completed", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:34.211397 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:34.211397 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:41:34.219080 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a9501e6-0c8c-4008-99e9-34e6c859e91f req-c514f4b0-f2aa-40b9-a84c-ce87a502c482 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:34.219532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a9501e6-0c8c-4008-99e9-34e6c859e91f req-c514f4b0-f2aa-40b9-a84c-ce87a502c482 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:34.231729 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6a9501e6-0c8c-4008-99e9-34e6c859e91f req-c514f4b0-f2aa-40b9-a84c-ce87a502c482 service nova] Creating event network-vif-plugged:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch2-master-1 Nov 06 21:41:34.236605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6a9501e6-0c8c-4008-99e9-34e6c859e91f req-c514f4b0-f2aa-40b9-a84c-ce87a502c482 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104694 Nov 06 21:41:34.237181 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4122/8355] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:41:34.504069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:34.504709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:34.511280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:34.511738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:34.512620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:34.513069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:34.645721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:34.653093 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13b00f26-365a-4be3-801d-8f5526540407 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1676 microversion: 2.1 time: 0.153333 Nov 06 21:41:34.653700 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4234/8356] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:34 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:35.628491 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b2c0e8d0-038b-4c30-9392-e1049ede827f req-c881e193-36c7-4179-adf6-25ef9fb1b164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b079c06-8aee-4ba1-801f-fae8b19eef40", "name": "network-vif-deleted", "tag": "238bc70c-367d-479d-89b4-b62481662174"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:35.630545 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:35.630545 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:41:35.646913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b2c0e8d0-038b-4c30-9392-e1049ede827f req-c881e193-36c7-4179-adf6-25ef9fb1b164 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:35.647521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b2c0e8d0-038b-4c30-9392-e1049ede827f req-c881e193-36c7-4179-adf6-25ef9fb1b164 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:35.660476 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b2c0e8d0-038b-4c30-9392-e1049ede827f req-c881e193-36c7-4179-adf6-25ef9fb1b164 service nova] Creating event network-vif-deleted:238bc70c-367d-479d-89b4-b62481662174 for instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 on nch2-master-1 Nov 06 21:41:35.665474 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b2c0e8d0-038b-4c30-9392-e1049ede827f req-c881e193-36c7-4179-adf6-25ef9fb1b164 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042692 Nov 06 21:41:35.666745 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4123/8357] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:41:35.670660 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:35.671366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:35.679646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:35.680417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:35.681525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:35.682186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:35.747485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:35.757993 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da470447-c243-4c30-a62b-891d62722199 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 200 len: 1324 microversion: 2.1 time: 0.091224 Nov 06 21:41:35.758746 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4235/8358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:35 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 1324 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:36.777498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:36.778196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:36.784379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:36.784832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:36.785604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:36.786076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:36.799750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. Nov 06 21:41:36.800392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:41:36.801216 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-badbcb05-8442-4b1c-8b43-b0094fde791b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 404 len: 111 microversion: 2.1 time: 0.028650 Nov 06 21:41:36.801733 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4124/8359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:36 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:41:36.813738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:36.814352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:36.821115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:36.821579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:36.822363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:36.822809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:36.835813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. Nov 06 21:41:36.836438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:41:36.837265 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9faef60-e5a4-484d-8c24-7fd3fb4f51d6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 404 len: 111 microversion: 2.1 time: 0.027929 Nov 06 21:41:36.837790 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4236/8360] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:36 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:41:36.890071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1196521643", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "22a42440-0ea7-49db-af06-da6aaccfe1f8"}], "security_groups": [{"name": "tempest-securitygroup--617496060"}], "key_name": "tempest-keypair-1399394096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:36.995306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] validate_networks() for [('22a42440-0ea7-49db-af06-da6aaccfe1f8', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:41:37.357245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:41:37.357671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:41:37.358149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:41:37.358563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:41:37.358972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:41:37.368392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:37.368846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:37.369653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:37.370089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:37.386050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:41:37.391058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:41:37.402729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:41:37.405081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:41:37.450987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aa40ecf0-821d-4f4b-83a2-90bbcb27e9be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.570583 Nov 06 21:41:37.451549 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4125/8361] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:41:36 2021] POST /compute/v2.1/servers => generated 405 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:41:37.461504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6d47c2ec-155d-4359-bbe7-6213ce881e3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:37.462120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6d47c2ec-155d-4359-bbe7-6213ce881e3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:37.520561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6d47c2ec-155d-4359-bbe7-6213ce881e3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:37.527489 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6d47c2ec-155d-4359-bbe7-6213ce881e3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1239 microversion: 2.1 time: 0.069589 Nov 06 21:41:37.528069 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4237/8362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:37 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:38.546153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:38.546858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:38.556691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:38.557151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:38.557952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:38.558396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:38.628634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:38.636067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5731203c-31f7-4780-b2ec-2b520eea1b3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1297 microversion: 2.1 time: 0.094493 Nov 06 21:41:38.636694 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4126/8363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:38 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:39.654683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:39.655317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:39.663723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:39.664591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:39.665471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:39.666292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:39.721212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-758e362a-80ea-4a11-a306-8d699e4429b7 req-21431258-7d4e-44fd-89d9-655eb3d1d5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:39.726678 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:39.726678 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:41:39.739905 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-758e362a-80ea-4a11-a306-8d699e4429b7 req-21431258-7d4e-44fd-89d9-655eb3d1d5c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:39.741157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-758e362a-80ea-4a11-a306-8d699e4429b7 req-21431258-7d4e-44fd-89d9-655eb3d1d5c3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:39.754920 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-758e362a-80ea-4a11-a306-8d699e4429b7 req-21431258-7d4e-44fd-89d9-655eb3d1d5c3 service nova] Creating event network-changed:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch1-master-1 Nov 06 21:41:39.762120 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-758e362a-80ea-4a11-a306-8d699e4429b7 req-21431258-7d4e-44fd-89d9-655eb3d1d5c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049555 Nov 06 21:41:39.763004 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4127/8364] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:41:39.939182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:39.946500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86cd5702-b2fe-4797-a29a-eee9179598b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.295849 Nov 06 21:41:39.947072 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4238/8365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:39 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:40.965575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:40.966197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:40.972318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:40.972800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:40.973593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:40.974047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:41.110127 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:41.117676 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c806f2a-66a6-4f96-a3cc-6d86e9141c04 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.157211 Nov 06 21:41:41.118250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4128/8366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:40 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:42.135476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:42.136007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:42.143318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:42.143778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:42.144610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:42.145055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:42.276492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:42.284867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7e227812-04cf-44cb-be60-c7bd0336bb82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.153285 Nov 06 21:41:42.285430 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4239/8367] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:42 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:43.302892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:43.303489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:43.310385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:43.310843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:43.311629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:43.312073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:43.443664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:43.450960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-193fba95-8366-4038-9e54-8a9830373ae2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.151731 Nov 06 21:41:43.451525 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4129/8368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:43 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:44.468232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:44.468989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:44.475815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:44.476281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:44.477108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:44.477564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:44.606383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:44.614301 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4752897-0fe3-4a7b-9410-f311d4cb7df8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.149734 Nov 06 21:41:44.615070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4240/8369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:44 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:45.631393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:45.632033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:45.638689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:45.639150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:45.639940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:45.640402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:45.764640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0e96f91c-bf0d-4915-a7b8-fd38866c188d req-9808b8ec-d923-47e9-85b9-1ddcffd76e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "name": "network-vif-plugged", "status": "completed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:45.766212 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:45.766212 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:41:45.775611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0e96f91c-bf0d-4915-a7b8-fd38866c188d req-9808b8ec-d923-47e9-85b9-1ddcffd76e0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:45.776082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0e96f91c-bf0d-4915-a7b8-fd38866c188d req-9808b8ec-d923-47e9-85b9-1ddcffd76e0a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:45.779266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:45.786941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5efd98f2-cbd1-4470-b963-548f337d8fb6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.159237 Nov 06 21:41:45.787854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4130/8370] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:45 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:45.788615 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0e96f91c-bf0d-4915-a7b8-fd38866c188d req-9808b8ec-d923-47e9-85b9-1ddcffd76e0a service nova] Creating event network-vif-plugged:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch1-master-1 Nov 06 21:41:45.793695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0e96f91c-bf0d-4915-a7b8-fd38866c188d req-9808b8ec-d923-47e9-85b9-1ddcffd76e0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Nov 06 21:41:45.794537 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4241/8371] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:41:46.804397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:46.805007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:46.811668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:46.812119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:46.812932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:46.813373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:46.952500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:46.960661 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-265d5feb-1a30-436d-9564-f81b9e35ce35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1364 microversion: 2.1 time: 0.159972 Nov 06 21:41:46.961226 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4131/8372] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:46 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:47.979315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:47.980052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:47.986945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:47.987407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:47.988222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:47.988691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:48.118713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:41:48.125978 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05d56460-82fe-4c50-ab46-c592b715523d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1551 microversion: 2.1 time: 0.151577 Nov 06 21:41:48.126558 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4242/8373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:41:47 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:41:48.142866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:41:48.143361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:48.150008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:48.150499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:48.151287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:48.151733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:48.232886 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80c309ef-d9e0-4651-a560-a99a63fe3d96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094266 Nov 06 21:41:48.233508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4132/8374] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:41:48 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:41:49.185003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:49.185936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:49.188838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0fde834b-9968-4f80-9b5d-03d27280a55b req-f1c2b417-778a-4979-8c18-64971c4fdc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:49.190434 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:41:49.190434 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:41:49.193480 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:49.193882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:49.194687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:49.195135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:49.197605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0fde834b-9968-4f80-9b5d-03d27280a55b req-f1c2b417-778a-4979-8c18-64971c4fdc97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:49.198282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0fde834b-9968-4f80-9b5d-03d27280a55b req-f1c2b417-778a-4979-8c18-64971c4fdc97 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:49.210074 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0fde834b-9968-4f80-9b5d-03d27280a55b req-f1c2b417-778a-4979-8c18-64971c4fdc97 service nova] Creating event network-changed:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch1-master-1 Nov 06 21:41:49.215343 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0fde834b-9968-4f80-9b5d-03d27280a55b req-f1c2b417-778a-4979-8c18-64971c4fdc97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Nov 06 21:41:49.216137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4133/8375] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:41:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:41:49.239337 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b3e2f37d-a816-4f08-bb66-322b5a2d9df0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.057803 Nov 06 21:41:49.242715 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4243/8376] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:49 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:50.251857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:50.252875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:50.259393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:50.259843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:50.260655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:50.261092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:50.301361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b94c3bef-1ab0-4440-b50a-6f3fdccd6c73 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.054233 Nov 06 21:41:50.301984 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4134/8377] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:50 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:51.314196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:51.315250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:51.322792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:51.323253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:51.324061 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:51.324535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:51.361852 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-416aa5d7-3487-475a-a2f1-817e6565cc53 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.052291 Nov 06 21:41:51.362656 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4244/8378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:51 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:52.373029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:52.374034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:52.381846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:52.382300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:52.383078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:52.383515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:52.420558 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09124f78-41cc-4d24-be30-7d16df05cd85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.051449 Nov 06 21:41:52.421192 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4135/8379] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:52 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:53.432161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:53.433242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:53.440376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:53.440850 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:53.441654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:53.442112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:53.478485 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8258f3ab-2d24-418d-9ee4-cc552550d214 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.050335 Nov 06 21:41:53.479125 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4245/8380] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:53 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:54.490506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:54.491511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:54.498805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:54.499259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:54.500038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:54.500511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:54.537076 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0f4e916-a142-4f77-9d13-b31e9b4e7529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.050514 Nov 06 21:41:54.537854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4136/8381] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:54 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:55.549327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:55.550293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:55.558101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:55.558556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:55.559356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:55.559798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:55.597623 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d92dac3b-7879-4022-8dd6-9279fe6a9646 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.053101 Nov 06 21:41:55.598261 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4246/8382] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:55 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:56.609129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:56.610195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:56.617622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:56.618077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:56.618854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:56.619307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:56.655918 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e61cf76-e699-4eda-b095-822c43040078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.050797 Nov 06 21:41:56.656619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4137/8383] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:56 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:57.666839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:57.667854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:57.676038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:57.676531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:57.677593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:57.678042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:57.713137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21a57f74-e8a5-4f5a-a725-956bc4ba169a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.050263 Nov 06 21:41:57.713781 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4247/8384] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:57 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:58.724560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:58.725563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:58.732809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:58.733260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:58.734031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:58.734979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:58.772760 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b3e57d6-8459-4764-9590-d37a82b8eac8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 14 microversion: 2.1 time: 0.052186 Nov 06 21:41:58.773353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4138/8385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:58 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:41:59.783467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:41:59.784507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:41:59.792006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:59.792495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:59.793294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:41:59.793741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:41:59.843683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e5bb411-7b19-4ea1-839f-69ffe4a341ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 8204 microversion: 2.1 time: 0.064168 Nov 06 21:41:59.844375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4248/8386] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:41:59 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 8204 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:42:00.857878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:00.858888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:00.866635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:00.867133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:00.867930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:00.868393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:00.925133 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73a7c498-7412-483d-81f7-a80b74db7829 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 16394 microversion: 2.1 time: 0.072949 Nov 06 21:42:00.926003 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4139/8387] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:00 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 16394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:01.936253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:01.937367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:01.944661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:01.945127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:01.945922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:01.946372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:01.987452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e619ad31-cca9-4b3a-96f4-a2fc040ad38c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 16394 microversion: 2.1 time: 0.055137 Nov 06 21:42:01.988090 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4249/8388] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:01 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 16394 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:02.999301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:03.000968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:03.008169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:03.008655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:03.009431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:03.009874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:03.047438 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c7e574d-40c9-4d6a-934e-08745cef4b72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 16394 microversion: 2.1 time: 0.051602 Nov 06 21:42:03.048457 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4140/8389] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:02 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:04.059490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:04.060546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:04.067869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:04.068360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:04.069149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:04.069592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:04.108063 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f2957af-bed6-4256-bcd1-7beeeddc137d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 16394 microversion: 2.1 time: 0.052481 Nov 06 21:42:04.108712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4250/8390] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:04 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:05.119850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:05.120888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:05.128210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:05.128636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:05.129700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:05.130145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:05.180157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-246ff246-762e-4af6-9b14-a23e10f81e4f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.064613 Nov 06 21:42:05.181113 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4141/8391] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:05 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:06.193181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:06.194108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:06.201391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:06.201852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:06.202636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:06.203077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:06.242889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a20fdfe6-3c35-4e3e-87ad-411cfcc4adcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053362 Nov 06 21:42:06.244048 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4251/8392] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:06 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:07.255843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:07.256877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:07.264043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:07.264530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:07.265307 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:07.266391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:07.304811 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-12567be4-f4aa-4068-b756-9673ec71976a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052865 Nov 06 21:42:07.305422 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4142/8393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:07 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:08.316816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:08.317852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:08.325347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:08.325819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:08.326621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:08.327074 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:08.366654 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0802ffc6-d32f-4be4-93d0-5c36f5f3d107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053841 Nov 06 21:42:08.367497 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4252/8394] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:08 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:09.378681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:09.379688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:09.386846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:09.387301 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:09.388075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:09.388553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:09.427865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e624882b-5937-49ae-beb2-1864a5ad3d67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053133 Nov 06 21:42:09.428672 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4143/8395] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:09 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:10.440485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:10.441443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:10.448686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:10.449144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:10.449926 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:10.450368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:10.490708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-543fd8ec-a1b0-4042-8c89-598bd32594c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.055141 Nov 06 21:42:10.491555 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4253/8396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:10 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:11.503384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:11.504341 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:11.511586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:11.512021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:11.512826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:11.513263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:11.552207 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c26a87f0-6a14-4b4a-8e16-1383608c295b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053407 Nov 06 21:42:11.553099 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4144/8397] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:11 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:42:12.564815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:12.565828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:12.573018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:12.573483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:12.574267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:12.574707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:12.614444 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef8d290f-656b-455d-a89e-96f75082f7c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054094 Nov 06 21:42:12.615082 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4254/8398] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:12 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:13.626473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:13.627516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:13.634834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:13.635291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:13.636072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:13.636544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:13.677728 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c2fe2b2b-b9fa-4928-9506-4aa22433c9da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.055274 Nov 06 21:42:13.678356 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4145/8399] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:13 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:14.690259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:14.691286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:14.698581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:14.699042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:14.699834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:14.700282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:14.740422 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d22a7bdb-5108-4bd2-b109-db9b28101263 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054583 Nov 06 21:42:14.741060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4255/8400] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:14 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:15.752506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:15.753519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:15.760780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:15.761236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:15.762019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:15.762456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:15.801054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08fee756-2d9b-461a-9236-e34d67892aa1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052624 Nov 06 21:42:15.801668 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4146/8401] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:15 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:16.813762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:16.814776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:16.822139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:16.822605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:16.823395 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:16.823845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:16.867438 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9be5f7cb-e3c1-4bc3-ad4a-414b1c74beb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.058192 Nov 06 21:42:16.868084 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4256/8402] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:16 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:17.880067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:17.881134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:17.888376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:17.888836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:17.889619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:17.890057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:17.928156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b40901ba-7ed8-4e5f-98e0-5732de37bf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052136 Nov 06 21:42:17.928813 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4147/8403] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:17 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:18.940280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:18.941334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:18.948709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:18.949176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:18.949964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:18.950412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:18.989894 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a99c0d11-eb13-46e6-8f23-98b73e9cab3e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053664 Nov 06 21:42:18.990527 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4257/8404] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:18 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:20.002764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:20.003796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:20.010960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:20.011412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:20.012186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:20.012649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:20.049656 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4863ec60-52ae-48cd-adaf-524a968ba226 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.051371 Nov 06 21:42:20.050271 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4148/8405] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:19 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:42:21.061323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:21.062352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:21.069938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:21.070419 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:21.071226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:21.071681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:21.111058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ec3b8044-e83d-4074-bab1-0d9535b3ef22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053719 Nov 06 21:42:21.111683 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4258/8406] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:21 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:22.123183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:22.124187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:22.131550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:22.131939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:22.132750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:22.133188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:22.171483 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c805bd60-f39c-4602-9b8f-c2d6a054274e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052246 Nov 06 21:42:22.172752 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4149/8407] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:22 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:23.184662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:23.185707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:23.193302 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:23.193765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:23.194557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:23.195024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:23.234029 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92871e52-7ab7-4587-a5f2-0fc0bb785f5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053526 Nov 06 21:42:23.237026 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4259/8408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:23 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:24.248135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:24.249113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:24.256829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:24.257314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:24.258103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:24.258539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:24.297418 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70a35c74-0f74-4032-804c-cae1ed74fc00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053406 Nov 06 21:42:24.298073 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4150/8409] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:24 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:25.309825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:25.310845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:25.318109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:25.318577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:25.319363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:25.319811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:25.357380 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7dbd98e8-38cb-4a05-a4e4-50b57ffbce2a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.051635 Nov 06 21:42:25.357993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4260/8410] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:25 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:26.370091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:26.371091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:26.379022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:26.379475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:26.380248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:26.380705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:26.426292 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c026f75-cc0c-4f67-a9fd-0ea36dfdbe72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.060136 Nov 06 21:42:26.426952 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4151/8411] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:26 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:27.438588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:27.439607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:27.446942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:27.447403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:27.448196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:27.448666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:27.489958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f77d8c4d-a804-4e69-ae30-21acc56aa080 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.055873 Nov 06 21:42:27.490599 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4261/8412] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:27 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:28.502152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:28.503158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:28.510426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:28.510881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:28.511678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:28.512117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:28.552583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0725b41d-b99f-440c-a2c5-66a94028b185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054409 Nov 06 21:42:28.553380 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4152/8413] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:28 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:29.565187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:29.566213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:29.573566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:29.574033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:29.574826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:29.575275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:29.613691 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-79039a39-1f66-4a87-b74e-2015c0e4d2d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053126 Nov 06 21:42:29.614538 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4262/8414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:29 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:30.626220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:30.627226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:30.634470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:30.634920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:30.635691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:30.636126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:30.674482 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff269aaf-b540-4549-80a0-70b92faf970e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052747 Nov 06 21:42:30.675118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4153/8415] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:30 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:31.686524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:31.687542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:31.694843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:31.695308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:31.696089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:31.696561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:31.735953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36043ff3-e787-4132-9edc-e00b8d7db5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053409 Nov 06 21:42:31.736638 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4263/8416] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:31 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:32.748256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:32.749294 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:32.756590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:32.757055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:32.757840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:32.758284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:32.797641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51b50fb6-af47-4c02-96e3-bf38934a285a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052529 Nov 06 21:42:32.799038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4154/8417] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:32 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:33.810602 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:33.811619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:33.819786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:33.820244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:33.821053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:33.821497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:33.862237 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46f76566-d983-41a2-8f76-c59f7243514e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.055631 Nov 06 21:42:33.862878 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4264/8418] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:33 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:34.874595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:34.876146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:34.883475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:34.883927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:34.884738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:34.885174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:34.924603 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f91ec83d-1595-474f-b2fb-5746357762c8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053964 Nov 06 21:42:34.925222 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4155/8419] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:34 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:35.936795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:35.937812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:35.945069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:35.945527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:35.946309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:35.946755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:35.987999 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-39bf924d-3289-445c-9b83-6c4c275c7d9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.055109 Nov 06 21:42:35.988687 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4265/8420] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:35 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:36.999994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:37.001042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:37.008383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:37.008850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:37.009642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:37.010085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:37.050028 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87bcd3bc-363a-4f0e-9f8f-1355cd71bb14 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054038 Nov 06 21:42:37.050650 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4156/8421] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:36 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:42:38.061722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:38.062795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:38.070672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:38.071140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:38.071931 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:38.072406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:38.112693 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-30bd7645-7961-46fe-9d17-3b3e42a9ed0c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054925 Nov 06 21:42:38.113548 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4266/8422] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:38 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:39.124864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:39.125908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:39.133059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:39.133461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:39.134243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:39.134686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:39.178018 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ff7b1ee7-412f-499d-a9fb-33242ac062aa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.057168 Nov 06 21:42:39.178698 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4157/8423] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:39 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:40.190757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:40.191717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:40.199056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:40.199523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:40.200335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:40.200782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:40.248613 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-94fd2c08-8c83-4e67-8d08-83bc06ba1bea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.062417 Nov 06 21:42:40.249257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4267/8424] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:40 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:41.260355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:41.261432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:41.268574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:41.269029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:41.269802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:41.270236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:41.308203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f23a7c3-c22b-4b55-a535-d27e53063692 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.051909 Nov 06 21:42:41.309106 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4158/8425] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:41 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:42.320081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:42.321121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:42.328410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:42.329503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:42.330287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:42.330738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:42.369270 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c5bf5531-7de1-49d9-bc49-69aaa0da22ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053061 Nov 06 21:42:42.369926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4268/8426] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:42 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:42:43.381548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:43.382565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:43.389942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:43.390402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:43.391195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:43.391632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:43.428601 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-754dfa9b-989d-401a-92cc-87eae4ca639c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.051028 Nov 06 21:42:43.429447 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4159/8427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:43 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:44.440164 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:44.441285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:44.448679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:44.449152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:44.449961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:44.450416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:44.491199 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2057db07-a238-4cfc-ad13-dcfa62898ec1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.054490 Nov 06 21:42:44.492280 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4269/8428] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:44 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:45.503320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:45.504358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:45.511584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:45.512034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:45.512906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:45.513293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:45.553173 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8c9f2108-873e-4667-990b-37b86c107e3b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053809 Nov 06 21:42:45.553840 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4160/8429] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:45 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:46.566015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:46.567037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:46.574473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:46.574937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:46.575729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:46.576178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:46.614964 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-808fdead-77dd-4a09-89fb-d301f2ff59b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053535 Nov 06 21:42:46.615612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4270/8430] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:46 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:47.627470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:47.628557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:47.635999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:47.636485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:47.637260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:47.637699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:47.676166 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47365bf8-1dd3-42ad-9a9d-43d4dc54191e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.053163 Nov 06 21:42:47.676807 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4161/8431] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:47 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:48.688177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:48.689216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:48.697067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:48.697872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:48.699273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:48.700083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:48.742782 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb83d339-c5b8-45bf-a5a3-8cadb87fe4d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.058536 Nov 06 21:42:48.743548 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4271/8432] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:48 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:49.755012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:49.756050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:49.763358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:49.763814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:49.764627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:49.765072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:49.803473 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-266fc591-3ef8-4699-bfc0-35dfa9e80185 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 24566 microversion: 2.1 time: 0.052442 Nov 06 21:42:49.804105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4162/8433] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:49 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:50.815197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:50.816218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:50.823696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:50.824163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:50.824990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:50.825444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:50.875708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bfed28b2-e713-4698-bee9-bb1d6e933bc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.064143 Nov 06 21:42:50.876982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4272/8434] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:50 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:51.887585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:51.888635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:51.896524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:51.897009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:51.897792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:51.898232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:51.942268 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5546408d-5dfd-4a5c-98f0-ef258efc5158 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.057736 Nov 06 21:42:51.942268 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4163/8435] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:51 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:52.953686 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:52.954702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:52.961627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:52.962084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:52.962868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:52.963313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:53.008212 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e85254a-b921-44ab-b556-7b6a5b640443 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.058685 Nov 06 21:42:53.008904 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4273/8436] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:52 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:54.020526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:54.021570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:54.028857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:54.029312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:54.030092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:54.030528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:54.069455 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98e55413-c1d7-460e-8296-ec29618929c4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052927 Nov 06 21:42:54.070102 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4164/8437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:54 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:55.082269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:55.083278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:55.090556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:55.091017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:55.091805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:55.092249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:55.130736 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e25e8aa-5835-4aa7-a325-ef5e58c132eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052929 Nov 06 21:42:55.131316 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4274/8438] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:55 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:56.142846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:56.143796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:56.151196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:56.151652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:56.152467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:56.152906 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:56.192187 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a0dd9bb-69f8-421b-9da8-64b0eab77ac2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053976 Nov 06 21:42:56.193141 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4165/8439] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:56 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:57.203630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:57.204651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:57.211936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:57.212441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:57.213244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:57.213753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:57.253823 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a3bfa0ed-df58-46c4-aa31-1bd748613b23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054240 Nov 06 21:42:57.254461 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4275/8440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:57 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:58.266128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:58.267647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:58.274951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:58.275411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:58.276196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:58.276671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:58.315850 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d6ba359-9e03-42c9-896d-774fd4ec3bd0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053782 Nov 06 21:42:58.316531 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4166/8441] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:58 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:42:59.327728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:42:59.328810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:42:59.336225 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:59.336731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:59.337520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:42:59.337968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:42:59.376773 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2cc849f2-1a08-4a58-bf35-0a34418d94d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052300 Nov 06 21:42:59.377410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4276/8442] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:42:59 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:00.389010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:00.390024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:00.397989 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:00.398449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:00.399230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:00.399672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:00.438945 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dcc9cb6b-94e3-4138-ad51-9f08aa6457b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053438 Nov 06 21:43:00.439578 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4167/8443] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:00 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:01.450562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:01.451614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:01.459619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:01.460087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:01.460907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:01.461358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:01.500472 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0bd13811-99c8-4361-b2bc-3dab4b2ade2e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053807 Nov 06 21:43:01.501103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4277/8444] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:01 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:02.512668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:02.513686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:02.521066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:02.521529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:02.522320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:02.522766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:02.563519 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f7315749-042e-44f1-98f4-d88c7d616421 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054799 Nov 06 21:43:02.564207 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4168/8445] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:02 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:03.575800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:03.576847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:03.584741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:03.585212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:03.585996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:03.586439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:03.625431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80a43a61-1ec0-448b-baaa-43c0f296520e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053661 Nov 06 21:43:03.626308 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4278/8446] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:03 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:04.637311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:04.638336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:04.646170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:04.646629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:04.647411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:04.647854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:04.689791 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-344431fb-a3d7-4dc6-b9cb-f47a44e707ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056409 Nov 06 21:43:04.690421 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4169/8447] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:04 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:05.702255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:05.703293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:05.710469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:05.710935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:05.711718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:05.712161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:05.754275 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4cf88f56-5081-47a7-9b8b-8422963df134 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056054 Nov 06 21:43:05.754915 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4279/8448] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:05 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:06.766943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:06.768020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:06.775314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:06.775768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:06.776575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:06.777015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:06.817059 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a636ecac-b9d5-44f5-ad72-fe5b0bc14ccd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054093 Nov 06 21:43:06.817682 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4170/8449] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:06 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:07.829098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:07.830704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:07.838063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:07.838534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:07.839327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:07.839777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:07.877879 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42556b8c-5fd3-475a-939e-596494b0b507 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052727 Nov 06 21:43:07.878835 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4280/8450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:07 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:08.433287 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:43:08.433897 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:43:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:43:08.891308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:08.892836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:08.899944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:08.900434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:08.901219 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:08.901657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:08.939773 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-626e0843-1dc1-4ba0-a575-04336b40a485 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052308 Nov 06 21:43:08.940360 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4171/8451] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:08 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:09.951989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:09.953040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:09.961095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:09.961567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:09.962360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:09.962808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:10.002876 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-621769f7-8eaa-4bb5-adba-ae11431c640a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054294 Nov 06 21:43:10.003535 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4281/8452] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:09 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:11.015211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:11.016225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:11.023854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:11.024330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:11.025119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:11.025564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:11.067508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e80ed3e-17bc-4e62-87ea-db2a666aca22 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056296 Nov 06 21:43:11.068144 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4172/8453] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:11 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:12.079441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:12.080579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:12.087972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:12.088504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:12.089309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:12.089765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:12.132589 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8f4228c1-862c-4b4a-a977-696026993d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056921 Nov 06 21:43:12.133164 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4282/8454] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:12 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:13.145620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:13.146683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:13.154044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:13.154506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:13.155283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:13.155756 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:13.194364 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4a7105b-c97d-40ed-a9df-f5bbee0a6e9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053368 Nov 06 21:43:13.195023 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4173/8455] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:13 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:14.207498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:14.208458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:14.215965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:14.216456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:14.217248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:14.217694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:14.256643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b28a24f8-c8ce-470a-95ce-af0036f787d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053705 Nov 06 21:43:14.257272 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4283/8456] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:14 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:15.268593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:15.269556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:15.276865 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:15.277321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:15.278103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:15.278542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:15.317632 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24c7589b-c4a0-47f0-aba3-3ab0e6171154 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053115 Nov 06 21:43:15.318286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4174/8457] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:15 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:16.329793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:16.330810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:16.338688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:16.339151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:16.339937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:16.340418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:16.379458 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e352080d-e425-48e1-9b50-c3110c7f8e38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052911 Nov 06 21:43:16.380094 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4284/8458] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:16 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:17.391506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:17.392612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:17.401812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:17.402299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:17.403099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:17.403810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:17.450701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd41452c-b0f7-4b50-8c9b-8397e67587ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.063163 Nov 06 21:43:17.451357 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4175/8459] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:17 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:18.463086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:18.464117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:18.471351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:18.471811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:18.473120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:18.473565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:18.515843 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-61a560aa-9b98-4a65-9239-2971ccda2985 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056725 Nov 06 21:43:18.516504 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4285/8460] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:18 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:19.527815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:19.528866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:19.536852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:19.537246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:19.538033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:19.538473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:19.579261 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-62e2d633-a028-4680-9d97-675f23ca48f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055350 Nov 06 21:43:19.579908 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4176/8461] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:19 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:20.591102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:20.592122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:20.600981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:20.601577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:20.603389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:20.603852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:20.643618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-108c01d2-65b3-4aa3-a7a3-195dc03cf116 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056491 Nov 06 21:43:20.644932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4286/8462] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:20 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:21.656711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:21.657729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:21.665676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:21.666134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:21.666919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:21.667362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:21.706189 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-49341e80-87fd-4836-8570-a0affea54218 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053507 Nov 06 21:43:21.707548 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4177/8463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:21 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:22.719237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:22.720272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:22.727654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:22.728109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:22.728920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:22.729681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:22.770689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf64889c-a73b-497b-a85d-1fc1efda88e2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055598 Nov 06 21:43:22.771328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4287/8464] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:22 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:23.783661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:23.784722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:23.791995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:23.792478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:23.793257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:23.793688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:23.833125 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ff21edf-9eb2-4140-83b8-12f0baa69e70 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053450 Nov 06 21:43:23.833747 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4178/8465] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:23 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:24.845400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:24.846418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:24.854335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:24.854804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:24.855597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:24.856052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:24.894787 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-55ef70fe-0575-490f-9d07-4de7afd819ff tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052794 Nov 06 21:43:24.895417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4288/8466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:24 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:25.906995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:25.908000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:25.916073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:25.916561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:25.917354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:25.917797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:25.956819 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dc68b82a-1008-4224-a017-98dce6eb7c07 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053767 Nov 06 21:43:25.957706 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4179/8467] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:25 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:26.975655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:26.976704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:26.984015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:26.984516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:26.985318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:26.985769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:27.026622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6839b751-d42b-477e-b15c-e35ae44b9a42 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054022 Nov 06 21:43:27.027251 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4289/8468] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:26 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:28.039135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:28.040145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:28.047427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:28.047903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:28.048972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:28.049556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:28.089311 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d929ce1-abbe-439e-9307-1668416b06b0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054196 Nov 06 21:43:28.090083 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4180/8469] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:28 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:29.161059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:29.162754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:29.168865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:29.169332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:29.170126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:29.170576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:29.209300 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-be0c7eed-cb7b-45b9-bee4-b52f2e035d72 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.110868 Nov 06 21:43:29.209905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4290/8470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:29 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:30.221497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:30.222967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:30.230389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:30.230845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:30.231628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:30.232066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:30.273864 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6541c59b-6bc6-4595-aa5c-20b0951bb7dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056391 Nov 06 21:43:30.274526 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4181/8471] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:30 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:31.152156 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:43:31.152765 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:43:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:43:31.285257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:31.286287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:31.293826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:31.294289 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:31.295086 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:31.295535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:31.337523 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-555938c0-6797-49d0-913d-c8a4e2bff2ed tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056204 Nov 06 21:43:31.338150 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4291/8472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:31 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:32.350213 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:32.351234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:32.358566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:32.359019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:32.359804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:32.360247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:32.400439 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45e4e5f2-f4d1-45f6-aeac-ea5ccd491272 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054711 Nov 06 21:43:32.401072 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4182/8473] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:32 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:33.413240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:33.414252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:33.421569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:33.422035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:33.422819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:33.423260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:33.466167 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-239af2f4-e252-45c5-b037-36b2eb055365 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.057454 Nov 06 21:43:33.466798 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4292/8474] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:33 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:34.479436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:34.480509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:34.488456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:34.488915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:34.489702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:34.490145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:34.529657 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf846413-faa3-4cee-8127-cd6ab23c2da1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054613 Nov 06 21:43:34.530294 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4183/8475] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:34 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:35.541742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:35.542674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:35.550240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:35.550738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:35.551532 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:35.551981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:35.593251 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b424ec11-6d4f-4382-876c-d6a712d9fdef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055421 Nov 06 21:43:35.593919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4293/8476] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:35 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:36.605607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:36.606622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:36.613995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:36.614460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:36.615250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:36.615695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:36.655538 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ccf6db3-e72d-40c9-a081-320300859a1f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053978 Nov 06 21:43:36.656172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4184/8477] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:36 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:37.667561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:37.668613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:37.676684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:37.677148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:37.677944 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:37.678396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:37.717350 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ae68a976-d2f0-48d9-8fa2-192b410a9131 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053667 Nov 06 21:43:37.717974 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4294/8478] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:37 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:38.729262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:38.730275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:38.737174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:38.737629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:38.738404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:38.738838 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:38.777299 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-568abd3a-965c-4611-b500-fcf21947b078 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052215 Nov 06 21:43:38.777919 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4185/8479] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:38 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:39.790290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:39.791312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:39.798815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:39.799275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:39.800055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:39.800529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:39.838671 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f480daf8-1cac-4ab1-a912-d857294801de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053016 Nov 06 21:43:39.839281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4295/8480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:39 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:40.851426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:40.852470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:40.859818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:40.860278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:40.861091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:40.861537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:40.900742 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-be757bb8-f9ff-4bfe-8913-029abc7ff008 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053745 Nov 06 21:43:40.901619 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4186/8481] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:40 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:41.913558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:41.914610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:41.921872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:41.922337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:41.923181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:41.923886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:41.963034 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73d4ca50-03a4-4fba-8979-553a2dcf12b4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054075 Nov 06 21:43:41.963913 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4296/8482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:41 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:42.975546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:42.976575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:42.983870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:42.984338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:42.985121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:42.985560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:43.027089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80281e70-1799-4fc8-bca3-70dba051a65b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055533 Nov 06 21:43:43.027720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4187/8483] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:42 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:44.039435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:44.040410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:44.047677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:44.048140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:44.049221 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:44.049704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:44.091460 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64bb6870-7a5e-45a1-b1f9-bb7bd5f87e65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056741 Nov 06 21:43:44.092104 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4297/8484] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:44 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:45.102810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:45.103844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:45.111186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:45.111644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:45.112460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:45.112899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:45.152389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e420e0a1-8758-4b47-a772-8605232c7ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053481 Nov 06 21:43:45.153203 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4188/8485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:45 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:46.164800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:46.165720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:46.172984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:46.173458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:46.174509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:46.174961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:46.213419 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2ea8c12f-4712-4d25-baaa-96c3de6c48c5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052749 Nov 06 21:43:46.214070 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4298/8486] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:46 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:47.226676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:47.227620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:47.234866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:47.235317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:47.236093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:47.236554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:47.275797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f424534d-dd48-4da0-b77e-c9b5b01c04dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053779 Nov 06 21:43:47.276437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4189/8487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:47 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:48.288084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:48.289038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:48.296363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:48.296826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:48.297610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:48.298054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:48.336918 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa6ef0c9-b64c-4956-a75b-3c4f7ca8d860 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053321 Nov 06 21:43:48.337772 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4299/8488] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:48 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:49.349058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:49.350062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:49.357455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:49.357908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:49.358681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:49.359117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:49.398508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3bd1de8-f8bc-443d-b92c-9e0c7d549344 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053437 Nov 06 21:43:49.399135 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4190/8489] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:49 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:50.410737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:50.411797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:50.419328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:50.419803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:50.420638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:50.421097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:50.461123 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ba9c900-9222-4c5c-9f01-9b10101bbcdc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054360 Nov 06 21:43:50.461761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4300/8490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:50 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:51.473388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:51.474914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:51.482327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:51.482760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:51.483527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:51.483963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:51.523843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10d8012d-01a9-4859-9acd-e5eb7112ce03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054447 Nov 06 21:43:51.524472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4191/8491] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:51 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:43:52.535684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:52.536758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:52.543585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:52.544046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:52.544870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:52.545315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:52.584737 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7c86445b-411f-4d22-b98a-c39abfdac1be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053173 Nov 06 21:43:52.589157 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4301/8492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:52 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:53.596893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:53.597915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:53.605269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:53.605728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:53.606508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:53.606948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:53.646614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b9e7d8f9-ea56-431c-8bd2-84934e6c4ea9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053751 Nov 06 21:43:53.647258 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4192/8493] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:53 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:54.659216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:54.660147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:54.668038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:54.668530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:54.669319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:54.669765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:54.709399 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1bd82c6e-d41a-45e9-bb74-9c4356d99808 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054210 Nov 06 21:43:54.710031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4302/8494] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:54 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:55.721173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:55.722215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:55.729997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:55.730450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:55.731230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:55.731670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:55.773369 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5307c757-02e5-474e-b5b2-0cf37fa8b4f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056169 Nov 06 21:43:55.774273 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4193/8495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:55 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:56.785856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:56.786870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:56.794228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:56.794687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:56.795468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:56.795908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:56.841221 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-165db4a7-6668-46ab-92bd-606da81a3419 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.059329 Nov 06 21:43:56.841882 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4303/8496] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:56 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:57.854059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:57.855070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:57.862361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:57.862819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:57.863611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:57.864135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:57.904939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8776f282-0c4e-49c6-af0f-a1822c06bb13 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054791 Nov 06 21:43:57.905580 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4194/8497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:57 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:58.917232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:58.918244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:58.925761 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:58.926223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:58.927004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:58.927455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:58.967126 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-178da61d-22a1-42e1-b846-576c4f8b2be4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053777 Nov 06 21:43:58.967766 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4304/8498] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:58 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:43:59.979463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:43:59.980502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:43:59.987888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:59.988377 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:43:59.990130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:43:59.990262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:00.030495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4fa3cc2d-63f6-44dc-a574-c654c16b12c9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055049 Nov 06 21:44:00.031124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4195/8499] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:43:59 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:01.042703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:01.043730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:01.051920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:01.052422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:01.053229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:01.053688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:01.092934 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8363191-2780-4c10-8e14-8f77744ccd1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054185 Nov 06 21:44:01.093561 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4305/8500] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:01 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:02.104858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:02.105878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:02.113240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:02.114188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:02.114977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:02.115417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:02.157150 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19fd2d6a-23b1-4403-a4ae-56cd4a7e9e86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056232 Nov 06 21:44:02.157711 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4196/8501] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:02 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:03.169492 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:03.170437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:03.178020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:03.178491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:03.179286 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:03.180060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:03.222987 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6045f6a8-c1da-445a-bfae-60f2619e9a0b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.057508 Nov 06 21:44:03.223958 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4306/8502] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:03 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:04.235246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:04.236170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:04.243762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:04.244212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:04.245018 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:04.245453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:04.284465 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-81f57a4c-5196-40fd-bd64-5d11ab6df98a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053248 Nov 06 21:44:04.285094 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4197/8503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:04 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:05.297246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:05.298192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:05.306281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:05.306754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:05.307557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:05.308010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:05.347771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b227b16-35e3-4a83-96f4-6fbd5fd5c8bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.054564 Nov 06 21:44:05.348441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4307/8504] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:05 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:06.359581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:06.360644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:06.368596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:06.369058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:06.369843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:06.370291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:06.408312 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e74953f9-2a19-4e3c-9743-45118a4ffe69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052786 Nov 06 21:44:06.408969 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4198/8505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:06 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:07.421066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:07.422138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:07.430114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:07.430607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:07.431384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:07.431829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:07.470691 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3a9ad2d6-6bfb-4328-9106-b4d8921dca9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053556 Nov 06 21:44:07.471371 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4308/8506] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:07 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:08.483117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:08.484137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:08.491699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:08.492168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:08.492983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:08.493428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:08.534637 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edb9ad97-26c8-455f-83b0-e88dedd0b2e0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055680 Nov 06 21:44:08.535281 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4199/8507] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:08 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:09.547380 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:09.548472 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:09.559680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:09.560079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:09.560950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:09.561407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:09.603996 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c80d4fcc-d6a1-42f0-b104-3fc571b55845 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.060575 Nov 06 21:44:09.604675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4309/8508] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:09 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:10.615609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:10.616665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:10.623879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:10.624362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:10.625140 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:10.625575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:10.664955 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60ccd17c-ca38-4f73-9ce9-3d95e8e5cd86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053332 Nov 06 21:44:10.665588 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4200/8509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:10 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:11.678127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:11.679146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:11.686535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:11.686950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:11.687747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:11.688231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:11.726230 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0834b9be-a44e-4669-aabe-6ac1112c68ea tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052949 Nov 06 21:44:11.726870 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4310/8510] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:11 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:12.738564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:12.740075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:12.747415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:12.747877 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:12.748708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:12.749158 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:12.788057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83e08e79-2823-4d5f-8ded-ff6c8eaad682 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.053489 Nov 06 21:44:12.788724 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4201/8511] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:12 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:13.800497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:13.801511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:13.808808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:13.809268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:13.810054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:13.810496 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:13.848530 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6e701aae-0c37-475c-918b-838152197cd1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.052207 Nov 06 21:44:13.849424 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4311/8512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:13 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:14.860736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:14.861768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:14.870357 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:14.870820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:14.871621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:14.872066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:14.912965 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-adfff9fc-14e2-495d-91d9-6f086fbcf072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.056181 Nov 06 21:44:14.913854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4202/8513] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:14 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:15.925510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:15.926522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:15.934384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:15.934842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:15.935627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:15.936075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:15.977135 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1211f790-6e4d-4b2d-8693-70c3c51202a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055742 Nov 06 21:44:15.978023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4312/8514] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:15 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:16.990380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:16.991427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:16.998806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:16.999257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:17.000037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:17.000508 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:17.041368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-58b422b0-7876-4fc6-b3f8-d852bfd2e0df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.055480 Nov 06 21:44:17.041933 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4203/8515] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:16 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:18.053753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:18.054772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:18.062056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:18.062521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:18.063317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:18.063767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:18.114959 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05c8130e-d62e-4380-b10e-7a6b376a123b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 200 len: 40792 microversion: 2.1 time: 0.065459 Nov 06 21:44:18.115586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4313/8516] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:18 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 40792 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:44:18.126285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba619cec-fe7c-41e0-b241-b0f418f70c9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:18.134235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba619cec-fe7c-41e0-b241-b0f418f70c9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:18.134627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba619cec-fe7c-41e0-b241-b0f418f70c9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:18.156659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba619cec-fe7c-41e0-b241-b0f418f70c9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Going to try to stop instance {{(pid=134828) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 21:44:18.197158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba619cec-fe7c-41e0-b241-b0f418f70c9e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 202 len: 0 microversion: 2.1 time: 0.074759 Nov 06 21:44:18.197763 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4204/8517] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:18 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:44:18.211563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:18.212414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:18.220722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:18.221248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:18.222244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:18.222731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:18.411913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:18.419408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-80c4bc60-d7dd-428f-b98d-9a5c03774c97 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.216582 Nov 06 21:44:18.419976 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4314/8518] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:18 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:19.438761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:19.439464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:19.447196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:19.447649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:19.448461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:19.448902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:19.638759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:19.646138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-42c6727a-8326-4dd5-a90d-1d2e4933654b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.212387 Nov 06 21:44:19.646714 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4205/8519] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:19 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:20.663131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:20.663733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:20.674744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:20.675215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:20.676023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:20.676510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:20.822104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:20.831056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fb3850fa-34ef-496a-bb58-3baf968e9d01 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.171488 Nov 06 21:44:20.831803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4315/8520] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:20 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:21.849050 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:21.849707 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:21.856374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:21.856830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:21.857611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:21.858051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:21.990457 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:21.997795 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6be4904e-74b7-4384-bd61-6aa249e7e642 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.153081 Nov 06 21:44:21.998372 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4206/8521] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:21 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:23.015208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:23.015822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:23.022791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:23.023254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:23.024038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:23.024519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:23.153788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:23.161754 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-34607962-1226-4845-9203-ce0e1bdf5c3c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.149650 Nov 06 21:44:23.162322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4316/8522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:23 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:24.179664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:24.180201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:24.187109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:24.187568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:24.188384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:24.188831 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:24.318090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:24.325697 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37f8ea8e-090d-4f20-b766-5fe55e8f6dad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.150481 Nov 06 21:44:24.326269 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4207/8523] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:24 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:25.342682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:25.343306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:25.349956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:25.350421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:25.351216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:25.351664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:25.483522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:25.492792 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0733f6c4-b0da-4d13-879a-9dafceb31d0a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.153769 Nov 06 21:44:25.493439 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4317/8524] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:25 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:44:26.512840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:26.513507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:26.520955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:26.521417 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:26.522195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:26.522631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:26.655550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:26.662915 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5fd7507-83be-4131-9996-acbb34a8f900 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.153817 Nov 06 21:44:26.663479 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4208/8525] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:26 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:27.680468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:27.681000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:27.687863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:27.688402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:27.689206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:27.689668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:27.874936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:27.882909 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-92dcaa6e-a4c5-4603-a5ea-2a3a7be68684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.206284 Nov 06 21:44:27.883471 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4318/8526] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:27 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:28.899818 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:28.900455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:28.907114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:28.907569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:28.908379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:28.908850 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:29.039800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:29.047132 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45947503-6675-4bf2-85f6-78c57d2f7b85 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1657 microversion: 2.1 time: 0.151056 Nov 06 21:44:29.047731 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4209/8527] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:28 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:29.063466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:29.064497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:29.071097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:29.071558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:29.072370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:29.072819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:29.101185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:29.106673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:44:29.112619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:44:29.113050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:44:29.113535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:44:29.114015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:44:29.114390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:44:29.174321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ffd8d08-416a-40ea-942f-b87fd8f425cd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 202 len: 0 microversion: 2.1 time: 0.114147 Nov 06 21:44:29.175036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4319/8528] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:29 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:44:29.183056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:29.183666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:29.189454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:29.189912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:29.190693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:29.191131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:29.352840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:29.360197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eebf14ca-0469-487b-bb14-2598f8f6434f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.180868 Nov 06 21:44:29.360798 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4210/8529] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:29 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:30.378280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:30.378903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:30.384967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:30.385440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:30.386210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:30.386652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:30.677574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:30.685227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-625c2ec5-d6e0-4396-9fd2-8e3b17625ac0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1680 microversion: 2.1 time: 0.311505 Nov 06 21:44:30.685840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4320/8530] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:30 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1680 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:31.702903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:31.703458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:31.710149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:31.710601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:31.711379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:31.711817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:31.889178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:31.896795 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09592a58-4493-48ec-8d9f-2ea6d5c925e7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1685 microversion: 2.1 time: 0.197654 Nov 06 21:44:31.897380 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4211/8531] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:31 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1685 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:32.914966 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:32.915599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:32.922211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:32.922675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:32.923471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:32.924175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:33.062299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:33.073271 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1b84eb8a-0af0-4b37-96ef-b8e7acdc5592 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1685 microversion: 2.1 time: 0.162631 Nov 06 21:44:33.073918 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4321/8532] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:32 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:33.555369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "name": "network-vif-unplugged", "status": "completed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:33.556999 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:33.556999 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:44:33.565039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:33.565500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:33.577827 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] Creating event network-vif-unplugged:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch2-master-1 Nov 06 21:44:33.583195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] Instance c659700d-b480-442a-a00f-2ca0208e28ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:44:33.593905 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-15031bbb-71a6-4943-b53e-d6ff78aec9f2 req-678d626a-cf94-44de-a3d0-97eb6a4bd545 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043695 Nov 06 21:44:33.594683 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4212/8533] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:44:34.090995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:34.091700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:34.099905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:34.100530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:34.101565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:34.102014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:34.483873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:34.491452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20bc4111-fc0c-46b2-a47e-0ee24a75bd65 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1684 microversion: 2.1 time: 0.404214 Nov 06 21:44:34.492036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4322/8534] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:34 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1684 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:35.510248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:35.510948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:35.517206 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:35.517659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:35.518441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:35.518880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:35.611091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:35.612911 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:35.612911 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:44:35.621411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:35.622092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:35.634460 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] Creating event network-changed:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch2-master-1 Nov 06 21:44:35.639880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] Instance c659700d-b480-442a-a00f-2ca0208e28ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:44:35.651825 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-db6b75b5-2529-47f8-a925-33b1ec7d4872 req-cf763153-7830-4678-800c-4476bd21562b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044463 Nov 06 21:44:35.652464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4323/8535] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:44:35.831470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:35.839540 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9f359364-ddb5-408b-9809-84038db3fb45 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1682 microversion: 2.1 time: 0.334216 Nov 06 21:44:35.840124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4213/8536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:35 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:36.858416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:36.859122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:36.866749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:36.867207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:36.868001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:36.868474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:37.003192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:37.011349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5210a13b-62da-4860-a201-c07b113db56a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1682 microversion: 2.1 time: 0.156948 Nov 06 21:44:37.011920 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4324/8537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:36 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:38.028081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:38.028719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:38.035515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.035972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.036785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.037225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.171281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:38.179351 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-02a223d2-93b0-48b9-afbf-f781cd236881 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1678 microversion: 2.1 time: 0.155049 Nov 06 21:44:38.179917 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4214/8538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:38 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:38.195824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:38.196393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:38.202974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.203650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.204637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.205251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.261396 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22b14fc1-13e6-475e-8d70-c2182a638cfa tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 204 len: 0 microversion: 2.1 time: 0.069643 Nov 06 21:44:38.262017 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4325/8539] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:38 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:44:38.270743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:38.271384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:38.277338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.277791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.278577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:38.279060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:38.483942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:38.491921 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-004791b4-0577-4fc4-87d4-e71814db0034 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1678 microversion: 2.1 time: 0.225642 Nov 06 21:44:38.492529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4215/8540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:38 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:39.510897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:39.511756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:39.518107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.518575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.519379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.519889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.662230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:39.669854 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c4c965d8-b13d-4941-9131-9c48446c2529 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1657 microversion: 2.1 time: 0.163892 Nov 06 21:44:39.670420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4326/8541] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:39 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:39.686815 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:39.687425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:39.694792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.695229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.696025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.696594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.830133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:39.837539 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-134a22ab-60a7-4bc2-9468-65b87eb03b57 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1657 microversion: 2.1 time: 0.154391 Nov 06 21:44:39.838113 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4216/8542] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:39 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:39.853510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3dead7b6-8791-449a-920f-b9ca96ba68c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:39.859528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dead7b6-8791-449a-920f-b9ca96ba68c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.859914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3dead7b6-8791-449a-920f-b9ca96ba68c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.885979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3dead7b6-8791-449a-920f-b9ca96ba68c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Going to try to start instance {{(pid=134827) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 21:44:39.925759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3dead7b6-8791-449a-920f-b9ca96ba68c6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action" status: 202 len: 0 microversion: 2.1 time: 0.075707 Nov 06 21:44:39.926943 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4327/8543] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:44:39 2021] POST /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:44:39.935312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:39.936099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:39.942116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.942574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:39.943386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:39.943832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:40.089913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:40.098136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e65156e0-79d9-420e-b234-bc9120782d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1666 microversion: 2.1 time: 0.166083 Nov 06 21:44:40.098720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4217/8544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:39 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:41.117893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:41.118479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:41.135553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.136051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.137594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.138387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.183870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a9e7683c-0ee7-414e-af32-a06628eeddb7 req-850e3053-554c-410e-b370-b9562cfe5ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "name": "network-vif-plugged", "status": "completed", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:41.186681 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:41.186681 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:44:41.196165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9e7683c-0ee7-414e-af32-a06628eeddb7 req-850e3053-554c-410e-b370-b9562cfe5ba5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.196654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9e7683c-0ee7-414e-af32-a06628eeddb7 req-850e3053-554c-410e-b370-b9562cfe5ba5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.215782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a9e7683c-0ee7-414e-af32-a06628eeddb7 req-850e3053-554c-410e-b370-b9562cfe5ba5 service nova] Creating event network-vif-plugged:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch2-master-1 Nov 06 21:44:41.221097 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a9e7683c-0ee7-414e-af32-a06628eeddb7 req-850e3053-554c-410e-b370-b9562cfe5ba5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040958 Nov 06 21:44:41.222088 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4218/8545] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:44:41.291037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:41.298534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0224fd18-2539-4866-a814-fc186c0de1ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1670 microversion: 2.1 time: 0.186963 Nov 06 21:44:41.299374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4328/8546] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:41 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:41.316020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:41.317306 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:41.323460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.323915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.324712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.325171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.351571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:44:41.426560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4634a883-705f-4d9b-b271-3b261ec51195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 204 len: 0 microversion: 2.1 time: 0.113554 Nov 06 21:44:41.427569 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4219/8547] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:44:41 2021] DELETE /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:44:41.436947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:41.437581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:41.443687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.444166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.444996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:41.445476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:41.572555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:41.579880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-831632bc-0832-4188-90cf-77e2fb0b00bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1676 microversion: 2.1 time: 0.146841 Nov 06 21:44:41.580475 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4329/8548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:41 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:42.597755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:42.598449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:42.605030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:42.605476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:42.606250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:42.606687 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:42.739364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:42.746708 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-604e8077-6d46-4a02-a9e7-133d195b9e74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1676 microversion: 2.1 time: 0.152985 Nov 06 21:44:42.747274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4220/8549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:42 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:44:43.764404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:43.765105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:43.774009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:43.775646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:43.776743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:43.781422 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:43.786578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-abff5a2a-63c6-48a5-af1a-a25b2e6a6247 req-6fa37c25-3ba6-4d17-9eab-1e0c9aef1934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659700d-b480-442a-a00f-2ca0208e28ed", "name": "network-vif-deleted", "tag": "7116f073-aaf1-4cb2-9af0-667ade7c2f21"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:43.788075 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:43.788075 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:44:43.797394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-abff5a2a-63c6-48a5-af1a-a25b2e6a6247 req-6fa37c25-3ba6-4d17-9eab-1e0c9aef1934 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:43.799982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-abff5a2a-63c6-48a5-af1a-a25b2e6a6247 req-6fa37c25-3ba6-4d17-9eab-1e0c9aef1934 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:43.817210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:43.817888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:43.818544 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-abff5a2a-63c6-48a5-af1a-a25b2e6a6247 req-6fa37c25-3ba6-4d17-9eab-1e0c9aef1934 service nova] Creating event network-vif-deleted:7116f073-aaf1-4cb2-9af0-667ade7c2f21 for instance c659700d-b480-442a-a00f-2ca0208e28ed on nch2-master-1 Nov 06 21:44:43.818821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lazy-loading 'fault' on Instance uuid c659700d-b480-442a-a00f-2ca0208e28ed {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:44:43.824421 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-abff5a2a-63c6-48a5-af1a-a25b2e6a6247 req-6fa37c25-3ba6-4d17-9eab-1e0c9aef1934 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111259 Nov 06 21:44:43.825692 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4330/8550] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:44:43.864956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:43.872649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-00487ab0-0b72-4eb2-b49c-316f5a279ad8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 200 len: 1329 microversion: 2.1 time: 0.111807 Nov 06 21:44:43.873241 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4221/8551] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:43 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:44.890094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:44.890738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:44.898460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:44.898922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:44.899712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:44.900159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:44.913678 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. Nov 06 21:44:44.914299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:44:44.915119 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9c8b7d1f-3992-4256-bb7f-e681b7327596 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 404 len: 111 microversion: 2.1 time: 0.029261 Nov 06 21:44:44.915649 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4331/8552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:44 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:44:44.993090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:44.994844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:45.001661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:45.002150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:45.002942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:45.003389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:45.016466 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. Nov 06 21:44:45.017067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:44:45.017902 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44d3902d-235b-4293-ac57-897788ce8eb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 404 len: 111 microversion: 2.1 time: 0.030197 Nov 06 21:44:45.018437 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4222/8553] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:44 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:44:45.065054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-335380359", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "22a42440-0ea7-49db-af06-da6aaccfe1f8"}], "security_groups": [{"name": "tempest-securitygroup--617496060"}], "key_name": "tempest-keypair-1399394096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:45.166763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] validate_networks() for [('22a42440-0ea7-49db-af06-da6aaccfe1f8', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:44:45.600122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:44:45.600622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:44:45.601115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:44:45.601543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:44:45.601975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:44:45.610728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:45.611190 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:45.612028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:45.612517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:45.628733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:44:45.633795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:44:45.646265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:44:45.648624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:44:45.694629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-621bbb8f-091c-4c62-9166-d1303d83a4a6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.633196 Nov 06 21:44:45.695271 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4332/8554] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:44:45 2021] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:44:45.705347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5b152a4-9b22-43fa-92d2-2fb93362082b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:45.705992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5b152a4-9b22-43fa-92d2-2fb93362082b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:45.757683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5b152a4-9b22-43fa-92d2-2fb93362082b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:45.764101 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5b152a4-9b22-43fa-92d2-2fb93362082b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1238 microversion: 2.1 time: 0.062644 Nov 06 21:44:45.764701 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4223/8555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:45 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:44:46.781078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5246fdb4-55ea-4d6d-a16d-b64b017e3bde tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:46.781697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5246fdb4-55ea-4d6d-a16d-b64b017e3bde tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:46.833586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5246fdb4-55ea-4d6d-a16d-b64b017e3bde tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:46.840949 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5246fdb4-55ea-4d6d-a16d-b64b017e3bde tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1238 microversion: 2.1 time: 0.063510 Nov 06 21:44:46.841496 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4333/8556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:46 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:47.858577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7613ecc9-172b-4df3-909f-156105382eb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:47.859194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7613ecc9-172b-4df3-909f-156105382eb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:47.913347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7613ecc9-172b-4df3-909f-156105382eb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:47.919800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7613ecc9-172b-4df3-909f-156105382eb5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1238 microversion: 2.1 time: 0.064958 Nov 06 21:44:47.930248 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4224/8557] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:47 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:48.381569 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:44:48.381806 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:44:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:44:48.937951 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b47a1f4-dfcb-4a86-9e8e-5c6c48f647de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:48.938568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b47a1f4-dfcb-4a86-9e8e-5c6c48f647de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:48.993112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2b47a1f4-dfcb-4a86-9e8e-5c6c48f647de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:49.001616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b47a1f4-dfcb-4a86-9e8e-5c6c48f647de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1238 microversion: 2.1 time: 0.067250 Nov 06 21:44:49.002544 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4334/8558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:48 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:50.027510 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:50.028325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:50.038171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:50.038679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:50.039516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:50.039971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:50.099042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:50.106246 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-770a7031-cd38-44b5-a71f-594d42ce3870 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1242 microversion: 2.1 time: 0.084734 Nov 06 21:44:50.106812 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4225/8559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:50 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:51.123141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:51.124972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:51.133076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:51.133625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:51.134504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:51.135051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:51.199721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:51.207613 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-094ab38a-e404-4053-b790-e8f80831ee1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1296 microversion: 2.1 time: 0.087894 Nov 06 21:44:51.208187 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4335/8560] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:51 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:52.226070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:52.227400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:52.234317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:52.234779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:52.235790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:52.236241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:52.350483 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a2241321-9f22-4c2c-95c5-c89cee529402 req-76f1a533-a3d7-48f4-948f-010471d51580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:52.351731 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:52.351731 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:44:52.383291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a2241321-9f22-4c2c-95c5-c89cee529402 req-76f1a533-a3d7-48f4-948f-010471d51580 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:52.383758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a2241321-9f22-4c2c-95c5-c89cee529402 req-76f1a533-a3d7-48f4-948f-010471d51580 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:52.397998 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a2241321-9f22-4c2c-95c5-c89cee529402 req-76f1a533-a3d7-48f4-948f-010471d51580 service nova] Creating event network-changed:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:44:52.403269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a2241321-9f22-4c2c-95c5-c89cee529402 req-76f1a533-a3d7-48f4-948f-010471d51580 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057969 Nov 06 21:44:52.403863 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4336/8561] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:44:52.470381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:52.479313 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4707673-100e-4537-b80f-4eaead3a6bcc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.257560 Nov 06 21:44:52.480801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4226/8562] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:52 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:53.498636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:53.499264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:53.505509 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:53.505971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:53.506753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:53.507198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:53.645255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:53.652564 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-91230abd-1026-471f-876b-6016155c5e56 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.159158 Nov 06 21:44:53.653265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4337/8563] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:53 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:54.670614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:54.671157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:54.678821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:54.679277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:54.680061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:54.680542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:54.810480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:54.818288 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b092aea-60ab-43ad-95af-c1701c06eb41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.151517 Nov 06 21:44:54.818869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4227/8564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:54 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:55.835439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:55.836060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:55.842957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:55.843424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:55.844211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:55.844680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:55.973479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:55.980623 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3807635-49c9-4514-81fa-9a3b9e84d00c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.149448 Nov 06 21:44:55.981193 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4338/8565] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:55 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:56.998464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:56.999083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:57.005899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:57.006362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:57.007152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:57.007594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:57.143789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:57.151867 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28f50784-961b-4aff-b429-47b8c1e4557f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.157325 Nov 06 21:44:57.152488 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4228/8566] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:56 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:58.169149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:58.169688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:58.177363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:58.177836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:58.178637 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:58.179098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:58.308036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:58.315310 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7cb89e29-523e-49ba-bff0-ace907e599bc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.150006 Nov 06 21:44:58.315879 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4339/8567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:58 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:44:58.622706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d5ededd5-d5ac-418a-a5bc-2f9fc9115b2e req-67e4bc6d-1afd-4f32-b570-51c7275216f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-plugged", "status": "completed", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:44:58.624636 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:44:58.624636 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:44:58.633520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d5ededd5-d5ac-418a-a5bc-2f9fc9115b2e req-67e4bc6d-1afd-4f32-b570-51c7275216f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:58.633991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d5ededd5-d5ac-418a-a5bc-2f9fc9115b2e req-67e4bc6d-1afd-4f32-b570-51c7275216f9 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:58.646270 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d5ededd5-d5ac-418a-a5bc-2f9fc9115b2e req-67e4bc6d-1afd-4f32-b570-51c7275216f9 service nova] Creating event network-vif-plugged:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:44:58.651227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d5ededd5-d5ac-418a-a5bc-2f9fc9115b2e req-67e4bc6d-1afd-4f32-b570-51c7275216f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Nov 06 21:44:58.651826 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4229/8568] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:44:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:44:59.332399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:44:59.333019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:44:59.339862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:59.340342 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:59.341139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:44:59.341591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:44:59.470604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:44:59.478447 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b15f444f-13b9-4c71-9a15-acca97857c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1363 microversion: 2.1 time: 0.149763 Nov 06 21:44:59.479030 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4340/8569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:44:59 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:45:00.498002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:45:00.498706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:00.505496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:00.505965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:00.506752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:00.507198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:00.641118 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:45:00.648605 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17ac7075-fb26-454c-aeef-f7a6e9e8ed7c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1551 microversion: 2.1 time: 0.155577 Nov 06 21:45:00.649179 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4230/8570] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:45:00 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:45:00.667041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:45:00.667584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:00.674577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:00.675043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:00.676394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:00.676879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:00.755571 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-36b1fdc7-ef58-4c0f-bcbb-21f0c3ccab08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092183 Nov 06 21:45:00.756179 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4341/8571] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:45:00 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:45:01.703490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:01.704464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:01.707053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-39c8b3e0-9ebd-499c-aa93-d4bce47adf86 req-cb0b9a61-9a24-49ef-a546-0b79d3b77dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:01.708837 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:45:01.708837 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:45:01.711208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:01.711668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:01.712489 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:01.713134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:01.716431 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39c8b3e0-9ebd-499c-aa93-d4bce47adf86 req-cb0b9a61-9a24-49ef-a546-0b79d3b77dcd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:01.717141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39c8b3e0-9ebd-499c-aa93-d4bce47adf86 req-cb0b9a61-9a24-49ef-a546-0b79d3b77dcd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:01.729409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-39c8b3e0-9ebd-499c-aa93-d4bce47adf86 req-cb0b9a61-9a24-49ef-a546-0b79d3b77dcd service nova] Creating event network-changed:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:45:01.742161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-39c8b3e0-9ebd-499c-aa93-d4bce47adf86 req-cb0b9a61-9a24-49ef-a546-0b79d3b77dcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039760 Nov 06 21:45:01.751366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9598152d-6902-489f-81d6-b938b9d27262 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.051733 Nov 06 21:45:01.752474 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4231/8572] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:01 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:01.755817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4342/8573] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:45:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:45:02.763349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:02.764430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:02.772233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:02.772789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:02.773580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:02.774026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:02.811277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54ec6a0d-5be2-441e-b6e4-5c2b8b06e35a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.052103 Nov 06 21:45:02.812140 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4232/8574] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:02 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:03.824957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:03.825968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:03.831893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:03.832402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:03.833195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:03.833668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:03.870755 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-674f0222-00fd-4189-9f69-9c5ada53df9f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.050607 Nov 06 21:45:03.874045 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4343/8575] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:03 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:04.882898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:04.883904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:04.891178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:04.891634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:04.892443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:04.892888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:04.929361 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d37a3e38-a688-4d70-b738-87bab6767aa9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.050972 Nov 06 21:45:04.929965 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4233/8576] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:04 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:05.940737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:05.941752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:05.949020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:05.949488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:05.950279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:05.950730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:05.990453 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da5d9fbb-8b28-4608-ab6a-373e97b090b1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.053745 Nov 06 21:45:05.991059 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4344/8577] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:05 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:07.001782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:07.002820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:07.010137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:07.010571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:07.011347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:07.011779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:07.055786 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db7be684-1827-40b3-8bae-49c39fe83f81 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.057907 Nov 06 21:45:07.056898 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4234/8578] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:06 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:08.068223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:08.069273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:08.076563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:08.077030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:08.077813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:08.078256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:08.115322 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c7303c2-7435-4176-9ad5-8af15e7c3bab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.051713 Nov 06 21:45:08.115961 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4345/8579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:08 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:09.126898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:09.127902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:09.135262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:09.135712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:09.136527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:09.136993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:09.173312 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db45f0e4-3144-4524-8ae7-b704279ecd74 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.050587 Nov 06 21:45:09.174196 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4235/8580] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:09 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:10.184834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:10.185848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:10.193114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:10.193578 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:10.194363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:10.194815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:10.230890 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8efe5f35-8eef-4900-b76c-a48965a87777 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.049987 Nov 06 21:45:10.231500 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4346/8581] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:10 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:11.242969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:11.243903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:11.251549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:11.252010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:11.252858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:11.253303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:11.288865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ee54dffd-e470-48d5-ad74-4082461d8b2d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 14 microversion: 2.1 time: 0.050456 Nov 06 21:45:11.289481 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4236/8582] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:11 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:45:12.299833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:12.300767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:12.308798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:12.309263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:12.310058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:12.310507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:12.357817 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-42251c9a-c93a-4109-b90c-bf0df9bf0bd8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 8205 microversion: 2.1 time: 0.062290 Nov 06 21:45:12.358464 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4347/8583] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:12 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 8205 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:45:13.369903 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:13.370907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:13.378173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:13.379212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:13.379988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:13.380456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:13.429406 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75fc732b-7048-40d3-89f2-dab35729c983 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 16394 microversion: 2.1 time: 0.063419 Nov 06 21:45:13.430044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4237/8584] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:13 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 16394 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:14.441222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:14.442247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:14.449552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:14.450024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:14.450819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:14.451272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:14.494556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dab0ffd7-e692-442c-b38c-e972bf692101 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 16394 microversion: 2.1 time: 0.057299 Nov 06 21:45:14.495408 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4348/8585] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:14 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 16394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:15.507205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:15.508225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:15.515618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:15.516075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:15.516892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:15.517336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:15.555497 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d29ce894-4827-4db9-b20b-b1607432d4d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 16394 microversion: 2.1 time: 0.052989 Nov 06 21:45:15.556120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4238/8586] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:15 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 16394 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:16.567399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:16.568941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:16.576171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:16.576653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:16.577447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:16.577889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:16.616138 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a132678-dec0-4f1e-a36e-bd835033dd15 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 16394 microversion: 2.1 time: 0.052641 Nov 06 21:45:16.616933 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4349/8587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:16 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:17.627735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:17.628724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:17.635986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:17.636490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:17.637278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:17.637726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:17.676754 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35c6ecc2-3a51-446a-8805-f8eb17e06ce7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 16394 microversion: 2.1 time: 0.052920 Nov 06 21:45:17.677899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4239/8588] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:17 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 16394 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:18.689391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:18.690452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:18.697974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:18.698439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:18.699223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:18.699667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:18.750940 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e0e00f6-da7b-4cb6-8a09-18380feefcdb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.065490 Nov 06 21:45:18.751791 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4350/8589] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:18 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:19.763173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:19.764129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:19.772087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:19.772580 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:19.773365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:19.773805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:19.816448 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ccf4abc1-2223-4b62-a146-947bcf89ebd9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.057371 Nov 06 21:45:19.817098 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4240/8590] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:19 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:20.829041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:20.830075 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:20.837824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:20.838279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:20.839059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:20.839599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:20.883012 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b09ca83-9845-4709-9218-1cec349d0f69 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.057929 Nov 06 21:45:20.883664 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4351/8591] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:20 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:21.895014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:21.896016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:21.903283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:21.903737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:21.904546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:21.904979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:21.944404 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48ea2ad9-fe5b-48df-8554-6d370da7e473 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053312 Nov 06 21:45:21.945032 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4241/8592] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:21 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:22.955812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:22.956865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:22.963901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:22.964398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:22.965203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:22.965662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:23.004388 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e708cb36-f893-4e59-a010-608ea2efc0d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052711 Nov 06 21:45:23.005023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4352/8593] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:22 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:45:24.018679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:24.019678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:24.027657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:24.028112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:24.028926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:24.029436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:24.070054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c907eb78-bc37-4f7d-850e-2770646c9b35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055315 Nov 06 21:45:24.070685 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4242/8594] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:24 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:25.082375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:25.083436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:25.090671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:25.091137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:25.091930 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:25.092427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:25.130679 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3c37def1-37b0-49cd-b7bb-8891eb9988d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052093 Nov 06 21:45:25.131218 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4353/8595] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:25 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:26.142929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:26.143864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:26.151299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:26.151762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:26.152578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:26.153024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:26.194310 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e39e86c0-e61a-457a-bc73-6784dce7a099 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055402 Nov 06 21:45:26.194974 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4243/8596] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:26 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:27.206406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:27.207329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:27.215312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:27.215768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:27.216586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:27.217033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:27.256431 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-87f08c80-ffc6-4967-b94e-75db37ed1c59 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.054059 Nov 06 21:45:27.257054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4354/8597] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:27 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:28.268537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:28.269473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:28.277438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:28.277897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:28.278686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:28.279123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:28.317200 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e766f8fb-45be-4bf1-bb17-2997f45a68da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052735 Nov 06 21:45:28.317853 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4244/8598] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:28 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:29.329364 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:29.330389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:29.337669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:29.338139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:29.338933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:29.339384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:29.379212 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5a29f7b0-3a65-46d6-96a1-a5189dc76b1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053825 Nov 06 21:45:29.379981 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4355/8599] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:29 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:30.391160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:30.392196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:30.400013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:30.400497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:30.401278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:30.401714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:30.443117 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9eb55bb0-2b22-45b6-b57a-7ea6bfb2164c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055876 Nov 06 21:45:30.444423 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4245/8600] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:30 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:31.455654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:31.456691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:31.464497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:31.464945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:31.465726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:31.466169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:31.506678 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2f2c67cc-ad28-45ec-b77b-414541cac46c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055055 Nov 06 21:45:31.507857 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4356/8601] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:31 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:32.519293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:32.520336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:32.527731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:32.528194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:32.529013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:32.529458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:32.571954 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f695825e-713f-4b73-ab9d-3593bd06a9d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.056633 Nov 06 21:45:32.572647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4246/8602] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:32 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:33.584023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:33.585116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:33.592613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:33.593067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:33.593859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:33.594305 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:33.631413 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc418318-df88-46b2-870b-9e409ff796b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.051286 Nov 06 21:45:33.632602 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4357/8603] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:33 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:34.643567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:34.644611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:34.652146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:34.652628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:34.653413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:34.653853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:34.692215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b95891e1-3940-4d6c-bf57-cc5b79a79e8c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052591 Nov 06 21:45:34.692877 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4247/8604] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:34 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:35.704600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:35.705539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:35.712830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:35.713306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:35.714098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:35.714545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:35.751306 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-154bcd7d-6bbe-4432-a560-2998f6f2b0ac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.050768 Nov 06 21:45:35.751930 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4358/8605] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:35 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:36.763942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:36.764977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:36.772204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:36.772728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:36.773621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:36.774066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:36.813313 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09c421b4-d5ca-4ae8-8540-42a7f4870fcb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053323 Nov 06 21:45:36.813947 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4248/8606] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:36 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:37.825842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:37.826901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:37.834198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:37.834665 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:37.836029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:37.836520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:37.875449 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf43fc81-fa2c-45a4-a5f5-5b2822f4b196 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053515 Nov 06 21:45:37.876334 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4359/8607] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:37 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:38.888318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:38.889328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:38.896524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:38.896980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:38.897810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:38.898243 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:38.936509 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79e35f95-a078-4bd2-a0c7-10fd9ca57b2f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052110 Nov 06 21:45:38.937353 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4249/8608] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:38 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:39.949194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:39.950211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:39.957517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:39.957984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:39.958804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:39.959256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:39.997908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ccfa5e26-9191-4cef-b577-ed25e052da4d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052505 Nov 06 21:45:39.998585 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4360/8609] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:39 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:41.009176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:41.010183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:41.017448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:41.017901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:41.018676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:41.019117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:41.057891 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b07134b-5d23-44b3-b86a-2c622a7974ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052706 Nov 06 21:45:41.058513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4250/8610] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:41 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:42.070194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:42.071207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:42.078416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:42.078875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:42.079658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:42.080103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:42.120120 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-500ad2ff-f652-421e-b507-e3f90ea24bf4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053923 Nov 06 21:45:42.120780 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4361/8611] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:42 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:43.132236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:43.133189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:43.140503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:43.140965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:43.141746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:43.142189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:43.181999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-368f7528-6dca-487b-b48f-e0259415e0a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.054429 Nov 06 21:45:43.182627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4251/8612] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:43 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:44.194538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:44.195565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:44.202831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:44.203295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:44.204091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:44.204570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:44.245442 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57f456fb-b3ca-41d4-b41b-d42b9a6c6d38 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055405 Nov 06 21:45:44.246401 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4362/8613] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:44 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:45.258061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:45.258991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:45.266270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:45.266722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:45.267500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:45.267935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:45.310810 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-626e1d3a-107e-4597-b9ab-f4d353866dfd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.057313 Nov 06 21:45:45.311452 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4252/8614] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:45 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:46.322811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:46.323823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:46.331090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:46.331546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:46.332350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:46.332795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:46.374084 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-739e5944-4969-4984-8266-37b5ea9fd906 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055111 Nov 06 21:45:46.374705 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4363/8615] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:46 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:47.386549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:47.387566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:47.394940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:47.395397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:47.396187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:47.396658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:47.436054 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-08da040f-1351-4b23-a81c-007692005430 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053458 Nov 06 21:45:47.436727 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4253/8616] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:47 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:48.447502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:48.448565 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:48.455800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:48.456267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:48.457095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:48.457545 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:48.497349 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21e759c2-b0a1-404f-87c0-4eb545deb2d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053844 Nov 06 21:45:48.497966 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4364/8617] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:48 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:45:49.510055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:49.511099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:49.518367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:49.518819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:49.519595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:49.520032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:49.563375 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ca708b1-1c3b-4ec3-aa3f-de053acc0181 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.057982 Nov 06 21:45:49.564021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4254/8618] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:49 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:50.576052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:50.577114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:50.585044 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:50.585513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:50.586344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:50.586793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:50.628222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ca657f1a-ba67-40c1-a491-e1c1d000dcd4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.056216 Nov 06 21:45:50.628887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4365/8619] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:50 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:51.641103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:51.642026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:51.651727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:51.652179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:51.652983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:51.653450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:51.692197 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b35e9901-0477-44c6-b4ca-7f50a68a4f37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055120 Nov 06 21:45:51.692876 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4255/8620] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:51 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:52.704272 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:52.705324 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:52.714704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:52.715171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:52.715968 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:52.716453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:52.756351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23f39073-9ef6-47a3-8563-db45eb5c6cc8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.056093 Nov 06 21:45:52.757012 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4366/8621] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:52 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:53.768330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:53.769273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:53.776660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:53.777115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:53.777893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:53.778328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:53.816983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8ab89344-a3e6-4801-87f1-96cf1474545f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052749 Nov 06 21:45:53.817618 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4256/8622] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:53 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:54.829862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:54.830897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:54.838211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:54.838673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:54.839462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:54.839906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:54.882498 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e6f1b13-807c-4e6f-8fcb-8945f7707758 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.056555 Nov 06 21:45:54.883137 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4367/8623] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:54 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:55.894472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:55.895536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:55.902835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:55.903284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:55.904057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:55.904531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:55.942384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-210e2ad5-df41-4856-afe9-0093f764f19b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.051884 Nov 06 21:45:55.943001 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4257/8624] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:55 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:56.955007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:56.956023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:56.964016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:56.964518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:56.965320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:56.965773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:57.007064 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0a94988-95ed-4bb1-84d7-beb08e5db040 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.055455 Nov 06 21:45:57.007709 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4368/8625] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:56 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:58.019297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:58.020335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:58.027752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:58.028223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:58.029039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:58.029487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:58.076876 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf690768-a93b-475e-9cb0-91ee2f1d225c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.061507 Nov 06 21:45:58.077531 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4258/8626] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:58 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:45:59.089130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:45:59.090143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:45:59.097729 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:59.098194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:59.098990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:45:59.099433 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:45:59.137950 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a56659c8-edad-4b75-b393-4323d9450668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.052909 Nov 06 21:45:59.138512 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4369/8627] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:45:59 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:00.150011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:00.150978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:00.158274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:00.158744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:00.159562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:00.160007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:00.199158 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a0c35b2-ee9c-4e32-abc8-588e8a1091be tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053831 Nov 06 21:46:00.199804 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4259/8628] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:00 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:01.211401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:01.212356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:01.219537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:01.220014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:01.220830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:01.221275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:01.260908 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da8d6849-0d39-491b-a46a-149eb76cf160 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.053596 Nov 06 21:46:01.261535 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4370/8629] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:01 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:02.274287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:02.275283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:02.282658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:02.283123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:02.283920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:02.284393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:02.337693 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0a726e9-fcab-4ac4-84cf-b5f5e47717b6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.068150 Nov 06 21:46:02.338328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4260/8630] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:02 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:03.349031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:03.350530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:03.357778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:03.358242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:03.359031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:03.359476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:03.402081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0909d13-58bb-4012-949a-32cbe9c6059e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056970 Nov 06 21:46:03.402712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4371/8631] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:03 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:04.413935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:04.414953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:04.422384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:04.422844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:04.423628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:04.424348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:04.467548 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6cadb11-2906-4870-a0c9-04f30e00c5d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057539 Nov 06 21:46:04.468183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4261/8632] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:04 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:05.479909 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:05.481001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:05.488163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:05.488645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:05.489444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:05.489888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:05.528715 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a0eb98e-7d14-4fc7-8dac-c0d18c5bb8de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052773 Nov 06 21:46:05.529337 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4372/8633] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:05 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:06.541784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:06.542791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:06.550691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:06.551181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:06.551971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:06.552439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:06.590889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e24c366b-00d1-413b-a9b4-1ce53338922f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053748 Nov 06 21:46:06.591575 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4262/8634] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:06 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:46:07.603587 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:07.604629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:07.611806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:07.612263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:07.613070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:07.613514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:07.652241 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7542f146-7c14-4f0f-be75-ae7dda527e93 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053083 Nov 06 21:46:07.652820 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4373/8635] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:07 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:08.664425 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:08.665444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:08.672433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:08.672918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:08.673711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:08.674452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:08.714871 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f6766612-3c8d-4a4d-a7c9-c1a5c2afcada tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054699 Nov 06 21:46:08.715511 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4263/8636] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:08 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:09.727806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:09.728782 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:09.736072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:09.736573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:09.737372 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:09.737823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:09.785009 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e07bac6-f25b-4b7d-b7ce-c3b695b82e33 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.061762 Nov 06 21:46:09.785654 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4374/8637] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:09 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:10.797385 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:10.798395 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:10.805923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:10.806375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:10.807149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:10.807589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:10.849309 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-21d47b16-2122-4d8d-90b2-a6f775e93cb8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055926 Nov 06 21:46:10.850009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4264/8638] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:10 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:46:11.861952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:11.862979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:11.870331 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:11.870799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:11.871606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:11.872057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:11.911835 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa7a0b1e-54e0-4b61-9992-575964a02338 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053826 Nov 06 21:46:11.913038 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4375/8639] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:11 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:12.924712 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:12.925655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:12.933236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:12.933686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:12.934459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:12.934892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:12.974073 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-19910dfd-9813-41a0-9cba-bdd71741faf9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053663 Nov 06 21:46:12.975183 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4265/8640] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:12 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:13.986279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:13.987462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:13.995614 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:13.996078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:13.996936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:13.997384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:14.048536 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c8c026db-9242-4db0-b480-741ada6e6483 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.066211 Nov 06 21:46:14.049420 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4376/8641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:13 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:15.061623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:15.062626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:15.070362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:15.070820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:15.071593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:15.072038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:15.111777 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5d38461e-a22f-47b5-aaf7-e41e17bb017a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054101 Nov 06 21:46:15.112455 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4266/8642] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:15 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:16.123841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:16.124885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:16.132111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:16.132606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:16.133400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:16.133842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:16.173151 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c4251a2-e725-466b-b23a-06f95e67accd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053333 Nov 06 21:46:16.173830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4377/8643] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:16 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:17.185765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:17.186774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:17.194622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:17.195075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:17.195856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:17.196312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:17.236926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf5aeb40-5a42-4873-8058-e2c57bc68892 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055126 Nov 06 21:46:17.238193 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4267/8644] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:17 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:18.250640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:18.251586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:18.259536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:18.260004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:18.260841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:18.261575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:18.301222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2b95123a-cbe3-4678-a3aa-933a1023f280 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054585 Nov 06 21:46:18.301881 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4378/8645] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:18 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:19.313613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:19.314545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:19.321971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:19.322439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:19.323230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:19.323673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:19.370344 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-98572075-ce28-4aa8-a469-31fbe4b82ad5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.060814 Nov 06 21:46:19.370990 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4268/8646] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:19 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:20.382716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:20.383736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:20.391054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:20.391514 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:20.392322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:20.392779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:20.432497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5cd79687-1d45-4334-9971-dbfd90875bf6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053765 Nov 06 21:46:20.433120 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4379/8647] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:20 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:21.445355 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:21.446587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:21.453553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:21.454005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:21.454779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:21.455214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:21.495115 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d772d6c3-2f05-468e-b81c-721f7e509dc7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054334 Nov 06 21:46:21.495755 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4269/8648] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:21 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:22.508151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:22.509195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:22.516131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:22.516631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:22.517428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:22.517874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:22.559658 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf5f636e-2012-4ed3-9998-b0f2f111a27b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056173 Nov 06 21:46:22.560340 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4380/8649] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:22 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:23.571888 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:23.572947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:23.580245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:23.580736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:23.581559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:23.582003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:23.624656 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-198b131b-209f-4988-9931-2d2ce702e93c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057294 Nov 06 21:46:23.625314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4270/8650] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:23 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:24.637253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:24.638295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:24.645700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:24.646161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:24.647448 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:24.647888 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:24.688567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dffd2bc8-5123-4a0b-9874-5256d9edf047 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055325 Nov 06 21:46:24.689206 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4381/8651] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:24 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:25.701516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:25.702440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:25.709621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:25.710635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:25.711418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:25.711855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:25.751145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54259928-b488-465a-a1b5-9381d7cd1c00 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053720 Nov 06 21:46:25.751785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4271/8652] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:25 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:26.763409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:26.764487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:26.771916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:26.772634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:26.773627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:26.774240 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:26.814973 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-008b80b8-622a-4353-8d05-cb34809dc89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055503 Nov 06 21:46:26.815726 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4382/8653] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:26 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:27.826727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:27.827748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:27.835788 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:27.836255 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:27.837071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:27.837524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:27.878857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0607c450-d8b1-4da9-8884-1a3089a6a3de tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055844 Nov 06 21:46:27.879238 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4272/8654] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:27 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:28.451465 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:46:28.451710 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:46:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:46:28.891235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:28.892248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:28.902198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:28.902657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:28.903441 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:28.903886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:28.943368 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b6f3695-6ba4-4500-a6c5-de5153dd9b6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056084 Nov 06 21:46:28.943993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4383/8655] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:28 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:29.955642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:29.956676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:29.963851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:29.964320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:29.965093 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:29.965530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:30.003652 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70274180-58b2-47b1-8964-bba7cbfd3111 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.051947 Nov 06 21:46:30.004334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4273/8656] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:29 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:31.016977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:31.018184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:31.026041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:31.026508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:31.027296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:31.027742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:31.069379 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15473d23-efbf-4605-819f-80cdf8d1efac tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057189 Nov 06 21:46:31.070019 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4384/8657] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:31 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:32.086886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:32.086886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:32.096088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:32.096785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:32.097884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:32.098511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:32.153333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5300c6a4-e3ba-4e62-bb79-671df52a0acd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.075454 Nov 06 21:46:32.153895 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4274/8658] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:32 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:33.166015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:33.167001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:33.174546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:33.175018 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:33.175817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:33.176268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:33.215468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3faf7cef-d568-4fea-8406-0edb4f7441c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054009 Nov 06 21:46:33.216103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4385/8659] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:33 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:34.229322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:34.230397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:34.238588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:34.239141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:34.241202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:34.241652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:34.282657 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bfbbe361-2105-47a4-9eff-175f8ceceb1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057314 Nov 06 21:46:34.283301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4275/8660] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:34 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:35.296322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:35.297255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:35.305310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:35.305777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:35.306576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:35.307022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:35.351464 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0991f2e0-445d-4df8-9096-36e27c92f176 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.059846 Nov 06 21:46:35.352129 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4386/8661] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:35 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:36.363559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:36.364602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:36.373197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:36.373655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:36.374453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:36.374898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:36.418290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-984222a3-3cc3-4d37-b723-6fe995808cf0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.058679 Nov 06 21:46:36.419227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4276/8662] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:36 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:37.430941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:37.431957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:37.439264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:37.439730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:37.440585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:37.441034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:37.479327 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84467935-8fe7-42ba-89a4-8331b3e77161 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052504 Nov 06 21:46:37.480214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4387/8663] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:37 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:38.492379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:38.493418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:38.500351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:38.500810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:38.501595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:38.502036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:38.541987 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8f8efd80-ca55-4646-8903-b2b73d387a3d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054424 Nov 06 21:46:38.542640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4277/8664] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:38 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:46:39.555143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:39.556161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:39.563435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:39.563900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:39.564724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:39.565172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:39.602703 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-64c19e05-1756-4530-b8b8-874fc6622842 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052057 Nov 06 21:46:39.603328 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4388/8665] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:39 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:40.614678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:40.615690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:40.623052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:40.623504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:40.624277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:40.624736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:40.662974 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c329667-e4a6-45a6-9022-458f9100dcb7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052236 Nov 06 21:46:40.663596 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4278/8666] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:40 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:41.675593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:41.676581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:41.683795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:41.684261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:41.685087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:41.685539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:41.723916 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-085b6537-bfa3-460d-b10a-9c4c991a2b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052672 Nov 06 21:46:41.724577 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4389/8667] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:41 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:42.736938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:42.737983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:42.745769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:42.746235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:42.747029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:42.747474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:42.787034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1765497f-f376-434a-92f6-84b7b8c28292 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054237 Nov 06 21:46:42.788154 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4279/8668] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:42 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:43.800162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:43.801117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:43.808438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:43.808900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:43.809681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:43.810129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:43.848714 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-914dd0b7-656c-4c58-9eea-988baacb31eb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052934 Nov 06 21:46:43.849722 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4390/8669] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:43 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:44.860589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:44.861601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:44.869011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:44.869468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:44.870321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:44.870764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:44.913349 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60d576cf-a757-4534-b153-11322ef5dd9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056077 Nov 06 21:46:44.913981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4280/8670] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:44 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:45.925890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:45.926923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:45.934860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:45.935333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:45.936126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:45.936620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:45.975404 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-11bb358c-8f1f-428d-9d74-d649abf1c2b7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053289 Nov 06 21:46:45.976031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4391/8671] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:45 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:46.987517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:46.988544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:46.996273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:46.996779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:46.997557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:46.997993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:47.036411 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-48aaf8b4-cf90-48ef-94d9-644fd69f5ad9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052859 Nov 06 21:46:47.037047 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4281/8672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:46 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:48.048806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:48.050090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:48.057495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:48.057958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:48.058746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:48.059192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:48.101450 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a07a081-e8fd-49c6-9949-245f9d48e49e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056803 Nov 06 21:46:48.102326 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4392/8673] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:48 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:49.113470 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:49.114481 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:49.122352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:49.122808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:49.123585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:49.124020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:49.166116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60d42f90-2ba6-436f-bc14-496d5d1542ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056652 Nov 06 21:46:49.166688 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4282/8674] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:49 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:50.179358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:50.180354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:50.187778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:50.188258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:50.189092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:50.189547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:50.229044 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee05f42d-a0ea-4c10-9c6b-53a6d3fc7e84 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054492 Nov 06 21:46:50.229670 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4393/8675] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:50 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:51.169447 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:46:51.169705 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:46:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:46:51.241318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:51.242358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:51.249732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:51.250193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:51.250980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:51.251419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:51.296549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-79e258d1-3f50-49d4-b072-3666d698e3ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.059078 Nov 06 21:46:51.297196 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4283/8676] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:51 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:52.310193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:52.311173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:52.318381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:52.318849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:52.319652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:52.320108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:52.358050 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2364f44e-09f5-46e6-bec3-fd1a3acbd7f8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052676 Nov 06 21:46:52.358961 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4394/8677] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:52 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:46:53.370914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:53.371926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:53.379231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:53.379721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:53.380589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:53.382962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:53.427814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e56febc8-833b-41b8-902b-4e0bbdc2e7f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.060921 Nov 06 21:46:53.428476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4284/8678] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:53 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:54.439569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:54.440619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:54.447833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:54.448374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:54.449167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:54.449617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:54.488496 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e7a72491-5a53-4770-aeec-fc73621b4b67 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052886 Nov 06 21:46:54.489374 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4395/8679] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:54 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:55.500785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:55.501796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:55.509363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:55.509813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:55.510584 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:55.511019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:55.550475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3c5c696b-6fc3-4e09-98e3-431e63e96482 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053751 Nov 06 21:46:55.551104 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4285/8680] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:55 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:56.563404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:56.564449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:56.572147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:56.572638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:56.573426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:56.573871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:56.613199 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-97beba90-b8fe-4c56-b4dc-e8a40b80b082 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053786 Nov 06 21:46:56.614076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4396/8681] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:56 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:57.625919 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:57.626961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:57.634898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:57.635356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:57.636168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:57.636639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:57.675939 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd21946c-c138-4a27-bc37-c7f8e068c8f7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053929 Nov 06 21:46:57.676538 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4286/8682] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:57 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:58.688981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:58.690050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:58.697290 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:58.697752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:58.698540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:58.698987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:58.737606 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b62099db-c73c-4455-87c8-623240a2beec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052576 Nov 06 21:46:58.738238 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4397/8683] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:58 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:46:59.750328 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:46:59.751258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:46:59.759199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:59.759659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:59.760459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:46:59.760897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:46:59.798692 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e58c6cac-1ffa-44c6-8da9-6e47a112c949 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052407 Nov 06 21:46:59.799576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4287/8684] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:46:59 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:00.811525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:00.812577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:00.820273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:00.820765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:00.821556 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:00.822007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:00.863402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ee23f63-246c-40c2-88ac-d5a27f4c347c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055803 Nov 06 21:47:00.864285 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4398/8685] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:00 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:01.875600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:01.876680 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:01.884147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:01.884624 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:01.885398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:01.885836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:01.928582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-128fc032-8c8c-4c2c-9b9f-70ee2674f568 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057016 Nov 06 21:47:01.929292 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4288/8686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:01 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:02.940797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:02.941821 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:02.949205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:02.949675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:02.950471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:02.950922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:02.989130 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9610cbeb-7a28-4cfe-ba60-959e23e8e112 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052307 Nov 06 21:47:02.989791 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4399/8687] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:02 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:04.001559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:04.002573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:04.010133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:04.010604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:04.011406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:04.011858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:04.052999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ac0e261-49d8-4d80-a62b-2446332ab285 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054816 Nov 06 21:47:04.053648 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4289/8688] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:03 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:05.065518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:05.066544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:05.074964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:05.075456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:05.076247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:05.076730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:05.114243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49eda724-1ab9-4875-ab50-578038d0f0c3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052724 Nov 06 21:47:05.115370 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4400/8689] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:05 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:06.126814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:06.127907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:06.135555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:06.136017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:06.136843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:06.137283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:06.176240 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f1cfe2b-cfc4-4215-9e4e-5a87d017ae66 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053330 Nov 06 21:47:06.176903 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4290/8690] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:06 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:07.189238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:07.190160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:07.197399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:07.197863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:07.198648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:07.199095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:07.238358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a48955a-a439-432b-871d-0913c616732f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053123 Nov 06 21:47:07.239059 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4401/8691] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:07 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:08.251151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:08.252076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:08.259257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:08.259711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:08.260516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:08.260956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:08.300713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-13e3d682-e8ec-4271-8dd5-61fd58e49005 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053876 Nov 06 21:47:08.301338 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4291/8692] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:08 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:09.312948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:09.313879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:09.321580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:09.322041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:09.322824 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:09.323274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:09.361821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e40fdc8-9143-40e6-9be8-eb599221825f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052948 Nov 06 21:47:09.362698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4402/8693] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:09 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:10.374231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:10.375236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:10.383892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:10.384309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:10.385092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:10.385529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:10.425830 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3bc63ba-434d-4bde-b883-313b3642a4da tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055565 Nov 06 21:47:10.426460 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4292/8694] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:10 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:11.438139 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:11.439200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:11.446410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:11.446875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:11.447667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:11.448117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:11.496061 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c04c86dc-1128-4ad6-8ce7-0ba41b32f0f4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.061838 Nov 06 21:47:11.496708 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4403/8695] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:11 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:12.508897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:12.509904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:12.517072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:12.517525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:12.518297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:12.518730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:12.557130 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dbf97efc-76db-4cc9-8fef-84501ed4d000 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.052798 Nov 06 21:47:12.557746 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4293/8696] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:12 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:13.570077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:13.571117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:13.578303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:13.578772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:13.579549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:13.579991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:13.622291 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3876ba23-b504-41b2-96f5-e8a5c4888139 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056593 Nov 06 21:47:13.622964 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4404/8697] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:13 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:14.635068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:14.635637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:14.642881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:14.643347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:14.644146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:14.644615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:14.689848 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e0a65f10-86f7-4484-beca-33503f76618d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.059747 Nov 06 21:47:14.690495 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4294/8698] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:14 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:15.702256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:15.703270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:15.710487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:15.710987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:15.711777 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:15.712229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:15.751330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6cd40a4f-c561-4f04-bc0f-d5cd78db5244 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053099 Nov 06 21:47:15.751977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4405/8699] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:15 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:47:16.763735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:16.764802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:16.772721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:16.773183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:16.773964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:16.774406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:16.814620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-11dad582-27fe-4022-8a12-284f9a001e96 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.054964 Nov 06 21:47:16.815256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4295/8700] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:16 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:17.827458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:17.828523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:17.836241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:17.836727 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:17.837512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:17.837957 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:17.877493 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2a59570-af2f-42d1-bf20-35bfe287198f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053947 Nov 06 21:47:17.878257 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4406/8701] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:17 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:18.889841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:18.890804 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:18.898091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:18.898553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:18.899344 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:18.899790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:18.941862 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84e2283d-73bd-4ae3-9e30-eadc51b1b91e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.056060 Nov 06 21:47:18.942540 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4296/8702] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:18 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:19.954429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:19.955430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:19.962656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:19.963116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:19.963898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:19.964370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:20.007880 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-250184ca-1443-4625-aa2e-bd6281d90467 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057426 Nov 06 21:47:20.008595 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4407/8703] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:19 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:21.019803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:21.020920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:21.028677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:21.029134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:21.029913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:21.030351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:21.069592 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7e2b27cf-8e13-4c20-981b-9c80c87d4583 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053711 Nov 06 21:47:21.070241 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4297/8704] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:21 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:22.082201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:22.083246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:22.090767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:22.091228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:22.092012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:22.092485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:22.131500 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f28c6a87-9c91-412e-8802-cf85465f1376 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053201 Nov 06 21:47:22.132044 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4408/8705] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:22 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:23.143656 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:23.144615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:23.151778 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:23.152233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:23.153104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:23.153545 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:23.193447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-83fd7aff-2edc-4247-9e61-a8b25ec28a98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053257 Nov 06 21:47:23.194081 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4298/8706] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:23 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:24.205675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:24.206605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:24.214524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:24.214982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:24.215767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:24.216211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:24.254749 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b7eaad0-a35a-4ee7-8c53-07a2cdd5a423 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.053013 Nov 06 21:47:24.255906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4409/8707] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:24 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:25.268082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:25.269025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:25.277117 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:25.277614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:25.278400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:25.278837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:25.321253 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb014637-a786-4d00-907d-e4d8cca5b640 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057362 Nov 06 21:47:25.321887 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4299/8708] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:25 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:26.334065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:26.335113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:26.342293 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:26.342755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:26.343535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:26.343980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:26.385257 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea83c30f-4fd0-452f-9fc4-f64a981b7e36 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.055733 Nov 06 21:47:26.385914 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4410/8709] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:26 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:27.398059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:27.399064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:27.406281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:27.406736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:27.407513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:27.407950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:27.451474 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-24d8cbba-4f12-4453-96ca-904773451b29 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 32643 microversion: 2.1 time: 0.057899 Nov 06 21:47:27.452114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4300/8710] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:27 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 32643 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:28.463735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:28.464772 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:28.471917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.472405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.473198 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.473641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.543402 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-162f9224-0e9b-42b4-8b9d-bea2a578c5fd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 200 len: 40788 microversion: 2.1 time: 0.083600 Nov 06 21:47:28.544031 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4411/8711] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:28 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 40788 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:47:28.555705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:28.556789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:28.564143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.564657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.565446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.565894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.704546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:28.711120 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:47:28.717302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:47:28.717676 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:47:28.718157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:47:28.718565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:47:28.718984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:47:28.783136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-60d2ae7e-3776-4a4f-9e75-b82b23569f1b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 202 len: 0 microversion: 2.1 time: 0.231806 Nov 06 21:47:28.783751 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4301/8712] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:28 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:47:28.793215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:28.794022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:28.802591 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.803066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.803871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:28.804343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:28.980866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:28.989173 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-45e12867-5b4d-4ef6-b566-b048bfe06bc2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1679 microversion: 2.1 time: 0.200448 Nov 06 21:47:28.989889 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4412/8713] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:28 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:47:30.008221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:30.008841 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:30.015667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:30.016123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:30.016956 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:30.017386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:30.236251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:30.244274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eeb2c4e8-1c04-45cb-847b-8b84d6bbea47 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1679 microversion: 2.1 time: 0.242056 Nov 06 21:47:30.244893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4302/8714] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:30 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:31.261906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:31.262438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:31.269108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:31.269570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:31.270357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:31.270803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:31.400990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:31.408232 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5d152077-79e3-4ee5-b542-37875a395532 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.150118 Nov 06 21:47:31.408824 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4413/8715] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:31 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:32.425697 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:32.426305 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:32.433045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:32.433496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:32.434269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:32.434704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:32.563439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:32.571234 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1dd0ed11-c69f-4d6c-b8fb-deb1535eb6f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.149545 Nov 06 21:47:32.571810 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4303/8716] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:32 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:33.588547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:33.589199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:33.595852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:33.596374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:33.597163 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:33.597609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:33.731247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:33.738538 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-288da02b-079f-4823-bccf-89c8d48714a3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.153706 Nov 06 21:47:33.739113 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4414/8717] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:33 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:34.755363 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:34.755998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:34.762666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:34.763113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:34.763890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:34.764353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:34.895257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:34.902918 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b29bfd39-38b8-4763-82c3-48e9691f8107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.151216 Nov 06 21:47:34.903490 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4304/8718] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:34 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:35.919692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:35.920360 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:35.927771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:35.928269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:35.929085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:35.929536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:36.062707 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:36.070083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9269f375-fb8c-4a9b-a0ac-2c63f3c17747 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.154102 Nov 06 21:47:36.070684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4415/8719] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:35 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:37.087535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:37.088142 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:37.094772 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:37.095226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:37.096000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:37.096465 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:37.231061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:37.240039 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c96e1f84-48ca-4323-858d-b588f16c5fc4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.156713 Nov 06 21:47:37.240788 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4305/8720] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:37 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:38.257780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:38.258317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:38.264916 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:38.265376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:38.266159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:38.266605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:38.397718 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:38.405018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-419ce1fd-e1c8-45df-afef-b6a3a1b878ae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.151497 Nov 06 21:47:38.405598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4416/8721] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:38 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:39.422031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:39.422669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:39.429326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:39.429780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:39.430562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:39.431001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:39.562795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:39.570069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7a9d460-3949-4b54-b083-a46cd7d96684 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.151742 Nov 06 21:47:39.570642 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4306/8722] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:39 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:40.586773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:40.587393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:40.594097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:40.594553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:40.595335 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:40.595815 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:40.725473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:40.732699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6c2a411-1962-4e1e-bcde-fa5784e679e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.149603 Nov 06 21:47:40.733266 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4417/8723] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:40 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:41.750670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:41.751282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:41.758693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:41.759154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:41.759972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:41.760451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:41.896083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:41.903513 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-90d8c397-2454-42bc-85b3-3dfd13d8714f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1684 microversion: 2.1 time: 0.156561 Nov 06 21:47:41.904088 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4307/8724] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:41 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:47:42.920482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:42.921108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:42.928304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:42.928789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:42.930201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:42.930743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:43.152268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:43.159895 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-22fea692-2c65-4c66-86c9-6c71a531d941 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1683 microversion: 2.1 time: 0.243065 Nov 06 21:47:43.160889 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4418/8725] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:42 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:43.439026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-unplugged", "status": "completed", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:43.441241 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:43.441241 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:47:43.450041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:43.450577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:43.462190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] Creating event network-vif-unplugged:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch2-master-1 Nov 06 21:47:43.467742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:47:43.478935 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-35cd6131-9191-46a5-b3c5-e45950ef5ace req-2a4705da-88ae-4217-880f-e6cb2d9ab690 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043794 Nov 06 21:47:43.479529 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4308/8726] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:47:44.177684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:44.178393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:44.185379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:44.185849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:44.186685 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:44.187171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:44.437279 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:44.445128 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fcb5a16-7bad-411f-9412-7a8e36f8e53b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1683 microversion: 2.1 time: 0.271383 Nov 06 21:47:44.445702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4419/8727] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:44 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:45.463813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:45.464569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:45.470885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:45.471342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:45.472125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:45.472598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:45.496802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:45.498447 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:45.498447 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:47:45.507278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:45.507838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:45.521362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] Creating event network-changed:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch2-master-1 Nov 06 21:47:45.527804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:47:45.539055 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-180bb115-5e16-433a-a0ff-953f9febe209 req-30c4c108-e88a-4a33-876e-c1cfafcc688f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047480 Nov 06 21:47:45.539684 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4420/8728] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:47:45.684600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:45.692057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0ca3a5a8-64d9-4a5c-b41a-4068af40a02f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1681 microversion: 2.1 time: 0.233138 Nov 06 21:47:45.704485 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4309/8729] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:45 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:46.714592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:46.715217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:46.721370 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:46.721838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:46.722627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:46.723077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:46.857249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:46.865204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f032bed4-05a7-44d3-8c7b-3bbeefa3c854 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1681 microversion: 2.1 time: 0.155588 Nov 06 21:47:46.865779 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4421/8730] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:46 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:47.883945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:47.884704 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:47.891329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:47.891784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:47.892607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:47.893051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.026359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:48.033736 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e8d2f390-e0a9-4576-8ae6-0c7906ea73e5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1678 microversion: 2.1 time: 0.153454 Nov 06 21:47:48.034313 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4310/8731] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:47 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:48.051026 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:48.052007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:48.059050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.059520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.060351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.060809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.095215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.095681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.096536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.096990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.118550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'ram', 'cores'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:47:48.123487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'ram', 'cores'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:47:48.227426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b3458ce-f79d-4585-933d-e6a7f0fdb567 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action" status: 202 len: 0 microversion: 2.1 time: 0.180472 Nov 06 21:47:48.228138 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4422/8732] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:47:48 2021] POST /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:47:48.236383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:48.236978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:48.243147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.243608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.244524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:48.244881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:48.778220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:48.786096 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4a9c6351-93ed-473d-9ef2-556876fc0603 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.553299 Nov 06 21:47:48.786667 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4311/8733] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:48 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:49.804917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:49.805544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:49.811706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:49.812162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:49.812974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:49.813418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:49.948554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:49.956277 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51c00e1f-2cb2-4031-a24c-6c31ab9724c0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.156171 Nov 06 21:47:49.956713 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4423/8734] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:49 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:50.083844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-plugged", "status": "completed", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:50.085431 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:50.085431 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:47:50.092409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:50.092870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:50.105056 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] Creating event network-vif-plugged:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch2-master-1 Nov 06 21:47:50.110291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:47:50.122295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c302df76-ca2f-4452-af76-89844f2b064d req-52be28e3-03c7-470d-a1ca-2c60400b3347 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091347 Nov 06 21:47:50.122950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4312/8735] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:47:50.973962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:50.974624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:50.981314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:50.981800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:50.982638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:50.983085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:51.125282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:51.133753 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d1da6a01-27a3-4775-b09d-8ff0d5f7a364 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.164149 Nov 06 21:47:51.134320 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4424/8736] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:50 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:47:51.635179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-unplugged", "status": "completed", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:51.636686 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:51.636686 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:47:51.645036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:51.645488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:51.658034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] Creating event network-vif-unplugged:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:47:51.663375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:47:51.674333 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a29d8377-9e0d-499c-bfd1-7cbd323d4bbf req-96ea8668-3b3e-4a98-a464-17da4de5e1f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044447 Nov 06 21:47:51.674950 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4313/8737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:47:52.151709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:52.153081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:52.159901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:52.160432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:52.161749 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:52.162295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:52.405570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:52.414028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8bf69361-51e7-40ff-956a-3f54f9f78b3a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.266177 Nov 06 21:47:52.414602 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4425/8738] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:52 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:53.432280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:53.433045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:53.439155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:53.439610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:53.440427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:53.440867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:53.574881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:53.582875 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf697966-b937-43aa-b8a5-e11dd65aba9c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.154963 Nov 06 21:47:53.583475 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4314/8739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:53 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:53.690767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:53.693447 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:53.693447 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:47:53.702148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:53.702604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:53.713760 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] Creating event network-changed:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:47:53.718897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:47:53.729242 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c89a9308-6c1f-4b67-9c70-9adb04febd04 req-e93c6e0b-56a1-452b-92d2-28e0ee469560 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042078 Nov 06 21:47:53.729826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4426/8740] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:47:54.600813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:54.601512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:54.608410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:54.608867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:54.609660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:54.610096 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:54.742910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:54.750287 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-baa96b79-fa5a-4eac-8867-933957e1112c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1677 microversion: 2.1 time: 0.154010 Nov 06 21:47:54.750856 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4315/8741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:54 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:55.768854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:55.769569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:55.775673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:55.776127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:55.776937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:55.777382 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:55.910952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:55.918357 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-261e7038-95a0-454f-8e0a-32a2cc1f835a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1670 microversion: 2.1 time: 0.154394 Nov 06 21:47:55.918932 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4427/8742] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:55 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:55.935148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:55.935757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:55.942781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:55.943245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:55.944043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:55.944528 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.076918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:56.084682 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-27afcecc-5c70-4545-858d-45880a355059 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1670 microversion: 2.1 time: 0.153172 Nov 06 21:47:56.085249 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4316/8743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:55 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:56.100920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:56.101540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:56.107204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.107661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.108482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.108927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.242118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:56.249408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7aa2bd00-b6d9-48c9-9cd3-99f3f110a3f0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1670 microversion: 2.1 time: 0.152857 Nov 06 21:47:56.249977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4428/8744] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:56 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:56.265830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:56.266340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:56.272820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.273288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.274079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.274529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.298240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:47:56.372242 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-73da3bfd-ca91-4b8c-9f60-28ac31fc71a2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 204 len: 0 microversion: 2.1 time: 0.109802 Nov 06 21:47:56.372937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4317/8745] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:47:56 2021] DELETE /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:47:56.381620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:56.382242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:56.388048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.388551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.389343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:56.389793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:56.524042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:56.531307 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-941a61e7-f1d7-4317-9209-f8981c25541f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1676 microversion: 2.1 time: 0.153936 Nov 06 21:47:56.531899 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4429/8746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:56 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:47:57.503928 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-45646c90-1a14-4b5d-88b0-3f9ce5a010f0 req-ddee4e3c-3edb-44c0-99a9-ec8fc9a8f1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-plugged", "status": "completed", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:57.505466 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:57.505466 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:47:57.513428 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-45646c90-1a14-4b5d-88b0-3f9ce5a010f0 req-ddee4e3c-3edb-44c0-99a9-ec8fc9a8f1bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:57.513955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-45646c90-1a14-4b5d-88b0-3f9ce5a010f0 req-ddee4e3c-3edb-44c0-99a9-ec8fc9a8f1bb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:57.525560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-45646c90-1a14-4b5d-88b0-3f9ce5a010f0 req-ddee4e3c-3edb-44c0-99a9-ec8fc9a8f1bb service nova] Creating event network-vif-plugged:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:47:57.530295 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-45646c90-1a14-4b5d-88b0-3f9ce5a010f0 req-ddee4e3c-3edb-44c0-99a9-ec8fc9a8f1bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030444 Nov 06 21:47:57.530872 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4318/8747] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:47:57.548215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:57.548866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:57.555666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:57.556131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:57.556960 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:57.557408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:57.694693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:57.702081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3799a66e-c813-49a0-abf8-a7e099df98bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1676 microversion: 2.1 time: 0.157481 Nov 06 21:47:57.702670 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4430/8748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:57 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:47:58.621303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-a9c0b837-f892-4450-bc58-1b80661d33a2 req-5fb59851-1912-45c3-b8a6-141b2276b326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc102d-e49d-4e5d-b95b-785a6ce1f7f3", "name": "network-vif-deleted", "tag": "48e2099d-dbc9-43b5-8946-890995e49ae6"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:47:58.622779 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:47:58.622779 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:47:58.629949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9c0b837-f892-4450-bc58-1b80661d33a2 req-5fb59851-1912-45c3-b8a6-141b2276b326 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:58.630404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-a9c0b837-f892-4450-bc58-1b80661d33a2 req-5fb59851-1912-45c3-b8a6-141b2276b326 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:58.641754 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-a9c0b837-f892-4450-bc58-1b80661d33a2 req-5fb59851-1912-45c3-b8a6-141b2276b326 service nova] Creating event network-vif-deleted:48e2099d-dbc9-43b5-8946-890995e49ae6 for instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 on nch1-master-1 Nov 06 21:47:58.646586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-a9c0b837-f892-4450-bc58-1b80661d33a2 req-5fb59851-1912-45c3-b8a6-141b2276b326 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030122 Nov 06 21:47:58.647206 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4319/8749] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:47:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:47:58.721313 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:58.722003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:58.729666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:58.730405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:58.731425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:58.732091 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:58.764199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:58.764700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:58.765216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lazy-loading 'fault' on Instance uuid 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:47:58.806291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:47:58.814176 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c49d6229-1354-49fe-85e3-56991e3da2db tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 200 len: 1328 microversion: 2.1 time: 0.096542 Nov 06 21:47:58.814770 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4431/8750] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:58 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:47:59.832180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:59.832912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:59.839054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:59.839516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:59.840321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:59.840770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:59.853577 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. Nov 06 21:47:59.854172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:47:59.854990 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ef6bc02-94ab-42a3-abe1-c3016ace2e6e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 404 len: 111 microversion: 2.1 time: 0.027871 Nov 06 21:47:59.855513 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4320/8751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:59 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:47:59.928169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:47:59.928828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:47:59.935621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:59.936033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:59.936860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:47:59.937320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:47:59.950810 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. Nov 06 21:47:59.951384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:47:59.952250 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b1b6fbc-9cab-49ef-87bc-deafe55ddae1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 404 len: 111 microversion: 2.1 time: 0.028575 Nov 06 21:47:59.952800 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4432/8752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:47:59 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:47:59.999000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2066555578", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "22a42440-0ea7-49db-af06-da6aaccfe1f8"}], "security_groups": [{"name": "tempest-securitygroup--617496060"}], "key_name": "tempest-keypair-1399394096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:00.101401 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] validate_networks() for [('22a42440-0ea7-49db-af06-da6aaccfe1f8', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:48:00.475112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:48:00.475564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:48:00.476378 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:48:00.476801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:48:00.477215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:48:00.489283 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:00.489736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:00.490549 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:00.490992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:00.510244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:48:00.515832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:48:00.528505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:48:00.530878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:48:00.575884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b0d2a97c-53de-4572-91fe-94edaf8970bf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.580827 Nov 06 21:48:00.576568 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4321/8753] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:47:59 2021] POST /compute/v2.1/servers => generated 405 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:48:00.586967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a03dec1-f755-448d-a200-4a4f6a7ca67f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:00.587595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a03dec1-f755-448d-a200-4a4f6a7ca67f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:00.640592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a03dec1-f755-448d-a200-4a4f6a7ca67f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:00.650109 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a03dec1-f755-448d-a200-4a4f6a7ca67f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1239 microversion: 2.1 time: 0.066806 Nov 06 21:48:00.651033 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4433/8754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:00 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:01.668231 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:01.668869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:01.678870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:01.679329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:01.680137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:01.680610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:01.759423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:01.766960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d7e45b20-2803-4de5-a352-366188820de8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1297 microversion: 2.1 time: 0.103411 Nov 06 21:48:01.767885 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4322/8755] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:01 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:02.785595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:02.786833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:02.794559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:02.795036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:02.795842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:02.796303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:03.021939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:03.030309 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-13b64d21-8e5f-41fd-b01a-9357246b182f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.248173 Nov 06 21:48:03.040507 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4434/8756] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:02 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:03.260462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2366ed56-f222-4098-8061-0f6ec1fd9b87 req-024ded42-f18b-4dc5-95f6-980f58db737d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:03.265914 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:48:03.265914 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:48:03.279444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2366ed56-f222-4098-8061-0f6ec1fd9b87 req-024ded42-f18b-4dc5-95f6-980f58db737d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:03.280254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2366ed56-f222-4098-8061-0f6ec1fd9b87 req-024ded42-f18b-4dc5-95f6-980f58db737d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:03.293645 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2366ed56-f222-4098-8061-0f6ec1fd9b87 req-024ded42-f18b-4dc5-95f6-980f58db737d service nova] Creating event network-changed:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:48:03.299029 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2366ed56-f222-4098-8061-0f6ec1fd9b87 req-024ded42-f18b-4dc5-95f6-980f58db737d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042202 Nov 06 21:48:03.299899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4323/8757] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:48:04.047323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:04.048051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:04.055833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:04.056494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:04.057303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:04.057767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:04.265255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:04.272561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c64ebf14-d32f-4ce7-b119-622ce8e6aee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.229401 Nov 06 21:48:04.273123 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4435/8758] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:04 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:05.290337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:05.290987 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:05.298245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:05.298698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:05.299734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:05.300169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:05.430969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:05.438372 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a5ccd120-5125-4ca0-ab71-9abc06f24f24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.152177 Nov 06 21:48:05.438942 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4324/8759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:05 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:06.456148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:06.457297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:06.464040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:06.464549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:06.465339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:06.465788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:06.600348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:06.607569 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-54c87c51-a554-45d0-be89-5ad7fdeb5762 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.155103 Nov 06 21:48:06.608136 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4436/8760] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:06 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:07.626343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:07.627022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:07.634543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:07.634997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:07.635814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:07.636256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:07.765523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:07.773563 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0372b959-7b7a-4750-bdbd-b8349ff03797 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.152301 Nov 06 21:48:07.774133 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4325/8761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:07 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:08.791508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:08.792130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:08.798892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:08.799615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:08.800440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:08.800919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:08.935701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:08.942951 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-05e42a07-e020-4b2d-85f0-748b73ec78ba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.155137 Nov 06 21:48:08.943524 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4437/8762] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:08 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:09.577406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-39e8b965-2c77-4db3-a934-c492b02a1a49 req-9c32ef00-9377-43d6-9c86-423d34d99f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-plugged", "status": "completed", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:09.578931 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:48:09.578931 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:48:09.586379 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-39e8b965-2c77-4db3-a934-c492b02a1a49 req-9c32ef00-9377-43d6-9c86-423d34d99f94 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:09.586899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-39e8b965-2c77-4db3-a934-c492b02a1a49 req-9c32ef00-9377-43d6-9c86-423d34d99f94 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:09.597893 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-39e8b965-2c77-4db3-a934-c492b02a1a49 req-9c32ef00-9377-43d6-9c86-423d34d99f94 service nova] Creating event network-vif-plugged:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:48:09.602707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-39e8b965-2c77-4db3-a934-c492b02a1a49 req-9c32ef00-9377-43d6-9c86-423d34d99f94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029364 Nov 06 21:48:09.603297 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4326/8763] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:48:09.959653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:09.960215 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:09.966904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:09.967371 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:09.968168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:09.968672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:10.104649 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:10.112651 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c0909a9-9c8d-4751-9439-fee6e849ec03 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1364 microversion: 2.1 time: 0.155997 Nov 06 21:48:10.112869 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4438/8764] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:09 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:11.129593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:11.130810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:11.137846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:11.138554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:11.139356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:11.139839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:11.272229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:48:11.279541 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9996f0a1-2f71-4a0f-a6cc-78efc56037af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1551 microversion: 2.1 time: 0.154972 Nov 06 21:48:11.280114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4327/8765] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:48:11 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:11.296484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:48:11.297009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:11.304610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:11.305076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:11.305868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:11.306322 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:11.383622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4053644b-c7eb-49ea-a981-b554bf05e5f2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090876 Nov 06 21:48:11.384244 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4439/8766] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Nov 6 21:48:11 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:48:12.333763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:12.335309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:12.337020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c7c9f2b3-7889-4287-bf5a-99bf8a83e27f req-6f0c7eb6-8682-46fe-9a3e-eab50b0c157a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:12.339061 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:48:12.339061 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:48:12.342497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:12.343094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:12.343929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:12.344590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:12.345859 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c7c9f2b3-7889-4287-bf5a-99bf8a83e27f req-6f0c7eb6-8682-46fe-9a3e-eab50b0c157a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:12.346320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c7c9f2b3-7889-4287-bf5a-99bf8a83e27f req-6f0c7eb6-8682-46fe-9a3e-eab50b0c157a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:12.357624 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c7c9f2b3-7889-4287-bf5a-99bf8a83e27f req-6f0c7eb6-8682-46fe-9a3e-eab50b0c157a service nova] Creating event network-changed:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:48:12.362925 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c7c9f2b3-7889-4287-bf5a-99bf8a83e27f req-6f0c7eb6-8682-46fe-9a3e-eab50b0c157a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031240 Nov 06 21:48:12.364905 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4440/8767] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:48:12.383037 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf0ade28-bb9b-4bf9-9eb0-3d0aeabbb8d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.053791 Nov 06 21:48:12.383853 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4328/8768] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:12 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:13.394847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:13.396573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:13.403385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:13.403872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:13.404700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:13.405143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:13.442883 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8b7680eb-b522-4afb-959c-8c94a9af4f6b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.051540 Nov 06 21:48:13.443532 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4441/8769] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:13 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:14.454402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:14.455895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:14.463110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:14.463568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:14.464382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:14.464830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:14.510560 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09a83de5-78a9-4d9c-9b02-803681aba846 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.060149 Nov 06 21:48:14.511460 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4329/8770] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:14 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:15.521928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:15.522945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:15.530236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:15.530703 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:15.531498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:15.531965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:15.568867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8e076f39-0c54-4b09-8a2b-811d6fb270b5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.050810 Nov 06 21:48:15.569472 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4442/8771] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:15 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:16.579570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:16.580620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:16.588570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:16.589031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:16.589817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:16.590262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:16.624923 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-103bc084-7391-4633-8d5c-4a2db70edee8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.049170 Nov 06 21:48:16.628048 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4330/8772] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:16 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:17.635574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:17.636631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:17.643910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:17.644423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:17.645218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:17.646165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:17.683253 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a9648884-fafc-4643-b290-f2a410ed8dae tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.051640 Nov 06 21:48:17.683893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4443/8773] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:17 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:18.695275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:18.696282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:18.703604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:18.704056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:18.704927 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:18.705365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:18.742534 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a4ab0498-25ec-4b6b-83f2-13960962d793 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.051855 Nov 06 21:48:18.743161 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4331/8774] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:18 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:19.754605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:19.756062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:19.763296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:19.763764 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:19.764577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:19.765025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:19.805521 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0f8ef00e-e644-46c5-8c1b-fac8f3715d24 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.054982 Nov 06 21:48:19.806139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4444/8775] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:19 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:20.816689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:20.817695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:20.824860 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:20.825309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:20.826094 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:20.826526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:20.892027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-159d400c-2f08-4a8d-a921-227b0541c80e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.079298 Nov 06 21:48:20.892741 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4332/8776] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:20 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:21.903573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:21.904623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:21.911834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:21.912319 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:21.913120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:21.913572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:21.949227 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3d63b3de-b40c-4f87-b3a1-8ea1c1c00e41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.049681 Nov 06 21:48:21.951023 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4445/8777] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:21 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:22.961308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:22.962347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:22.969590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:22.970044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:22.970843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:22.971279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:23.009451 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5633adac-8cf4-42cc-8bce-c8ab73a5fa10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 14 microversion: 2.1 time: 0.052707 Nov 06 21:48:23.010062 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4333/8778] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:22 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:48:24.021131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:24.022150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:24.029551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:24.030032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:24.030826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:24.031278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:24.081469 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-480dbb31-c290-4b89-8bb8-5dd8bae018ee tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 8207 microversion: 2.1 time: 0.064372 Nov 06 21:48:24.082122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4446/8779] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:24 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 8207 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:48:25.093400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:25.094446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:25.101746 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:25.102205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:25.102993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:25.103432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:25.150405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37e95554-b633-43b8-84bf-e78453a63ea3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 16397 microversion: 2.1 time: 0.060965 Nov 06 21:48:25.151187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4334/8780] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:25 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 16397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:26.162988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:26.163933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:26.171193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:26.171652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:26.172466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:26.172913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:26.212878 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-437874a8-026e-4dc0-8ee9-f2b5166ad10d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 16397 microversion: 2.1 time: 0.054464 Nov 06 21:48:26.213538 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4447/8781] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:26 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 16397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:27.225482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:27.226548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:27.233995 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:27.234612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:27.235469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:27.236041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:27.282256 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9ce5d058-bccd-4a8a-a067-a2a58f98b1ef tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 16397 microversion: 2.1 time: 0.061448 Nov 06 21:48:27.283067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4335/8782] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:27 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 16397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:28.294428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:28.295363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:28.303656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:28.304118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:28.304969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:28.305424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:28.343650 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-37a66318-8ea1-4427-85ed-278bb868debe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 16397 microversion: 2.1 time: 0.053381 Nov 06 21:48:28.344515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4448/8783] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:28 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:29.468792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:29.469965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:29.476950 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:29.477439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:29.478218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:29.478658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:29.525984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-47f27298-e49f-4dae-8ab8-2ab002109fa0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.174213 Nov 06 21:48:29.526599 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4336/8784] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:29 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:30.538674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:30.539746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:30.547151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:30.547629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:30.548449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:30.548900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:30.587947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c6166c2-5a16-4005-8481-9700c908cf5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053909 Nov 06 21:48:30.588603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4449/8785] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:30 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:31.600660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:31.601360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:31.608512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:31.609691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:31.610478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:31.610945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:31.655676 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-706d8fe3-7e2a-43b3-914e-bd013977e953 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.060101 Nov 06 21:48:31.656875 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4337/8786] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:31 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:32.668127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:32.669180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:32.676722 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:32.677186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:32.677973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:32.678446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:32.718269 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15819615-15bb-45ea-94df-c154d5d64c12 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054106 Nov 06 21:48:32.718896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4450/8787] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:32 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:33.730611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:33.731560 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:33.738839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:33.739302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:33.740721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:33.741171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:33.778751 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad36dd62-8960-4bcf-8ad8-754c4fd6df98 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.052264 Nov 06 21:48:33.779385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4338/8788] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:33 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:34.790922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:34.791942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:34.799502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:34.799954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:34.800773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:34.801223 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:34.840585 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-67d7ecbe-0789-4e55-92e7-665314170b48 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053610 Nov 06 21:48:34.842008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4451/8789] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:34 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:35.853273 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:35.854317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:35.861586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:35.862044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:35.862835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:35.863279 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:35.915885 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a940ef20-11d5-4bbc-b7d4-b3e2b64c0db1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.067194 Nov 06 21:48:35.916557 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4339/8790] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:35 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:36.928813 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:36.929819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:36.936964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:36.937423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:36.938204 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:36.938646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:36.980541 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4e07e985-62dc-426c-8324-2dc15ee4b42a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.056503 Nov 06 21:48:36.981196 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4452/8791] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:36 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:37.993310 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:37.994353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:38.001621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:38.002075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:38.002862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:38.003299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:38.042298 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9e280e90-219b-4e1c-b386-5846a7755152 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053668 Nov 06 21:48:38.042960 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4340/8792] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:37 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:39.054657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:39.055662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:39.063196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:39.063658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:39.064466 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:39.064915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:39.103263 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-25437ee0-1f2d-4e47-8b22-e36f41585a6c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.052537 Nov 06 21:48:39.103938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4453/8793] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:39 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:40.115958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:40.116994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:40.124071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:40.124565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:40.125359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:40.125807 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:40.167841 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac30219a-e610-4eeb-84e1-0f461180d208 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.056344 Nov 06 21:48:40.168692 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4341/8794] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:40 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:41.179892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:41.180886 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:41.188149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:41.188641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:41.189439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:41.189889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:41.234970 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0684e47-e8be-4b56-b7bf-b47ab5b0cda7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.059117 Nov 06 21:48:41.235704 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4454/8795] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:41 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:42.247602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:42.248665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:42.256057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:42.256563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:42.257351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:42.257791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:42.297667 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-68373d19-6857-4f1e-b555-c4c2d0aad52c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054162 Nov 06 21:48:42.298286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4342/8796] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:42 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:43.310540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:43.311506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:43.319435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:43.319955 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:43.320804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:43.321300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:43.360655 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea480800-7247-451c-824f-9676c01f195d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054105 Nov 06 21:48:43.361488 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4455/8797] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:43 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:44.372732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:44.373663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:44.381494 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:44.381949 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:44.382731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:44.383170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:44.421145 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-985c72fa-1599-4bc9-9691-f2eee6650873 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.052486 Nov 06 21:48:44.421772 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4343/8798] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:44 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:45.433442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:45.434502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:45.441731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:45.442195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:45.443070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:45.443510 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:45.484324 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7601f75e-2bf5-44ca-ad6a-d8117425e29a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054834 Nov 06 21:48:45.484975 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4456/8799] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:45 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:46.495962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:46.497000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:46.504175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:46.504653 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:46.505464 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:46.505895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:46.543988 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-421dc5b3-95d2-42b0-bedb-41a0c9df8a5f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.051963 Nov 06 21:48:46.544708 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4344/8800] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:46 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:47.556786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:47.557798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:47.565014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:47.565476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:47.566259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:47.566700 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:47.609102 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b6b2b695-64a1-43cd-8a89-829747a656c1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.056825 Nov 06 21:48:47.609730 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4457/8801] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:47 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:48.621189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:48.622210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:48.629493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:48.629954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:48.630742 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:48.631195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:48.670445 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3d9e07ba-19b5-44ef-8012-573aecdf8b82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053253 Nov 06 21:48:48.671080 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4345/8802] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:48 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:49.682442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:49.683407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:49.690629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:49.691088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:49.691870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:49.692337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:49.731282 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-09d3a30a-2e3c-482c-b38e-064bfc91a5e1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053019 Nov 06 21:48:49.731911 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4458/8803] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:49 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:50.743265 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:50.744280 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:50.751577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:50.752039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:50.752873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:50.753314 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:50.792084 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0408d67b-ff1e-4d94-a935-9938c2d06197 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.052726 Nov 06 21:48:50.792893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4346/8804] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:50 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:51.804792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:51.805704 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:51.812768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:51.813233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:51.814017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:51.814461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:51.853400 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aeceb774-ab96-4b59-91b2-455bb4b96907 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.052785 Nov 06 21:48:51.854234 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4459/8805] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:51 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:52.866034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:52.866963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:52.874032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:52.874488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:52.875291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:52.875715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:52.918155 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d567b117-3fe3-479a-9ca4-db5df9a72d23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.056618 Nov 06 21:48:52.918820 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4347/8806] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:52 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:53.930547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:53.931583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:53.938767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:53.939229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:53.940010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:53.940488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:53.986086 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d5cc5e57-8085-4591-ba0b-431d8d7b1850 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.059527 Nov 06 21:48:53.986698 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4460/8807] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:53 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:54.998181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:54.999201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:55.006515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:55.006974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:55.007762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:55.008204 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:55.049113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-375c6f6e-d484-4ded-8f31-d1c93c53a46e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054882 Nov 06 21:48:55.050019 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4348/8808] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:54 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:56.061550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:56.062589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:56.070487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:56.070947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:56.071732 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:56.072175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:56.109467 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02123d4a-1f52-4c98-aaf2-1c7f27f93330 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.051884 Nov 06 21:48:56.110083 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4461/8809] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:56 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:57.121593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:57.122603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:57.130517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:57.130921 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:57.131705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:57.132150 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:57.170910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-32c86f7a-36a4-4e50-9ed4-b1eb6e43a78b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053318 Nov 06 21:48:57.171542 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4349/8810] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:57 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:58.183227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:58.184187 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:58.191617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:58.192117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:58.192941 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:58.193421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:58.233893 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81d07cfb-197e-40b4-85df-3e0ae1778944 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054668 Nov 06 21:48:58.234556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4462/8811] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:58 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:48:59.246829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:48:59.247752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:48:59.254997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:59.255450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:59.256225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:48:59.256691 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:48:59.293350 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-84553e51-2871-4f83-8648-a48208527021 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.050583 Nov 06 21:48:59.294006 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4350/8812] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:48:59 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:00.308571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:00.309810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:00.318618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:00.319116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:00.319943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:00.320430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:00.361587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5c19c8bb-964f-436a-88f5-a0c7fda889af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.058618 Nov 06 21:49:00.362233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4463/8813] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:00 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:49:01.374713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:01.375731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:01.382994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:01.383454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:01.384229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:01.384701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:01.429345 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28556ae6-905e-4a66-9128-7a28d9d80f10 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.058577 Nov 06 21:49:01.429971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4351/8814] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:01 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:02.441469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:02.442585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:02.449854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:02.450320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:02.451115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:02.451569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:02.488881 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-15635b0d-93e6-49a4-8c9c-b3593d2b4a68 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.051298 Nov 06 21:49:02.490060 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4464/8815] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:02 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:03.501548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:03.502590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:03.510392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:03.510843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:03.511628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:03.512073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:03.549853 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd7c685a-a84f-421e-bcfc-adea2ccced9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.051985 Nov 06 21:49:03.550487 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4352/8816] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:03 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:04.562915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:04.563963 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:04.572871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:04.572871 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:04.574952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:04.574952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:04.613336 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-84d02ea3-eed9-4fbf-b4a2-a06fb74f2094 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054711 Nov 06 21:49:04.614008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4465/8817] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:04 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:05.625762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:05.626773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:05.634066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:05.634521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:05.635300 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:05.635744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:05.679065 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e7764de5-38af-4a5a-a61d-7cdd8d863d61 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.057370 Nov 06 21:49:05.679758 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4353/8818] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:05 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:06.691642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:06.692748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:06.699918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:06.700409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:06.701192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:06.701638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:06.741319 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a220430-d4e9-4e10-aa7f-5cd92e88a5d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053668 Nov 06 21:49:06.742154 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4466/8819] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:06 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:07.753468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:07.754880 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:07.762252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:07.762706 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:07.763484 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:07.763915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:07.803529 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7df8c849-bcc1-4fb6-b2f9-773bdf6e803d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054138 Nov 06 21:49:07.804156 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4354/8820] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:07 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:08.815569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:08.816640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:08.824725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:08.825195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:08.825988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:08.826439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:08.871911 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74ccbbd4-183d-4010-9049-e1a420704ed5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.060244 Nov 06 21:49:08.872802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4467/8821] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:08 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:09.883884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:09.884939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:09.891822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:09.892277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:09.893076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:09.893511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:09.932568 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-600e51fc-ec99-422e-b588-6f71ccb4689f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.053296 Nov 06 21:49:09.933405 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4355/8822] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:09 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:10.944503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:10.945516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:10.952659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:10.953122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:10.953900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:10.954343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:10.996004 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5180b2d8-0b02-49b1-9f11-cebfb0c2203f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.055480 Nov 06 21:49:10.996648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4468/8823] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:10 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:12.008181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:12.009263 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:12.016665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:12.017133 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:12.017925 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:12.018369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:12.058712 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9b077f62-5b89-43de-b367-ca9d183d8938 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054566 Nov 06 21:49:12.059508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4356/8824] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:12 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:49:13.070783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:13.071802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:13.079128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:13.079594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:13.080423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:13.080877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:13.132180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-74c175d4-64df-4963-9a03-6179e18cce39 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.065289 Nov 06 21:49:13.132761 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4469/8825] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:13 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:14.143740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:14.144683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:14.151934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:14.152473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:14.153248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:14.153700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:14.194025 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c0e28a84-c27d-4f37-aac3-c59048d6beca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054420 Nov 06 21:49:14.194660 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4357/8826] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:14 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:15.206413 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:15.207381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:15.215207 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:15.215673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:15.216567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:15.217024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:15.254561 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0a1b8b9c-7a0a-4d3f-b223-80b4b653c52e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052148 Nov 06 21:49:15.255695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4470/8827] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:15 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:16.267246 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:16.268201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:16.275960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:16.276433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:16.277209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:16.277761 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:16.319655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-affcc8c7-68da-44dc-a3d8-d21882de2679 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056400 Nov 06 21:49:16.320287 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4358/8828] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:16 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:17.333174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:17.334227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:17.341639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:17.342114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:17.342900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:17.343348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:17.383914 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-256012a9-9d50-40be-a0e5-d232af2ba826 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054682 Nov 06 21:49:17.384568 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4471/8829] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:17 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:18.396319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:18.397478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:18.404469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:18.404951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:18.405739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:18.406175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:18.450781 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df094947-03c2-4850-90db-895007de31d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.058567 Nov 06 21:49:18.451676 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4359/8830] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:18 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:19.463167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:19.464320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:19.471428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:19.471890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:19.472721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:19.473185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:19.514623 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f1e6f448-6f3c-4b6c-8e70-6dae87492c46 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055418 Nov 06 21:49:19.515545 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4472/8831] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:19 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:20.527836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:20.528861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:20.536013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:20.536513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:20.537296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:20.537734 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:20.583362 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c871cdc-be03-414b-87f4-c030e9566668 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.059838 Nov 06 21:49:20.584264 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4360/8832] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:20 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:21.595612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:21.596663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:21.604566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:21.605036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:21.605831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:21.606285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:21.644875 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c187bb28-dac4-4dd5-802f-325754ed1936 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053296 Nov 06 21:49:21.646130 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4473/8833] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:21 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:22.657274 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:22.658313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:22.666083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:22.666537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:22.667313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:22.667750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:22.709561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f2b1a711-cfe5-440a-b77c-8a219d826cf7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056303 Nov 06 21:49:22.710188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4361/8834] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:22 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:23.722049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:23.722991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:23.729999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:23.730460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:23.731242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:23.731679 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:23.773611 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-315203ab-a3eb-4006-8a15-09d7dd6e9add tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055560 Nov 06 21:49:23.774263 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4474/8835] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:23 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:24.786036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:24.787045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:24.794313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:24.794769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:24.795553 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:24.795996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:24.836597 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c5b4f3cc-a59b-486d-9c75-9d281ebd4675 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054622 Nov 06 21:49:24.837237 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4362/8836] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:24 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:49:25.849416 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:25.850426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:25.857701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:25.858141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:25.858922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:25.859386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:25.899002 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86288730-2df7-4a2a-a8ba-a78137f12a9b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054204 Nov 06 21:49:25.899633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4475/8837] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:25 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:26.911011 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:26.912022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:26.919334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:26.919791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:26.920598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:26.921041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:26.960668 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a487248-9c81-4fdb-a13f-b44c952b3381 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053618 Nov 06 21:49:26.961307 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4363/8838] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:26 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:27.972506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:27.974015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:27.981209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:27.981671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:27.982455 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:27.982974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:28.022053 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3fc256e-dd01-44f3-87b3-140620d34784 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053016 Nov 06 21:49:28.023161 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4476/8839] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:27 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:29.034803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:29.035811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:29.043000 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:29.043455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:29.044225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:29.044683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:29.084689 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-86479ac3-edc5-4308-8df1-f4a633ba435a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053824 Nov 06 21:49:29.085315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4364/8840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:29 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:30.096499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:30.097598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:30.104913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:30.105376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:30.106159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:30.106606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:30.145258 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73a0e0e9-8422-41ed-8036-af6d4635e2bb tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052748 Nov 06 21:49:30.146452 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4477/8841] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:30 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:31.159287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:31.160186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:31.169266 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:31.169724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:31.170517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:31.170966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:31.214331 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-109a423b-f6e8-4e88-89e0-f1242e6a4a82 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.060056 Nov 06 21:49:31.214989 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4365/8842] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:31 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:32.227141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:32.228068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:32.235285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:32.235748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:32.236559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:32.237031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:32.276837 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b4b6dc84-ac0a-470e-b5c9-72407aaa4eca tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054148 Nov 06 21:49:32.277724 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4478/8843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:32 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:33.289290 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:33.290229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:33.297682 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:33.298139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:33.298942 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:33.299645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:33.339720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4932e6f2-5651-4411-91e3-c608bbfe2a37 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054507 Nov 06 21:49:33.340383 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4366/8844] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:33 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:34.352677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:34.353696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:34.361016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:34.361484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:34.362274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:34.362801 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:34.401712 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a21f7d07-9439-4fa5-b5ed-3b9c61d43ddd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053607 Nov 06 21:49:34.402342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4479/8845] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:34 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:35.413825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:35.414832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:35.421992 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:35.422446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:35.423216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:35.423675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:35.462814 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-10a67603-eb22-4d4d-b320-c86476fc2b49 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052925 Nov 06 21:49:35.463433 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4367/8846] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:35 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:36.475550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:36.476607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:36.483825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:36.484311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:36.485113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:36.485561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:36.527643 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a612984e-4b5c-4641-afa6-503fe0e531fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056659 Nov 06 21:49:36.528282 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4480/8847] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:36 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:37.540512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:37.541530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:37.548858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:37.549582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:37.550370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:37.550810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:37.589550 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb78ba0a-5fca-4a88-8409-bc56755bd871 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053628 Nov 06 21:49:37.590175 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4368/8848] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:37 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:38.601833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:38.602870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:38.610156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:38.610618 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:38.611399 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:38.611843 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:38.650180 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad4ec679-8bed-4b32-9425-691fb2a211d7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052243 Nov 06 21:49:38.650797 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4481/8849] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:38 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:39.662544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:39.663581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:39.670924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:39.671390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:39.672180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:39.672646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:39.712517 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0b05170-4ad4-4a7b-90a0-f11d19c100af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054066 Nov 06 21:49:39.713186 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4369/8850] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:39 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:49:40.725443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:40.726487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:40.733639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:40.734101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:40.734885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:40.735329 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:40.774065 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aa34daef-d819-4661-b536-eb419bafc438 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053150 Nov 06 21:49:40.774669 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4482/8851] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:40 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:41.789421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:41.790432 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:41.797490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:41.797944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:41.798728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:41.799161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:41.839489 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39da26fc-c692-4b8b-9f74-38b1723ecf34 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056909 Nov 06 21:49:41.840118 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4370/8852] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:41 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:42.851882 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:42.852938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:42.860237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:42.860731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:42.861533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:42.861984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:42.901695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4c8f8e8e-aed4-49ad-95f0-f48f364f43d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053798 Nov 06 21:49:42.902322 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4483/8853] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:42 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:43.914591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:43.915618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:43.922896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:43.923360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:43.924146 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:43.924869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:43.967621 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2ec40735-6f3f-4f0c-9ddf-bb36e60712d0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057683 Nov 06 21:49:43.968264 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4371/8854] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:43 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:44.980428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:44.981495 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:44.989351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:44.989823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:44.990615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:44.991070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:45.030771 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b409122a-1774-4e45-b31a-0e9220f2e39b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054368 Nov 06 21:49:45.031417 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4484/8855] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:44 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:46.043688 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:46.044720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:46.052566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:46.053021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:46.053800 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:46.054502 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:46.094125 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a355802-a856-4fbd-9b39-4b56fc6a7195 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054991 Nov 06 21:49:46.094783 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4372/8856] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:46 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:47.108080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:47.109122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:47.116307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:47.116771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:47.117558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:47.118002 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:47.158328 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1d1fd051-d0f0-4bb3-83a0-d4372659d92b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055319 Nov 06 21:49:47.158881 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4485/8857] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:47 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:48.170783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:48.171698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:48.179770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:48.180252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:48.181047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:48.181485 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:48.218631 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2cbfe5f0-cf2d-4dd9-ac5a-77505b9d1ce0 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.051970 Nov 06 21:49:48.219291 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4373/8858] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:48 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:48.468620 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:49:48.468835 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:49:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:49:49.230474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:49.231398 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:49.239059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:49.239519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:49.240323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:49.240773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:49.283217 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9ab8ee34-5000-42a4-a307-aca9d97de843 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056710 Nov 06 21:49:49.283855 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4486/8859] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:49 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:50.295627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:50.296594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:50.304114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:50.304596 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:50.305376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:50.305814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:50.344870 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7881ce2b-64e3-4b06-aea0-bbc4877703af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053279 Nov 06 21:49:50.345499 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4374/8860] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:50 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:51.357196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:51.358214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:51.365574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:51.366036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:51.366828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:51.367273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:51.405962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3a524da-3761-4876-b591-5af69d3fa83c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052774 Nov 06 21:49:51.406598 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4487/8861] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:51 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:52.081695 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:49:52.081853 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:49:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:49:52.418372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:52.419390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:52.427579 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:52.428037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:52.428856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:52.429303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:52.468149 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fe358a1a-7637-4fd5-b273-79f7bd7c381a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053761 Nov 06 21:49:52.469138 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4375/8862] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:52 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:53.481680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:53.482697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:53.490353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:53.490822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:53.491626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:53.492079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:53.532081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ce6b509-af6e-4cf7-9337-807a7dfed78a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054388 Nov 06 21:49:53.533011 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4488/8863] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:53 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:54.544477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:54.545506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:54.553059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:54.553519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:54.554303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:54.554749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:54.593619 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c99e57fb-7dba-4175-a662-1e659f222a35 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053102 Nov 06 21:49:54.594187 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4376/8864] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:54 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:55.605604 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:55.606624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:55.614690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:55.615054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:55.615851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:55.616318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:55.654947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-cf32f158-7f6d-4196-9ce6-0743f6137236 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053290 Nov 06 21:49:55.655566 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4489/8865] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:55 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:56.667296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:56.668327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:56.676331 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:56.676799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:56.677585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:56.678026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:56.720089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c26cae69-f4ee-4e0c-b9cd-6b7ae4ba1ca4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056810 Nov 06 21:49:56.720757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4377/8866] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:56 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:57.732656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:57.733621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:57.740868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:57.741334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:57.742127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:57.742586 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:57.781655 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d2e2a09c-8cfc-4c53-a94f-60fa9f735989 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053080 Nov 06 21:49:57.782267 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4490/8867] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:57 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:49:58.794123 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:58.795132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:58.802652 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:58.803113 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:58.803896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:58.804361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:58.847199 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0178e72f-0cfb-4893-a69c-92e7c0dee368 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057061 Nov 06 21:49:58.848608 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4378/8868] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:58 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:49:59.859816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:49:59.860857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:49:59.868738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:59.869200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:59.870021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:49:59.870465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:49:59.911182 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e9cfeb77-e838-4db4-a196-b6399304ad5e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054837 Nov 06 21:49:59.911817 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4491/8869] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:49:59 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:00.923426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:00.924724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:00.931985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:00.932477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:00.933260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:00.933701 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:00.971934 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57dc3fae-0dd6-4f00-a573-c8582c0fa077 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052525 Nov 06 21:50:00.972613 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4379/8870] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:00 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:01.983581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:01.987634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:01.993264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:01.993724 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:01.994508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:01.994949 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:02.037308 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-14671a15-d67c-4f52-964e-53c242e25120 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057814 Nov 06 21:50:02.037931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4492/8871] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:01 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:03.049863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:03.051589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:03.058907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:03.059365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:03.060155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:03.060625 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:03.098253 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fddb02d8-90f2-4d60-80e9-c4984617e6ab tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052184 Nov 06 21:50:03.098878 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4380/8872] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:03 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:04.109716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:04.110730 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:04.118531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:04.119003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:04.119832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:04.120283 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:04.159365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-73005495-68b2-4e9e-95bb-5d5f2d7dd1a9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053518 Nov 06 21:50:04.159927 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4493/8873] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:04 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:05.171784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:05.172765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:05.180318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:05.180793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:05.181577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:05.182019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:05.221506 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bf94ec16-d068-427b-b230-c6713c4d0619 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053827 Nov 06 21:50:05.222165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4381/8874] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:05 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:06.233905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:06.234826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:06.242721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:06.243259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:06.244079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:06.244552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:06.283129 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d27e5ef4-0c19-46fe-8132-f3118b913223 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053244 Nov 06 21:50:06.283994 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4494/8875] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:06 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:50:07.295547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:07.296543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:07.304072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:07.304557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:07.305337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:07.305776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:07.343334 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e63a20d-8e11-446d-a4d6-4fe94228ea8a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.051871 Nov 06 21:50:07.343967 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4382/8876] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:07 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:08.357853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:08.358873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:08.367745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:08.368211 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:08.369049 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:08.369500 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:08.408418 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88600a25-ec93-46bd-b38a-fce60d1644d1 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055353 Nov 06 21:50:08.409052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4495/8877] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:08 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:09.421487 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:09.422504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:09.430168 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:09.430631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:09.431411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:09.431851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:09.474774 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25aaf716-8f44-479d-8fd5-b94c00332dbd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057466 Nov 06 21:50:09.475414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4383/8878] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:09 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:10.488515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:10.489583 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:10.496852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:10.497321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:10.498124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:10.498576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:10.538868 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6754a33b-5d42-44c6-86bf-6cb8c25e9edf tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055543 Nov 06 21:50:10.539737 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4496/8879] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:10 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:11.187222 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:50:11.187427 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:50:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:50:11.550735 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:11.551752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:11.559029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:11.559488 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:11.560268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:11.560736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:11.602230 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4e407a90-0d70-4fac-8fbf-468151f50dc5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055724 Nov 06 21:50:11.603097 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4384/8880] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:11 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:12.615349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:12.616403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:12.623936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:12.624423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:12.625226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:12.625670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:12.665150 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9e5540a3-7f4d-424f-a1e8-7927dfa30ca5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054511 Nov 06 21:50:12.665774 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4497/8881] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:12 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:50:13.677666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:13.678685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:13.686064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:13.686532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:13.687322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:13.687770 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:13.727701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3a86953d-290f-4e79-bb73-511db251fd63 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054358 Nov 06 21:50:13.728584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4385/8882] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:13 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:14.739572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:14.740645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:14.747760 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:14.748220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:14.749036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:14.749482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:14.791426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f7a4c88f-ce00-4ec7-86d4-77f8deac63df tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055788 Nov 06 21:50:14.792349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4498/8883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:14 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:15.804218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:15.805157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:15.812443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:15.812902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:15.813684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:15.814125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:15.853735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-080ba04b-96eb-4bce-b4c5-3a754f51f5af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054503 Nov 06 21:50:15.854385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4386/8884] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:15 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:16.867980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:16.869025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:16.876267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:16.876751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:16.877542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:16.877975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:16.917867 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1daf3f1-3c3a-4cc1-b733-5788e6525ad3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055333 Nov 06 21:50:16.918802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4499/8885] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:16 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:17.930951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:17.931972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:17.939224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:17.939681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:17.940503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:17.940948 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:17.983914 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-37cbf91b-3b17-4e1a-a6bc-b1453ae148af tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057544 Nov 06 21:50:17.984816 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4387/8886] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:17 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:18.996015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:18.997057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:19.004170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:19.004658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:19.005444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:19.006437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:19.045330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6f500474-2699-48f2-80d4-68be9a5abf89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053258 Nov 06 21:50:19.045959 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4500/8887] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:18 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:20.057537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:20.058591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:20.066071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:20.066531 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:20.067324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:20.067767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:20.107735 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b073764c-fa8a-49e7-8e36-24002fb423f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054117 Nov 06 21:50:20.108643 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4388/8888] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:20 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:21.120063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:21.121122 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:21.128426 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:21.128901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:21.129697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:21.130150 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:21.169917 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db3f444f-bce5-4a41-8d38-9af20d91a8f6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053774 Nov 06 21:50:21.170570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4501/8889] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:21 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:22.182282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:22.183232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:22.190609 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:22.191074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:22.191859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:22.192374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:22.234629 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8bbc8262-a4cd-48b6-bc1f-edb4c02a1820 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056371 Nov 06 21:50:22.235288 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4389/8890] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:22 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:23.247577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:23.248547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:23.255710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:23.256186 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:23.257010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:23.257457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:23.295550 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4bc00f1-3d27-406f-85cc-8ee6aa7dbb58 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052059 Nov 06 21:50:23.296175 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4502/8891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:23 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:24.309232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:24.310249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:24.317480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:24.318555 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:24.319333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:24.319771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:24.359003 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-de175481-f152-4e2c-98fe-c27610506c41 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054145 Nov 06 21:50:24.359649 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4390/8892] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:24 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:50:25.371576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:25.372770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:25.380045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:25.381040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:25.381829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:25.382273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:25.421345 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b2e1c27-ee67-47a6-873c-6ad5edf7fba7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053815 Nov 06 21:50:25.421977 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4503/8893] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:25 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:26.434337 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:26.435336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:26.442588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:26.443042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:26.443820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:26.444258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:26.482666 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a238f49-fc06-4ec9-8149-2e3a79103374 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052329 Nov 06 21:50:26.483293 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4391/8894] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:26 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:27.495389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:27.496438 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:27.503677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:27.504144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:27.505039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:27.505491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:27.547054 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bfca9e6f-ed19-4b24-bde7-05a770485cb2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055578 Nov 06 21:50:27.547688 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4504/8895] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:27 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:28.559588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:28.560657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:28.567869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:28.568842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:28.569623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:28.570056 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:28.608972 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-325408cd-e3b2-4555-87a1-094bfbe9939f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053332 Nov 06 21:50:28.609597 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4392/8896] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:28 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:29.620676 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:29.621699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:29.629494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:29.629991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:29.630793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:29.631258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:29.670395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7011433d-4ef2-4af3-aa27-53b2cf6c60a5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053633 Nov 06 21:50:29.671033 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4505/8897] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:29 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:30.683784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:30.684836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:30.692101 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:30.692599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:30.693400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:30.693843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:30.732137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7f101d9a-5d6f-4195-ae87-2e775c216722 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052349 Nov 06 21:50:30.732819 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4393/8898] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:30 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:31.745755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:31.746800 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:31.754321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:31.754725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:31.755523 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:31.756630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:31.795752 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f4d36267-11e3-48bd-b2a9-fb0a3555448c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055326 Nov 06 21:50:31.796442 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4506/8899] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:31 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:32.808173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:32.809228 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:32.816512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:32.816976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:32.817765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:32.818212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:32.857376 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4da58d88-1a9f-4725-8976-6694d4eca8fe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.053244 Nov 06 21:50:32.858013 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4394/8900] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:32 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:33.869642 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:33.870965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:33.878402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:33.878803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:33.879633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:33.880080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:33.920007 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dd99450d-7a4f-4dcd-9dc3-14490e97baa6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.054358 Nov 06 21:50:33.920979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4507/8901] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:33 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:34.931765 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:34.932814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:34.940057 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:34.940546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:34.941325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:34.941764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:34.983651 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1f159644-cfe5-4b36-9a67-33b7966ca6dd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.055790 Nov 06 21:50:34.984311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4395/8902] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:34 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:35.996188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:35.997243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:36.004507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:36.004979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:36.005799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:36.006257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:36.045127 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8251599-01ef-43ff-896f-5136e67ea318 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052897 Nov 06 21:50:36.045778 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4508/8903] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:35 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:37.057912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:37.058932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:37.066179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:37.066636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:37.067420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:37.067863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:37.110568 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ba9647f-6922-4f60-8b54-0c8e9cdc2107 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.056618 Nov 06 21:50:37.111202 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4396/8904] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:37 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:38.122728 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:38.123733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:38.131534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:38.131934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:38.132742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:38.133188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:38.171575 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6abfd28b-4642-4ace-99ed-8224ebff3072 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.052800 Nov 06 21:50:38.172190 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4509/8905] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:38 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:39.184388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:39.185319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:39.192433 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:39.192895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:39.193768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:39.194211 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:39.232093 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-277270b5-3993-455b-9ded-5161933f57d5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.051745 Nov 06 21:50:39.232757 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4397/8906] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:39 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 06 21:50:40.245810 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:40.246795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:40.253978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:40.254440 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:40.255217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:40.256206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:40.298953 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-53b4ec65-494c-41e2-8b55-3911262c40d9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 32641 microversion: 2.1 time: 0.057979 Nov 06 21:50:40.300085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4510/8907] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:40 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:41.312025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:41.312981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:41.320984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:41.321439 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:41.322216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:41.322651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:41.375652 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ab65acf9-2d49-4f33-bdda-92bff7a53455 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 200 len: 40791 microversion: 2.1 time: 0.067569 Nov 06 21:50:41.376328 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4398/8908] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:41 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 40791 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:50:42.705113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:42.705823 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:42.713253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:42.713716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:42.714505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:42.714956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:42.974868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:42.982598 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9241997f-7d5c-48c3-9dba-41112bc0ffd3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1670 microversion: 2.1 time: 0.281486 Nov 06 21:50:42.983166 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4511/8909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:42 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1670 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:42.999947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2680b66-e736-449e-9716-5ea61519c9e0"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:43.001147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:43.008392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:43.008858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:43.009644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:43.010089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:43.390857 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b6acc21-ba14-43c8-8897-7141b0780ee6 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394946 Nov 06 21:50:43.391839 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4399/8910] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:50:42 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:50:46.648162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:50:46.649158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:46.656487 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:46.656927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:46.657711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:46.658155 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:46.766908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:46.773463 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Old instance type m1.heat2, new instance type m1.heat {{(pid=134827) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 21:50:46.779986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:50:46.780449 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:50:46.780940 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:50:46.781355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:50:46.781773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:50:46.843114 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a330256c-4ea8-45ca-9828-72a9263e592f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 202 len: 0 microversion: 2.1 time: 0.198630 Nov 06 21:50:46.844022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4512/8911] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:50:46 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:50:46.853007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:46.853717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:46.861507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:46.867037 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:46.867878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:46.868343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:47.040634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:47.048701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9401ffa7-4818-441d-99ad-80500da674b3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1725 microversion: 2.1 time: 0.200277 Nov 06 21:50:47.049609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4400/8912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:46 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:48.067622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:48.068554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:48.074550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:48.075022 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:48.075816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:48.076269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:48.287840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:48.295802 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ad032791-177a-4bfb-9853-14ea3b3ddd5a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1725 microversion: 2.1 time: 0.232752 Nov 06 21:50:48.296416 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4513/8913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:48 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:49.312498 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:49.313115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:49.319780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:49.320242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:49.321068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:49.321512 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:49.461074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:49.468869 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1d460fc4-9b86-42c6-b23d-450f7d3a59d8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.160047 Nov 06 21:50:49.469448 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4401/8914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:49 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:50.486562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:50.487306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:50.494735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:50.495203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:50.496004 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:50.496497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:50.625357 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:50.633187 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2e83d42-44d8-4820-8b41-ae9b3b6c0905 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.150559 Nov 06 21:50:50.633752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4514/8915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:50 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:51.651033 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:51.651646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:51.658322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:51.658774 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:51.659556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:51.660002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:51.787254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:51.795136 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2c53433f-d3e6-49cb-92b0-540dd202c69e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.147743 Nov 06 21:50:51.795714 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4402/8916] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:51 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:50:52.812864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:52.813485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:52.819981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:52.820505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:52.821299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:52.821750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:52.955748 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:52.964011 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-68b22b88-a6ec-44d6-be29-6a7c2e55f432 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.154852 Nov 06 21:50:52.964617 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4515/8917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:52 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:53.980951 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:53.981564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:53.988141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:53.988626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:53.990039 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:53.990483 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:54.119944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:54.127834 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db2bd58e-708b-49b7-88ec-47e615d95c1e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.150510 Nov 06 21:50:54.128370 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4403/8918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:53 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:55.144947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:55.145615 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:55.152070 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:55.152572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:55.153376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:55.153826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:55.284977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:55.292808 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2e870bd3-b0a0-4f9a-b7fc-c84e2b24399f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.151634 Nov 06 21:50:55.293395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4516/8919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:55 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:56.310775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:56.311333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:56.318533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:56.318997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:56.319789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:56.320234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:56.451446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:56.459750 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1ccc8df1-0564-4ff3-8261-4bf975c8bcba tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.152791 Nov 06 21:50:56.460350 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4404/8920] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:56 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:57.477227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:57.477851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:57.484778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:57.485301 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:57.486100 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:57.486559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:57.619367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:57.627178 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e916fcd1-75d3-45d6-bcd0-e3961635f1d4 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.154107 Nov 06 21:50:57.627754 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4517/8921] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:57 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:58.644167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:58.644795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:58.651477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:58.651933 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:58.652751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:58.653200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:58.780914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:58.789217 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f243036d-2d36-41c5-9d82-c1f35ff23f89 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.148813 Nov 06 21:50:58.789785 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4405/8922] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:58 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:50:59.806132 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:50:59.806654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:50:59.813309 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:59.813773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:59.814567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:50:59.815017 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:50:59.948476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:50:59.956358 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e05011d3-20cc-4f36-86c4-8fb77f6b4be3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.153979 Nov 06 21:50:59.956923 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4518/8923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:50:59 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:00.973251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:00.974461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:00.981135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:00.981592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:00.982382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:00.982825 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:01.119016 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:01.126915 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-823568f2-38a8-47ec-a61a-440ef84e0967 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.157360 Nov 06 21:51:01.127495 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4406/8924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:00 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:02.143942 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:02.144518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:02.151711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:02.152170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:02.152991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:02.153436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:02.283555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:02.292190 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d92752a-078b-4c63-82f8-451ec42a501b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.152019 Nov 06 21:51:02.292803 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4519/8925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:02 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:03.310001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:03.310565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:03.317226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:03.317683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:03.318475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:03.319564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:03.776736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:03.784746 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-57d2d68d-c2d6-41bc-816a-35adc289e89e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.478518 Nov 06 21:51:03.786341 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4407/8926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:03 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:04.804407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:04.805037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:04.811702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:04.812160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:04.812982 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:04.813428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:04.941245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:04.949732 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d52151cb-bfae-4f72-9b33-1a8ad23a535d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.149962 Nov 06 21:51:04.950307 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4520/8927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:04 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:05.966661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:05.967309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:05.974099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:05.974565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:05.975359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:05.975808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:06.104371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:06.112173 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28d4834d-a75c-46d4-8f55-f4fd77c0b62d tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1730 microversion: 2.1 time: 0.149241 Nov 06 21:51:06.112773 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4408/8928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:05 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:07.064710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-unplugged", "status": "completed", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:07.068052 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:07.068052 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:51:07.077194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:07.077648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:07.090502 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] Creating event network-vif-unplugged:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch2-master-1 Nov 06 21:51:07.096653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:51:07.109452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-d9eb6326-1669-4055-a4ef-6ea8a7d92a09 req-9a54eacb-0643-42b6-ba6f-5d98860b45a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102668 Nov 06 21:51:07.110180 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4521/8929] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:07.129139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:07.135166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:07.142585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:07.143162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:07.144070 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:07.144620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:07.380436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:07.389109 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18afd202-a87c-45d3-8f6d-a8d8bce0ab23 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1729 microversion: 2.1 time: 0.263617 Nov 06 21:51:07.389866 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4409/8930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:07 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:08.407494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:08.408451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:08.417051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:08.417524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:08.418539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:08.419003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:08.564035 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:08.572122 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51ca2322-7ffb-46ad-837c-29cc9975388f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1727 microversion: 2.1 time: 0.168866 Nov 06 21:51:08.572938 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4522/8931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:08 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:09.127529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:09.129109 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:09.129109 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:09.136968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:09.137414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:09.149125 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] Creating event network-changed:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch2-master-1 Nov 06 21:51:09.154238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:51:09.164712 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4705fa18-22f0-4580-8939-747a4d4c356d req-73e6c732-80a7-4380-84ef-282844ee0702 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040861 Nov 06 21:51:09.165219 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4410/8932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:09.590268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:09.590892 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:09.597643 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:09.598107 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:09.598902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:09.599358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:09.921462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:09.930067 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa9ebcbd-83fa-4e7c-b9fc-1529d62a5f2c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1727 microversion: 2.1 time: 0.343487 Nov 06 21:51:09.930645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4523/8933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:09 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1727 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:10.948184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:10.949122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:10.957421 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:10.957884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:10.958669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:10.959115 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:11.096684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:11.105027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c62b950e-673a-469d-a873-a87f165973d3 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1727 microversion: 2.1 time: 0.161530 Nov 06 21:51:11.105598 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4411/8934] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:10 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:12.122422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:12.123001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:12.129737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:12.130157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:12.131535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:12.131988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:12.265326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:12.273006 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ef3e9eb3-8a42-443f-9f58-0338aa0d2f8f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1727 microversion: 2.1 time: 0.154671 Nov 06 21:51:12.273578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4524/8935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:12 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:13.290610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:13.291250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:13.297854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:13.298303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:13.299078 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:13.299782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:13.446543 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:13.456472 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d1664121-fec4-4285-b499-e3eefe2e708b tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1727 microversion: 2.1 time: 0.170147 Nov 06 21:51:13.457058 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4412/8936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:13 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:14.474195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:14.475473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:14.482173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.482633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.483421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.483867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.616588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:14.624652 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6b863528-5e27-4fa7-95a3-9955163cd1b9 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1724 microversion: 2.1 time: 0.154254 Nov 06 21:51:14.625210 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4525/8937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:14 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:14.640980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:14.641524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:14.648677 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.649134 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.649926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.650392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.685063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.685511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.686322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.686760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.706333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:51:14.711814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Getting quotas for user 30877052910c43f8b93059d5edc5d333 and project 26004b59815e4c2eb2f07cb2f1066ed3. Resources: {'ram', 'cores'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:51:14.819681 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-55c157e3-beed-4111-b9ee-9ea6b81056a7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action" status: 202 len: 0 microversion: 2.1 time: 0.182282 Nov 06 21:51:14.820322 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4413/8938] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:51:14 2021] POST /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:51:14.828108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:14.828836 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:14.835327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.836078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:14.836837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:14.837134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:15.044003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:15.052100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5ae2b66c-05d9-4b1f-8809-22567128c8ec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.227664 Nov 06 21:51:15.052747 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4526/8939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:14 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:51:16.070451 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:16.071157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:16.077504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:16.077965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:16.078750 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:16.079210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:16.210013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:16.217846 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8141bc1d-79ef-47f2-a6fb-ca0e94408d86 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.152519 Nov 06 21:51:16.218417 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4414/8940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:16 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:16.860157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-plugged", "status": "completed", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:16.865882 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:16.865882 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:51:16.871314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:16.872673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:16.885609 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] Creating event network-vif-plugged:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch2-master-1 Nov 06 21:51:16.891626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:51:16.903140 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-552c177d-2fc2-4343-a2af-f882b228b706 req-62d3a785-5b9d-4469-9c08-3b2d158f6520 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046504 Nov 06 21:51:16.904338 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4527/8941] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:17.235190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:17.235740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:17.242952 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:17.243407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:17.244187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:17.244684 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:17.382003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:17.390138 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01568b9e-3a94-42c3-b779-8e04cdd413f5 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.158703 Nov 06 21:51:17.390708 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4415/8942] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:17 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:18.408781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:18.409387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:18.417251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:18.418682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:18.419527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:18.419986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:18.588099 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-unplugged", "status": "completed", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:18.589765 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:18.589765 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:18.597412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:18.597872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:18.611384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] Creating event network-vif-unplugged:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:51:18.617450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:51:18.629251 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d50a0281-1a45-4e8e-9a2f-52e313086e54 req-05e05703-7f25-4101-9388-3b285d42edc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045930 Nov 06 21:51:18.629859 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4416/8943] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:51:18.647961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:18.656230 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-785751ca-ce92-48b3-8b3d-7835facb1501 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.252507 Nov 06 21:51:18.657487 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4528/8944] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:18 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:19.674994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:19.675694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:19.683077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:19.683526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:19.684320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:19.685177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:19.904809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:19.913433 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0dc1f7e3-e8f2-4d3b-ad50-1d9c11fe71c2 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.242818 Nov 06 21:51:19.914015 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4417/8945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:19 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:20.659997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:20.662570 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:20.662570 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:51:20.670257 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:20.670726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:20.684268 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] Creating event network-changed:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:51:20.695702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 21:51:20.707527 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5be5a732-0088-4e34-9386-e9f7ee18a9b2 req-ac535793-9e09-40ca-842d-0042f9b4454c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050794 Nov 06 21:51:20.708454 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4529/8946] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:20.930934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:20.931554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:20.938540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:20.939205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:20.940322 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:20.940769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:21.254424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:21.262616 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ea2a8ec4-db3d-4e13-bb2f-f33edde0c767 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.335343 Nov 06 21:51:21.263192 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4418/8947] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:20 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:22.281631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:22.282256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:22.288343 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:22.288809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:22.289596 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:22.290040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:22.431546 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:22.439448 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d93d3b62-9ec1-4102-81da-436181437e19 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.162885 Nov 06 21:51:22.440036 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4530/8948] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:22 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:23.456339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:23.456955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:23.464175 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:23.464663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:23.465454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:23.465892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:23.598627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:23.606545 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e3f98d4f-addd-4cf0-acea-03f7296757fc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.153850 Nov 06 21:51:23.607111 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4419/8949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:23 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:24.624269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:24.624838 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:24.632167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:24.632653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:24.633447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:24.633950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:24.776855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:24.786202 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edea9a67-c7b9-45ac-b0fb-f81ed163c046 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1723 microversion: 2.1 time: 0.165470 Nov 06 21:51:24.786794 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4531/8950] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:24 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:25.803141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:25.803768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:25.810320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:25.810776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:25.811627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:25.812065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:25.941409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:25.949424 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7deb0307-f70c-406e-9ccc-23bfa3e161ad tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1716 microversion: 2.1 time: 0.150076 Nov 06 21:51:25.949996 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4420/8951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:25 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:25.966259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:25.966900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:25.973277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:25.973739 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:25.975109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:25.975553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.102900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:26.110629 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-51764385-34d2-4a47-a1c2-e7f11a131dbc tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1716 microversion: 2.1 time: 0.147968 Nov 06 21:51:26.111194 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4532/8952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:25 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:26.126264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:26.126872 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:26.133178 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.133629 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.134404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.134840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.269073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:26.277433 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0388dc22-b086-4824-b6b2-32846dbf44c7 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1716 microversion: 2.1 time: 0.154776 Nov 06 21:51:26.278002 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4421/8953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:26 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:26.293241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:26.293742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:26.299785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.300251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.301058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.301502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.325734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:51:26.400029 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58d313df-4d65-4e48-95c3-8c13ef53abec tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 204 len: 0 microversion: 2.1 time: 0.110113 Nov 06 21:51:26.400679 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4533/8954] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:26 2021] DELETE /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:51:26.409471 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:26.410081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:26.416041 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.416548 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.417496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.417968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.556166 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:26.564225 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7548b74-d903-408b-8d37-32fac937d182 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1722 microversion: 2.1 time: 0.159237 Nov 06 21:51:26.565047 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4422/8955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:26 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:51:26.577079 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ba6565ae-6108-4297-a132-40efd4296011 req-597782ce-7e35-4f6b-a092-6bbd2af0e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-plugged", "status": "completed", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:26.578517 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:26.578517 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:51:26.592184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ba6565ae-6108-4297-a132-40efd4296011 req-597782ce-7e35-4f6b-a092-6bbd2af0e3da service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:26.592889 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ba6565ae-6108-4297-a132-40efd4296011 req-597782ce-7e35-4f6b-a092-6bbd2af0e3da service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:26.604392 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ba6565ae-6108-4297-a132-40efd4296011 req-597782ce-7e35-4f6b-a092-6bbd2af0e3da service nova] Creating event network-vif-plugged:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:51:26.609156 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ba6565ae-6108-4297-a132-40efd4296011 req-597782ce-7e35-4f6b-a092-6bbd2af0e3da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Nov 06 21:51:26.609758 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4534/8956] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:27.581884 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:27.582521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:27.590617 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:27.591075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:27.591856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:27.592309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:27.728038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:27.735833 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-edffc42e-2169-43c5-8eb2-95e82e1e2a08 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1722 microversion: 2.1 time: 0.157704 Nov 06 21:51:27.736425 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4423/8957] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:27 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:28.753612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:28.754338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:28.761540 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:28.762012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:28.762827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:28.763280 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:28.837404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30877052910c43f8b93059d5edc5d333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26004b59815e4c2eb2f07cb2f1066ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:28.845556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57dcf1fc-3029-48ef-9a5a-6e822df72909 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 200 len: 1655 microversion: 2.1 time: 0.096041 Nov 06 21:51:28.846153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4535/8958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:28 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:29.030534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-627634f2-b572-4156-b4d3-918fd3dfd7d5 req-2d80985c-7749-4cc6-9a65-d1905390e2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101f6f75-2b81-426f-bcb4-ec5a0418ad9b", "name": "network-vif-deleted", "tag": "7ee61af7-fff4-410f-b212-d54881c342d0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:29.032283 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:29.032283 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:29.043376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-627634f2-b572-4156-b4d3-918fd3dfd7d5 req-2d80985c-7749-4cc6-9a65-d1905390e2f1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:29.043840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-627634f2-b572-4156-b4d3-918fd3dfd7d5 req-2d80985c-7749-4cc6-9a65-d1905390e2f1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:29.056127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-627634f2-b572-4156-b4d3-918fd3dfd7d5 req-2d80985c-7749-4cc6-9a65-d1905390e2f1 service nova] Creating event network-vif-deleted:7ee61af7-fff4-410f-b212-d54881c342d0 for instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b on nch1-master-1 Nov 06 21:51:29.061175 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-627634f2-b572-4156-b4d3-918fd3dfd7d5 req-2d80985c-7749-4cc6-9a65-d1905390e2f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034564 Nov 06 21:51:29.061979 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4424/8959] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:29.864918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:29.865553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:29.872979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:29.873439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:29.874456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:29.874907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:29.889525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. Nov 06 21:51:29.890173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:29.891035 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d98f3343-a139-485c-8377-59fc684b4307 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 404 len: 111 microversion: 2.1 time: 0.029963 Nov 06 21:51:29.891606 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4536/8960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:29 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:29.947717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:29.948753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:29.954934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:29.955389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:29.956171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:29.956662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:29.969758 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. Nov 06 21:51:29.970361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:29.971224 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5c808913-f32f-4822-b9db-cf3954c9f48c tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028265 Nov 06 21:51:29.971779 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4425/8961] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:51:29 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.217795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.218341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.225080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.225554 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.226351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.226804 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.242525 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. Nov 06 21:51:31.243126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.243962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1978d363-917b-4903-ac3f-db19a8ce1363 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 404 len: 111 microversion: 2.1 time: 0.029813 Nov 06 21:51:31.244515 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4537/8962] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:31 2021] DELETE /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.253334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.253963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 101f6f75-2b81-426f-bcb4-ec5a0418ad9b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.260837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.261312 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.262085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.262521 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.275649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. Nov 06 21:51:31.276234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 101f6f75-2b81-426f-bcb4-ec5a0418ad9b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.277083 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ae31a27-b21e-448a-9d13-22d09da5d18e tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b" status: 404 len: 111 microversion: 2.1 time: 0.028064 Nov 06 21:51:31.277592 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4426/8963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:31 2021] GET /compute/v2.1/servers/101f6f75-2b81-426f-bcb4-ec5a0418ad9b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.285258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.285762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.291465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.291922 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.292735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.293181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.311248 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. Nov 06 21:51:31.311861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.312744 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9a373a81-be20-44ce-a268-cb4ac760e172 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 404 len: 111 microversion: 2.1 time: 0.031054 Nov 06 21:51:31.313287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4538/8964] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:31 2021] DELETE /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.321591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.322202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.328028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.328533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.329308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.329749 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.342675 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. Nov 06 21:51:31.343256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.344063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3776d2e2-962e-4a07-963f-1bf1f19a702f tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3" status: 404 len: 111 microversion: 2.1 time: 0.026797 Nov 06 21:51:31.344604 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4427/8965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:31 2021] GET /compute/v2.1/servers/27cc102d-e49d-4e5d-b95b-785a6ce1f7f3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.352805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.353323 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.359253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.359731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.360563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.361020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.374635 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. Nov 06 21:51:31.375263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.376096 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a8531e18-5c13-451c-9640-12879826fbfe tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 404 len: 111 microversion: 2.1 time: 0.027512 Nov 06 21:51:31.376661 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4539/8966] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:31 2021] DELETE /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.384170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.384824 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: c659700d-b480-442a-a00f-2ca0208e28ed] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.390618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.391068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.391840 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.392275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.406985 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. Nov 06 21:51:31.407571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance c659700d-b480-442a-a00f-2ca0208e28ed could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.408410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b36b424c-dc99-4d26-850c-72bd06130c9a tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed" status: 404 len: 111 microversion: 2.1 time: 0.027850 Nov 06 21:51:31.408937 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4428/8967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:31 2021] GET /compute/v2.1/servers/c659700d-b480-442a-a00f-2ca0208e28ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.417897 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.418452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.424786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.425246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.426050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.426498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.439995 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. Nov 06 21:51:31.440622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.441446 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d031bdaf-d34a-479c-ad2d-754eaaa10271 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 404 len: 111 microversion: 2.1 time: 0.027229 Nov 06 21:51:31.441960 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4540/8968] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:31 2021] DELETE /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:31.449535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.450081 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] [instance: 3b079c06-8aee-4ba1-801f-fae8b19eef40] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:31.455900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.456384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.457159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:31.457595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:31.470617 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] HTTP exception thrown: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. Nov 06 21:51:31.471193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Returning 404 to user: Instance 3b079c06-8aee-4ba1-801f-fae8b19eef40 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:31.472000 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-87624094-e04a-435a-a030-7c6e430878a8 tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40" status: 404 len: 111 microversion: 2.1 time: 0.026169 Nov 06 21:51:31.472544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4429/8969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:31 2021] GET /compute/v2.1/servers/3b079c06-8aee-4ba1-801f-fae8b19eef40 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:51:31.480789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a2b707f-1d0f-4925-ab9f-102d556d84bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] Calling method '.version_select at 0x7f6707ec5550>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:31.503745 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a2b707f-1d0f-4925-ab9f-102d556d84bd tempest-ServerActionsTestJSON-2001272451 tempest-ServerActionsTestJSON-2001272451-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399394096" status: 202 len: 0 microversion: 2.1 time: 0.026426 Nov 06 21:51:31.504344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4541/8970] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Nov 6 21:51:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399394096 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:51:37.560519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-718029055", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "5a56622a-09f5-4dd6-8663-e14bbfc2a18d"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:37.612475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] validate_networks() for [('5a56622a-09f5-4dd6-8663-e14bbfc2a18d', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:51:37.953938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:51:37.954376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:51:37.954864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:51:37.955285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:51:37.955747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:51:37.964970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:37.965431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:37.966261 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:37.966708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:37.983258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Getting quotas for project a24671d0a1cd49098984bf31f81bd98f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:51:37.988251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Getting quotas for user 2c65fb312cf748a0a5c96fae94dfb523 and project a24671d0a1cd49098984bf31f81bd98f. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:51:38.000028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:51:38.002382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:51:38.046753 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d2cc9fb-3153-405d-bafd-53dc252a1c50 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616578 Nov 06 21:51:38.047445 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4430/8971] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:51:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:51:38.058218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-953186ef-70aa-4ba9-9ac1-9a272cf1a19e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:38.058848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-953186ef-70aa-4ba9-9ac1-9a272cf1a19e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:38.112183 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-953186ef-70aa-4ba9-9ac1-9a272cf1a19e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:38.118941 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-953186ef-70aa-4ba9-9ac1-9a272cf1a19e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1216 microversion: 2.1 time: 0.065271 Nov 06 21:51:38.119586 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4542/8972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:38 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:39.136898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:39.137643 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:39.145156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:39.145618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:39.146412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:39.146855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:39.236492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:39.244116 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd7c086a-a7c7-4563-9fa5-ececa53fe4da tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1274 microversion: 2.1 time: 0.112360 Nov 06 21:51:39.244728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4431/8973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:39 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:40.190278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-2eb1c3d7-bec0-4a5d-a39b-20ad83be8fe2 req-3d0690f6-f37e-4894-b4ca-ee164c8e1c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2", "tag": "fec93d07-4c0c-4367-bc87-3116d5e43f69"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:40.193039 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:40.193039 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:51:40.201358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2eb1c3d7-bec0-4a5d-a39b-20ad83be8fe2 req-3d0690f6-f37e-4894-b4ca-ee164c8e1c4d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:40.201814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-2eb1c3d7-bec0-4a5d-a39b-20ad83be8fe2 req-3d0690f6-f37e-4894-b4ca-ee164c8e1c4d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:40.212978 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-2eb1c3d7-bec0-4a5d-a39b-20ad83be8fe2 req-3d0690f6-f37e-4894-b4ca-ee164c8e1c4d service nova] Creating event network-changed:fec93d07-4c0c-4367-bc87-3116d5e43f69 for instance b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 on nch1-master-1 Nov 06 21:51:40.218042 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-2eb1c3d7-bec0-4a5d-a39b-20ad83be8fe2 req-3d0690f6-f37e-4894-b4ca-ee164c8e1c4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031389 Nov 06 21:51:40.218688 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4543/8974] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:40.262387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:40.263214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:40.270027 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:40.270550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:40.271409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:40.271916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:40.514658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:40.521979 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dec05806-998b-4b42-904b-50952704bb69 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1316 microversion: 2.1 time: 0.263377 Nov 06 21:51:40.522551 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4432/8975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:40 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:41.540336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:41.541084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:41.547185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:41.547678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:41.548497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:41.548947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:41.678900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:41.686155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a321a075-053a-4385-8add-58219274a26b tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1316 microversion: 2.1 time: 0.150788 Nov 06 21:51:41.686718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4544/8976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:41 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:42.702965 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:42.703616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:42.710285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:42.710737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:42.711524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:42.711990 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:42.840601 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:42.847809 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d2477b39-7b2f-44a5-a097-2495adf9eeb8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1316 microversion: 2.1 time: 0.148760 Nov 06 21:51:42.848394 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4433/8977] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:42 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:43.865687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:43.866348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:43.873245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:43.873715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:43.874524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:43.874980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:44.011563 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:44.018860 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f260088-3eac-473d-89af-acfc65c44d88 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1316 microversion: 2.1 time: 0.157672 Nov 06 21:51:44.019428 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4545/8978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:43 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:44.635200 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-79fb443a-7c0e-4d3e-ba57-19783d313a8d req-bf2a8459-54d1-4b11-b45c-7cabfab35ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2", "name": "network-vif-plugged", "status": "completed", "tag": "fec93d07-4c0c-4367-bc87-3116d5e43f69"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:44.636997 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:44.636997 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:44.647126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-79fb443a-7c0e-4d3e-ba57-19783d313a8d req-bf2a8459-54d1-4b11-b45c-7cabfab35ad7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:44.647581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-79fb443a-7c0e-4d3e-ba57-19783d313a8d req-bf2a8459-54d1-4b11-b45c-7cabfab35ad7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:44.658713 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-79fb443a-7c0e-4d3e-ba57-19783d313a8d req-bf2a8459-54d1-4b11-b45c-7cabfab35ad7 service nova] Creating event network-vif-plugged:fec93d07-4c0c-4367-bc87-3116d5e43f69 for instance b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 on nch1-master-1 Nov 06 21:51:44.664839 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-79fb443a-7c0e-4d3e-ba57-19783d313a8d req-bf2a8459-54d1-4b11-b45c-7cabfab35ad7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Nov 06 21:51:44.665432 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4434/8979] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:51:45.035025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:45.035559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:45.042444 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:45.042905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:45.043695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:45.044141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:45.518913 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:45.526155 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78b1fb13-a46f-4b52-9c92-2877caa8af10 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1316 microversion: 2.1 time: 0.494999 Nov 06 21:51:45.526718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4546/8980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:45 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:46.543173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:46.543873 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:46.550932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:46.551383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:46.553720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:46.554176 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:46.682599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:46.690956 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f35d515e-7a34-45de-b345-6daf1f85a7ce tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.151796 Nov 06 21:51:46.691585 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4435/8981] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:46 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:46.744807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1574087314", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "5a56622a-09f5-4dd6-8663-e14bbfc2a18d"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:46.797069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] validate_networks() for [('5a56622a-09f5-4dd6-8663-e14bbfc2a18d', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:51:47.163830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:51:47.164263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:51:47.164781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:51:47.165233 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:51:47.165661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:51:47.174267 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:47.174979 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:47.175808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:47.176256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:47.192932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Getting quotas for project a24671d0a1cd49098984bf31f81bd98f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:51:47.197904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Getting quotas for user 2c65fb312cf748a0a5c96fae94dfb523 and project a24671d0a1cd49098984bf31f81bd98f. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:51:47.209507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:51:47.211809 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:51:47.255962 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e39d0920-996d-4a15-b473-07ef2218a4de tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514706 Nov 06 21:51:47.256655 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4547/8982] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:51:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:51:47.266347 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74490416-b789-4379-844c-bd4d26daa228 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:47.267069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74490416-b789-4379-844c-bd4d26daa228 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:47.318981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74490416-b789-4379-844c-bd4d26daa228 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:47.326069 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74490416-b789-4379-844c-bd4d26daa228 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1217 microversion: 2.1 time: 0.063512 Nov 06 21:51:47.326636 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4436/8983] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:47 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:48.343883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:48.344533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:48.350432 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:48.350904 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:48.351705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:48.352158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:48.433422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:48.440844 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e38469ff-1344-4f00-8fc5-2375b63b32a8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1275 microversion: 2.1 time: 0.101588 Nov 06 21:51:48.441416 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4548/8984] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:48 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:49.412664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-9a2730d3-c4ac-445d-af2c-a9ea8c28bfa8 req-3c184d2f-a68e-4580-81ad-009183e5ce30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98270633-c21d-4880-93b7-dfe91e3e6afa", "tag": "e6140be0-0d93-4ba7-b84f-4bdd10cba117"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:49.414182 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:49.414182 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:49.427616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9a2730d3-c4ac-445d-af2c-a9ea8c28bfa8 req-3c184d2f-a68e-4580-81ad-009183e5ce30 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:49.428389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-9a2730d3-c4ac-445d-af2c-a9ea8c28bfa8 req-3c184d2f-a68e-4580-81ad-009183e5ce30 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:49.439153 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-9a2730d3-c4ac-445d-af2c-a9ea8c28bfa8 req-3c184d2f-a68e-4580-81ad-009183e5ce30 service nova] Creating event network-changed:e6140be0-0d93-4ba7-b84f-4bdd10cba117 for instance 98270633-c21d-4880-93b7-dfe91e3e6afa on nch2-master-1 Nov 06 21:51:49.443837 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-9a2730d3-c4ac-445d-af2c-a9ea8c28bfa8 req-3c184d2f-a68e-4580-81ad-009183e5ce30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Nov 06 21:51:49.444483 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4437/8985] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:49.458110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:49.458735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:49.465721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:49.466185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:49.466992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:49.467447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:49.688055 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:49.695499 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e4c05628-ae39-45d0-9673-47a63ae9a8f9 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.241002 Nov 06 21:51:49.696252 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4549/8986] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:49 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:50.713777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:50.714472 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:50.720733 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:50.721189 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:50.721970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:50.722437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:50.853592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:50.860832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dd80169f-450f-49fd-91b7-321c2157d5cf tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.152340 Nov 06 21:51:50.861397 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4438/8987] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:50 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:51.878097 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:51.878715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:51.885553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:51.886013 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:51.886795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:51.887241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:52.025467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:52.032689 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a6ee83f5-f017-4f4a-af6b-a5060d61c111 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.158424 Nov 06 21:51:52.033283 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4550/8988] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:51 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:53.049390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:53.050297 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:53.057089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:53.057550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:53.058476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:53.058930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:53.190372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:53.198161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-176a59d7-4dd6-4cee-a9f3-12f0c472e9a1 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.152605 Nov 06 21:51:53.198730 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4439/8989] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:53 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:54.214671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:54.215337 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:54.221920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:54.222384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:54.223795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:54.224253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:54.359539 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:54.366850 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d7105726-ca12-40ed-9ad6-b2c8aaecd7f8 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.155997 Nov 06 21:51:54.367416 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4551/8990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:54 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:51:55.059785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-126dc3f1-16c9-4d11-9ab9-d16a707522e7 req-34a01c10-8594-4ca0-9b04-f257a238b94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98270633-c21d-4880-93b7-dfe91e3e6afa", "name": "network-vif-plugged", "status": "completed", "tag": "e6140be0-0d93-4ba7-b84f-4bdd10cba117"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:55.061331 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:55.061331 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:55.069713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-126dc3f1-16c9-4d11-9ab9-d16a707522e7 req-34a01c10-8594-4ca0-9b04-f257a238b94b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:55.070585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-126dc3f1-16c9-4d11-9ab9-d16a707522e7 req-34a01c10-8594-4ca0-9b04-f257a238b94b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:55.081413 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-126dc3f1-16c9-4d11-9ab9-d16a707522e7 req-34a01c10-8594-4ca0-9b04-f257a238b94b service nova] Creating event network-vif-plugged:e6140be0-0d93-4ba7-b84f-4bdd10cba117 for instance 98270633-c21d-4880-93b7-dfe91e3e6afa on nch2-master-1 Nov 06 21:51:55.086137 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-126dc3f1-16c9-4d11-9ab9-d16a707522e7 req-34a01c10-8594-4ca0-9b04-f257a238b94b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 Nov 06 21:51:55.086893 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4440/8991] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:55.383392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:55.384036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:55.390808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:55.391266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:55.392052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:55.392527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:55.520377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:55.527560 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-163b1b98-10ba-45d0-bf05-c71722938246 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1317 microversion: 2.1 time: 0.147989 Nov 06 21:51:55.528144 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4552/8992] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:55 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:56.546083 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:56.546764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:56.553626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.554077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.554849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.555284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.690220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:56.698255 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-607cd29b-8ca7-48b6-bedd-e5931538743e tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1505 microversion: 2.1 time: 0.157059 Nov 06 21:51:56.698831 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4441/8993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:56 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:56.714034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:56.714568 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:56.720918 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.721389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.722195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.722650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.750593 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:51:56.823025 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b836611e-3b0e-4144-b278-3a62a1353761 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 204 len: 0 microversion: 2.1 time: 0.112486 Nov 06 21:51:56.823640 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4553/8994] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:51:56 2021] DELETE /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:51:56.831944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:56.832608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:56.838507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.838967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.839757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:56.840209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:56.969806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:56.977638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d3a82ee5-a5a4-48fd-b8d0-51a02cde7ef6 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1511 microversion: 2.1 time: 0.149808 Nov 06 21:51:56.978203 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4442/8995] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:56 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:57.995474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:57.996224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:58.002884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:58.003356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:58.004158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:58.004644 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:58.138895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:58.146314 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ff370d2-fce2-48c2-b5b0-319e9017f412 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 200 len: 1511 microversion: 2.1 time: 0.154923 Nov 06 21:51:58.146887 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4554/8996] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:57 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:58.679375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-59191d61-1a82-4862-b8ea-78e2dcdef8fc req-6fefe567-29ad-4409-9a47-555dd4292f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98270633-c21d-4880-93b7-dfe91e3e6afa", "name": "network-vif-deleted", "tag": "e6140be0-0d93-4ba7-b84f-4bdd10cba117"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:58.681230 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:51:58.681230 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:51:58.689610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59191d61-1a82-4862-b8ea-78e2dcdef8fc req-6fefe567-29ad-4409-9a47-555dd4292f32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:58.690690 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59191d61-1a82-4862-b8ea-78e2dcdef8fc req-6fefe567-29ad-4409-9a47-555dd4292f32 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:58.703301 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-59191d61-1a82-4862-b8ea-78e2dcdef8fc req-6fefe567-29ad-4409-9a47-555dd4292f32 service nova] Creating event network-vif-deleted:e6140be0-0d93-4ba7-b84f-4bdd10cba117 for instance 98270633-c21d-4880-93b7-dfe91e3e6afa on nch2-master-1 Nov 06 21:51:58.709564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-59191d61-1a82-4862-b8ea-78e2dcdef8fc req-6fefe567-29ad-4409-9a47-555dd4292f32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034770 Nov 06 21:51:58.710265 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4443/8997] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:51:59.162953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.163609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.170560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.171032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.171870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.172354 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.185889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. Nov 06 21:51:59.186491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 404 to user: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:59.187326 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7fe5308c-75d3-4b3c-be31-7a0b0b5f9dcb tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 404 len: 111 microversion: 2.1 time: 0.028206 Nov 06 21:51:59.187864 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4555/8998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:51:59.197311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.198012 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.204087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.204581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.205354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.205792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.341947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:59.350495 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-43098629-3d61-4fe2-aef7-657ddb0a524c tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.157775 Nov 06 21:51:59.351084 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4444/8999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:59.366697 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85dcb48d-5b15-416e-93bb-dcccbd4a6eff tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:59.367737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85dcb48d-5b15-416e-93bb-dcccbd4a6eff tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 21e65e6c-ca4b-4a51-bd75-3bcb93736939] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.373145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-85dcb48d-5b15-416e-93bb-dcccbd4a6eff tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Instance 21e65e6c-ca4b-4a51-bd75-3bcb93736939 could not be found. Nov 06 21:51:59.373731 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85dcb48d-5b15-416e-93bb-dcccbd4a6eff tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 404 to user: Instance 21e65e6c-ca4b-4a51-bd75-3bcb93736939 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:59.374548 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85dcb48d-5b15-416e-93bb-dcccbd4a6eff tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "POST /compute/v2.1/servers/21e65e6c-ca4b-4a51-bd75-3bcb93736939/action" status: 404 len: 111 microversion: 2.1 time: 0.011687 Nov 06 21:51:59.375071 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4556/9000] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:51:59 2021] POST /compute/v2.1/servers/21e65e6c-ca4b-4a51-bd75-3bcb93736939/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:51:59.383128 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.383738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.389513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.389971 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.390753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.391195 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.522920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:59.530274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7e7ac23-6637-42fc-80a4-d65409287918 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.151275 Nov 06 21:51:59.530864 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4445/9001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:59.548285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.548938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.556693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.557161 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.557954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.558401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.694073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:59.701514 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5891631e-1811-4db0-8f3c-dfadc9830089 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.156999 Nov 06 21:51:59.702076 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4557/9002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:59.718038 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2fc48b3f-dc4e-4fba-87d1-3f417d41bdb6"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:51:59.719005 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.726210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.726663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.727443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.727883 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.754626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:59.759614 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Flavor 2fc48b3f-dc4e-4fba-87d1-3f417d41bdb6 could not be found. Nov 06 21:51:59.760214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 400 to user: Flavor 2fc48b3f-dc4e-4fba-87d1-3f417d41bdb6 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:51:59.761081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23dc940e-720f-4b1c-b136-7b3f33a03783 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "POST /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2/action" status: 400 len: 107 microversion: 2.1 time: 0.046789 Nov 06 21:51:59.761647 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4446/9003] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:51:59 2021] POST /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2/action => generated 107 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:51:59.769705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.770352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.776682 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.777156 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.777943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.778394 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.908875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:51:59.916204 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8423ae41-13da-4106-879a-e1a05d1518b7 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.150157 Nov 06 21:51:59.916821 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4558/9004] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:51:59.933014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:51:59.933637 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:51:59.939568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.940023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:51:59.940871 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:51:59.941343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.071040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:00.078382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a44882b9-44d0-4c59-9bb9-46fe2e9a4eb0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.148983 Nov 06 21:52:00.078946 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4447/9005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:51:59 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:00.094854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5c44edf-49c0-49d7-afd4-341c08e331b4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:52:00.095980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e5c44edf-49c0-49d7-afd4-341c08e331b4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:52:00.096821 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e5c44edf-49c0-49d7-afd4-341c08e331b4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "POST /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2/action" status: 400 len: 113 microversion: 2.1 time: 0.005677 Nov 06 21:52:00.097325 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4559/9006] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:52:00 2021] POST /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 06 21:52:00.106564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:00.107229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:00.113116 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.113569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.114349 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.114791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.247235 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:00.254707 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-74ed3bf7-578c-42cb-b0af-b2a536033839 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1504 microversion: 2.1 time: 0.151706 Nov 06 21:52:00.255274 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4448/9007] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:00 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:00.275866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:00.276414 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:00.283203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.283669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.284486 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.284935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.297407 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. Nov 06 21:52:00.297989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 404 to user: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:52:00.298801 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2a0379d-e7e2-4363-b8af-746cd76488f3 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 404 len: 111 microversion: 2.1 time: 0.027642 Nov 06 21:52:00.299314 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4560/9008] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:52:00 2021] DELETE /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:52:00.307667 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:00.308272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: 98270633-c21d-4880-93b7-dfe91e3e6afa] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:00.314132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.314587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.315366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.315805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.329566 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. Nov 06 21:52:00.330152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 404 to user: Instance 98270633-c21d-4880-93b7-dfe91e3e6afa could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:52:00.330971 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1007e1e5-490f-4f09-840b-e4414528d3e5 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa" status: 404 len: 111 microversion: 2.1 time: 0.026975 Nov 06 21:52:00.331493 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4449/9009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:00 2021] GET /compute/v2.1/servers/98270633-c21d-4880-93b7-dfe91e3e6afa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 06 21:52:00.339099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:00.339606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:00.345314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.345785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.346559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.347003 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.370885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:52:00.439866 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85e08d55-baa7-49e4-8b15-9d02fe118172 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 204 len: 0 microversion: 2.1 time: 0.104053 Nov 06 21:52:00.440543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4561/9010] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:52:00 2021] DELETE /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:52:00.448911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:00.449515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:00.455236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.455685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.456492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:00.456930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:00.585431 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:00.594336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7eab7cd7-cf68-4fd9-9e55-00c7af7519d0 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1510 microversion: 2.1 time: 0.149246 Nov 06 21:52:00.594918 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4450/9011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:00 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:52:01.611304 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:01.612008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:01.619311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:01.619770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:01.620652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:01.621098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:02.032928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:02.041646 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f532773-9881-4656-8561-ee3fa4f04e21 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1510 microversion: 2.1 time: 0.434387 Nov 06 21:52:02.042212 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4562/9012] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:01 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:02.670527 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6a166d2d-ed6f-49d3-87bd-9a5db28ab18b req-02ab9178-2f33-4027-a907-a84c650aa563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2", "name": "network-vif-deleted", "tag": "fec93d07-4c0c-4367-bc87-3116d5e43f69"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:52:02.672048 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:52:02.672048 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:52:02.681145 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a166d2d-ed6f-49d3-87bd-9a5db28ab18b req-02ab9178-2f33-4027-a907-a84c650aa563 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:02.681438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6a166d2d-ed6f-49d3-87bd-9a5db28ab18b req-02ab9178-2f33-4027-a907-a84c650aa563 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:02.693843 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6a166d2d-ed6f-49d3-87bd-9a5db28ab18b req-02ab9178-2f33-4027-a907-a84c650aa563 service nova] Creating event network-vif-deleted:fec93d07-4c0c-4367-bc87-3116d5e43f69 for instance b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 on nch1-master-1 Nov 06 21:52:02.698653 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6a166d2d-ed6f-49d3-87bd-9a5db28ab18b req-02ab9178-2f33-4027-a907-a84c650aa563 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031961 Nov 06 21:52:02.699256 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4451/9013] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:52:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:52:03.059303 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:03.059924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:03.066639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:03.067110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:03.067934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:03.068411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:03.099898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:03.100488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:03.101056 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lazy-loading 'fault' on Instance uuid b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:52:03.142549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c65fb312cf748a0a5c96fae94dfb523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24671d0a1cd49098984bf31f81bd98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:03.150667 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78a97eca-c931-45b3-bfa7-54816dfc965d tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 200 len: 1306 microversion: 2.1 time: 0.095027 Nov 06 21:52:03.151228 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4563/9014] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:03 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:04.168361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:04.169010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] [instance: b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:04.175633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:04.176086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:04.176916 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:04.177929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:04.190835 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] HTTP exception thrown: Instance b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 could not be found. Nov 06 21:52:04.191424 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] Returning 404 to user: Instance b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:52:04.192244 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e0098d7-da74-4668-a4e8-f6aea2239ee4 tempest-ServersNegativeTestJSON-238596090 tempest-ServersNegativeTestJSON-238596090-project] 10.222.0.13 "GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2" status: 404 len: 111 microversion: 2.1 time: 0.029016 Nov 06 21:52:04.192794 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4452/9015] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:04 2021] GET /compute/v2.1/servers/b61cdefc-7880-4008-a5a1-f3f1cbd5b1a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:52:41.217900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'create', calling method: .version_select at 0x7f6707e9f790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-526887148"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:52:41.236175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:52:41.241105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for user 408897a95ae34cb1b49d3ec06752e4fb and project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:52:41.473750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:52:41.478402 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for user 408897a95ae34cb1b49d3ec06752e4fb and project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:52:41.492632 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2b36b05-e1c2-4c13-aedc-69037ddc450c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.278469 Nov 06 21:52:41.493256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4564/9016] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:52:41 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:41.543004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-58446268", "imageRef": "d420e85d-ea4f-4c36-a25b-d3b11be3df20", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-526887148", "networks": [{"uuid": "cbe8ecd2-33c5-4590-bace-94182f4ce59b"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:52:41.592646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] validate_networks() for [('cbe8ecd2-33c5-4590-bace-94182f4ce59b', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:52:42.047365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:52:42.047796 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:52:42.048277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:52:42.048727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:52:42.049174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:52:42.058700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:42.059156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:42.060042 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:42.060450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:42.076718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:52:42.081854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Getting quotas for user 408897a95ae34cb1b49d3ec06752e4fb and project 872e719b2a874cdc91e0c215ef3ea959. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:52:42.093639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:52:42.095875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d420e85d-ea4f-4c36-a25b-d3b11be3df20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:52:42.141086 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8298e037-6bff-497f-9bae-008b6911b0fb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602078 Nov 06 21:52:42.141734 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4453/9017] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:52:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:52:42.151803 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d71611bb-15d5-4648-99eb-3922fbfa5e14 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:42.152548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d71611bb-15d5-4648-99eb-3922fbfa5e14 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:42.212171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d71611bb-15d5-4648-99eb-3922fbfa5e14 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:42.218870 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d71611bb-15d5-4648-99eb-3922fbfa5e14 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1256 microversion: 2.1 time: 0.071187 Nov 06 21:52:42.219474 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4565/9018] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:42 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:43.237114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:43.238356 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:43.247292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:43.247748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:43.248591 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:43.249065 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:43.343546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:43.352821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d49e5bc1-41ed-4278-9dee-525f622f0545 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1314 microversion: 2.1 time: 0.120212 Nov 06 21:52:43.353401 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4454/9019] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:43 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1314 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:44.373171 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:44.374603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:44.382393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:44.382855 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:44.383669 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:44.384125 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:44.519209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:44.527808 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02eeb328-4ed4-4ad9-8c1a-d64f17c3aa40 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.160857 Nov 06 21:52:44.537694 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4566/9020] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:44 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:45.545156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:45.545794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:45.553461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:45.553924 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:45.554719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:45.555153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:45.706615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:45.714679 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-66e705f8-cc2a-49e7-ac11-b543cfc315d4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.173277 Nov 06 21:52:45.715246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4455/9021] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:45 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:46.731037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:46.731757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:46.738560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:46.739027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:46.739826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:46.740275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:46.891094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:46.898986 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a62066a-45d8-4c3b-89f8-2eff0c0e6158 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.171576 Nov 06 21:52:46.899543 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4567/9022] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:46 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:47.915544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:47.916368 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:47.923554 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:47.924103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:47.925275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:47.925787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:48.063944 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:48.073080 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d4ddd1e-578e-470c-b5fe-16c32e10f5c1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.161176 Nov 06 21:52:48.073941 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4456/9023] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:47 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:49.090009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:49.090664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:49.097497 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:49.097967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:49.098794 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:49.099244 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:49.240218 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:49.248058 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e21ff34d-69d2-404c-88d8-175ab39c66ed tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.161685 Nov 06 21:52:49.248677 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4568/9024] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:49 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:50.267262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:50.267849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:50.274362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:50.274833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:50.275649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:50.276107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:50.431753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:50.439427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d4baaa8f-4f86-4592-b602-3e4b47e5ecf3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.177101 Nov 06 21:52:50.439999 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4457/9025] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:50 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:51.457652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:51.458467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:51.465265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:51.465755 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:51.466557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:51.467038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:51.613442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:51.621532 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6ea48faa-fda1-4e81-9d06-46cdfbeebe29 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.168694 Nov 06 21:52:51.622099 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4569/9026] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:51 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:52.639139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:52.639975 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:52.648214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:52.648695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:52.649497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:52.649931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:52.790662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:52.797997 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b1d6b68f-7d73-4cd5-8ec1-25954a899dbf tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.164009 Nov 06 21:52:52.798577 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4458/9027] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:52 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:53.816368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:53.817488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:53.823786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:53.824192 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:53.825007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:53.825459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:53.961284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:53.968468 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e8d156b-cd48-463d-820d-0adce15a6fa5 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.156050 Nov 06 21:52:53.969027 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4570/9028] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:53 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:54.985216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:54.985836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:54.992623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:54.993082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:54.993869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:54.994313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:55.121338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:55.128886 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e79e8ffb-efac-442b-b457-04c2d69cdc99 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.147073 Nov 06 21:52:55.129178 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4459/9029] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:54 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:56.145580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:56.146224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:56.153021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:56.153592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:56.154410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:56.154867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:56.367692 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:56.375161 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c88f2796-980d-4acf-b0ed-82abdfc39e3e tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.233389 Nov 06 21:52:56.375738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4571/9030] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:56 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:56.711642 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3e372613-8869-4e87-991c-7f3cd4a98dec req-abc99472-54f0-4b32-8451-395e48c4a951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:52:56.717370 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:52:56.717370 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:52:56.742350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e372613-8869-4e87-991c-7f3cd4a98dec req-abc99472-54f0-4b32-8451-395e48c4a951 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:56.742805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3e372613-8869-4e87-991c-7f3cd4a98dec req-abc99472-54f0-4b32-8451-395e48c4a951 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:56.756067 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3e372613-8869-4e87-991c-7f3cd4a98dec req-abc99472-54f0-4b32-8451-395e48c4a951 service nova] Creating event network-changed:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:52:56.761895 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3e372613-8869-4e87-991c-7f3cd4a98dec req-abc99472-54f0-4b32-8451-395e48c4a951 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054772 Nov 06 21:52:56.762504 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4460/9031] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:52:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:52:57.392104 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:57.392770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:57.399469 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:57.399933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:57.400792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:57.401249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:57.601458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:57.608710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-275fc124-fa02-48f1-841e-9c8fd16c16f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.220246 Nov 06 21:52:57.609456 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4572/9032] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:57 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:58.626438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:58.627143 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:58.634532 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:58.634991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:58.635773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:58.636217 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:58.768592 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:58.775798 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df00f541-ff9e-4200-9227-526f097d5e72 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.153396 Nov 06 21:52:58.776391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4461/9033] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:58 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:52:59.792566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:52:59.793188 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:52:59.800119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:59.800623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:59.801420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:52:59.801868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:52:59.935184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:52:59.943041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-29b1d238-5d2d-46c4-8776-0de087cf22f7 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.154348 Nov 06 21:52:59.943611 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4573/9034] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:52:59 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:00.960001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:00.960654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:00.967260 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:00.967685 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:00.968509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:00.968947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:01.106264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:01.113532 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c99feeb7-eb5d-4f8d-ad5c-776d680ce110 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.157724 Nov 06 21:53:01.114095 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4462/9035] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:00 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:02.130390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:02.130927 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:02.137564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:02.138031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:02.138828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:02.139278 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:02.272566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:02.279757 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03645c72-9da6-4570-b83e-77caf1654818 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.153228 Nov 06 21:53:02.280349 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4574/9036] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:02 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:03.108559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3ae6cc0f-5a0f-4ef2-9e7b-037e3cf80425 req-f1e115d5-4f3a-41d6-b268-cc9d5726af93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "name": "network-vif-plugged", "status": "completed", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:53:03.110073 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:53:03.110073 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:53:03.117411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3ae6cc0f-5a0f-4ef2-9e7b-037e3cf80425 req-f1e115d5-4f3a-41d6-b268-cc9d5726af93 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:03.117874 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3ae6cc0f-5a0f-4ef2-9e7b-037e3cf80425 req-f1e115d5-4f3a-41d6-b268-cc9d5726af93 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:03.128593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3ae6cc0f-5a0f-4ef2-9e7b-037e3cf80425 req-f1e115d5-4f3a-41d6-b268-cc9d5726af93 service nova] Creating event network-vif-plugged:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:53:03.133602 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3ae6cc0f-5a0f-4ef2-9e7b-037e3cf80425 req-f1e115d5-4f3a-41d6-b268-cc9d5726af93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146683 Nov 06 21:53:03.134188 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4463/9037] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:53:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:53:03.296234 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:03.296890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:03.303712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:03.304176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:03.305008 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:03.305459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:03.437675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:03.445028 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72625b96-c864-4bd3-a65f-07fc3eb53a7f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.152525 Nov 06 21:53:03.446051 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4575/9038] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:03 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:04.463403 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:04.464104 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:04.470159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:04.470616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:04.471396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:04.471842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:04.607998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:04.616789 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b2449ff-6de7-4b5f-85be-4994e11f334f tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1356 microversion: 2.1 time: 0.158170 Nov 06 21:53:04.617476 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4464/9039] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:04 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:05.634338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:05.635011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:05.641667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.642140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.642945 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.643397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.771063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:05.778475 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33614819-61b0-4ffc-9447-45ea0efde6d3 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1547 microversion: 2.1 time: 0.147906 Nov 06 21:53:05.779052 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4576/9040] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:05 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:05.794605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:05.795293 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:05.802868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.803315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.804086 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.804547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.937370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:05.944650 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e03d254d-cb5f-4ddd-980d-8020d2273fb4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1547 microversion: 2.1 time: 0.153629 Nov 06 21:53:05.945215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4465/9041] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:05 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:05.959819 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:05.963097 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:53:05.963097 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:53:05.964103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:05.964894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Searching by: {'deleted': False, 'project_id': '872e719b2a874cdc91e0c215ef3ea959'} {{(pid=134827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 06 21:53:05.970032 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.970489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.971308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:05.971752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:05.997428 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.multi_cell_list [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 06 21:53:06.022040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72092370-4aa7-4a16-a79f-9c81768eb6f0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.065801 Nov 06 21:53:06.022615 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4577/9042] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Nov 6 21:53:05 2021] GET /compute/v2.1/servers => generated 341 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:53:06.032674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:06.033287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:06.039605 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:06.040236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:06.041160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:06.041639 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:06.171846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:06.180389 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dfdd8a8a-95cf-47ed-b48e-bf94ee5a3b12 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1547 microversion: 2.1 time: 0.151290 Nov 06 21:53:06.180964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4466/9043] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:06 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:07.659297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea140385-59ea-472a-805e-1bffd2ee94f1"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:53:07.661019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:07.667900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:07.668401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:07.669216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:07.669664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:07.894428 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238804 Nov 06 21:53:07.895547 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4578/9044] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Nov 6 21:53:07 2021] POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:53:08.486701 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:53:08.487328 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:53:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:53:10.162662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:10.163413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:10.170436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:10.170967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:10.171835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:10.172286 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:10.308719 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:10.316541 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23bda1e2-5198-4979-9b2a-4b7f86885d3d tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1593 microversion: 2.1 time: 0.157783 Nov 06 21:53:10.317110 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4467/9045] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:10 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:53:12.379339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c4a68ea8-6b0c-419e-a790-0165378ce3d8 req-dc079502-0d1d-4128-96f1-de2b53f26bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:53:12.382148 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:53:12.382148 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:53:12.392654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c4a68ea8-6b0c-419e-a790-0165378ce3d8 req-dc079502-0d1d-4128-96f1-de2b53f26bee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:12.393245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c4a68ea8-6b0c-419e-a790-0165378ce3d8 req-dc079502-0d1d-4128-96f1-de2b53f26bee service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:12.405842 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c4a68ea8-6b0c-419e-a790-0165378ce3d8 req-dc079502-0d1d-4128-96f1-de2b53f26bee service nova] Creating event network-changed:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:53:12.414330 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c4a68ea8-6b0c-419e-a790-0165378ce3d8 req-dc079502-0d1d-4128-96f1-de2b53f26bee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099973 Nov 06 21:53:12.415695 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4579/9046] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:53:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:53:13.206593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-383571252"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:53:13.207174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:13.214220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:13.215196 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:13.216215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:13.216859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:13.352368 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Adding security group ccb35dea-56e0-4802-bf09-fc9bc3a10037 to port c2995dc8-0532-4e18-b8ec-8e98383e426c Nov 06 21:53:13.695113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-805373ee-8402-4298-8994-0e77291b6fd0 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action" status: 202 len: 0 microversion: 2.1 time: 0.492296 Nov 06 21:53:13.696065 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4468/9047] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:53:13 2021] POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:53:13.705177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:53:13.706544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:53:13.709659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-e121c1ff-11c5-4c37-a3d9-91ca31ced607 req-270a000c-364d-4058-a325-cf129d41b4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:53:13.711228 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:53:13.711228 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:53:13.719954 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e121c1ff-11c5-4c37-a3d9-91ca31ced607 req-270a000c-364d-4058-a325-cf129d41b4ed service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:13.720146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:13.720662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:13.720963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-e121c1ff-11c5-4c37-a3d9-91ca31ced607 req-270a000c-364d-4058-a325-cf129d41b4ed service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:13.721485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:53:13.721948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:53:13.736583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-e121c1ff-11c5-4c37-a3d9-91ca31ced607 req-270a000c-364d-4058-a325-cf129d41b4ed service nova] Creating event network-changed:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:53:13.746612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-e121c1ff-11c5-4c37-a3d9-91ca31ced607 req-270a000c-364d-4058-a325-cf129d41b4ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041071 Nov 06 21:53:13.748005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4469/9048] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:53:13.998581 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:53:14.007673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-298ec02d-7bd4-4cb4-a96d-0dadc3505d8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1758 microversion: 2.1 time: 0.307434 Nov 06 21:53:14.008421 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4580/9049] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:53:13 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1758 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:14.523271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:54:14.524339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:14.530665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:14.531114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:14.531918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:14.532381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:14.600324 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3062e675-840e-40ad-ab87-cac2e749fca1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action" status: 202 len: 0 microversion: 2.1 time: 0.081892 Nov 06 21:54:14.601036 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4470/9050] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:54:14 2021] POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:54:14.609827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:14.610542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:14.618351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:14.618351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:14.618914 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:14.619403 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:15.200269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:15.208625 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dffc0f58-398f-4605-8922-b56c6916a9a8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1750 microversion: 2.1 time: 0.603421 Nov 06 21:54:15.209395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4581/9051] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:14 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1750 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:16.228669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:16.229340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:16.235415 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:16.235870 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:16.236681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:16.237121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:16.385463 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:16.393397 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6812d017-0f48-48ff-918e-ada8462838cd tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.170455 Nov 06 21:54:16.393962 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4471/9052] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:16 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:17.410726 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:17.411377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:17.418172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:17.418629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:17.419410 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:17.419853 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:17.565839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:17.574321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a41b165-38ea-4696-9934-c75e507542c8 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.167407 Nov 06 21:54:17.574890 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4582/9053] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:17 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:18.591106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:18.591710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:18.598946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:18.599393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:18.600173 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:18.600634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:18.744668 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:18.752432 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-41e37568-38ef-486d-8e33-159b33d94150 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.164984 Nov 06 21:54:18.752997 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4472/9054] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:18 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:19.769308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:19.769971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:19.776711 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:19.777177 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:19.777973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:19.778437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:19.925099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:19.933532 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aecf465d-2046-40a0-a6dd-e096d4fd4dba tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.167973 Nov 06 21:54:19.934102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4583/9055] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:19 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:20.950821 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:20.951440 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:20.958794 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:20.959253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:20.960043 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:20.960515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:21.103380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:21.111277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-055f42f8-7696-4b9b-a57f-4f35ea0f8380 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.164215 Nov 06 21:54:21.111850 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4473/9056] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:20 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:22.128903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:22.129576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:22.136034 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:22.136547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:22.137345 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:22.137795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:22.283723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:22.293484 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f2010660-f371-416b-9e05-30bf27e4cd38 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.168370 Nov 06 21:54:22.294063 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4584/9057] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:22 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:23.311107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:23.311713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:23.318438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:23.318918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:23.319666 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:23.320102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:23.463358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:23.471665 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0c809af6-fb1d-45ed-a2f1-b3b275cc1746 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.164396 Nov 06 21:54:23.472235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4474/9058] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:23 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:24.490121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:24.490737 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:24.497573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:24.498060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:24.498842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:24.499288 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:24.644336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:24.652848 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eb4b0967-3962-4671-9731-61398b2f77e1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.166547 Nov 06 21:54:24.653578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4585/9059] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:24 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:25.670497 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:25.671135 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:25.678563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:25.679022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:25.679812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:25.680256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:25.831843 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:25.839678 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-dee4f645-0f8b-462f-a2af-2db849906acb tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1755 microversion: 2.1 time: 0.173028 Nov 06 21:54:25.840299 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4475/9060] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:25 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:26.856740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:54:26.857392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:54:26.863854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:26.864378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:26.865138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:54:26.865582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:54:27.006787 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:54:27.014656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21d6a3fb-00d5-4e24-87bf-4f80f6cf3592 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1758 microversion: 2.1 time: 0.161655 Nov 06 21:54:27.015226 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4586/9061] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:54:26 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:54:48.405836 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:54:48.406503 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:54:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:54:52.100810 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:54:52.101297 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:54:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:55:11.206723 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:55:11.206723 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 21:55:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:55:30.288202 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-383571252"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:30.288896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:30.294681 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:30.295136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:30.295902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:30.296360 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:30.429591 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.network.security_group_api [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Removing security group ccb35dea-56e0-4802-bf09-fc9bc3a10037 from port c2995dc8-0532-4e18-b8ec-8e98383e426c Nov 06 21:55:30.754127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d5403b72-7929-4f28-9b0f-d8c756547ca4 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action" status: 202 len: 0 microversion: 2.1 time: 0.470100 Nov 06 21:55:30.755308 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4476/9062] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:55:30 2021] POST /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:55:30.764857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-a7a54c52-983c-4395-a0ae-e09b166a3837 req-cc425ea3-e29f-44c5-a7bc-36eb509f8c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:30.767909 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:55:30.767909 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:55:30.783193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a7a54c52-983c-4395-a0ae-e09b166a3837 req-cc425ea3-e29f-44c5-a7bc-36eb509f8c34 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:30.785209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-a7a54c52-983c-4395-a0ae-e09b166a3837 req-cc425ea3-e29f-44c5-a7bc-36eb509f8c34 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:30.804899 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-a7a54c52-983c-4395-a0ae-e09b166a3837 req-cc425ea3-e29f-44c5-a7bc-36eb509f8c34 service nova] Creating event network-changed:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:55:30.813041 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-a7a54c52-983c-4395-a0ae-e09b166a3837 req-cc425ea3-e29f-44c5-a7bc-36eb509f8c34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054397 Nov 06 21:55:30.814102 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4587/9063] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:55:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:55:32.132991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:32.133501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:32.139318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:32.139780 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:32.140600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:32.141047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:32.217724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lazy-loading 'services' on Instance uuid 79afd67d-9d67-460a-8b99-e13091e39f39 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:55:32.287649 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments/ea140385-59ea-472a-805e-1bffd2ee94f1" status: 202 len: 0 microversion: 2.1 time: 0.159341 Nov 06 21:55:32.288235 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4477/9064] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:55:32 2021] DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments/ea140385-59ea-472a-805e-1bffd2ee94f1 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 21:55:32.297622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:32.299252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:32.307078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:32.307595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:32.308491 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:32.309473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:32.343113 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-02fabaae-036f-4b4a-9e45-370b2b0b6873 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049677 Nov 06 21:55:32.343786 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4588/9065] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:55:32 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:55:32.828244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-33c5187b-19c6-48d0-95ab-8fc073de98ea req-089c7ed8-b5db-4404-b466-0db2e4f43a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:32.830447 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:55:32.830447 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:55:32.837705 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-33c5187b-19c6-48d0-95ab-8fc073de98ea req-089c7ed8-b5db-4404-b466-0db2e4f43a5f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:32.838139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-33c5187b-19c6-48d0-95ab-8fc073de98ea req-089c7ed8-b5db-4404-b466-0db2e4f43a5f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:32.849009 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-33c5187b-19c6-48d0-95ab-8fc073de98ea req-089c7ed8-b5db-4404-b466-0db2e4f43a5f service nova] Creating event network-changed:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:55:32.853840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-33c5187b-19c6-48d0-95ab-8fc073de98ea req-089c7ed8-b5db-4404-b466-0db2e4f43a5f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029916 Nov 06 21:55:32.854605 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4478/9066] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:55:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:55:33.355036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:33.356619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:33.363688 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:33.364144 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:33.364964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:33.365407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:33.395670 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f8a53599-14d4-4b1b-a962-26c06a6f00d1 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044421 Nov 06 21:55:33.396365 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4589/9067] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Nov 6 21:55:33 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 06 21:55:33.406635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:33.407225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:33.414036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:33.414496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:33.415281 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:33.415727 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:33.491660 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] HTTP exception thrown: Instance 79afd67d-9d67-460a-8b99-e13091e39f39 is not attached to volume ea140385-59ea-472a-805e-1bffd2ee94f1 Nov 06 21:55:33.492264 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Returning 404 to user: Instance 79afd67d-9d67-460a-8b99-e13091e39f39 is not attached to volume ea140385-59ea-472a-805e-1bffd2ee94f1 {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:55:33.493139 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-07b5551d-0549-41ae-af72-e8e023b8863b tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments/ea140385-59ea-472a-805e-1bffd2ee94f1" status: 404 len: 154 microversion: 2.1 time: 0.090690 Nov 06 21:55:33.493713 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4479/9068] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Nov 6 21:55:33 2021] DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39/os-volume_attachments/ea140385-59ea-472a-805e-1bffd2ee94f1 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:55:34.617995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:34.618504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:34.625138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:34.625605 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:34.626407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:34.626857 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:34.651459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:55:34.721915 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1ee9eb9a-5212-4e2a-9cc1-ba6127430bf6 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 204 len: 0 microversion: 2.1 time: 0.107301 Nov 06 21:55:34.722497 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4590/9069] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:55:34 2021] DELETE /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:55:34.730863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:34.731460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:34.739386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:34.739839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:34.740660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:34.741100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:34.875226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:34.883478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0edf9a7-060f-47cf-82d6-6144321c6b27 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1553 microversion: 2.1 time: 0.156289 Nov 06 21:55:34.884038 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4480/9070] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:34 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:35.901320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:35.901994 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:35.908715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:35.909184 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:35.909984 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:35.910436 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:36.046848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:36.054562 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ea57874c-ed2b-48dd-8a5f-a993af167d15 tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1553 microversion: 2.1 time: 0.157469 Nov 06 21:55:36.055147 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4591/9071] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:35 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:36.975721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6ea5bb1d-7866-4015-b614-78a31c792f07 req-99f9b60d-2d6c-4f34-a9ea-8fc63268eae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79afd67d-9d67-460a-8b99-e13091e39f39", "name": "network-vif-deleted", "tag": "c2995dc8-0532-4e18-b8ec-8e98383e426c"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:36.977701 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:55:36.977701 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:55:36.985622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6ea5bb1d-7866-4015-b614-78a31c792f07 req-99f9b60d-2d6c-4f34-a9ea-8fc63268eae8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:36.986156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6ea5bb1d-7866-4015-b614-78a31c792f07 req-99f9b60d-2d6c-4f34-a9ea-8fc63268eae8 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:36.998343 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6ea5bb1d-7866-4015-b614-78a31c792f07 req-99f9b60d-2d6c-4f34-a9ea-8fc63268eae8 service nova] Creating event network-vif-deleted:c2995dc8-0532-4e18-b8ec-8e98383e426c for instance 79afd67d-9d67-460a-8b99-e13091e39f39 on nch1-master-1 Nov 06 21:55:37.003205 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6ea5bb1d-7866-4015-b614-78a31c792f07 req-99f9b60d-2d6c-4f34-a9ea-8fc63268eae8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Nov 06 21:55:37.003787 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4481/9072] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:55:37.072206 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:37.072895 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:37.079896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:37.081028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:37.081971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:37.082447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:37.112923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:37.113383 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:37.113848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lazy-loading 'fault' on Instance uuid 79afd67d-9d67-460a-8b99-e13091e39f39 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:55:37.155418 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408897a95ae34cb1b49d3ec06752e4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e719b2a874cdc91e0c215ef3ea959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:37.163568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f0665933-3790-4d16-b647-766eebc66d7c tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 200 len: 1346 microversion: 2.1 time: 0.096425 Nov 06 21:55:37.164135 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4592/9073] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:37 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:38.182518 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:38.183220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] [instance: 79afd67d-9d67-460a-8b99-e13091e39f39] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:38.189393 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:38.189802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:38.190583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:38.191025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:38.203797 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] HTTP exception thrown: Instance 79afd67d-9d67-460a-8b99-e13091e39f39 could not be found. Nov 06 21:55:38.204408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Returning 404 to user: Instance 79afd67d-9d67-460a-8b99-e13091e39f39 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:55:38.205227 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cd305029-aa87-44fc-b3d0-ef35c14b6d5a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39" status: 404 len: 111 microversion: 2.1 time: 0.027635 Nov 06 21:55:38.205744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4482/9074] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:38 2021] GET /compute/v2.1/servers/79afd67d-9d67-460a-8b99-e13091e39f39 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:55:38.213851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-66480e55-c004-42b2-8798-b5e90e48cd8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] Calling method '.version_select at 0x7f67141568b0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:38.237117 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-66480e55-c004-42b2-8798-b5e90e48cd8a tempest-TestMinimumBasicScenario-854053992 tempest-TestMinimumBasicScenario-854053992-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-526887148" status: 202 len: 0 microversion: 2.1 time: 0.026252 Nov 06 21:55:38.237738 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4593/9075] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Nov 6 21:55:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-526887148 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:55:47.442517 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: .version_select at 0x7f67153a30d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-401446697"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:47.459895 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:55:47.465598 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:55:47.631209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:55:47.635936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:55:47.649582 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-51626371-b275-487c-8e41-d117919a0a93 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.374947 Nov 06 21:55:47.650182 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4483/9076] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:55:47 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:53.577852 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-430478325", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "e269c104-c79b-414b-8a0c-499a59f5fd27"}], "key_name": "tempest-TestNetworkAdvancedServerOps-401446697", "security_groups": [{"name": "tempest-secgroup-smoke-1310066277"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:53.928063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] validate_networks() for [('e269c104-c79b-414b-8a0c-499a59f5fd27', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:55:54.428654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:55:54.429131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:55:54.429629 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:55:54.430057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:55:54.430494 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:55:54.441016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:54.441489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:54.442367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:54.442826 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:54.459442 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:55:54.464541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:55:54.479562 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:55:54.482232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:55:54.537481 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d0eb8e6-608a-4ce2-bd14-d568a1d7ee39 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962540 Nov 06 21:55:54.538153 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4594/9077] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:55:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:55:54.550284 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-23688adf-fa39-4916-a71a-c4efa9dbc222 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:54.551583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-23688adf-fa39-4916-a71a-c4efa9dbc222 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:54.692663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-23688adf-fa39-4916-a71a-c4efa9dbc222 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:54.703063 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-23688adf-fa39-4916-a71a-c4efa9dbc222 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1265 microversion: 2.1 time: 0.158682 Nov 06 21:55:54.703684 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4484/9078] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:54 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:55.723937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:55.725311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:55.732550 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:55.733239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:55.734228 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:55.734848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:55.820407 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:55.836889 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16951c50-6cc1-41e4-9c07-21128a6a85f9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1325 microversion: 2.1 time: 0.119791 Nov 06 21:55:55.837891 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4595/9079] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:55 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1325 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:56.855074 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:56.855730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:56.865493 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:56.866089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:56.866896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:56.867338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:57.107857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:57.115664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45f0a488-0f1d-4624-9863-e1d8785bc6b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.264758 Nov 06 21:55:57.116250 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4485/9080] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:56 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:57.235015 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0f3ff4a9-eddd-4aa3-abaf-1ae35f1ad855 req-855e2556-51ef-42f2-8e33-105f74274118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b662dde9-dd0d-4fd2-a482-fb5f103e0c1c", "tag": "981a51d3-3363-4fe2-8705-6c1d37434510"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:55:57.238160 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:55:57.238160 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:55:57.248610 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0f3ff4a9-eddd-4aa3-abaf-1ae35f1ad855 req-855e2556-51ef-42f2-8e33-105f74274118 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:57.249373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0f3ff4a9-eddd-4aa3-abaf-1ae35f1ad855 req-855e2556-51ef-42f2-8e33-105f74274118 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:57.266521 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0f3ff4a9-eddd-4aa3-abaf-1ae35f1ad855 req-855e2556-51ef-42f2-8e33-105f74274118 service nova] Creating event network-changed:981a51d3-3363-4fe2-8705-6c1d37434510 for instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c on nch1-master-1 Nov 06 21:55:57.272018 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0f3ff4a9-eddd-4aa3-abaf-1ae35f1ad855 req-855e2556-51ef-42f2-8e33-105f74274118 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040705 Nov 06 21:55:57.272926 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4596/9081] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:55:58.132630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:58.133272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:58.139834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:58.140313 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:58.141114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:58.141562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:58.273045 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:58.280384 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-323833f2-97f5-4d11-af81-da1b74005209 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.151459 Nov 06 21:55:58.280983 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4486/9082] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:58 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:55:59.298005 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:55:59.299112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:55:59.305533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:59.305995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:59.306779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:55:59.307227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:55:59.436252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:55:59.444110 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-947eeab1-1b19-4198-b73d-7d4a1987d51e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.151047 Nov 06 21:55:59.444704 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4597/9083] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:55:59 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:00.461399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:00.461999 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:00.468479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:00.468945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:00.469732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:00.470174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:00.607478 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:00.615355 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9882063a-47d1-47f5-83aa-b866f8aceb81 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.157786 Nov 06 21:56:00.615924 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4487/9084] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:00 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:01.632613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:01.633489 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:01.640574 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:01.641041 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:01.641834 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:01.642285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:01.777393 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:01.784777 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b69205c7-83a9-4ca4-b391-a29fe387adbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.155819 Nov 06 21:56:01.785350 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4598/9085] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:01 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:02.801782 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:02.802413 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:02.809085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:02.809540 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:02.810321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:02.810758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:02.945650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:02.952977 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9408364b-64ca-46dd-8a22-6f0f42a94e74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.155229 Nov 06 21:56:02.953572 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4488/9086] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:02 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:03.827674 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-5df79408-2e16-427d-9268-642f806e9cb2 req-c76e24fa-8c8a-4c95-9d35-762bebb55823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b662dde9-dd0d-4fd2-a482-fb5f103e0c1c", "name": "network-vif-plugged", "status": "completed", "tag": "981a51d3-3363-4fe2-8705-6c1d37434510"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:56:03.829310 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:56:03.829310 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:56:03.837900 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5df79408-2e16-427d-9268-642f806e9cb2 req-c76e24fa-8c8a-4c95-9d35-762bebb55823 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:03.838485 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-5df79408-2e16-427d-9268-642f806e9cb2 req-c76e24fa-8c8a-4c95-9d35-762bebb55823 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:03.853673 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-5df79408-2e16-427d-9268-642f806e9cb2 req-c76e24fa-8c8a-4c95-9d35-762bebb55823 service nova] Creating event network-vif-plugged:981a51d3-3363-4fe2-8705-6c1d37434510 for instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c on nch1-master-1 Nov 06 21:56:03.858836 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-5df79408-2e16-427d-9268-642f806e9cb2 req-c76e24fa-8c8a-4c95-9d35-762bebb55823 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Nov 06 21:56:03.859446 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4599/9087] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:56:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:56:03.970186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:03.971380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:03.978021 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:03.978479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:03.979268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:03.979713 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:04.109388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:04.116992 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ae53cb9-cdd1-44d3-8a7e-ebd5ee511c40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.150400 Nov 06 21:56:04.117564 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4489/9088] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:03 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:05.134249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:05.134952 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:05.141799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:05.142262 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:05.143328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:05.143775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:05.286603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:05.294125 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5e525b32-d616-4433-a0e5-d70c1de46166 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1391 microversion: 2.1 time: 0.163862 Nov 06 21:56:05.294906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4600/9089] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:05 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 21:56:06.312183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:06.312834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:06.320155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:06.320633 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:06.321414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:06.321846 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:06.454317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:06.461704 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fd816b70-b51f-43ca-af21-dd16edde0e08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1563 microversion: 2.1 time: 0.153223 Nov 06 21:56:06.462257 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4490/9090] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:06 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:06.478048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:06.478672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:06.485445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:06.486484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:06.487306 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:06.487758 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:06.621167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:06.628437 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-99f73ee9-18a1-45c9-9acc-d6d8258ad63c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1563 microversion: 2.1 time: 0.154094 Nov 06 21:56:06.629227 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4601/9091] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:06 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:08.543345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:56:08.543979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:08.553165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:08.553658 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:08.554459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:08.554896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:08.610624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c7374ecf-ecb5-469e-b1e1-f2ad60b08bbc req-2572e0cb-0dd8-4468-bc43-5af19f721f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b662dde9-dd0d-4fd2-a482-fb5f103e0c1c", "tag": "981a51d3-3363-4fe2-8705-6c1d37434510"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:56:08.613162 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:56:08.613162 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:56:08.620379 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c7374ecf-ecb5-469e-b1e1-f2ad60b08bbc req-2572e0cb-0dd8-4468-bc43-5af19f721f33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:08.621128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c7374ecf-ecb5-469e-b1e1-f2ad60b08bbc req-2572e0cb-0dd8-4468-bc43-5af19f721f33 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:08.634567 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c7374ecf-ecb5-469e-b1e1-f2ad60b08bbc req-2572e0cb-0dd8-4468-bc43-5af19f721f33 service nova] Creating event network-changed:981a51d3-3363-4fe2-8705-6c1d37434510 for instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c on nch1-master-1 Nov 06 21:56:08.639710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c7374ecf-ecb5-469e-b1e1-f2ad60b08bbc req-2572e0cb-0dd8-4468-bc43-5af19f721f33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097689 Nov 06 21:56:08.640572 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4602/9092] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:56:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:56:08.720114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:56:08.728825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-01ea718a-a1f7-489b-8a01-e56b9152c4ab tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1563 microversion: 2.1 time: 0.189419 Nov 06 21:56:08.729643 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4491/9093] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:56:08 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:56:40.022315 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:56:40.023373 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:56:40.032763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:40.033227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:40.034029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:56:40.034478 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:56:40.084052 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c65ad55a-0979-4f7b-a375-98f209eb623f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065644 Nov 06 21:56:40.084720 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4603/9094] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:56:40 2021] POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:57:10.314251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:10.314848 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:10.320730 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:10.321180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:10.321958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:10.322397 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:10.389193 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7ccbf266-43dd-4994-b017-51260018713f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.079458 Nov 06 21:57:10.390301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4492/9095] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:57:10 2021] POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:57:10.398837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:10.399560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:10.409680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:10.410326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:10.411477 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:10.411935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:10.555153 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:10.563409 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b7bebce1-51d4-465d-b7ab-3972605710da tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1686 microversion: 2.1 time: 0.168600 Nov 06 21:57:10.563976 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4604/9096] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:10 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:11.581599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:11.582672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:11.590437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:11.590894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:11.591673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:11.592106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:11.725459 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:11.732718 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c12f0626-5461-48ea-a6ec-88cba97ca00a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1666 microversion: 2.1 time: 0.155334 Nov 06 21:57:11.733311 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4493/9097] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:11 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:12.825351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:12.826281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:12.833743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.834208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:12.834993 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.835439 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:12.886746 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-16935048-1b2a-4e88-a488-9185ad32ed2d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action" status: 200 len: 32649 microversion: 2.1 time: 0.065014 Nov 06 21:57:12.887434 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4605/9098] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:57:12 2021] POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action => generated 32649 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:57:12.898068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:12.898586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:12.905382 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.905836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:12.906608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.907091 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:12.969887 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c28f6528-c74c-4cb9-b1ac-9a4418802490 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.075367 Nov 06 21:57:12.970519 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4494/9099] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:57:12 2021] POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:57:12.980327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:12.981043 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:12.988680 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.989196 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:12.990057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:12.990512 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:13.130507 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:13.138076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fa58b030-ba28-479d-881c-774b466f6bce tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1673 microversion: 2.1 time: 0.161889 Nov 06 21:57:13.138645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4606/9100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:12 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:14.156852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:14.157556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:14.163758 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:14.164212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:14.165031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:14.165474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:14.297122 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:14.304655 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aac3362b-5265-4a82-9c7d-c82063b70054 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1681 microversion: 2.1 time: 0.152688 Nov 06 21:57:14.305217 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4495/9101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:14 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:14.399603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:14.400595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:14.407992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:14.408443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:14.409241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:14.409694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:14.460274 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-938fccf2-19a9-4309-9b01-937245ed8065 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action" status: 200 len: 38414 microversion: 2.1 time: 0.064314 Nov 06 21:57:14.460925 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4607/9102] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:57:14 2021] POST /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c/action => generated 38414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:57:15.470110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:15.471238 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:15.473197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ad74c2c2-a37a-4801-ac50-4b4ecae1e004 req-257c89de-4631-42c0-b5b8-f4f5fd054b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b662dde9-dd0d-4fd2-a482-fb5f103e0c1c", "tag": "981a51d3-3363-4fe2-8705-6c1d37434510"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:15.474655 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:57:15.474655 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:57:15.479184 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:15.479722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:15.480714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:15.481159 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:15.483338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ad74c2c2-a37a-4801-ac50-4b4ecae1e004 req-257c89de-4631-42c0-b5b8-f4f5fd054b22 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:15.483905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ad74c2c2-a37a-4801-ac50-4b4ecae1e004 req-257c89de-4631-42c0-b5b8-f4f5fd054b22 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:15.494976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ad74c2c2-a37a-4801-ac50-4b4ecae1e004 req-257c89de-4631-42c0-b5b8-f4f5fd054b22 service nova] Creating event network-changed:981a51d3-3363-4fe2-8705-6c1d37434510 for instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c on nch1-master-1 Nov 06 21:57:15.501208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ad74c2c2-a37a-4801-ac50-4b4ecae1e004 req-257c89de-4631-42c0-b5b8-f4f5fd054b22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Nov 06 21:57:15.502173 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4608/9103] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:57:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:57:15.508185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:57:15.594366 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5a416aab-b160-4784-a677-5b7ebcde1780 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 204 len: 0 microversion: 2.1 time: 0.128354 Nov 06 21:57:15.595434 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4496/9104] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:57:15 2021] DELETE /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 06 21:57:15.606501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:15.607503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:15.614454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:15.615367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:15.616193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:15.616691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:15.849424 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:15.857268 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e78fee87-ce96-4ae7-b8be-f17966d802f3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1687 microversion: 2.1 time: 0.257215 Nov 06 21:57:15.857982 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4609/9105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:15 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:16.875911 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:16.876766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:16.883586 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:16.884055 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:16.884876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:16.885320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:17.031218 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:17.038664 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93459ecb-408b-4880-9f0f-1ef830edffb2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1569 microversion: 2.1 time: 0.166861 Nov 06 21:57:17.039232 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4497/9106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:16 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:17.755560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-1ba94db8-10cc-4a73-8f38-e1652b5ed88f req-2480b262-2a71-41a2-94f7-38b6029ffbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b662dde9-dd0d-4fd2-a482-fb5f103e0c1c", "name": "network-vif-deleted", "tag": "981a51d3-3363-4fe2-8705-6c1d37434510"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:17.757719 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:57:17.757719 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:57:17.767468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1ba94db8-10cc-4a73-8f38-e1652b5ed88f req-2480b262-2a71-41a2-94f7-38b6029ffbb1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:17.768333 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-1ba94db8-10cc-4a73-8f38-e1652b5ed88f req-2480b262-2a71-41a2-94f7-38b6029ffbb1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:17.782568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-1ba94db8-10cc-4a73-8f38-e1652b5ed88f req-2480b262-2a71-41a2-94f7-38b6029ffbb1 service nova] Creating event network-vif-deleted:981a51d3-3363-4fe2-8705-6c1d37434510 for instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c on nch1-master-1 Nov 06 21:57:17.788273 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-1ba94db8-10cc-4a73-8f38-e1652b5ed88f req-2480b262-2a71-41a2-94f7-38b6029ffbb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036616 Nov 06 21:57:17.788881 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4610/9107] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:57:18.056248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:18.057329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:18.065256 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:18.066029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:18.067193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:18.067760 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:18.102182 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:18.102627 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:18.103436 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lazy-loading 'fault' on Instance uuid b662dde9-dd0d-4fd2-a482-fb5f103e0c1c {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:57:18.147659 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:18.155685 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94bb04a3-e267-4bec-a170-3ab4ab2e47b1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 200 len: 1355 microversion: 2.1 time: 0.104044 Nov 06 21:57:18.157168 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4498/9108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:18 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:19.175327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:19.175996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: b662dde9-dd0d-4fd2-a482-fb5f103e0c1c] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:19.182908 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:19.183375 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:19.184170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:19.184668 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:19.197806 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] HTTP exception thrown: Instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c could not be found. Nov 06 21:57:19.198405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Returning 404 to user: Instance b662dde9-dd0d-4fd2-a482-fb5f103e0c1c could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:57:19.199238 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-39144053-14f0-49d5-89b0-870e13fcb5aa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c" status: 404 len: 111 microversion: 2.1 time: 0.029158 Nov 06 21:57:19.199768 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4611/9109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:19 2021] GET /compute/v2.1/servers/b662dde9-dd0d-4fd2-a482-fb5f103e0c1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:57:22.767946 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-20e70f18-e88e-409b-8ae1-e68b1f210587 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '.version_select at 0x7f67148ac940>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:22.787670 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-20e70f18-e88e-409b-8ae1-e68b1f210587 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-401446697" status: 202 len: 0 microversion: 2.1 time: 0.023309 Nov 06 21:57:22.788315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4499/9110] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Nov 6 21:57:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-401446697 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:57:22.814222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: .version_select at 0x7f6707f85310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-181253294"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:22.832389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:57:22.837274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:57:23.044675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:57:23.051516 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:57:23.065991 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-acd582f1-aa92-4784-b73a-85efea51337a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.256173 Nov 06 21:57:23.066597 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4612/9111] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:57:22 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:28.466740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-725844521", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "e21fe8f9-f205-475c-8b91-7df74e889cfb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-181253294", "security_groups": [{"name": "tempest-secgroup-smoke-1458020160"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:28.588755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] validate_networks() for [('e21fe8f9-f205-475c-8b91-7df74e889cfb', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 21:57:28.984499 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 21:57:28.984931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 21:57:28.985412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 21:57:28.985830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 21:57:28.986272 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 21:57:28.995986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:28.996474 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:28.997296 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:28.997736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:29.014414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:57:29.025926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:57:29.042981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 21:57:29.045407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 21:57:29.093278 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6d6cb70-3959-4944-81a0-4c4d5779f44e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630960 Nov 06 21:57:29.094155 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4500/9112] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 21:57:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 21:57:29.104841 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ebfdeac-3349-454b-af5b-83209330f378 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:29.105471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ebfdeac-3349-454b-af5b-83209330f378 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:29.162058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ebfdeac-3349-454b-af5b-83209330f378 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:29.171408 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ebfdeac-3349-454b-af5b-83209330f378 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1265 microversion: 2.1 time: 0.070438 Nov 06 21:57:29.180344 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4613/9113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:29 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:30.189359 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:30.190587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:30.199327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:30.200268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:30.201963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:30.203416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:30.639197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:30.646140 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8043853b-a5a1-4842-9eb3-38806477a550 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1325 microversion: 2.1 time: 0.461664 Nov 06 21:57:30.647325 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4501/9114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:30 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:31.663386 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:31.664589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:31.672308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:31.673059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:31.673872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:31.674356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:31.911603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:31.922603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d3c8948-9f4c-4593-b6ff-41ee850412fc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.262606 Nov 06 21:57:31.923516 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4614/9115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:31 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:32.145904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b1096539-d8c2-4f7b-a878-08ef002b8292 req-aa6ff718-995e-48d4-8ff8-8eda316aa1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541da6a-42ba-44e2-bc21-d8ebe09adb4b", "tag": "dbef4b14-e9e2-43ea-8e23-234efd1259da"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:32.147657 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:57:32.147657 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:57:32.160251 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b1096539-d8c2-4f7b-a878-08ef002b8292 req-aa6ff718-995e-48d4-8ff8-8eda316aa1fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:32.160726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b1096539-d8c2-4f7b-a878-08ef002b8292 req-aa6ff718-995e-48d4-8ff8-8eda316aa1fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:32.176625 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b1096539-d8c2-4f7b-a878-08ef002b8292 req-aa6ff718-995e-48d4-8ff8-8eda316aa1fe service nova] Creating event network-changed:dbef4b14-e9e2-43ea-8e23-234efd1259da for instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b on nch1-master-1 Nov 06 21:57:32.181998 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b1096539-d8c2-4f7b-a878-08ef002b8292 req-aa6ff718-995e-48d4-8ff8-8eda316aa1fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039591 Nov 06 21:57:32.182662 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4502/9116] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:57:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:57:32.940316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:32.940961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:32.947667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:32.948138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:32.948973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:32.949427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:33.156817 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:33.164241 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d803f832-92a6-4b67-bb82-bb03361e16c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.227981 Nov 06 21:57:33.164871 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4615/9117] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:32 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:34.181741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:34.182454 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:34.188762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:34.189224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:34.190004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:34.190444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:34.326051 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:34.333407 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cf2b9f91-bb3b-476a-b81a-9efeb0ca1117 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.156499 Nov 06 21:57:34.333971 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4503/9118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:34 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:35.350115 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:35.350741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:35.357555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:35.358023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:35.359376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:35.359832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:35.496785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:35.504809 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ac35ead-6473-4df8-9869-b7c998b6a73d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.158415 Nov 06 21:57:35.505375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4616/9119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:35 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:36.521743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:36.522460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:36.529288 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:36.529755 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:36.530561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:36.531001 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:36.666154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:36.673764 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e45c7398-89c3-45a6-8296-09487588412d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.155755 Nov 06 21:57:36.674351 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4504/9120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:36 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:37.691501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:37.692127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:37.698920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:37.699338 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:37.700137 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:37.700623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:37.837631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:37.845208 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-170b2ed5-d846-4595-809f-eb194611ec14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.157531 Nov 06 21:57:37.845768 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4617/9121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:37 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:38.246657 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-f0f5322b-aefc-4294-9bd5-5b63154941bd req-51c060c5-7a52-4705-bc70-4c169cb37ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541da6a-42ba-44e2-bc21-d8ebe09adb4b", "name": "network-vif-plugged", "status": "completed", "tag": "dbef4b14-e9e2-43ea-8e23-234efd1259da"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:38.248249 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:57:38.248249 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:57:38.256453 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f0f5322b-aefc-4294-9bd5-5b63154941bd req-51c060c5-7a52-4705-bc70-4c169cb37ab7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:38.257064 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-f0f5322b-aefc-4294-9bd5-5b63154941bd req-51c060c5-7a52-4705-bc70-4c169cb37ab7 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:38.272073 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-f0f5322b-aefc-4294-9bd5-5b63154941bd req-51c060c5-7a52-4705-bc70-4c169cb37ab7 service nova] Creating event network-vif-plugged:dbef4b14-e9e2-43ea-8e23-234efd1259da for instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b on nch1-master-1 Nov 06 21:57:38.277163 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-f0f5322b-aefc-4294-9bd5-5b63154941bd req-51c060c5-7a52-4705-bc70-4c169cb37ab7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034123 Nov 06 21:57:38.277777 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4505/9122] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:57:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:57:38.861840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:38.862490 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:38.869520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:38.869988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:38.870796 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:38.871241 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:39.008427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:39.016419 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5fac1a1d-b466-4b0f-9587-f0b89971e92b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1391 microversion: 2.1 time: 0.158305 Nov 06 21:57:39.016993 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4618/9123] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:38 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:40.034708 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:40.035324 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:40.041426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:40.041886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:40.042670 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:40.043114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:40.175581 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:40.182908 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94de5670-f886-4bdd-bae3-0db34a4d5de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1563 microversion: 2.1 time: 0.153226 Nov 06 21:57:40.183473 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4506/9124] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:40 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:40.198756 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:40.199381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:40.206073 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:40.206570 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:40.207347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:40.207802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:40.340652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:40.348474 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e6cbc5fd-da65-43c6-a217-4ab379c17ea8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1563 microversion: 2.1 time: 0.153328 Nov 06 21:57:40.349151 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4619/9125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:40 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:57:41.951809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:57:41.953023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:57:41.956351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ad3393d9-1882-4c9e-92d9-7ed1a67710bd req-8165009d-8015-4812-90c2-3d0662b7ae29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541da6a-42ba-44e2-bc21-d8ebe09adb4b", "tag": "dbef4b14-e9e2-43ea-8e23-234efd1259da"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:57:41.959155 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:57:41.959155 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 21:57:41.960136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:41.961205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:41.962089 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:41.962595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:41.968170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ad3393d9-1882-4c9e-92d9-7ed1a67710bd req-8165009d-8015-4812-90c2-3d0662b7ae29 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:57:41.968683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ad3393d9-1882-4c9e-92d9-7ed1a67710bd req-8165009d-8015-4812-90c2-3d0662b7ae29 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:57:41.980504 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ad3393d9-1882-4c9e-92d9-7ed1a67710bd req-8165009d-8015-4812-90c2-3d0662b7ae29 service nova] Creating event network-changed:dbef4b14-e9e2-43ea-8e23-234efd1259da for instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b on nch1-master-1 Nov 06 21:57:41.986372 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ad3393d9-1882-4c9e-92d9-7ed1a67710bd req-8165009d-8015-4812-90c2-3d0662b7ae29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034478 Nov 06 21:57:41.987607 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4620/9126] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:57:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:57:42.185991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:57:42.195520 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-54f2bd9d-cc92-4c55-960e-c14831c0fb53 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1563 microversion: 2.1 time: 0.248045 Nov 06 21:57:42.196708 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4507/9127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:57:41 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:15.469151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:58:15.470117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:15.476887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:15.477365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:15.478181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:15.478631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:15.538614 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3e032d12-0fa4-48d7-98e1-0b95544baf54 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action" status: 200 len: 24572 microversion: 2.1 time: 0.074721 Nov 06 21:58:15.539300 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4621/9128] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:58:15 2021] POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:58:45.808832 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:58:45.809783 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:45.815717 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:45.816212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:45.817022 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:45.817467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:45.887947 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-723bd8c2-7c8b-4de3-b03d-7c3964eba9d5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action" status: 202 len: 0 microversion: 2.1 time: 0.083774 Nov 06 21:58:45.888626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4508/9129] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:58:45 2021] POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:58:45.898027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:45.898860 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:45.906296 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:45.906919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:45.907814 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:45.908264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:46.140827 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:46.148785 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1feae0f7-1ad9-46ba-b1e2-b726dc61bda8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1673 microversion: 2.1 time: 0.255709 Nov 06 21:58:46.149356 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4622/9130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:45 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:47.167509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:47.168124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:47.174254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:47.175014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:47.175747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:47.176192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:47.309655 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:47.317079 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e9776fd7-89c2-4d42-9fc1-5e4cbd57b451 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.154758 Nov 06 21:58:47.317640 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4509/9131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:47 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:48.334592 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:48.335328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:48.342950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:48.343425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:48.344264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:48.344779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:48.478362 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:48.485723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab35eb33-e53c-4665-98a0-9cd89916005a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.155000 Nov 06 21:58:48.486287 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4623/9132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:48 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:49.502645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:49.503259 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:49.509994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:49.510456 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:49.511248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:49.511694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:49.647414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:49.654748 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c6d3cdc8-9d86-4a06-aa5c-a729a8bd600d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.155841 Nov 06 21:58:49.655315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4510/9133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:49 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:50.672178 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:50.672868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:50.680341 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:50.680811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:50.681600 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:50.682051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:50.813020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:50.820351 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fe5d9b4-808c-4945-be5f-064d30b205d0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.151861 Nov 06 21:58:50.820921 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4624/9134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:50 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:51.837367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:51.837979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:51.844940 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:51.845391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:51.846170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:51.846611 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:51.984534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:51.992613 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d6ec4bd6-7b55-47ff-8c55-afb19db2c03e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.158787 Nov 06 21:58:51.993114 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4511/9135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:51 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:53.009678 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:53.010230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:53.016694 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:53.017169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:53.017965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:53.019076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:53.152938 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:53.160827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5b79ebd9-fefd-490a-a2a9-cb8cf2265517 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.154963 Nov 06 21:58:53.161392 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4625/9136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:53 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:54.178085 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:54.178679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:54.185569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:54.186061 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:54.186844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:54.187319 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:54.321970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:54.329291 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71f3d7fb-4abb-4866-b694-502b6f439080 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.155215 Nov 06 21:58:54.329853 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4512/9137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:54 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:55.347078 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:55.347705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:55.354461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:55.354937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:55.355743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:55.356222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:55.496037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:55.503556 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-33c4ff32-b6ed-410f-9fb4-c34ddf73de6c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.160877 Nov 06 21:58:55.504119 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4626/9138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:55 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:56.520779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:56.521381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:56.528262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:56.528739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:56.529524 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:56.529959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:56.659249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:56.666648 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0491904b-310d-480c-a6cb-675f1b016ce7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1678 microversion: 2.1 time: 0.149637 Nov 06 21:58:56.667212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4513/9139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:56 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:58:57.684368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:58:57.685001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:58:57.691967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:57.692471 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:57.694110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:58:57.694572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:58:57.832986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:58:57.840321 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6c65eb35-dbc2-4607-bf5f-a09e19743680 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1681 microversion: 2.1 time: 0.159863 Nov 06 21:58:57.840895 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4627/9140] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:58:57 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:59:30.046131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:59:30.046969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:30.053784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:30.054237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:30.055014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:30.055449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:30.114284 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-35490e68-fe72-45f6-8db6-79368a7e7523 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action" status: 200 len: 69178 microversion: 2.1 time: 0.071673 Nov 06 21:59:30.114951 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4514/9141] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 21:59:30 2021] POST /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b/action => generated 69178 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 21:59:47.339783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:47.340454 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:47.342878 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-301d57ac-0193-4617-9db1-835d20e659a3 req-73ca7434-fd93-4590-8011-f3eb324c6cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541da6a-42ba-44e2-bc21-d8ebe09adb4b", "tag": "dbef4b14-e9e2-43ea-8e23-234efd1259da"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:59:47.344876 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:59:47.344876 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:59:47.346995 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:47.347499 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:47.348582 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:47.349230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:47.354522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-301d57ac-0193-4617-9db1-835d20e659a3 req-73ca7434-fd93-4590-8011-f3eb324c6cbd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:47.354988 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-301d57ac-0193-4617-9db1-835d20e659a3 req-73ca7434-fd93-4590-8011-f3eb324c6cbd service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:47.367000 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-301d57ac-0193-4617-9db1-835d20e659a3 req-73ca7434-fd93-4590-8011-f3eb324c6cbd service nova] Creating event network-changed:dbef4b14-e9e2-43ea-8e23-234efd1259da for instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b on nch1-master-1 Nov 06 21:59:47.373462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-301d57ac-0193-4617-9db1-835d20e659a3 req-73ca7434-fd93-4590-8011-f3eb324c6cbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035351 Nov 06 21:59:47.374245 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4515/9142] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:59:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 21:59:47.374896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 21:59:47.459239 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3cd92a93-9f48-4b7b-8997-3e22919b4931 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 204 len: 0 microversion: 2.1 time: 0.123715 Nov 06 21:59:47.459830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4628/9143] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 21:59:47 2021] DELETE /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 21:59:47.469390 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:47.470381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:47.477537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:47.477993 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:47.478781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:47.479220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:47.709295 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:59:47.717685 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-fc29e1aa-9ea5-4886-9f46-677901348b96 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1687 microversion: 2.1 time: 0.252874 Nov 06 21:59:47.718262 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4516/9144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:59:47 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:59:48.424640 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 21:59:48.425520 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 21:59:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 21:59:48.735388 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:48.736128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:48.743522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:48.743987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:48.744806 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:48.745256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:48.883124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:59:48.890508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6de26518-e2e3-40bc-ae0a-1a0f546ed720 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1569 microversion: 2.1 time: 0.159255 Nov 06 21:59:48.891080 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4629/9145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:59:48 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:59:49.797619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-509c93b6-b931-497f-a3d8-6e2b98e15dcf req-759f3a4f-4be8-4716-b623-837eb8d051fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541da6a-42ba-44e2-bc21-d8ebe09adb4b", "name": "network-vif-deleted", "tag": "dbef4b14-e9e2-43ea-8e23-234efd1259da"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:59:49.799321 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 21:59:49.799321 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 21:59:49.812066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-509c93b6-b931-497f-a3d8-6e2b98e15dcf req-759f3a4f-4be8-4716-b623-837eb8d051fa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:49.812556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-509c93b6-b931-497f-a3d8-6e2b98e15dcf req-759f3a4f-4be8-4716-b623-837eb8d051fa service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:49.829156 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-509c93b6-b931-497f-a3d8-6e2b98e15dcf req-759f3a4f-4be8-4716-b623-837eb8d051fa service nova] Creating event network-vif-deleted:dbef4b14-e9e2-43ea-8e23-234efd1259da for instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b on nch1-master-1 Nov 06 21:59:49.835480 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-509c93b6-b931-497f-a3d8-6e2b98e15dcf req-759f3a4f-4be8-4716-b623-837eb8d051fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041482 Nov 06 21:59:49.836147 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4517/9146] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 21:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 21:59:49.907093 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:49.907717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:49.914505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:49.915579 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:49.916408 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:49.916856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:49.949168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:49.949626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:49.950083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lazy-loading 'fault' on Instance uuid a541da6a-42ba-44e2-bc21-d8ebe09adb4b {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 21:59:49.991723 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 21:59:49.999019 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-32479a6b-2726-4261-aa7c-4538df60c462 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 200 len: 1355 microversion: 2.1 time: 0.095708 Nov 06 21:59:49.999603 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4630/9147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:59:49 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 1355 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 21:59:51.017224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:51.017926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: a541da6a-42ba-44e2-bc21-d8ebe09adb4b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 21:59:51.025351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:51.025806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:51.026582 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 21:59:51.027023 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 21:59:51.040100 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] HTTP exception thrown: Instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b could not be found. Nov 06 21:59:51.040716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Returning 404 to user: Instance a541da6a-42ba-44e2-bc21-d8ebe09adb4b could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 21:59:51.041529 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06d47885-1369-4a2e-974c-0fb32f1cd7b2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b" status: 404 len: 111 microversion: 2.1 time: 0.028413 Nov 06 21:59:51.042040 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4518/9148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 21:59:51 2021] GET /compute/v2.1/servers/a541da6a-42ba-44e2-bc21-d8ebe09adb4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 21:59:54.382997 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4108687c-8561-4518-9ea7-ccbab55ff845 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '.version_select at 0x7f67148e4310>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 21:59:54.411367 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4108687c-8561-4518-9ea7-ccbab55ff845 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181253294" status: 202 len: 0 microversion: 2.1 time: 0.032210 Nov 06 21:59:54.412357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4631/9149] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Nov 6 21:59:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181253294 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 21:59:54.438495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: .version_select at 0x7f671ad28280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1677606566"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 21:59:54.459613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:59:54.467523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:59:54.670793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 21:59:54.675855 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 21:59:54.689462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f8ea1061-955d-464d-af6a-8403339672ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.254816 Nov 06 21:59:54.690544 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4519/9150] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 21:59:54 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:00.364805 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-887119868", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "42fff02e-d0a7-4957-ba66-33dbc6d0f77f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1677606566", "security_groups": [{"name": "tempest-secgroup-smoke-1261098527"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:00:00.495567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] validate_networks() for [('42fff02e-d0a7-4957-ba66-33dbc6d0f77f', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:00:00.933060 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:00:00.933709 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:00:00.934353 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:00:00.934783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:00:00.935609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:00:00.945636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:00.946359 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:00.947271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:00.947725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:00.965136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:00:00.970536 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:00:00.983462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:00:00.986197 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:00:01.041240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f57baec1-950d-447e-8f7b-ba7f826169e3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680627 Nov 06 22:00:01.053406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ad5ca378-abe4-493d-8845-907a0b64d78a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:01.054663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ad5ca378-abe4-493d-8845-907a0b64d78a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:01.057645 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4632/9151] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:00:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:00:01.119069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ad5ca378-abe4-493d-8845-907a0b64d78a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:01.126901 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ad5ca378-abe4-493d-8845-907a0b64d78a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1266 microversion: 2.1 time: 0.078395 Nov 06 22:00:01.127793 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4520/9152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:01 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:02.145255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:02.167791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:02.167791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:02.167791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:02.167791 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:02.170657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:02.295321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:02.303794 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-58305d82-b5bf-4630-951d-e2987d3b6de1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1336 microversion: 2.1 time: 0.163296 Nov 06 22:00:02.313459 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4633/9153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:02 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:03.320013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:03.321254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:03.329262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:03.335724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:03.336972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:03.337620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:03.545651 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:03.553327 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-638243e9-d0ea-40d5-a419-da310e98559c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.236808 Nov 06 22:00:03.553889 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4521/9154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:03 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:03.616520 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-46e72053-5ce8-4e5e-a3ec-4167fc2b3ca0 req-24a02617-badc-4d82-a2b3-246c0af96e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:00:03.619218 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:00:03.619218 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:00:03.629237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-46e72053-5ce8-4e5e-a3ec-4167fc2b3ca0 req-24a02617-badc-4d82-a2b3-246c0af96e60 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:03.629962 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-46e72053-5ce8-4e5e-a3ec-4167fc2b3ca0 req-24a02617-badc-4d82-a2b3-246c0af96e60 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:03.643508 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-46e72053-5ce8-4e5e-a3ec-4167fc2b3ca0 req-24a02617-badc-4d82-a2b3-246c0af96e60 service nova] Creating event network-changed:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch1-master-1 Nov 06 22:00:03.648572 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-46e72053-5ce8-4e5e-a3ec-4167fc2b3ca0 req-24a02617-badc-4d82-a2b3-246c0af96e60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035652 Nov 06 22:00:03.649214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4634/9155] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:00:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:00:04.570646 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:04.571268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:04.579015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:04.579473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:04.580890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:04.581330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:04.712597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:04.719879 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8d93a974-29c6-488d-80a2-88c54077c683 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.152901 Nov 06 22:00:04.720534 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4522/9156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:04 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:05.738378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:05.739090 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:05.745245 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:05.745743 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:05.746527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:05.747019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:05.885270 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:05.893281 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e3081dde-8323-4be4-9b0f-269547bff599 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.159193 Nov 06 22:00:05.893860 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4635/9157] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:05 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:06.910492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:06.911109 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:06.917798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:06.918257 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:06.919046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:06.919520 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:07.051823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:07.059147 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ad7dc3f-f80a-4157-9488-3925408cd324 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.152910 Nov 06 22:00:07.059713 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4523/9158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:06 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:08.075716 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:08.076351 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:08.082991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:08.083457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:08.084246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:08.084713 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:08.218626 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:08.226341 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4f10f982-8710-4a7c-bfe8-dbd204075651 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.154332 Nov 06 22:00:08.226906 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4636/9159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:08 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:09.243102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:09.243721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:09.250350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:09.250809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:09.251602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:09.252714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:09.393092 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:09.400213 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-93aa70a5-0a9b-4d65-8544-53087329b622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.160812 Nov 06 22:00:09.400805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4524/9160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:09 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:10.417068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:10.417608 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:10.424537 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:10.425312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:10.426111 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:10.426595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:10.558910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:10.566677 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e7d4c5e-5e4e-4dbb-800f-07b02a69e094 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.153475 Nov 06 22:00:10.567245 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4637/9161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:10 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:11.041203 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ab086533-675b-4d92-b488-bf54b30179ac req-a586d389-9d37-4751-90f1-721e372dc70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "name": "network-vif-plugged", "status": "completed", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:00:11.042768 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:00:11.042768 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:00:11.050450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ab086533-675b-4d92-b488-bf54b30179ac req-a586d389-9d37-4751-90f1-721e372dc70c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:11.050893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ab086533-675b-4d92-b488-bf54b30179ac req-a586d389-9d37-4751-90f1-721e372dc70c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:11.061405 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ab086533-675b-4d92-b488-bf54b30179ac req-a586d389-9d37-4751-90f1-721e372dc70c service nova] Creating event network-vif-plugged:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch1-master-1 Nov 06 22:00:11.066850 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ab086533-675b-4d92-b488-bf54b30179ac req-a586d389-9d37-4751-90f1-721e372dc70c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089691 Nov 06 22:00:11.067458 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4525/9162] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:00:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:00:11.583349 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:11.583986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:11.590702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:11.591166 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:11.591989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:11.592468 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:11.724965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:11.732229 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0796750f-f243-4eed-a2d1-7474330bb705 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1392 microversion: 2.1 time: 0.152629 Nov 06 22:00:11.732893 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4638/9163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:11 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:12.751233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:12.752495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:12.758636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:12.759095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:12.759889 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:12.760358 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:12.900075 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:12.907378 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9db5a759-cb52-47ab-89a1-67f126cb67cc tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1564 microversion: 2.1 time: 0.161360 Nov 06 22:00:12.907943 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4526/9164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:12 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:12.923239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:12.923912 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:12.930788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:12.931258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:12.932051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:12.932531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:13.065067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:13.072478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5f7148a4-4b2a-41e4-9e53-153c0f9135ee tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1564 microversion: 2.1 time: 0.152853 Nov 06 22:00:13.073074 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4639/9165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:12 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:14.992793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:00:14.998129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-83291ca6-c41b-4aa6-985c-fd6c061bf2ae req-c55a9467-7ee3-46af-9b9b-344020535c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:00:14.999811 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:00:14.999811 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:00:15.003835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:15.008376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-83291ca6-c41b-4aa6-985c-fd6c061bf2ae req-c55a9467-7ee3-46af-9b9b-344020535c6f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:15.009121 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-83291ca6-c41b-4aa6-985c-fd6c061bf2ae req-c55a9467-7ee3-46af-9b9b-344020535c6f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:15.011192 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:15.011798 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:15.012641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:15.013578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:15.021039 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-83291ca6-c41b-4aa6-985c-fd6c061bf2ae req-c55a9467-7ee3-46af-9b9b-344020535c6f service nova] Creating event network-changed:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch1-master-1 Nov 06 22:00:15.027578 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-83291ca6-c41b-4aa6-985c-fd6c061bf2ae req-c55a9467-7ee3-46af-9b9b-344020535c6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033018 Nov 06 22:00:15.028395 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4640/9166] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:00:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:00:15.237364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:00:15.244980 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-44393efa-0d0e-466b-b7fc-73e82a086b5d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1564 microversion: 2.1 time: 0.255935 Nov 06 22:00:15.245798 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4527/9167] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:00:14 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:00:48.595479 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:00:48.596524 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:00:48.602858 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:48.603327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:48.604128 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:00:48.604609 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:00:48.660401 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6aa009a7-ddb4-4832-91cd-16c321b51622 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action" status: 200 len: 24571 microversion: 2.1 time: 0.142117 Nov 06 22:00:48.661008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4641/9168] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:00:48 2021] POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action => generated 24571 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:01:18.884679 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:01:18.885649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:18.892606 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:18.893063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:18.893847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:18.894287 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:18.986201 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:18.992479 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=134828) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 06 22:01:18.998537 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:01:18.998961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:01:18.999435 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:01:18.999847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:01:19.000960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:01:19.063957 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2efb5bca-ba98-48d3-a635-5ade5b37bc50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action" status: 202 len: 0 microversion: 2.1 time: 0.182605 Nov 06 22:01:19.064607 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4528/9169] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:01:18 2021] POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:01:19.073217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:19.073935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:19.080902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:19.081369 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:19.082167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:19.082623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:19.269519 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:19.277046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1801e179-2b37-432c-8108-738164af4f4c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1691 microversion: 2.1 time: 0.208043 Nov 06 22:01:19.277622 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4642/9170] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:19 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:20.297304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:20.298046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:20.307576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:20.308129 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:20.309054 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:20.309597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:20.615638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:20.623089 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c03bf61f-f3ad-4ef2-85c4-0a7eae69ab1a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1691 microversion: 2.1 time: 0.331674 Nov 06 22:01:20.623658 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4529/9171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:20 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1691 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:21.640028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:21.640701 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:21.647544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:21.648011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:21.648835 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:21.649287 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:21.789205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:21.797663 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c276571f-4955-48c7-a237-62000f437b8a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.161304 Nov 06 22:01:21.798279 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4643/9172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:21 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:22.816822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:22.817444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:22.824186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:22.824678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:22.825467 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:22.825914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:22.961638 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:22.969005 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-231217fe-64fc-4c04-8a9a-4db5f8ab5457 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.156824 Nov 06 22:01:22.969571 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4530/9173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:22 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:23.986126 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:23.986785 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:23.993558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:23.994033 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:23.994840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:23.995299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:24.126548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:24.134497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7122157e-9df1-498c-800b-4b037986eb0e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.152100 Nov 06 22:01:24.135008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4644/9174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:23 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:25.151937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:25.152503 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:25.159181 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:25.160241 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:25.161053 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:25.161492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:25.297583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:25.305825 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-75cb459d-c06a-460a-8836-d685b67d850b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.157701 Nov 06 22:01:25.306389 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4531/9175] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:25 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:26.322907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:26.323511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:26.330173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:26.330639 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:26.332116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:26.332594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:26.465832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:26.473171 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8d55bc53-801c-49b7-8288-67e0edd39234 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.154096 Nov 06 22:01:26.473740 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4645/9176] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:26 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:27.490254 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:27.490882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:27.497525 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:27.497984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:27.498764 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:27.499199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:27.634650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:27.641910 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b612e69c-7096-440f-8481-8e05dac8dbc5 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.155371 Nov 06 22:01:27.642472 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4532/9177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:27 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:28.658816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:28.659525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:28.666775 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:28.667248 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:28.668062 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:28.668548 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:28.802200 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:28.811045 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81aaa750-cbad-4872-85d8-bafaa511644e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.155968 Nov 06 22:01:28.811617 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4646/9178] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:28 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:29.827879 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:29.828530 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:29.835506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:29.835963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:29.836791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:29.837237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:29.975852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:29.983274 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5e79b64a-7913-4f62-ac23-ebb4a5e0e00c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.159051 Nov 06 22:01:29.983843 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4533/9179] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:29 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:31.000875 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:31.001429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:31.008580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:31.009046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:31.009829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:31.010277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:31.146464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:31.153775 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b258ce0a-9c86-4626-abd9-62fb319a9de8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.156759 Nov 06 22:01:31.154345 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4647/9180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:30 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:32.170886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:32.171452 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:32.178103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:32.178561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:32.179352 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:32.179792 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:32.311100 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:32.318612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-71736e5c-858c-498f-a711-71bea1696a4a tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1696 microversion: 2.1 time: 0.151664 Nov 06 22:01:32.319172 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4534/9181] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:32 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:33.335084 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:33.335925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:33.342848 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:33.343328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:33.344136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:33.344620 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:33.484151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "name": "network-vif-unplugged", "status": "completed", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:01:33.485761 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:01:33.485761 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:01:33.495561 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:33.496009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:33.513453 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] Creating event network-vif-unplugged:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch2-master-1 Nov 06 22:01:33.518866 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] Instance f1705285-c481-47ef-937c-7b4b1e63d5f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134828) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 22:01:33.531551 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c0aa841b-9f08-454d-abe1-b5a0d3f703ae req-aee1e258-4c6f-4a64-a1ed-ffbab5fd7d58 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102179 Nov 06 22:01:33.532854 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4535/9182] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:01:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:01:33.617259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:33.625215 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-172b76d1-5d19-4578-8f08-c54e73aaad23 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1695 microversion: 2.1 time: 0.293885 Nov 06 22:01:33.626132 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4648/9183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:33 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1695 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:34.643163 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:34.643981 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:34.650826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:34.651277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:34.652052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:34.652516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:34.789700 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:34.797014 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d9b56823-ed25-4465-9fcb-f37129c5fa08 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1693 microversion: 2.1 time: 0.157885 Nov 06 22:01:34.797606 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4536/9184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:34 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:35.565069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:01:35.567144 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:01:35.567144 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:01:35.574851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:35.575312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:35.587209 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] Creating event network-changed:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch2-master-1 Nov 06 22:01:35.592420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] Instance f1705285-c481-47ef-937c-7b4b1e63d5f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=134827) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 06 22:01:35.602990 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-e6a0b181-10e8-4b49-977e-e084d1bc7931 req-4d8f4b60-2c82-4f7e-848b-f374bfac5d5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041590 Nov 06 22:01:35.603574 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4649/9185] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:01:35.815350 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:35.816709 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:35.823348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:35.823900 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:35.824791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:35.825233 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:36.152152 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:36.160190 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-94352d56-def6-4b53-b472-c4e4e6ebc949 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1693 microversion: 2.1 time: 0.348622 Nov 06 22:01:36.160869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4537/9186] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:35 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1693 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:37.179284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:37.180025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:37.186263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:37.186740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:37.187549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:37.188009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:37.340670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:37.349004 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-eccaf855-06d7-4683-9ac8-44a2f2e1c3cf tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1693 microversion: 2.1 time: 0.175113 Nov 06 22:01:37.349571 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4650/9187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:37 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:38.366048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:38.367447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:38.374191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.374776 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.375597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.376036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.507036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:38.514323 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d327447-e73c-43d6-a28e-3179e839a925 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1690 microversion: 2.1 time: 0.152272 Nov 06 22:01:38.514889 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4538/9188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:38 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:38.530998 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:01:38.531559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:38.538170 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.538630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.539415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.539863 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.595738 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8ae0bdd0-1967-47fb-9cbf-45c729c57814 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action" status: 204 len: 0 microversion: 2.1 time: 0.068264 Nov 06 22:01:38.596413 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4651/9189] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:01:38 2021] POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:01:38.604514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:38.605205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:38.611170 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.611636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.612551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.613082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.826165 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:38.833744 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7b381a1-23b0-4b02-b208-eba68ca04aff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1690 microversion: 2.1 time: 0.233005 Nov 06 22:01:38.834315 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4539/9190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:38 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:38.850243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:38.850954 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:38.857019 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.857481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:38.858282 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:38.858736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:39.081708 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:39.089197 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4b252708-8a4a-4453-bbc9-047c580c9558 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1690 microversion: 2.1 time: 0.243037 Nov 06 22:01:39.089770 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4652/9191] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:38 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:01:39.851087 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-11c395a3-c6db-4ff9-b6a0-a505c998b008 req-c18c5037-bf86-492d-bcdd-afbe8b0a79bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "name": "network-vif-plugged", "status": "completed", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:01:39.852713 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:01:39.852713 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:01:39.860953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-11c395a3-c6db-4ff9-b6a0-a505c998b008 req-c18c5037-bf86-492d-bcdd-afbe8b0a79bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:39.861408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-11c395a3-c6db-4ff9-b6a0-a505c998b008 req-c18c5037-bf86-492d-bcdd-afbe8b0a79bf service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:39.882182 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-11c395a3-c6db-4ff9-b6a0-a505c998b008 req-c18c5037-bf86-492d-bcdd-afbe8b0a79bf service nova] Creating event network-vif-plugged:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch2-master-1 Nov 06 22:01:39.887316 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-11c395a3-c6db-4ff9-b6a0-a505c998b008 req-c18c5037-bf86-492d-bcdd-afbe8b0a79bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040023 Nov 06 22:01:39.888220 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4540/9192] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:01:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:01:40.105780 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:01:40.106411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:01:40.113768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:40.114251 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:40.115059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:01:40.115521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:01:40.255311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:01:40.262851 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c9e7f5d7-accf-48a9-b660-a33294e88bd2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1682 microversion: 2.1 time: 0.161067 Nov 06 22:01:40.263413 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4653/9193] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:01:40 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:10.462858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:10.463823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:10.470015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:10.470473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:10.471253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:10.471689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:10.526331 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db4ca9b5-9b70-4871-849c-20da68ef44cd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action" status: 200 len: 24576 microversion: 2.1 time: 0.068342 Nov 06 22:02:10.527258 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4541/9194] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:02:10 2021] POST /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3/action => generated 24576 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:02:27.557045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:27.558203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:27.565088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:27.565555 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:27.566991 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:27.567443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:27.594051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:02:27.649124 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-959c0253-0a16-4804-87cd-cccf37859c31 req-d6f89aa7-cd56-4c34-9052-087ceb3bc346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:27.651512 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:02:27.651512 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:02:27.660185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-959c0253-0a16-4804-87cd-cccf37859c31 req-d6f89aa7-cd56-4c34-9052-087ceb3bc346 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:27.660673 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-959c0253-0a16-4804-87cd-cccf37859c31 req-d6f89aa7-cd56-4c34-9052-087ceb3bc346 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:27.671464 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-959c0253-0a16-4804-87cd-cccf37859c31 req-d6f89aa7-cd56-4c34-9052-087ceb3bc346 service nova] Creating event network-changed:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch2-master-1 Nov 06 22:02:27.678169 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-959c0253-0a16-4804-87cd-cccf37859c31 req-d6f89aa7-cd56-4c34-9052-087ceb3bc346 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122168 Nov 06 22:02:27.680985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8956b085-50a9-4447-b7f2-c803596cc1d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 204 len: 0 microversion: 2.1 time: 0.127050 Nov 06 22:02:27.684233 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4542/9196] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:02:27.686184 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4654/9196] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:02:27 2021] DELETE /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:02:27.690769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:27.692138 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:27.699006 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:27.699559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:27.700462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:27.700977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:27.913790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:27.921800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-06d63546-3c77-40bf-9ca2-c2db5648fb14 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1688 microversion: 2.1 time: 0.235314 Nov 06 22:02:27.922511 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4543/9197] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:27 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1688 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:28.940854 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:28.942054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:28.949493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:28.949965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:28.950770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:28.951224 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:29.090202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:29.097637 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7635bc58-a383-4827-8e31-baa1a81c2466 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 200 len: 1570 microversion: 2.1 time: 0.160815 Nov 06 22:02:29.098992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4655/9198] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:28 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:29.656036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-4e5a980d-c3fd-4578-be7e-ad5ecae4843d req-ebb4b0b2-6b7d-4996-a94a-59c98911f1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1705285-c481-47ef-937c-7b4b1e63d5f3", "name": "network-vif-deleted", "tag": "bf70f70f-d0bb-4e3c-8c39-48668215c1ef"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:29.658163 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:02:29.658163 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:02:29.666998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4e5a980d-c3fd-4578-be7e-ad5ecae4843d req-ebb4b0b2-6b7d-4996-a94a-59c98911f1d2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:29.667448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-4e5a980d-c3fd-4578-be7e-ad5ecae4843d req-ebb4b0b2-6b7d-4996-a94a-59c98911f1d2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:29.679578 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-4e5a980d-c3fd-4578-be7e-ad5ecae4843d req-ebb4b0b2-6b7d-4996-a94a-59c98911f1d2 service nova] Creating event network-vif-deleted:bf70f70f-d0bb-4e3c-8c39-48668215c1ef for instance f1705285-c481-47ef-937c-7b4b1e63d5f3 on nch2-master-1 Nov 06 22:02:29.684478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-4e5a980d-c3fd-4578-be7e-ad5ecae4843d req-ebb4b0b2-6b7d-4996-a94a-59c98911f1d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Nov 06 22:02:29.685075 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4544/9199] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:02:30.117275 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:30.117901 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: f1705285-c481-47ef-937c-7b4b1e63d5f3] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:30.124662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:30.125175 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:30.126048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:30.126501 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:30.140013 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] HTTP exception thrown: Instance f1705285-c481-47ef-937c-7b4b1e63d5f3 could not be found. Nov 06 22:02:30.140557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Returning 404 to user: Instance f1705285-c481-47ef-937c-7b4b1e63d5f3 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:02:30.141386 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-85bb7515-47e1-4152-8797-15712d36fafb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3" status: 404 len: 111 microversion: 2.1 time: 0.027970 Nov 06 22:02:30.141909 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4656/9200] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:30 2021] GET /compute/v2.1/servers/f1705285-c481-47ef-937c-7b4b1e63d5f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:02:33.122302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a679feb8-79d1-47aa-b8cf-4516e6bd86c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '.version_select at 0x7f67141f9820>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:33.127665 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a679feb8-79d1-47aa-b8cf-4516e6bd86c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:02:34.145766 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [None req-a679feb8-79d1-47aa-b8cf-4516e6bd86c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [847ce36c-b920-4bc6-8c56-6e747433ca44] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 40974. Nov 06 22:02:34.166454 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a679feb8-79d1-47aa-b8cf-4516e6bd86c9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677606566" status: 202 len: 0 microversion: 2.1 time: 1.052683 Nov 06 22:02:34.167026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4545/9201] 10.222.0.13 () {58 vars in 1283 bytes} [Sat Nov 6 22:02:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677606566 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:02:34.191205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: .version_select at 0x7f67148e4820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-530398759"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:34.210151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:02:34.215880 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:02:34.719946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:02:34.724671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:02:34.738242 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3fd6a0da-25c9-4956-ae68-6b3efee2345d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.550894 Nov 06 22:02:34.738837 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4657/9202] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 22:02:34 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:40.385121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-418734624", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "69acd9f6-f750-4cbb-a925-7e8d27e526f3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-530398759", "security_groups": [{"name": "tempest-secgroup-smoke-641646607"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:40.511937 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] validate_networks() for [('69acd9f6-f750-4cbb-a925-7e8d27e526f3', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:02:40.922915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:02:40.923354 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:02:40.923892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:02:40.924330 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:02:40.925935 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:02:40.934620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:40.935076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:40.935902 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:40.936370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:40.953820 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:02:40.959732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:02:40.972812 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:02:40.975278 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:02:41.021508 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0da8b48e-2ee5-41db-bfd4-213549e2fb77 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640337 Nov 06 22:02:41.022364 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4546/9203] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:02:40 2021] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:02:41.031973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b9e99dd7-cae2-4abb-9a10-45932231be12 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:41.032657 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b9e99dd7-cae2-4abb-9a10-45932231be12 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:41.090925 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b9e99dd7-cae2-4abb-9a10-45932231be12 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:41.098040 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b9e99dd7-cae2-4abb-9a10-45932231be12 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1265 microversion: 2.1 time: 0.069206 Nov 06 22:02:41.098626 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4658/9204] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:41 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:42.116564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:42.117763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:42.133998 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:42.134936 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:42.135934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:42.138887 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:42.229130 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:42.238047 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a96bb352-d05e-4001-b7cc-6197ecb0f725 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1323 microversion: 2.1 time: 0.126854 Nov 06 22:02:42.239286 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4547/9205] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:42 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1323 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:43.262763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:43.263822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:43.272229 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:43.272736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:43.273576 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:43.274027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:43.540673 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:43.549283 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1c087a26-c420-4065-a972-fcca9e7038ad tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.295686 Nov 06 22:02:43.551366 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4659/9206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:43 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:43.924664 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-2c842e93-07b2-48af-b005-b1c1616fc620 req-7501d85b-c287-45c5-8fbb-7b847571772f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd645251-75d9-4f65-9dd1-2d43f4db5217", "tag": "239dba46-544f-452c-8c6f-7ba982eb7c2e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:43.927838 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:02:43.927838 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:02:43.937400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c842e93-07b2-48af-b005-b1c1616fc620 req-7501d85b-c287-45c5-8fbb-7b847571772f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:43.938183 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-2c842e93-07b2-48af-b005-b1c1616fc620 req-7501d85b-c287-45c5-8fbb-7b847571772f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:43.958414 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-2c842e93-07b2-48af-b005-b1c1616fc620 req-7501d85b-c287-45c5-8fbb-7b847571772f service nova] Creating event network-changed:239dba46-544f-452c-8c6f-7ba982eb7c2e for instance cd645251-75d9-4f65-9dd1-2d43f4db5217 on nch1-master-1 Nov 06 22:02:43.964034 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-2c842e93-07b2-48af-b005-b1c1616fc620 req-7501d85b-c287-45c5-8fbb-7b847571772f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043127 Nov 06 22:02:43.964705 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4548/9207] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:02:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:02:44.567311 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:44.567928 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:44.574833 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:44.575294 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:44.576088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:44.576560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:44.752906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:44.760977 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-27aa593d-f0de-4fa6-83ff-18a10071ee65 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.197862 Nov 06 22:02:44.761553 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4660/9208] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:44 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:45.779076 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:45.779699 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:45.786455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:45.786913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:45.787694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:45.788136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:45.924896 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:45.932549 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-39d3da5c-8cd6-4a67-904a-27a7c869bcfb tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.158375 Nov 06 22:02:45.933124 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4549/9209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:45 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:46.949656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:46.950298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:46.957460 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:46.957919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:46.958710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:46.959151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:47.094020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:47.102077 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-edf29539-16e1-4cbe-92aa-190e166726d7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.156106 Nov 06 22:02:47.102633 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4661/9210] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:46 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:48.118833 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:48.119445 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:48.126325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:48.126785 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:48.127565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:48.128003 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:48.263253 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:48.270720 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-1a6c0c9f-5adf-41e2-b888-a87f892b49ec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.155595 Nov 06 22:02:48.271314 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4550/9211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:48 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:49.287409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:49.287990 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:49.294695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:49.295168 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:49.295969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:49.296459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:49.437160 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:49.445131 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-164e12d9-c828-46f2-b9a1-5bb117f0fd0f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.161517 Nov 06 22:02:49.445718 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4662/9212] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:49 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:49.869738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-66fd85f6-469d-4331-a331-94d3a772587a req-231ba301-9ca6-4995-a4e2-ce7216c6622e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd645251-75d9-4f65-9dd1-2d43f4db5217", "name": "network-vif-plugged", "status": "completed", "tag": "239dba46-544f-452c-8c6f-7ba982eb7c2e"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:49.871498 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:02:49.871498 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:02:49.880695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-66fd85f6-469d-4331-a331-94d3a772587a req-231ba301-9ca6-4995-a4e2-ce7216c6622e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:49.881151 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-66fd85f6-469d-4331-a331-94d3a772587a req-231ba301-9ca6-4995-a4e2-ce7216c6622e service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:49.892260 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-66fd85f6-469d-4331-a331-94d3a772587a req-231ba301-9ca6-4995-a4e2-ce7216c6622e service nova] Creating event network-vif-plugged:239dba46-544f-452c-8c6f-7ba982eb7c2e for instance cd645251-75d9-4f65-9dd1-2d43f4db5217 on nch1-master-1 Nov 06 22:02:49.897286 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-66fd85f6-469d-4331-a331-94d3a772587a req-231ba301-9ca6-4995-a4e2-ce7216c6622e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Nov 06 22:02:49.898060 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4551/9213] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:02:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:02:50.462291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:50.462917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:50.469584 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:50.470050 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:50.470847 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:50.471299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:50.611082 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:50.618426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bb9171ca-6dd7-48bb-bdd5-b41a35700084 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1390 microversion: 2.1 time: 0.159913 Nov 06 22:02:50.618992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4663/9214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:50 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:51.636258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:51.637004 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:51.643351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:51.644336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:51.645132 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:51.645602 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:51.777226 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:51.785119 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f5adbaaa-0a0a-4a6a-9b98-4bd092359ab2 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1562 microversion: 2.1 time: 0.153057 Nov 06 22:02:51.785690 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4552/9215] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:51 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:51.801535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:51.802162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:51.808573 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:51.809048 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:51.809851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:51.810312 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:51.942118 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:51.949533 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-08bbbdc4-5f88-4a1a-b80b-dbd78c9b6b19 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1562 microversion: 2.1 time: 0.152167 Nov 06 22:02:51.950103 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4664/9216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:51 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:02:53.520702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:02:53.521320 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:02:53.523606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-91b2f7f9-cc72-468e-b553-0f39515892d0 req-b0a50c27-b623-4555-a07a-04eab4c66003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd645251-75d9-4f65-9dd1-2d43f4db5217", "tag": "239dba46-544f-452c-8c6f-7ba982eb7c2e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:02:53.526051 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:02:53.526051 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:02:53.528566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:53.529036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:53.529842 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:53.530277 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:53.534560 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-91b2f7f9-cc72-468e-b553-0f39515892d0 req-b0a50c27-b623-4555-a07a-04eab4c66003 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:02:53.535165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-91b2f7f9-cc72-468e-b553-0f39515892d0 req-b0a50c27-b623-4555-a07a-04eab4c66003 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:02:53.547200 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-91b2f7f9-cc72-468e-b553-0f39515892d0 req-b0a50c27-b623-4555-a07a-04eab4c66003 service nova] Creating event network-changed:239dba46-544f-452c-8c6f-7ba982eb7c2e for instance cd645251-75d9-4f65-9dd1-2d43f4db5217 on nch1-master-1 Nov 06 22:02:53.552827 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-91b2f7f9-cc72-468e-b553-0f39515892d0 req-b0a50c27-b623-4555-a07a-04eab4c66003 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033696 Nov 06 22:02:53.553802 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4665/9217] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:02:53.752069 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:02:53.761299 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-327398ef-ff89-4d9c-bbe8-83c0794dd7c1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1562 microversion: 2.1 time: 0.245181 Nov 06 22:02:53.762218 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4553/9218] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:02:53 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:03:12.124457 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:03:12.124952 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:03:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:03:25.026059 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:03:25.027066 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:03:25.033320 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:25.033786 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:25.034572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:25.035020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:25.086497 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-175ef1e5-943f-4654-8ec1-568c7456b799 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action" status: 200 len: 24569 microversion: 2.1 time: 0.064700 Nov 06 22:03:25.087363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4666/9219] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:03:25 2021] POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action => generated 24569 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:03:55.459186 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c69935df-cff6-4e35-ac63-4bd84bfbe620 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:03:55.465409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c69935df-cff6-4e35-ac63-4bd84bfbe620 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:55.465869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c69935df-cff6-4e35-ac63-4bd84bfbe620 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:55.488910 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c69935df-cff6-4e35-ac63-4bd84bfbe620 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Going to try to stop instance {{(pid=134828) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 06 22:03:55.529999 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c69935df-cff6-4e35-ac63-4bd84bfbe620 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action" status: 202 len: 0 microversion: 2.1 time: 0.075434 Nov 06 22:03:55.530626 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4554/9220] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:03:55 2021] POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 22:03:55.539535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:03:55.540250 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:03:55.547374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:55.547856 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:55.549216 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:55.549667 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:55.687292 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:03:55.694955 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0be404ad-70e9-4768-95f3-4c2ec28edb6b tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.159793 Nov 06 22:03:55.695517 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4667/9221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:03:55 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:03:56.713915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:03:56.714604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:03:56.720737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:56.721187 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:56.721961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:56.722394 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:56.852329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:03:56.859580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4f333125-bf8f-40f6-b6f4-9b042d1b8b64 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.150714 Nov 06 22:03:56.860134 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4555/9222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:03:56 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:03:57.877606 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:03:57.878675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:03:57.884865 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:57.885326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:57.886114 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:57.886558 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:58.019920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:03:58.027193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-fbe166b0-e714-4409-9129-403814180858 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.153800 Nov 06 22:03:58.027749 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4668/9223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:03:57 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:03:59.044757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:03:59.045369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:03:59.052557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:59.053024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:59.053913 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:03:59.054362 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:03:59.187562 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:03:59.194877 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb9525f2-aeb9-41c5-9604-f407d7a0fbd1 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.153837 Nov 06 22:03:59.195442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4556/9224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:03:59 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:00.212467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:00.213021 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:00.219656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:00.220120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:00.220939 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:00.221389 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:00.357670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:00.365101 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1a7361a-96b6-44ca-92ea-ddb770b64b37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.156488 Nov 06 22:04:00.365685 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4669/9225] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:00 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:01.383095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:01.383740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:01.390155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:01.390604 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:01.391383 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:01.391819 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:01.524563 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:01.531926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-22ea4cac-9ac9-4e60-903a-a9083799caec tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.153061 Nov 06 22:04:01.532524 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4557/9226] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:01 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:02.548451 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:02.549675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:02.556654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:02.557120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:02.557915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:02.558365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:02.688750 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:02.696057 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ac53c0e4-b188-430e-b9aa-5c7c079ad15e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.151431 Nov 06 22:04:02.696659 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4670/9227] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:02 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:03.713367 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:03.714017 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:03.721380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:03.721849 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:03.722631 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:03.723071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:03.855095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:03.862468 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-df99f80a-6342-4a3f-a988-abeee3ba611d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.152772 Nov 06 22:04:03.863041 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4558/9228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:03 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:04.879020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:04.879645 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:04.886411 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:04.886878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:04.887684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:04.888181 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:05.028807 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:05.036857 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-83de81a5-e647-4800-97b8-f781130f14f7 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1690 microversion: 2.1 time: 0.161728 Nov 06 22:04:05.037433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4671/9229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:04 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:06.054762 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:06.055381 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:06.062154 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:06.062621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:06.063412 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:06.063894 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:06.197375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:06.204940 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-730bc62b-f308-4196-83c5-fc36c30ce92f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1667 microversion: 2.1 time: 0.154171 Nov 06 22:04:06.205508 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4559/9230] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:06 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:07.294252 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:04:07.295108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:07.302619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:07.303085 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:07.303879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:07.304358 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:07.355892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-d3226df4-2891-4a06-aff0-b964b3f84a69 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action" status: 200 len: 37043 microversion: 2.1 time: 0.065283 Nov 06 22:04:07.356546 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4672/9231] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:04:07 2021] POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action => generated 37043 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:04:07.367970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-685c2752-97fa-40d9-b822-4325bb40600f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:04:07.374784 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-685c2752-97fa-40d9-b822-4325bb40600f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:07.375244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-685c2752-97fa-40d9-b822-4325bb40600f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:07.397654 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-685c2752-97fa-40d9-b822-4325bb40600f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Going to try to start instance {{(pid=134828) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 06 22:04:07.437127 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-685c2752-97fa-40d9-b822-4325bb40600f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action" status: 202 len: 0 microversion: 2.1 time: 0.072737 Nov 06 22:04:07.437730 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4560/9232] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:04:07 2021] POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 06 22:04:07.446932 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:07.447646 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:07.454530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:07.455001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:07.455842 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:07.456243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:07.667068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:07.675083 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-04efe1ad-c61b-4ad7-b6a5-23501e72e43c tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1676 microversion: 2.1 time: 0.232188 Nov 06 22:04:07.675653 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4673/9233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:07 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:08.694112 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:08.694808 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:08.700881 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:08.701329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:08.702103 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:08.702539 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:08.838960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:08.846161 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-283d74bf-5db9-415c-ad13-d37080ef3bdd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1680 microversion: 2.1 time: 0.156981 Nov 06 22:04:08.846744 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4561/9234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:08 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:41.055208 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:04:41.056146 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:41.062636 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:41.063098 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:41.063893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:41.064381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:41.117252 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-72e58ac6-0ce3-4567-8a76-0f982f00994f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action" status: 200 len: 61612 microversion: 2.1 time: 0.065911 Nov 06 22:04:41.117896 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4674/9235] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:04:41 2021] POST /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217/action => generated 61612 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:04:48.444028 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:04:48.444708 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:04:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:04:58.508663 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:58.509285 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:58.512147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-04ba04b3-fb69-42dd-b35f-2d0dfd47a60a req-b95c8935-00b9-443f-b9f2-7fee225547ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd645251-75d9-4f65-9dd1-2d43f4db5217", "tag": "239dba46-544f-452c-8c6f-7ba982eb7c2e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:04:58.514333 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:04:58.514333 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:04:58.515564 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:58.516020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:58.518447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:58.518621 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:58.524663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-04ba04b3-fb69-42dd-b35f-2d0dfd47a60a req-b95c8935-00b9-443f-b9f2-7fee225547ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:58.525237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-04ba04b3-fb69-42dd-b35f-2d0dfd47a60a req-b95c8935-00b9-443f-b9f2-7fee225547ff service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:58.537802 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-04ba04b3-fb69-42dd-b35f-2d0dfd47a60a req-b95c8935-00b9-443f-b9f2-7fee225547ff service nova] Creating event network-changed:239dba46-544f-452c-8c6f-7ba982eb7c2e for instance cd645251-75d9-4f65-9dd1-2d43f4db5217 on nch1-master-1 Nov 06 22:04:58.543243 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-04ba04b3-fb69-42dd-b35f-2d0dfd47a60a req-b95c8935-00b9-443f-b9f2-7fee225547ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035240 Nov 06 22:04:58.544375 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4675/9236] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:04:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:04:58.546526 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:04:58.638338 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6bc35199-d0d9-4956-bdcb-e8caf3f9da40 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 204 len: 0 microversion: 2.1 time: 0.133354 Nov 06 22:04:58.642747 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4562/9237] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:04:58 2021] DELETE /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:04:58.649053 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:58.649921 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:58.658820 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:58.659295 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:58.660140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:58.660616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:58.888832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:04:58.897616 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6856d423-bb37-49a1-8e87-8670e6234f74 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1686 microversion: 2.1 time: 0.253462 Nov 06 22:04:58.898199 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4676/9238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:58 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1686 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:04:59.915468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:04:59.916171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:04:59.923557 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:59.924032 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:04:59.924970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:04:59.925411 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:00.064830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:00.072427 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-8b7c3fbb-9920-4973-80ed-4edcb00317a0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1568 microversion: 2.1 time: 0.160961 Nov 06 22:05:00.073026 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4563/9239] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:04:59 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:00.936080 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-0faf94fe-1607-43c9-b8b4-7916bbaec1d9 req-bc4374ec-312f-4133-bf33-5c0c24338161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd645251-75d9-4f65-9dd1-2d43f4db5217", "name": "network-vif-deleted", "tag": "239dba46-544f-452c-8c6f-7ba982eb7c2e"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:00.937632 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:05:00.937632 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:05:00.945948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0faf94fe-1607-43c9-b8b4-7916bbaec1d9 req-bc4374ec-312f-4133-bf33-5c0c24338161 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:00.946409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-0faf94fe-1607-43c9-b8b4-7916bbaec1d9 req-bc4374ec-312f-4133-bf33-5c0c24338161 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:00.957587 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-0faf94fe-1607-43c9-b8b4-7916bbaec1d9 req-bc4374ec-312f-4133-bf33-5c0c24338161 service nova] Creating event network-vif-deleted:239dba46-544f-452c-8c6f-7ba982eb7c2e for instance cd645251-75d9-4f65-9dd1-2d43f4db5217 on nch1-master-1 Nov 06 22:05:00.962618 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-0faf94fe-1607-43c9-b8b4-7916bbaec1d9 req-bc4374ec-312f-4133-bf33-5c0c24338161 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 Nov 06 22:05:00.963207 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4677/9240] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:05:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:05:01.089731 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:01.090351 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:01.096771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:01.097224 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:01.098002 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:01.098441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:01.130616 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:01.130994 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:01.131441 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lazy-loading 'fault' on Instance uuid cd645251-75d9-4f65-9dd1-2d43f4db5217 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 22:05:01.170147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:01.178448 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6fe6d348-be9d-445b-b590-d49c6fbea6c6 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 200 len: 1355 microversion: 2.1 time: 0.092834 Nov 06 22:05:01.179021 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4564/9241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:01 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 1355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:02.196253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:02.205549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: cd645251-75d9-4f65-9dd1-2d43f4db5217] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:02.205549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:02.205549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:02.205917 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:02.206376 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:02.219568 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] HTTP exception thrown: Instance cd645251-75d9-4f65-9dd1-2d43f4db5217 could not be found. Nov 06 22:05:02.220828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Returning 404 to user: Instance cd645251-75d9-4f65-9dd1-2d43f4db5217 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:05:02.221675 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7b8d3ef9-48d8-42ef-8471-46ffc2f02484 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217" status: 404 len: 111 microversion: 2.1 time: 0.030490 Nov 06 22:05:02.222214 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4678/9242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:02 2021] GET /compute/v2.1/servers/cd645251-75d9-4f65-9dd1-2d43f4db5217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:05:05.576899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-645deaed-9351-45b2-9479-d9d95f138fb4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '.version_select at 0x7f67141de1f0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:05.599491 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-645deaed-9351-45b2-9479-d9d95f138fb4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-530398759" status: 202 len: 0 microversion: 2.1 time: 0.026241 Nov 06 22:05:05.600084 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4565/9243] 10.222.0.13 () {58 vars in 1280 bytes} [Sat Nov 6 22:05:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-530398759 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:05:05.631459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: .version_select at 0x7f67147cf430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-17447508"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:05.650978 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:05:05.655919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:05:05.974693 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:05:05.979474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:05:05.994056 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-324b76fe-f298-4d11-8969-1221f9408c6e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.367707 Nov 06 22:05:05.994648 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4679/9244] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 22:05:05 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:11.707969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-230223742", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "networks": [{"uuid": "eb724bc6-0560-4f09-a8e6-5e55de2e453b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-17447508", "security_groups": [{"name": "tempest-secgroup-smoke-831543132"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:11.817019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] validate_networks() for [('eb724bc6-0560-4f09-a8e6-5e55de2e453b', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:05:12.277437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:05:12.277996 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:05:12.278813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:05:12.279607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:05:12.280945 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:05:12.291212 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:12.294771 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:12.295898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:12.296565 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:12.321077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:05:12.329578 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Getting quotas for user b88efb04f686419b9cd5d3a8616deb88 and project 71a123f12330481db90fdb7ac20e602e. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:05:12.343728 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:05:12.348513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:05:12.411580 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-28690f94-8b47-4326-9e9c-4a5be5a71e50 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.707191 Nov 06 22:05:12.417453 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4566/9245] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:05:11 2021] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:05:12.424023 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e1e70e4e-4559-4b2c-bdef-a1786ec27981 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:12.424799 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e1e70e4e-4559-4b2c-bdef-a1786ec27981 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:12.527236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e1e70e4e-4559-4b2c-bdef-a1786ec27981 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:12.537153 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e1e70e4e-4559-4b2c-bdef-a1786ec27981 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1264 microversion: 2.1 time: 0.117877 Nov 06 22:05:12.540998 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4680/9246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:12 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1264 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:13.558868 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:13.560156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:13.579618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:13.580619 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:13.584071 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:13.584862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:13.710430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:13.723370 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0952701c-04b7-41fb-8d18-93ca212b68d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1334 microversion: 2.1 time: 0.169123 Nov 06 22:05:13.725301 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4567/9247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:13 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:14.742154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:14.742947 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:14.750640 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:14.751664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:14.752768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:14.753401 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:15.015165 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:15.024220 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aef676c8-61b0-4d59-aa31-4c7cc2df575e tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.285663 Nov 06 22:05:15.024840 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4681/9248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:14 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:15.174803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b2318c94-5b9c-435b-b4af-38a8697b47e0 req-917faec1-45c2-4c99-8e49-28e9f16e7594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d710b-cc80-4278-abb3-7d4c46696686", "tag": "f20bd2d8-998e-4351-8610-396dfbc4a730"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:15.184771 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:05:15.184771 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:05:15.205978 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b2318c94-5b9c-435b-b4af-38a8697b47e0 req-917faec1-45c2-4c99-8e49-28e9f16e7594 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:15.206822 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b2318c94-5b9c-435b-b4af-38a8697b47e0 req-917faec1-45c2-4c99-8e49-28e9f16e7594 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:15.227593 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b2318c94-5b9c-435b-b4af-38a8697b47e0 req-917faec1-45c2-4c99-8e49-28e9f16e7594 service nova] Creating event network-changed:f20bd2d8-998e-4351-8610-396dfbc4a730 for instance 572d710b-cc80-4278-abb3-7d4c46696686 on nch1-master-1 Nov 06 22:05:15.233276 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b2318c94-5b9c-435b-b4af-38a8697b47e0 req-917faec1-45c2-4c99-8e49-28e9f16e7594 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065625 Nov 06 22:05:15.234085 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4568/9249] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:05:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:05:16.042076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:16.042763 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:16.050185 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:16.050658 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:16.051735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:16.052193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:16.216406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:16.224235 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e806e947-31c7-4aa8-b3db-72c8fae7a638 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.185924 Nov 06 22:05:16.224836 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4682/9250] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:16 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:17.241495 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:17.242191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:17.249028 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:17.249476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:17.250262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:17.251177 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:17.387801 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:17.395686 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-caf39790-554b-4434-b7b6-d473e246c072 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.158192 Nov 06 22:05:17.396246 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4569/9251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:17 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:18.413058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:18.413687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:18.420396 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:18.420866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:18.421670 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:18.422179 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:18.558253 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:18.566094 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-48ed321c-4fe3-41a5-8a3d-27911b9ca6ff tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.156590 Nov 06 22:05:18.566512 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4683/9252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:18 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:19.582622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:19.583229 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:19.589914 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:19.590369 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:19.591149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:19.591590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:19.728650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:19.736486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9846872d-f16c-423f-9b3c-1b5cc37faee3 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.157607 Nov 06 22:05:19.737067 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4570/9253] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:19 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:20.548915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-97731b9c-d2ad-4e61-aad8-3b3ac43a7820 req-67c23310-a839-4289-a2e5-aa159b4afcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572d710b-cc80-4278-abb3-7d4c46696686", "name": "network-vif-plugged", "status": "completed", "tag": "f20bd2d8-998e-4351-8610-396dfbc4a730"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:20.551901 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:05:20.551901 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:05:20.558839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-97731b9c-d2ad-4e61-aad8-3b3ac43a7820 req-67c23310-a839-4289-a2e5-aa159b4afcef service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:20.559651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-97731b9c-d2ad-4e61-aad8-3b3ac43a7820 req-67c23310-a839-4289-a2e5-aa159b4afcef service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:20.570196 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-97731b9c-d2ad-4e61-aad8-3b3ac43a7820 req-67c23310-a839-4289-a2e5-aa159b4afcef service nova] Creating event network-vif-plugged:f20bd2d8-998e-4351-8610-396dfbc4a730 for instance 572d710b-cc80-4278-abb3-7d4c46696686 on nch1-master-1 Nov 06 22:05:20.575295 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-97731b9c-d2ad-4e61-aad8-3b3ac43a7820 req-67c23310-a839-4289-a2e5-aa159b4afcef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087772 Nov 06 22:05:20.576237 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4684/9254] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:05:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:05:20.753587 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:20.754197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:20.760790 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:20.761245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:20.762026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:20.762462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:20.897500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:20.904820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5cefab9b-a3a5-400b-a4c2-2dee692b5b46 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.155488 Nov 06 22:05:20.905385 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4571/9255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:20 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:21.922415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:21.923140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:21.929986 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:21.930391 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:21.931180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:21.931631 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:22.076367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:22.084924 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a2db3341-76a6-4b5a-b611-f3381ceed4a4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1389 microversion: 2.1 time: 0.166941 Nov 06 22:05:22.085521 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4685/9256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:21 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:23.101610 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:23.102234 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:23.109153 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:23.109618 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:23.110418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:23.110864 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:23.241698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:23.248978 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7c36ac4c-5a63-485a-8e45-8cf4bb68ad1d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1560 microversion: 2.1 time: 0.151069 Nov 06 22:05:23.249565 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4572/9257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:23 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:23.265110 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:23.265742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:23.273239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:23.273721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:23.274517 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:23.274961 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:23.408832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:23.416139 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1a6d4f8e-a2a7-462e-8f67-ceb62faa0d6f tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1560 microversion: 2.1 time: 0.154669 Nov 06 22:05:23.416735 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4686/9258] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:23 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:25.341501 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:05:25.342156 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:25.344696 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-39c0996a-ff11-4e02-8f80-e42686b79a54 req-6f4e0d30-63e8-42db-8f11-adaf1663133c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d710b-cc80-4278-abb3-7d4c46696686", "tag": "f20bd2d8-998e-4351-8610-396dfbc4a730"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:25.346771 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:05:25.346771 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:05:25.349030 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:25.349736 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:25.350763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:25.351365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:25.355141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39c0996a-ff11-4e02-8f80-e42686b79a54 req-6f4e0d30-63e8-42db-8f11-adaf1663133c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:25.355779 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-39c0996a-ff11-4e02-8f80-e42686b79a54 req-6f4e0d30-63e8-42db-8f11-adaf1663133c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:25.367406 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-39c0996a-ff11-4e02-8f80-e42686b79a54 req-6f4e0d30-63e8-42db-8f11-adaf1663133c service nova] Creating event network-changed:f20bd2d8-998e-4351-8610-396dfbc4a730 for instance 572d710b-cc80-4278-abb3-7d4c46696686 on nch1-master-1 Nov 06 22:05:25.372698 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-39c0996a-ff11-4e02-8f80-e42686b79a54 req-6f4e0d30-63e8-42db-8f11-adaf1663133c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032445 Nov 06 22:05:25.373441 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4687/9259] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:05:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:05:25.592620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:05:25.601057 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0a668acd-5fd9-4d88-9bd0-2dd8aa976bbd tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1560 microversion: 2.1 time: 0.263470 Nov 06 22:05:25.601848 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4573/9260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:05:25 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:05:57.056768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:05:57.057778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:05:57.063733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:57.064195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:57.065012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:05:57.065458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:05:57.120745 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9d2a5ef1-efb2-4f7d-9ac2-4847d0943067 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action" status: 200 len: 24572 microversion: 2.1 time: 0.257753 Nov 06 22:05:57.121264 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4688/9261] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:05:56 2021] POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action => generated 24572 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:06:27.333392 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:27.334015 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:27.339789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:27.340240 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:27.341047 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:27.341486 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:27.364589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lazy-loading 'flavor' on Instance uuid 572d710b-cc80-4278-abb3-7d4c46696686 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 22:06:27.427374 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-25498449-1a3f-484f-8a8b-5bacf13b1142 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action" status: 202 len: 0 microversion: 2.1 time: 0.099385 Nov 06 22:06:27.428069 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4574/9262] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:06:27 2021] POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:06:27.436992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:27.437759 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:27.445502 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:27.446083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:27.446936 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:27.448314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:27.689740 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:27.697089 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-4efe1e19-25b6-4007-a43b-83b5d39a4389 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1687 microversion: 2.1 time: 0.264502 Nov 06 22:06:27.697654 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4689/9263] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:27 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1687 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:28.716507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:28.717210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:28.723399 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:28.723858 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:28.724665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:28.725107 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:28.905098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:28.912462 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e5d4be90-53af-483f-8eb0-ec867e63db26 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1687 microversion: 2.1 time: 0.201015 Nov 06 22:06:28.913028 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4575/9264] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:28 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 22:06:29.930328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:29.930946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:29.939010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:29.939473 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:29.940249 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:29.940720 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:30.078595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:30.086137 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0ba5972c-b613-4702-8ea8-a8d832bf72d9 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1670 microversion: 2.1 time: 0.159867 Nov 06 22:06:30.086712 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4690/9265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:29 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:31.177205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:31.178049 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:31.184648 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.185106 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.185886 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.186325 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.240785 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9a010247-874c-427f-b8b3-450f481dd837 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action" status: 200 len: 38370 microversion: 2.1 time: 0.067426 Nov 06 22:06:31.241576 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4576/9266] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:06:31 2021] POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action => generated 38370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:06:31.252511 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:31.253076 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:31.259770 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.260237 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.261064 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.261515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.329240 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-069fe560-6b0d-43d9-a97b-9b95ddb61300 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action" status: 202 len: 0 microversion: 2.1 time: 0.080256 Nov 06 22:06:31.329992 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4691/9267] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:06:31 2021] POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:06:31.339205 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:31.339899 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:31.348567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.349315 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.350110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:31.350559 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:31.568007 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:31.576330 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ba7a4f30-9862-4aae-807c-2d622a66a1fa tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1676 microversion: 2.1 time: 0.241129 Nov 06 22:06:31.580915 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4577/9268] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:31 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:32.142469 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:06:32.142734 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:06:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:06:32.595356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:32.596052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:32.603016 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:32.603476 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:32.604261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:32.604736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:32.739087 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:32.746361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-78735094-bf20-4729-9b48-2fe865617a36 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1676 microversion: 2.1 time: 0.155561 Nov 06 22:06:32.746930 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4692/9269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:32 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:33.763249 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:33.763863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:33.771136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:33.771595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:33.772402 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:33.772869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:33.907767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:33.915328 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-ac2eaf2f-a52b-4845-8ee8-da8694ab5e0d tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1679 microversion: 2.1 time: 0.155669 Nov 06 22:06:33.915838 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4578/9270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:33 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:34.011162 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:34.012092 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:34.019340 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:34.019798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:34.020621 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:34.021063 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:34.059346 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-60867e50-a509-45d0-b4eb-41ccd69940b0 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action" status: 200 len: 38370 microversion: 2.1 time: 0.051752 Nov 06 22:06:34.059980 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4693/9271] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:06:34 2021] POST /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686/action => generated 38370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 06 22:06:35.405066 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:35.405613 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:35.426437 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:35.426909 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:35.427726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:35.428171 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:35.455852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:06:35.475209 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-464e2fbd-7692-48a2-b95f-bea5cd043721 req-7577c44f-396b-438a-a2d7-48ff954cdeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d710b-cc80-4278-abb3-7d4c46696686", "tag": "f20bd2d8-998e-4351-8610-396dfbc4a730"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:35.476771 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:06:35.476771 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:06:35.486577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-464e2fbd-7692-48a2-b95f-bea5cd043721 req-7577c44f-396b-438a-a2d7-48ff954cdeeb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:35.487039 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-464e2fbd-7692-48a2-b95f-bea5cd043721 req-7577c44f-396b-438a-a2d7-48ff954cdeeb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:35.511662 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-464e2fbd-7692-48a2-b95f-bea5cd043721 req-7577c44f-396b-438a-a2d7-48ff954cdeeb service nova] Creating event network-changed:f20bd2d8-998e-4351-8610-396dfbc4a730 for instance 572d710b-cc80-4278-abb3-7d4c46696686 on nch1-master-1 Nov 06 22:06:35.517395 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-464e2fbd-7692-48a2-b95f-bea5cd043721 req-7577c44f-396b-438a-a2d7-48ff954cdeeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112749 Nov 06 22:06:35.518377 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4694/9272] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:06:35.548518 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-5ed00e71-f22c-4b06-abba-c906366da1c4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 204 len: 0 microversion: 2.1 time: 0.146594 Nov 06 22:06:35.549801 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4579/9273] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:06:35 2021] DELETE /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:06:35.564797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:35.565890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:35.572246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:35.572839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:35.573650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:35.574105 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:35.714154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:35.722945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-967bc764-8720-4459-8e59-a9f289a37271 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1685 microversion: 2.1 time: 0.163306 Nov 06 22:06:35.723740 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4695/9274] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:35 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:36.741188 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:36.741930 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:36.748506 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:36.748969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:36.749810 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:36.750252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:36.883763 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:36.891391 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-09fa1d30-c71c-45b0-846d-4c8092fb92ae tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1566 microversion: 2.1 time: 0.154243 Nov 06 22:06:36.891954 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4580/9275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:36 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:37.909154 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:37.909784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:37.916887 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:37.917456 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:37.918285 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:37.918745 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:37.975703 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-59c5eca6-cc06-4557-919a-c7357d48af31 req-ec61e91b-d3d0-4067-98be-1b138538ab2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572d710b-cc80-4278-abb3-7d4c46696686", "name": "network-vif-deleted", "tag": "f20bd2d8-998e-4351-8610-396dfbc4a730"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:37.977274 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:06:37.977274 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:06:37.986302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59c5eca6-cc06-4557-919a-c7357d48af31 req-ec61e91b-d3d0-4067-98be-1b138538ab2b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:37.987388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-59c5eca6-cc06-4557-919a-c7357d48af31 req-ec61e91b-d3d0-4067-98be-1b138538ab2b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:37.999378 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88efb04f686419b9cd5d3a8616deb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a123f12330481db90fdb7ac20e602e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:37.999554 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-59c5eca6-cc06-4557-919a-c7357d48af31 req-ec61e91b-d3d0-4067-98be-1b138538ab2b service nova] Creating event network-vif-deleted:f20bd2d8-998e-4351-8610-396dfbc4a730 for instance 572d710b-cc80-4278-abb3-7d4c46696686 on nch1-master-1 Nov 06 22:06:38.005081 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-59c5eca6-cc06-4557-919a-c7357d48af31 req-ec61e91b-d3d0-4067-98be-1b138538ab2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033126 Nov 06 22:06:38.005789 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4581/9276] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:06:38.007532 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2a07133b-f61f-4fae-941c-66f554d6c4b8 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 200 len: 1499 microversion: 2.1 time: 0.102760 Nov 06 22:06:38.008256 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4696/9277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:37 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 1499 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:39.026665 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:39.027364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] [instance: 572d710b-cc80-4278-abb3-7d4c46696686] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:39.033504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:39.033960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:39.034739 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:39.035179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:39.047840 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] HTTP exception thrown: Instance 572d710b-cc80-4278-abb3-7d4c46696686 could not be found. Nov 06 22:06:39.048449 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Returning 404 to user: Instance 572d710b-cc80-4278-abb3-7d4c46696686 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:06:39.049264 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-631270b6-baaa-4a51-92e0-b0ece4a9c2d4 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686" status: 404 len: 111 microversion: 2.1 time: 0.027515 Nov 06 22:06:39.049781 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4582/9278] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:39 2021] GET /compute/v2.1/servers/572d710b-cc80-4278-abb3-7d4c46696686 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:06:42.049261 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebcc58f3-9ae8-46f1-8adc-f01968729a37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] Calling method '.version_select at 0x7f6707e6e4c0>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:42.073534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebcc58f3-9ae8-46f1-8adc-f01968729a37 tempest-TestNetworkAdvancedServerOps-1555015722 tempest-TestNetworkAdvancedServerOps-1555015722-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17447508" status: 202 len: 0 microversion: 2.1 time: 0.029019 Nov 06 22:06:42.074122 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4697/9279] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Nov 6 22:06:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17447508 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:06:53.431387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'create', calling method: .version_select at 0x7f6714060040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1406769980"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:53.456573 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:06:53.462225 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:06:53.599835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:06:53.604856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:06:53.624501 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cae25699-c610-4aca-867e-03586c724bb6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.453019 Nov 06 22:06:53.625215 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4583/9280] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 22:06:53 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:54.559291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1792101433", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1406769980", "security_groups": [{"name": "tempest-secgroup-smoke-222663241"}], "networks": [{"uuid": "4939f2bf-e700-41ee-be52-d516f6a4a61c"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:54.682972 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] validate_networks() for [('4939f2bf-e700-41ee-be52-d516f6a4a61c', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:06:55.190193 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:06:55.190630 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:06:55.191119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:06:55.191544 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:06:55.191969 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:06:55.200873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:55.201334 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:55.202167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:55.202616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:55.219613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:06:55.226571 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:06:55.241634 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:06:55.244024 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:06:55.291592 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-56b3b3b2-2935-40aa-b82b-6315fae23fed tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736874 Nov 06 22:06:55.292240 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4698/9281] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:06:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:06:55.303374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a1916f8b-73b8-4bb7-8597-c93143907896 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:55.303983 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a1916f8b-73b8-4bb7-8597-c93143907896 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:55.357693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a1916f8b-73b8-4bb7-8597-c93143907896 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:55.365152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a1916f8b-73b8-4bb7-8597-c93143907896 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1247 microversion: 2.1 time: 0.066453 Nov 06 22:06:55.365728 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4584/9282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:55 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:56.383409 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:56.384030 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:56.390702 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:56.391167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:56.391964 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:56.392617 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:56.488561 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:56.495969 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-350ccb50-941e-4432-817f-f729644296b9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1305 microversion: 2.1 time: 0.117390 Nov 06 22:06:56.496639 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4699/9283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:56 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:57.513546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:57.514221 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:57.522805 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:57.523569 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:57.524407 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:57.524857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:57.757747 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:57.765325 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9d8bf7fb-b3e0-4693-be63-72ab9bc2346f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.255803 Nov 06 22:06:57.766558 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4585/9284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:57 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:06:58.102965 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-995133c6-7f73-4b1e-8892-9f5901ed3329 req-907b0a42-b6d1-4c7a-9762-f3895a87be11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:06:58.104576 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:06:58.104576 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:06:58.113505 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-995133c6-7f73-4b1e-8892-9f5901ed3329 req-907b0a42-b6d1-4c7a-9762-f3895a87be11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:58.113975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-995133c6-7f73-4b1e-8892-9f5901ed3329 req-907b0a42-b6d1-4c7a-9762-f3895a87be11 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:58.133947 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-995133c6-7f73-4b1e-8892-9f5901ed3329 req-907b0a42-b6d1-4c7a-9762-f3895a87be11 service nova] Creating event network-changed:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:06:58.140100 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-995133c6-7f73-4b1e-8892-9f5901ed3329 req-907b0a42-b6d1-4c7a-9762-f3895a87be11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041209 Nov 06 22:06:58.140752 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4700/9285] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:06:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:06:58.783426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:06:58.784789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:06:58.791918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:58.792574 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:58.793384 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:06:58.794026 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:06:59.022789 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:06:59.031114 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d82e4b3f-759a-4aa0-a7b2-b1656f1f4578 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.251826 Nov 06 22:06:59.031943 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4586/9286] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:06:58 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:00.049935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:00.050837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:00.058037 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:00.058594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:00.059464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:00.059980 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:00.199094 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:00.207579 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-82af8756-19e6-41f0-8bdc-5d24faa7d69e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.161875 Nov 06 22:07:00.208176 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4701/9287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:00 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:01.224738 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:01.225275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:01.231967 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:01.232458 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:01.233242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:01.233683 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:01.366199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:01.373469 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-0085f3bc-a2ef-415a-93b6-690a5739df12 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.152470 Nov 06 22:07:01.374033 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4587/9288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:01 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:02.390910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:02.391526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:02.398277 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:02.398742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:02.399527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:02.399974 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:02.533141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:02.540426 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c1ad079f-15ec-4014-b53f-c04d6717fa44 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.153812 Nov 06 22:07:02.540986 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4702/9289] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:02 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:03.557271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:03.557836 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:03.564536 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:03.565010 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:03.565787 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:03.566282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:03.696645 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:03.704429 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a26e3708-dd9e-483f-b5f7-cf880572b85f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.150991 Nov 06 22:07:03.705001 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4588/9290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:03 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:04.721654 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:04.722274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:04.728959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:04.729423 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:04.730212 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:04.730663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:04.863152 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:04.873769 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-20db0f37-3bf4-40b7-818a-aad45c968866 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.155555 Nov 06 22:07:04.874717 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4703/9291] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:04 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:04.923147 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c3824044-4a37-4b5d-a29d-7bb30a674ae6 req-db322b16-6995-4f2a-8ff4-d87d3210bf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "name": "network-vif-plugged", "status": "completed", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:07:04.924727 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:07:04.924727 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:07:04.933102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c3824044-4a37-4b5d-a29d-7bb30a674ae6 req-db322b16-6995-4f2a-8ff4-d87d3210bf0d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:04.933558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c3824044-4a37-4b5d-a29d-7bb30a674ae6 req-db322b16-6995-4f2a-8ff4-d87d3210bf0d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:04.944431 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c3824044-4a37-4b5d-a29d-7bb30a674ae6 req-db322b16-6995-4f2a-8ff4-d87d3210bf0d service nova] Creating event network-vif-plugged:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:07:04.949297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c3824044-4a37-4b5d-a29d-7bb30a674ae6 req-db322b16-6995-4f2a-8ff4-d87d3210bf0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029765 Nov 06 22:07:04.949877 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4589/9292] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:07:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:07:05.890866 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:05.891521 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:05.898256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:05.898725 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:05.899525 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:05.899977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:06.031220 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:06.038711 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8a3130cf-db69-42d7-867d-cf7461262766 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1372 microversion: 2.1 time: 0.151555 Nov 06 22:07:06.039278 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4704/9293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:05 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:07.057547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:07.058245 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:07.064375 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:07.064828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:07.065608 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:07.066046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:07.199614 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:07.207425 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-577f6843-66be-4c58-a007-61cbda107ea9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1556 microversion: 2.1 time: 0.154732 Nov 06 22:07:07.208004 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4590/9294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:07 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:07.223890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:07:07.224533 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:07:07.231140 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:07.231603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:07.232452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:07.232874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:07.369762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:07:07.377190 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-38c42c82-60fb-46a8-82df-c84034d045e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1556 microversion: 2.1 time: 0.157010 Nov 06 22:07:07.377757 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4705/9295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:07:07 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:07:09.028649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-d3006c2c-583e-4b30-83a3-e62f03399b9d req-22b92828-52c8-45ed-a6a8-867ac1a8f9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:07:09.030838 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:07:09.030838 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:07:09.038696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d3006c2c-583e-4b30-83a3-e62f03399b9d req-22b92828-52c8-45ed-a6a8-867ac1a8f9b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:07:09.039237 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-d3006c2c-583e-4b30-83a3-e62f03399b9d req-22b92828-52c8-45ed-a6a8-867ac1a8f9b5 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:07:09.053855 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-d3006c2c-583e-4b30-83a3-e62f03399b9d req-22b92828-52c8-45ed-a6a8-867ac1a8f9b5 service nova] Creating event network-changed:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:07:09.058960 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-d3006c2c-583e-4b30-83a3-e62f03399b9d req-22b92828-52c8-45ed-a6a8-867ac1a8f9b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034406 Nov 06 22:07:09.059753 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4591/9296] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:07:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:08:08.462085 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:08:08.462784 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:08:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:09:35.057152 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 06 22:09:35.058324 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 06 22:09:35.062465 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:09:35.063028 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:35.068958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:35.069415 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:35.070205 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:35.070648 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:35.092683 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lazy-loading 'flavor' on Instance uuid a83f53a5-8569-4759-93f0-3fa67621435e {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 22:09:35.349375 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e00e1062-456c-47c3-b20b-d6cca0d6e70b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e/action" status: 202 len: 0 microversion: 2.1 time: 0.293393 Nov 06 22:09:35.350180 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4706/9297] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:09:35 2021] POST /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:09:35.357793 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:09:35.358827 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:09:35.363901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:35.364752 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:35.374662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:35.375304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:35.376139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:35.376892 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:35.519136 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:35.526564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-343f1f30-87c6-46d5-8b95-fa505248ec71 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.171530 Nov 06 22:09:35.527120 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4592/9298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:35 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:36.567291 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:36.568014 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:36.576129 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:36.576627 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:36.577429 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:36.577885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:36.581827 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41708. Nov 06 22:09:36.584572 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41706. Nov 06 22:09:36.712276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:36.720115 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-5be10862-cd84-467b-91ea-4a08560ceb28 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.178802 Nov 06 22:09:36.720702 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4707/9299] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:36 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:37.737084 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:37.737696 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:37.765885 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:37.766335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:37.767126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:37.767566 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:37.771372 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41716. Nov 06 22:09:37.774092 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41714. Nov 06 22:09:37.901926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:37.909396 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-deabbe37-88ed-4493-b44a-a2f0abdd9605 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.176042 Nov 06 22:09:37.909955 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4593/9300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:37 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:38.927552 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:38.928173 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:38.935405 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:38.935874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:38.936706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:38.937159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:39.127622 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:39.135103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2657064-6ee7-462a-b86d-1a57be2d5034 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.211560 Nov 06 22:09:39.135675 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4708/9301] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:38 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:40.153326 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:40.153891 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:40.160991 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:40.161444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:40.162482 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:40.162953 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:40.295980 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:40.303596 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7099ad0b-1bde-4b41-99d3-d6eae555b7a9 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.154721 Nov 06 22:09:40.304165 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4594/9302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:40 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:41.320025 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:41.320664 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:41.327385 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:41.327846 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:41.328666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:41.329112 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:41.461130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:41.468985 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-193f13af-84ee-4503-8880-01a4f392b64e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.152673 Nov 06 22:09:41.469556 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4709/9303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:41 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:42.486302 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:42.486893 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:42.493500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:42.493961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:42.494740 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:42.495172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:42.631423 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:42.638725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a65a1e34-307f-4ab2-9756-4a3400af18f2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.156114 Nov 06 22:09:42.639294 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4595/9304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:42 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:43.657557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:43.658180 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:43.665784 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:43.666515 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:43.668580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:43.669266 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:43.800612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:43.808250 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-41dec47d-83f1-428e-aded-3a924e2997d0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.154456 Nov 06 22:09:43.809093 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4710/9305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:43 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:44.825448 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:44.826062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:44.832845 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:44.833304 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:44.834088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:44.834529 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:44.969897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:44.977313 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eb3cb448-42bf-4c7c-9bc3-944d589ec032 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.155603 Nov 06 22:09:44.977884 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4596/9306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:44 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:45.994935 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:45.995559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:46.002896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:46.003365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:46.004158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:46.004641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:46.135274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:46.142710 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-571f6826-1f9c-4cc8-a2a1-749acae4bcbc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.151515 Nov 06 22:09:46.143281 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4711/9307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:45 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:47.159585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:47.160126 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:47.167090 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:47.167547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:47.168372 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:47.168817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:47.306661 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:47.314730 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-80f06477-a9ec-47e8-85cd-6d49d875c3f5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1701 microversion: 2.1 time: 0.158851 Nov 06 22:09:47.315299 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4597/9308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:47 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:48.332101 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:48.332746 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:48.339488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:48.339959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:48.341446 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:48.341905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:48.475837 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:48.483476 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-2422ebe4-2b38-4ada-a70c-a06c288f6175 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1701 microversion: 2.1 time: 0.155155 Nov 06 22:09:48.484054 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4712/9309] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:48 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:48.516899 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:09:48.517396 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:09:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:09:49.500729 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:49.501334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:49.507904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:49.508396 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:49.509161 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:49.509593 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:49.645934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:49.653701 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-e2001e53-edf3-45d7-9673-29234a28f498 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1701 microversion: 2.1 time: 0.156870 Nov 06 22:09:49.654276 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4598/9310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:49 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:49.684069 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-57a87afd-7c50-4678-950a-1f7c12431bff req-87493b4e-99d8-458b-9318-0a5916734a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "name": "network-vif-plugged", "status": "completed", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:09:49.686325 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:09:49.686325 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:09:49.694230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-57a87afd-7c50-4678-950a-1f7c12431bff req-87493b4e-99d8-458b-9318-0a5916734a70 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:49.694677 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-57a87afd-7c50-4678-950a-1f7c12431bff req-87493b4e-99d8-458b-9318-0a5916734a70 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:49.706258 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-57a87afd-7c50-4678-950a-1f7c12431bff req-87493b4e-99d8-458b-9318-0a5916734a70 service nova] Creating event network-vif-plugged:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:09:49.711361 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-57a87afd-7c50-4678-950a-1f7c12431bff req-87493b4e-99d8-458b-9318-0a5916734a70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Nov 06 22:09:49.712086 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4713/9311] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:09:50.670806 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:50.671455 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:50.678504 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:50.678960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:50.679744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:50.680185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:50.814317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:50.821529 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d0da8eb6-f3f9-434b-9a77-d8dd65b847ba tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1701 microversion: 2.1 time: 0.154391 Nov 06 22:09:50.822086 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4599/9312] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:50 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:51.840412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:51.842054 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:51.848136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:51.848652 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:51.850751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:51.850751 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:51.988138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:51.995622 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-aebdcc12-fa82-48ee-8db3-793e54b67bb8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.160159 Nov 06 22:09:51.996199 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4714/9313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:51 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:52.159759 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:09:52.159913 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:09:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:09:53.014020 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:53.014632 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:53.022013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:53.022473 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:53.023275 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:53.023720 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:53.169155 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:53.178277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c8fd0fa2-57ca-4f38-b1d6-da23ab3dc684 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.168661 Nov 06 22:09:53.179227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4600/9314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:53 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:54.198000 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:54.199377 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:54.207077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:54.207077 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:54.208096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:54.208781 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:54.371635 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:54.380563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c234ca30-7ea3-4f5e-ae26-1d20212901eb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.186309 Nov 06 22:09:54.381358 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4715/9315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:54 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:55.399890 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:55.400534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:55.410098 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:55.410546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:55.411340 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:55.411775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:55.568282 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:55.577926 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2f5ba90b-7c5d-4874-b020-14009c79b99c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.181926 Nov 06 22:09:55.578795 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4601/9316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:55 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:56.595238 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:56.596714 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:56.603656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:56.604127 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:56.605274 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:56.605734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:56.751242 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:56.758845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ab613ce4-67cf-4750-a627-809b25bb0f7b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.167562 Nov 06 22:09:56.759782 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4716/9317] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:56 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:57.776334 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:57.777068 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:57.783926 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:57.784406 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:57.785370 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:57.785813 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:57.931960 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:57.939983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-db36ce26-d735-40a6-876b-995121cadbbb tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.167309 Nov 06 22:09:57.940584 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4602/9318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:57 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:09:58.956893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:09:58.957541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:09:58.966647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:58.966647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:58.966999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:09:58.967443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:09:59.112462 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:09:59.120385 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce4d91b1-a62c-410d-b8e3-5bd7cacc6062 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.167088 Nov 06 22:09:59.120979 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4717/9319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:09:58 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:00.138603 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:00.140019 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:00.147125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:00.147571 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:00.148669 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:00.149110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:00.299162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:00.307027 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-36930572-ee7a-43ca-9569-dfd3049a4716 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.172810 Nov 06 22:10:00.307602 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4603/9320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:00 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:01.324633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:01.325254 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:01.332235 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:01.332736 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:01.333535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:01.333987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:01.475243 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:01.483628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-23f4dab1-6aab-4121-8fbc-01f7a4672a95 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1696 microversion: 2.1 time: 0.163039 Nov 06 22:10:01.484213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4718/9321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:01 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:02.501149 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:02.501779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:02.508321 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:02.508768 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:02.509542 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:02.509973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:02.644837 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:02.652210 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4ab4a39c-9ed6-4ecf-83a5-64fe94c7912d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1678 microversion: 2.1 time: 0.154734 Nov 06 22:10:02.652869 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4604/9322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:02 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:03.668551 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:03.669172 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:03.675768 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:03.676265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:03.677352 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:03.677797 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:03.750724 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-7292d9c3-fec5-4dd4-97af-7e870aa50fd0 req-504d30dd-5c5b-49dd-9688-e47eb7143557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "name": "network-vif-unplugged", "status": "completed", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:10:03.752314 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:10:03.752314 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:10:03.761376 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7292d9c3-fec5-4dd4-97af-7e870aa50fd0 req-504d30dd-5c5b-49dd-9688-e47eb7143557 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:03.765365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-7292d9c3-fec5-4dd4-97af-7e870aa50fd0 req-504d30dd-5c5b-49dd-9688-e47eb7143557 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:03.778131 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-7292d9c3-fec5-4dd4-97af-7e870aa50fd0 req-504d30dd-5c5b-49dd-9688-e47eb7143557 service nova] Creating event network-vif-unplugged:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:10:03.783259 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-7292d9c3-fec5-4dd4-97af-7e870aa50fd0 req-504d30dd-5c5b-49dd-9688-e47eb7143557 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036811 Nov 06 22:10:03.784382 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4605/9323] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:10:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:10:03.830159 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:03.837696 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da9fd0f6-c993-409e-8702-dfe7533c1967 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1678 microversion: 2.1 time: 0.172945 Nov 06 22:10:03.838274 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4719/9324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:03 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:04.856008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:04.856754 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:04.862882 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:04.863338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:04.864125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:04.864595 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:04.998714 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:05.006064 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6e896c6c-07ec-44a1-a257-2a26a84dd800 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1621 microversion: 2.1 time: 0.154967 Nov 06 22:10:05.006633 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4606/9325] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:04 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1621 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:05.026890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:10:05.027452 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:05.034690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:05.035135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:05.035923 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:05.036397 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:05.122690 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c99351ae-af39-407d-8a67-84409b78da1b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e/action" status: 202 len: 0 microversion: 2.1 time: 0.099555 Nov 06 22:10:05.123213 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4720/9326] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:10:05 2021] POST /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:10:05.130962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:05.131572 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:05.138036 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:05.138490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:05.139276 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:05.139710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:05.274338 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:05.281981 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14f56913-a04a-41e5-be9a-308dd64f26fe tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1629 microversion: 2.1 time: 0.154608 Nov 06 22:10:05.282541 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4607/9327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:05 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:06.299675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:06.300317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:06.306435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:06.306899 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:06.307967 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:06.308447 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:06.537981 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:06.545331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3b64ccce-7a90-4b4d-87c7-e42b28fe6f11 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.250263 Nov 06 22:10:06.545897 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4721/9328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:06 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:07.563144 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:07.563773 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:07.570509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:07.570972 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:07.571766 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:07.572210 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:07.723374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:07.736042 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-636cab9e-f06c-4512-addf-1410fdf09089 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.176512 Nov 06 22:10:07.748477 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4608/9329] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:07 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:08.753822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:08.754498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:08.760666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:08.761136 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:08.761934 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:08.762390 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:08.902828 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:08.912260 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-03671bc9-4be9-42f4-9a98-46e24d624977 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.162051 Nov 06 22:10:08.913181 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4722/9330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:08 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:09.930753 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:09.931380 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:09.937583 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:09.938034 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:09.938839 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:09.939269 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:10.087650 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:10.095123 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b034ed33-5712-48b9-8df3-09f02b19458c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.168469 Nov 06 22:10:10.095691 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4609/9331] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:09 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:11.118065 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:11.119691 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:11.129356 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:11.129933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:11.130752 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:11.131202 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:11.274896 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:11.306211 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-e288e3c0-cc1b-4d76-8801-8f47250e82ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.196356 Nov 06 22:10:11.306907 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4723/9332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:11 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:12.324162 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:12.324814 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:12.331626 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:12.332077 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:12.332901 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:12.333398 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:12.476781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:12.484090 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-062287cf-e532-42d0-b949-c1c7473b04b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.163567 Nov 06 22:10:12.484684 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4610/9333] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:12 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:13.503989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:13.505493 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:13.513535 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:13.514001 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:13.514808 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:13.515259 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:13.654467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:13.662570 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-615c3c31-19ac-4dbf-9513-4edf4899e3d7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.163361 Nov 06 22:10:13.672205 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4724/9334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:13 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:14.679759 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:14.680492 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:14.687767 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:14.688220 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:14.689232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:14.689674 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:14.831869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:14.839782 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4097b315-d216-4651-a079-e483129187e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.164520 Nov 06 22:10:14.841005 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4611/9335] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:14 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:15.858506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:15.859230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:15.866647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:15.867131 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:15.867958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:15.868445 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:16.015543 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:16.024626 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da021ee0-7450-4e97-ab1c-012b9ebc8d52 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.170772 Nov 06 22:10:16.029762 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4725/9336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:15 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:17.042450 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:17.043063 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:17.050172 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:17.050630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:17.051426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:17.052119 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:17.183847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:17.191157 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cc79c151-c5c3-4bdd-992c-f28468da2144 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.152422 Nov 06 22:10:17.191715 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4612/9337] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:17 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:18.208124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:18.208754 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:18.215321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:18.215792 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:18.216603 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:18.217057 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:18.352572 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:18.360748 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ba1fdea8-d497-4c5f-802a-6810871297e0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.156328 Nov 06 22:10:18.361292 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4726/9338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:18 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:19.378046 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:19.378647 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:19.385298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:19.385748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:19.386534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:19.386970 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:19.519589 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:19.526919 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14d93a57-7a32-4598-8f68-2b594025c697 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.152527 Nov 06 22:10:19.527627 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4613/9339] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:19 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:20.543874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:20.544484 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:20.551095 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:20.551559 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:20.552638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:20.553099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:20.689258 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:20.696534 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b262c158-276e-4bac-951f-609e556db836 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.156446 Nov 06 22:10:20.697101 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4727/9340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:20 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:21.714044 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:21.714635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:21.721710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:21.722160 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:21.722934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:21.723365 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:21.859781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:21.867135 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c3918879-7159-4164-9fc5-bf3ddcd841a5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.156863 Nov 06 22:10:21.867696 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4614/9341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:21 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:22.883575 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:22.884194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:22.891020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:22.891482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:22.892317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:22.892767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:23.023317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:23.030699 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0e0c0a93-92c5-447e-9c45-74d8554f99b6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.150815 Nov 06 22:10:23.031369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4728/9342] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:22 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:24.047852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:24.048420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:24.055327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:24.055781 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:24.056597 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:24.057040 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:24.192475 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:24.199727 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f40d5150-87fe-4f15-b90f-325ec8ac6a99 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.155650 Nov 06 22:10:24.200326 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4615/9343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:24 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:25.217915 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:25.218474 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:25.225157 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:25.225624 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:25.226421 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:25.226868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:25.359141 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:25.366602 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ebe65c6d-bef0-4ead-ba52-512ff484b9bf tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.153228 Nov 06 22:10:25.367172 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4729/9344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:25 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:25.944795 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-b04e0699-8794-4fdd-a102-743f563673e8 req-fc345b31-48bf-4373-a8fc-16057dec0d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "name": "network-vif-plugged", "status": "completed", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:10:25.946422 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:10:25.946422 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:10:25.953721 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b04e0699-8794-4fdd-a102-743f563673e8 req-fc345b31-48bf-4373-a8fc-16057dec0d92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:25.954174 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-b04e0699-8794-4fdd-a102-743f563673e8 req-fc345b31-48bf-4373-a8fc-16057dec0d92 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:25.964729 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-b04e0699-8794-4fdd-a102-743f563673e8 req-fc345b31-48bf-4373-a8fc-16057dec0d92 service nova] Creating event network-vif-plugged:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:10:25.969688 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-b04e0699-8794-4fdd-a102-743f563673e8 req-fc345b31-48bf-4373-a8fc-16057dec0d92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084855 Nov 06 22:10:25.970252 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4616/9345] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:10:26.384230 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:26.384868 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:26.391849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:26.392327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:26.393119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:26.393566 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:26.528255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:26.536234 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db5b81e4-5ab5-425e-985a-343a3ed5a36b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.155844 Nov 06 22:10:26.536830 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4730/9346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:26 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:27.554496 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:27.555323 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:27.561941 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:27.562635 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:27.563588 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:27.563907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:27.706931 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:27.714363 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9437e672-9ada-44aa-bcd7-81744e96e137 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1687 microversion: 2.1 time: 0.165522 Nov 06 22:10:27.714939 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4617/9347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:27 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:10:28.731876 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:10:28.733046 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:10:28.740088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:28.740598 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:28.741406 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:10:28.741864 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:10:28.880368 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:10:28.887759 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-63bb3aef-7922-4896-90d2-0be1d93937a0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1674 microversion: 2.1 time: 0.159613 Nov 06 22:10:28.888363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4731/9348] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:10:28 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:11:28.479719 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:11:28.480256 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:11:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:11:51.240856 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:11:51.241441 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:11:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:12:05.890711 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:05.891209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:05.897802 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:05.898364 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:05.899345 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:05.899985 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:05.926695 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:12:05.973504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-7e43d46f-ef8e-4b6c-8335-7ab4e438c75a req-a2eb13e3-b5d2-4e08-87cb-94e111b7ec09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:05.975097 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:12:05.975097 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:12:05.983264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7e43d46f-ef8e-4b6c-8335-7ab4e438c75a req-a2eb13e3-b5d2-4e08-87cb-94e111b7ec09 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:05.983467 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-7e43d46f-ef8e-4b6c-8335-7ab4e438c75a req-a2eb13e3-b5d2-4e08-87cb-94e111b7ec09 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:05.994695 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-7e43d46f-ef8e-4b6c-8335-7ab4e438c75a req-a2eb13e3-b5d2-4e08-87cb-94e111b7ec09 service nova] Creating event network-changed:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:12:05.999904 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-7e43d46f-ef8e-4b6c-8335-7ab4e438c75a req-a2eb13e3-b5d2-4e08-87cb-94e111b7ec09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117676 Nov 06 22:12:06.000756 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4732/9349] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:12:06.016561 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-661a6900-cdea-4065-b306-6ae236e27632 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 204 len: 0 microversion: 2.1 time: 0.135567 Nov 06 22:12:06.021032 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4618/9350] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:12:05 2021] DELETE /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:12:06.030738 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:06.031557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:06.037861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:06.038332 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:06.039138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:06.039594 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:06.344611 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:06.353365 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-93cc95e8-cafb-4a5e-b9d5-318de46d6748 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1680 microversion: 2.1 time: 0.327851 Nov 06 22:12:06.354222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4733/9351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:06 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:07.372934 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:07.373686 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:07.380622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:07.381082 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:07.381867 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:07.382298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:07.576997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:07.584437 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-b35334d0-d690-41be-b1af-632cf379d13e tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 200 len: 1562 microversion: 2.1 time: 0.215498 Nov 06 22:12:07.585009 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4619/9352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:07 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 1562 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:08.023783 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-be2d0f7b-decd-4fdc-9970-d70e2be0f4f6 req-2d683465-e057-421c-80ec-980fae7b75c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f53a5-8569-4759-93f0-3fa67621435e", "name": "network-vif-deleted", "tag": "9667a9d0-caab-4472-8eb7-c7e43c804932"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:08.025602 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:12:08.025602 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:12:08.034675 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be2d0f7b-decd-4fdc-9970-d70e2be0f4f6 req-2d683465-e057-421c-80ec-980fae7b75c4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:08.035145 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-be2d0f7b-decd-4fdc-9970-d70e2be0f4f6 req-2d683465-e057-421c-80ec-980fae7b75c4 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:08.046656 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-be2d0f7b-decd-4fdc-9970-d70e2be0f4f6 req-2d683465-e057-421c-80ec-980fae7b75c4 service nova] Creating event network-vif-deleted:9667a9d0-caab-4472-8eb7-c7e43c804932 for instance a83f53a5-8569-4759-93f0-3fa67621435e on nch1-master-1 Nov 06 22:12:08.051557 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-be2d0f7b-decd-4fdc-9970-d70e2be0f4f6 req-2d683465-e057-421c-80ec-980fae7b75c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 Nov 06 22:12:08.052587 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4734/9353] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:12:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:12:08.602121 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:08.602741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: a83f53a5-8569-4759-93f0-3fa67621435e] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:08.609291 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:08.609732 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:08.610516 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:08.610958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:08.624467 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] HTTP exception thrown: Instance a83f53a5-8569-4759-93f0-3fa67621435e could not be found. Nov 06 22:12:08.625062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Returning 404 to user: Instance a83f53a5-8569-4759-93f0-3fa67621435e could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:12:08.625884 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-cb737980-1bd9-4e85-8c6b-f7b335edbc02 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e" status: 404 len: 111 microversion: 2.1 time: 0.027636 Nov 06 22:12:08.626414 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4620/9354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:08 2021] GET /compute/v2.1/servers/a83f53a5-8569-4759-93f0-3fa67621435e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:12:08.780948 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-158a9e93-af30-487b-b08c-98ce37e4d76b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '.version_select at 0x7f67148cc280>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:08.809222 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-158a9e93-af30-487b-b08c-98ce37e4d76b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1406769980" status: 202 len: 0 microversion: 2.1 time: 0.032652 Nov 06 22:12:08.810663 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4735/9355] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 22:12:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1406769980 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:12:08.833847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'create', calling method: .version_select at 0x7f67142255e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2127152861"}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:08.851551 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:12:08.856480 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:12:09.004811 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:12:09.009599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'key_pairs'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:12:09.023634 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-366fcd26-ea53-49e1-a9cc-84f9680f4608 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.193417 Nov 06 22:12:09.024227 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4621/9356] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 22:12:08 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 22:12:12.424687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-779302298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2127152861", "security_groups": [{"name": "tempest-secgroup-smoke-458597263"}], "networks": [{"uuid": "4939f2bf-e700-41ee-be52-d516f6a4a61c"}], "block_device_mapping_v2": [{"uuid": "a46c546f-8575-440c-a9f5-a39df29d5eb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:12.540822 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] validate_networks() for [('4939f2bf-e700-41ee-be52-d516f6a4a61c', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:12:12.951625 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:12:12.952072 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:12:12.952597 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:12:12.953029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:12:12.953461 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:12:12.962134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:12.962599 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:12.963434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:12.963890 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:12.981891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:12:12.987366 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Getting quotas for user baaf73954dfc4547a212c76c0be70fe8 and project c7a47c6d4a6e4ada8f8d230f6f1a72f7. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:12:13.042195 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:12:13.044481 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a46c546f-8575-440c-a9f5-a39df29d5eb3',volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:12:13.165551 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-db008a29-e72e-499a-8105-9806444241dc tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744576 Nov 06 22:12:13.166195 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4736/9357] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:12:12 2021] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:12:13.176538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3b69d817-6822-4e67-8e4b-f8b6e8ebda86 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:13.177409 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3b69d817-6822-4e67-8e4b-f8b6e8ebda86 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:13.240430 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3b69d817-6822-4e67-8e4b-f8b6e8ebda86 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:13.247042 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3b69d817-6822-4e67-8e4b-f8b6e8ebda86 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1088 microversion: 2.1 time: 0.074217 Nov 06 22:12:13.247632 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4622/9358] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:13 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:14.265638 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:14.266268 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:14.276089 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:14.276482 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:14.277832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:14.278330 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:14.350522 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:14.360314 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-027b1511-9533-4d6d-94a9-8ab533006b0f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1204 microversion: 2.1 time: 0.099835 Nov 06 22:12:14.360916 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4737/9359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:14 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:15.377391 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:15.378024 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:15.385387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:15.386447 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:15.386726 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:15.387180 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:15.568506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-46577331-ebe0-485c-9212-4863d8e6e760 req-89101975-2112-4978-9e4e-fedfe8df7659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:15.570747 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:12:15.570747 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:12:15.579564 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-46577331-ebe0-485c-9212-4863d8e6e760 req-89101975-2112-4978-9e4e-fedfe8df7659 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:15.586508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-46577331-ebe0-485c-9212-4863d8e6e760 req-89101975-2112-4978-9e4e-fedfe8df7659 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:15.607193 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-46577331-ebe0-485c-9212-4863d8e6e760 req-89101975-2112-4978-9e4e-fedfe8df7659 service nova] Creating event network-changed:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:12:15.612838 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-46577331-ebe0-485c-9212-4863d8e6e760 req-89101975-2112-4978-9e4e-fedfe8df7659 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049074 Nov 06 22:12:15.614369 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4738/9360] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:12:15.661088 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:15.669290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-762cbfd4-9b7c-44a7-8496-e4d2746064b7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.295485 Nov 06 22:12:15.669914 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4623/9361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:15 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:16.687937 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:16.688690 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:16.694798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:16.695260 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:16.696045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:16.696530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:16.834096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:16.841439 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-86ac6d5a-712a-4787-9906-336a6ed56727 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.158376 Nov 06 22:12:16.842612 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4739/9362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:16 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:17.859141 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:17.859828 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:17.866500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:17.866962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:17.867751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:17.868193 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:18.008947 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:18.016243 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d46bcd9d-9738-4455-ad16-a468f6239628 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.161357 Nov 06 22:12:18.016842 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4624/9363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:17 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:19.032831 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:19.033453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:19.040182 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:19.040687 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:19.041488 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:19.041943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:19.175569 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:19.183144 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e807d7d-a0eb-41bf-828b-b984b339d8b4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.154050 Nov 06 22:12:19.183716 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4740/9364] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:19 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:20.200361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:20.200938 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:20.207612 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:20.208072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:20.208904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:20.209371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:20.370346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:20.377889 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-f45f22a9-239f-4d87-b6df-b4868bb00850 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.181237 Nov 06 22:12:20.381956 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4625/9365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:20 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:21.394387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:21.395011 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:21.401793 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:21.402264 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:21.403058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:21.403513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:21.534067 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:21.545148 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f82ba158-66ed-476d-a2eb-c56f23e56575 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.154460 Nov 06 22:12:21.545737 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4741/9366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:21 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:22.402250 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-ccf1ab35-017c-40e6-9e08-fd4826e8755d req-2ab6de58-a9fe-4b77-9749-b8037958a1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "name": "network-vif-plugged", "status": "completed", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:22.403811 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:12:22.403811 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:12:22.411809 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ccf1ab35-017c-40e6-9e08-fd4826e8755d req-2ab6de58-a9fe-4b77-9749-b8037958a1b3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:22.412248 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-ccf1ab35-017c-40e6-9e08-fd4826e8755d req-2ab6de58-a9fe-4b77-9749-b8037958a1b3 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:22.423410 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-ccf1ab35-017c-40e6-9e08-fd4826e8755d req-2ab6de58-a9fe-4b77-9749-b8037958a1b3 service nova] Creating event network-vif-plugged:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:12:22.428725 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-ccf1ab35-017c-40e6-9e08-fd4826e8755d req-2ab6de58-a9fe-4b77-9749-b8037958a1b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030065 Nov 06 22:12:22.429522 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4626/9367] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:12:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:12:22.567435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:22.568058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:22.574506 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:22.574971 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:22.575773 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:22.576231 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:22.708877 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:22.717813 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c19f0e2c-30c8-4fa1-b1a3-79ba2e05f1b0 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.154058 Nov 06 22:12:22.718384 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4742/9368] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:22 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:23.735102 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:23.735799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:23.742073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:23.742523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:23.743309 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:23.743744 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:23.896671 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:23.905733 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-eee14ca2-50d0-4206-862d-43febad4e7d6 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1259 microversion: 2.1 time: 0.175454 Nov 06 22:12:23.906304 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4627/9369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:23 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:24.922734 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:24.923363 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:24.930435 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:24.930906 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:24.931742 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:24.932203 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:25.067009 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:25.074362 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-90761ef8-6f4d-49c2-9665-16ae54f08542 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1443 microversion: 2.1 time: 0.155345 Nov 06 22:12:25.074931 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4743/9370] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:24 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:25.090523 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:12:25.091131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:12:25.098335 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:25.098791 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:25.099576 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:25.100014 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:25.238718 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:12:25.246118 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-88a01170-7e4c-41bb-85e6-1ee26c6e3496 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1443 microversion: 2.1 time: 0.159235 Nov 06 22:12:25.246899 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4628/9371] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:12:25 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:12:27.202541 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-c3da1f77-ec3f-4212-a3da-904a315a1f81 req-babccc3f-98ae-477f-9445-37046e3d12f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:12:27.204070 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:12:27.204070 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:12:27.211839 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c3da1f77-ec3f-4212-a3da-904a315a1f81 req-babccc3f-98ae-477f-9445-37046e3d12f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:12:27.212327 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-c3da1f77-ec3f-4212-a3da-904a315a1f81 req-babccc3f-98ae-477f-9445-37046e3d12f2 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:12:27.223081 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-c3da1f77-ec3f-4212-a3da-904a315a1f81 req-babccc3f-98ae-477f-9445-37046e3d12f2 service nova] Creating event network-changed:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:12:27.228331 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-c3da1f77-ec3f-4212-a3da-904a315a1f81 req-babccc3f-98ae-477f-9445-37046e3d12f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030139 Nov 06 22:12:27.229222 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4744/9372] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:12:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:14:32.344636 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:14:32.345239 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:32.351125 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:32.351590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:32.352410 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:32.352857 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:32.376505 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.objects.instance [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lazy-loading 'flavor' on Instance uuid c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 {{(pid=134828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 22:14:32.446564 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2896f3b1-8763-45c2-bede-17f4f7241d56 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35/action" status: 202 len: 0 microversion: 2.1 time: 0.106705 Nov 06 22:14:32.447491 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4629/9373] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:14:32 2021] POST /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:14:32.454154 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 06 22:14:32.455243 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 06 22:14:32.459201 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:32.459924 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:32.466549 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:32.467040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:32.467920 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:32.468641 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:32.611344 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:32.618834 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-21748f7e-6861-4bf8-ba59-df5443d27ec5 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.166850 Nov 06 22:14:32.619400 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4745/9374] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:32 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:33.637567 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:33.638268 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:33.646247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:33.646694 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:33.647777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:33.648216 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:33.784600 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:33.792126 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3127e728-df21-4f6e-a271-01e599adde83 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.158630 Nov 06 22:14:33.792726 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4630/9375] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:33 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:34.810213 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:34.810767 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:34.838430 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:34.838893 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:34.839884 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:34.840384 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:34.850333 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42314. Nov 06 22:14:34.851064 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42312. Nov 06 22:14:34.984503 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:34.991958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-59c967ef-e1a5-4668-9845-fc8d6d6bce93 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.185585 Nov 06 22:14:34.992577 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4746/9376] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:34 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:36.008797 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:36.009404 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:36.017678 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:36.018167 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:36.018955 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:36.022444 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:36.162835 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:36.170236 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-64a1ff1b-c904-4360-9838-355a7847e97b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.165102 Nov 06 22:14:36.170805 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4631/9377] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:36 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:37.188518 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:37.189081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:37.195778 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:37.196246 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:37.197081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:37.197538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:37.339412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:37.346845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c0ed284e-86a5-4dc0-b09b-ac20ddb2284f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.162718 Nov 06 22:14:37.347410 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4747/9378] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:37 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:38.363775 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:38.364434 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:38.370416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:38.370961 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:38.371974 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:38.372634 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:38.507292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:38.514768 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-959e63f8-5b2d-468f-b33c-5284863c8dc1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.154940 Nov 06 22:14:38.515326 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4632/9379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:38 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:39.531042 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:39.531706 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:39.538374 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:39.538832 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:39.539619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:39.540068 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:39.672811 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:39.680454 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc6b5acb-763c-493c-8773-15ebce117ef2 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.153176 Nov 06 22:14:39.681022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4748/9380] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:39 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:40.697915 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:40.698476 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:40.705599 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:40.706052 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:40.706863 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:40.707303 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:40.841308 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:40.848570 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6dab5b57-86d2-4c4b-baaf-0305d989b225 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.154410 Nov 06 22:14:40.849137 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4633/9381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:40 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:41.865891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:41.866508 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:41.873619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:41.874081 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:41.874873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:41.875816 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:42.010459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:42.020015 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-26a0e2e4-5454-4c13-b67e-449b8e20e670 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.157843 Nov 06 22:14:42.020615 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4749/9382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:41 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:43.037544 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:43.038157 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:43.044737 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:43.045194 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:43.045986 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:43.046418 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:43.278247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:43.286038 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-814092de-dae7-427e-b5ce-7a796448ab63 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.252229 Nov 06 22:14:43.286603 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4634/9383] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:43 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:44.303310 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:44.303878 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:44.310650 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:44.311117 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:44.311911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:44.312387 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:44.450557 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:44.458690 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-882f69e0-d524-46de-94c7-1303e39d37d1 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.159374 Nov 06 22:14:44.459265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4750/9384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:44 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:45.475348 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:45.475920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:45.482519 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.482977 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.483743 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.484179 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.621131 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:45.628705 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd02bb86-113c-4682-93a7-6cf55d41cc03 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1568 microversion: 2.1 time: 0.157104 Nov 06 22:14:45.638334 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4635/9385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:45 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:45.646663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:14:45.647271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:45.654789 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.655255 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.656872 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.657328 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.732743 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-a1bb6e62-0c5d-45d4-b842-689274347a96 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "POST /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35/action" status: 202 len: 0 microversion: 2.1 time: 0.090409 Nov 06 22:14:45.733357 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4751/9386] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:14:45 2021] POST /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:14:45.741208 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:45.741817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:45.747644 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.748095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.748908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:45.749343 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:45.890570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:45.899336 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7110d0b-32ea-4e15-97fc-45285d7df2ce tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1516 microversion: 2.1 time: 0.161665 Nov 06 22:14:45.899897 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4636/9387] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:45 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:46.918088 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:46.918705 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:46.925891 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:46.926347 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:46.927392 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:46.927840 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:47.076316 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:47.084474 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5313545-dd78-4560-a1eb-adf067d8755d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1518 microversion: 2.1 time: 0.170827 Nov 06 22:14:47.085085 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4752/9388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:46 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:48.104427 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:48.104958 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:48.112137 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:48.112623 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:48.113426 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:48.113869 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:48.244546 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:48.252586 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-16c4cbde-b345-43bd-86e2-668b69b1b895 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1574 microversion: 2.1 time: 0.151862 Nov 06 22:14:48.253273 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4637/9389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:48 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:48.498432 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:14:48.498640 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:14:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:14:48.535793 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:14:48.535967 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:14:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:14:48.969721 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "name": "network-vif-unplugged", "status": "completed", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:14:48.971329 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:14:48.971329 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:14:48.979695 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:48.980214 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:48.992539 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] Creating event network-vif-unplugged:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:14:48.996003 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] [b425cd39-75f1-48b9-9600-f0e4b84aab2e] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:14:49.270575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:49.271148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:49.278289 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:49.278748 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:49.279533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:49.279979 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:49.417443 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:49.425544 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-17e0b418-e35b-4174-8b93-281152e405f8 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1574 microversion: 2.1 time: 0.158782 Nov 06 22:14:49.426106 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4638/9390] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:49 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:50.011294 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] [b425cd39-75f1-48b9-9600-f0e4b84aab2e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42376. Nov 06 22:14:50.015145 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-96cbc1d7-4b37-4efb-bad5-e0616b493e87 req-780f3fcb-defa-4f3d-a67f-1bceed3a62c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.049799 Nov 06 22:14:50.016488 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4753/9391] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:14:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:14:50.442984 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:50.443590 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:50.450169 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:50.450620 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:50.451388 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:50.451829 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:50.587438 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:50.595475 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c48c61a5-2917-4f3d-92d2-f1af710f0bc4 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1574 microversion: 2.1 time: 0.156075 Nov 06 22:14:50.596044 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4639/9392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:50 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:51.613830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:51.614547 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:51.620633 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:51.621099 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:51.621894 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:51.622350 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:51.758367 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:51.765845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b2ab3a02-a646-4554-a2e0-163a402ef0a3 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1574 microversion: 2.1 time: 0.156964 Nov 06 22:14:51.766416 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4754/9393] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:51 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:52.784029 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:14:52.784757 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:14:52.791507 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:52.791963 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:52.792793 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:52.793230 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:52.931270 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:14:52.939297 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3e217387-8ddb-40f9-8f5d-a95d97100f5f tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1561 microversion: 2.1 time: 0.160272 Nov 06 22:14:52.939858 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4640/9394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:14:52 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:14:53.039987 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-4f7ca677-35a1-4f50-a360-d7c03784874d req-798dec61-ad75-4940-ad32-3d6858646d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "name": "network-vif-plugged", "status": "completed", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:14:53.041733 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:14:53.041733 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:14:53.051307 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f7ca677-35a1-4f50-a360-d7c03784874d req-798dec61-ad75-4940-ad32-3d6858646d1d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:14:53.051919 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-4f7ca677-35a1-4f50-a360-d7c03784874d req-798dec61-ad75-4940-ad32-3d6858646d1d service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:14:53.064683 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-4f7ca677-35a1-4f50-a360-d7c03784874d req-798dec61-ad75-4940-ad32-3d6858646d1d service nova] Creating event network-vif-plugged:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:14:53.070181 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-4f7ca677-35a1-4f50-a360-d7c03784874d req-798dec61-ad75-4940-ad32-3d6858646d1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Nov 06 22:14:53.071139 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4755/9395] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:15:11.258639 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:15:11.259301 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:15:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:16:17.154405 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:17.154968 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:17.163060 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:17.163594 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:17.164420 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:17.164862 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:17.191550 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Going to try to terminate instance {{(pid=134828) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:16:17.252861 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-ae126cd9-0116-418b-988d-21b925eaec62 req-ef87e22c-d65e-4fbc-aaa1-b14a4a3be02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:17.255067 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:16:17.255067 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:16:17.262849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ae126cd9-0116-418b-988d-21b925eaec62 req-ef87e22c-d65e-4fbc-aaa1-b14a4a3be02b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:17.263300 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-ae126cd9-0116-418b-988d-21b925eaec62 req-ef87e22c-d65e-4fbc-aaa1-b14a4a3be02b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:17.275397 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-ae126cd9-0116-418b-988d-21b925eaec62 req-ef87e22c-d65e-4fbc-aaa1-b14a4a3be02b service nova] Creating event network-changed:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:16:17.278984 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 204 len: 0 microversion: 2.1 time: 0.129353 Nov 06 22:16:17.280010 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4641/9396] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:16:17 2021] DELETE /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:16:17.281663 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-ae126cd9-0116-418b-988d-21b925eaec62 req-ef87e22c-d65e-4fbc-aaa1-b14a4a3be02b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129775 Nov 06 22:16:17.282283 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4756/9397] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:16:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:16:17.289615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:17.290533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:17.297577 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:17.298031 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:17.298823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:17.299258 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:17.506400 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:17.514382 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-3ea328df-ead2-4fbb-b799-ccf0b9465273 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1567 microversion: 2.1 time: 0.230142 Nov 06 22:16:17.523981 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4642/9398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:17 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 22:16:18.534907 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:18.535607 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:18.541741 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:18.542199 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:18.542999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:18.543443 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:18.683977 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:18.691478 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-3be6348f-2677-44c7-8147-828548c40aa7 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1449 microversion: 2.1 time: 0.161579 Nov 06 22:16:18.692042 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4757/9399] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:18 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:19.709509 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:19.710114 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:19.717461 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:19.717912 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:19.718702 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:19.719139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:19.750950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [req-9f338cbc-99b9-4bb2-a77b-c9e0a4701b5c req-fa54b6fd-bb69-42aa-86e7-b1bee6867859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a1ab5f-d7c0-46fe-9ddd-a26414456a35", "name": "network-vif-deleted", "tag": "5a7e9cb4-43e7-4385-b0c3-3277399ac0f3"}]} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:19.753610 ncdv-master-1 devstack@n-api.service[134827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:16:19.753610 ncdv-master-1 devstack@n-api.service[134827]: warnings.warn(msg) Nov 06 22:16:19.761958 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f338cbc-99b9-4bb2-a77b-c9e0a4701b5c req-fa54b6fd-bb69-42aa-86e7-b1bee6867859 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:19.762681 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [req-9f338cbc-99b9-4bb2-a77b-c9e0a4701b5c req-fa54b6fd-bb69-42aa-86e7-b1bee6867859 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:19.774766 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.compute.server_external_events [req-9f338cbc-99b9-4bb2-a77b-c9e0a4701b5c req-fa54b6fd-bb69-42aa-86e7-b1bee6867859 service nova] Creating event network-vif-deleted:5a7e9cb4-43e7-4385-b0c3-3277399ac0f3 for instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 on nch1-master-1 Nov 06 22:16:19.779976 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [req-9f338cbc-99b9-4bb2-a77b-c9e0a4701b5c req-fa54b6fd-bb69-42aa-86e7-b1bee6867859 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 Nov 06 22:16:19.780610 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4758/9400] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:16:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:16:19.791419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf73954dfc4547a212c76c0be70fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a47c6d4a6e4ada8f8d230f6f1a72f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:19.801320 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-d8590487-a9de-4700-a0d5-bff97cb1f07b tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 200 len: 1382 microversion: 2.1 time: 0.095829 Nov 06 22:16:19.802131 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4643/9401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:19 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:20.820222 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:20.820973 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] [instance: c6a1ab5f-d7c0-46fe-9ddd-a26414456a35] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:20.827829 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:20.828321 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:20.829119 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:20.829567 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:20.842698 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] HTTP exception thrown: Instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 could not be found. Nov 06 22:16:20.843326 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Returning 404 to user: Instance c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:16:20.844152 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ee3f6419-7d16-48e1-80e1-69c02eaeec81 tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35" status: 404 len: 111 microversion: 2.1 time: 0.028883 Nov 06 22:16:20.844723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4759/9402] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:20 2021] GET /compute/v2.1/servers/c6a1ab5f-d7c0-46fe-9ddd-a26414456a35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:16:21.000907 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-77690b10-7520-434d-a524-324e71f6455d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] Calling method '.version_select at 0x7f67141f75e0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:21.031173 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-77690b10-7520-434d-a524-324e71f6455d tempest-TestShelveInstance-1314861516 tempest-TestShelveInstance-1314861516-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2127152861" status: 202 len: 0 microversion: 2.1 time: 0.034681 Nov 06 22:16:21.031748 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4644/9403] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Nov 6 22:16:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2127152861 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:16:38.239776 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Action: 'create', calling method: .version_select at 0x7f6715ad0700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1433989166"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:38.269276 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:16:38.274534 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for user bee1604ba5f5411194b1857ef95c83f0 and project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:16:39.212273 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:16:39.217747 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for user bee1604ba5f5411194b1857ef95c83f0 and project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'key_pairs'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:16:39.231628 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7efaf341-1364-41bf-a3df-523fbf0d4905 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.191044 Nov 06 22:16:39.232233 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4760/9404] 10.222.0.13 () {60 vars in 1157 bytes} [Sat Nov 6 22:16:38 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:40.252414 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-756612218", "imageRef": "84b8d88b-fc57-44cc-ba26-535c5373e60c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1433989166", "security_groups": [{"name": "tempest-secgroup-smoke-1481204569"}], "networks": [{"uuid": "b35cef6f-4a69-4d99-8af0-3ba8ca66cebc"}]}} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:40.369366 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.network.neutron [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] validate_networks() for [('b35cef6f-4a69-4d99-8af0-3ba8ca66cebc', None, None, None, None, None)] {{(pid=134828) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:16:40.913932 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Flavor limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:16:40.914386 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Image limits 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:16:40.915013 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Flavor pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:16:40.915429 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Image pref 0:0:0 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:16:40.915844 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.virt.hardware [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:16:40.925215 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:40.925660 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:40.926468 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:40.926904 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:40.943236 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:16:40.948232 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.quota [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for user bee1604ba5f5411194b1857ef95c83f0 and project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'cores', 'ram', 'instances'} {{(pid=134828) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:16:40.960262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Going to run 1 instances... {{(pid=134828) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:16:40.962628 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84b8d88b-fc57-44cc-ba26-535c5373e60c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:16:41.009583 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c1894036-ad22-4c97-b6b7-118c9e2eed5f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762211 Nov 06 22:16:41.010259 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4645/9405] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:16:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:16:41.020885 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f5b33ffe-ebd0-4333-ac5a-21f92a5ba89b tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:41.022194 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f5b33ffe-ebd0-4333-ac5a-21f92a5ba89b tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:41.091992 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f5b33ffe-ebd0-4333-ac5a-21f92a5ba89b tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:41.100694 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f5b33ffe-ebd0-4333-ac5a-21f92a5ba89b tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1248 microversion: 2.1 time: 0.083780 Nov 06 22:16:41.101285 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4761/9406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:41 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:42.120462 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:42.121876 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:42.128511 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:42.128966 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:42.129769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:42.130191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:42.230067 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:42.238904 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a0706571-ca96-4086-a810-cecd1e58c017 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1306 microversion: 2.1 time: 0.123575 Nov 06 22:16:42.239461 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4646/9407] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:42 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:43.256542 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:43.257158 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:43.268123 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:43.268619 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:43.269425 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:43.269873 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:43.498020 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:43.506076 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9b532cfc-6831-4d89-842a-5ee3a86e8c38 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.253134 Nov 06 22:16:43.506751 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4762/9408] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:43 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:43.818244 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-6de9df76-b499-4adc-9968-d6753e77464a req-7ed9cd01-72d7-4d55-863f-10a485a28df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:43.832808 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:16:43.832808 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:16:43.844689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6de9df76-b499-4adc-9968-d6753e77464a req-7ed9cd01-72d7-4d55-863f-10a485a28df1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:43.845374 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-6de9df76-b499-4adc-9968-d6753e77464a req-7ed9cd01-72d7-4d55-863f-10a485a28df1 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:43.876612 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-6de9df76-b499-4adc-9968-d6753e77464a req-7ed9cd01-72d7-4d55-863f-10a485a28df1 service nova] Creating event network-changed:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:16:43.884393 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-6de9df76-b499-4adc-9968-d6753e77464a req-7ed9cd01-72d7-4d55-863f-10a485a28df1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073102 Nov 06 22:16:43.885601 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4647/9409] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:16:44.523040 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:44.523616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:44.531529 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:44.531996 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:44.532849 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:44.533297 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:44.745653 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:44.752988 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-18a41113-2df7-495e-9218-5f602ef2d0a7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.233865 Nov 06 22:16:44.753565 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4763/9410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:44 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:45.770997 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:45.771722 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:45.777852 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:45.778311 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:45.779095 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:45.779535 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:45.917522 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:45.925478 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-4b134d9c-ac7e-41a5-8fd1-1e4363ecf00f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.159366 Nov 06 22:16:45.926051 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4648/9411] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:45 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:46.943318 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:46.943946 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:46.951298 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:46.951765 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:46.952588 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:46.953038 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:47.087147 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:47.094456 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-81cc8018-a61f-4c91-ad00-f70590afa4a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.154940 Nov 06 22:16:47.095022 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4764/9412] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:46 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 06 22:16:48.110853 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:48.111477 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:48.118185 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:48.118649 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:48.119446 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:48.119897 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:48.260271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:48.267641 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-aae04a80-efd9-4ea9-a174-13a7fe26d2ed tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.160495 Nov 06 22:16:48.268212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4649/9413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:48 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:49.285247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:49.285867 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:49.292656 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:49.293116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:49.293950 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:49.294404 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:49.426553 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:49.435136 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-b1597ea9-136a-422c-bc39-71cd8ab75223 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.153679 Nov 06 22:16:49.435723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4765/9414] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:49 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:49.625917 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-399d4832-7cd8-49ca-8a59-f14186f70c8b req-3119d659-a7bb-445a-a83f-f7e7b0a37bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "name": "network-vif-plugged", "status": "completed", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:49.627006 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:16:49.627006 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:16:49.633898 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-399d4832-7cd8-49ca-8a59-f14186f70c8b req-3119d659-a7bb-445a-a83f-f7e7b0a37bde service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:49.634346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-399d4832-7cd8-49ca-8a59-f14186f70c8b req-3119d659-a7bb-445a-a83f-f7e7b0a37bde service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:49.644784 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-399d4832-7cd8-49ca-8a59-f14186f70c8b req-3119d659-a7bb-445a-a83f-f7e7b0a37bde service nova] Creating event network-vif-plugged:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:16:49.649790 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-399d4832-7cd8-49ca-8a59-f14186f70c8b req-3119d659-a7bb-445a-a83f-f7e7b0a37bde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089087 Nov 06 22:16:49.650367 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4650/9415] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:16:50.451400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:50.452031 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:50.458830 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:50.459299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:50.460102 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:50.460585 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:50.597623 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:50.604945 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-7d7d8034-707f-47ea-a899-2573665e0c12 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1374 microversion: 2.1 time: 0.157281 Nov 06 22:16:50.606270 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4766/9416] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:50 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:51.623373 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:51.624062 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:51.630969 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:51.631419 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:51.632199 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:51.632662 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:51.765964 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:51.773290 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-581aa860-1b95-4f74-b5c2-ff768a3b4bec tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1558 microversion: 2.1 time: 0.154592 Nov 06 22:16:51.773846 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4651/9417] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:51 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:51.789247 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:16:51.789870 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:16:51.797299 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:51.797802 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:51.798613 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:51.799096 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:51.935169 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:16:51.942452 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-6398ed15-1bb3-4e2e-a5b1-c1ad95cc40c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1558 microversion: 2.1 time: 0.156961 Nov 06 22:16:51.943008 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4767/9418] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:16:51 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:16:53.598336 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-23c42672-0864-464e-acb4-38453702ce83 req-3d3062a9-d0da-4132-b09b-dde5612eff2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:16:53.600052 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:16:53.600052 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:16:53.608675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-23c42672-0864-464e-acb4-38453702ce83 req-3d3062a9-d0da-4132-b09b-dde5612eff2a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:16:53.609197 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-23c42672-0864-464e-acb4-38453702ce83 req-3d3062a9-d0da-4132-b09b-dde5612eff2a service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:16:53.619967 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-23c42672-0864-464e-acb4-38453702ce83 req-3d3062a9-d0da-4132-b09b-dde5612eff2a service nova] Creating event network-changed:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:16:53.625277 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-23c42672-0864-464e-acb4-38453702ce83 req-3d3062a9-d0da-4132-b09b-dde5612eff2a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030801 Nov 06 22:16:53.626177 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4652/9419] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:19:19.721813 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 06 22:19:19.722895 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 06 22:19:19.726427 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2146754932"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:19:19.727513 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:19.737284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:19.737769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:19.738580 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:19.739036 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:20.100723 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bf39802b-0d90-4fe0-832a-1b78e5d2cd03 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "POST /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b/action" status: 202 len: 0 microversion: 2.1 time: 0.380842 Nov 06 22:19:20.101363 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4768/9420] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:19:19 2021] POST /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 22:19:28.196370 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:19:28.197306 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:19:28.201570 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-67db8e10-335b-4dce-a9ab-9cab48be6b16 req-d43ac00a-e462-4512-95e5-61b505c503d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "name": "network-vif-plugged", "status": "completed", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:19:28.203757 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:19:28.203757 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:19:28.211741 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-67db8e10-335b-4dce-a9ab-9cab48be6b16 req-d43ac00a-e462-4512-95e5-61b505c503d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:28.212198 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-67db8e10-335b-4dce-a9ab-9cab48be6b16 req-d43ac00a-e462-4512-95e5-61b505c503d6 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:28.222983 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-67db8e10-335b-4dce-a9ab-9cab48be6b16 req-d43ac00a-e462-4512-95e5-61b505c503d6 service nova] Creating event network-vif-plugged:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:19:28.227863 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-67db8e10-335b-4dce-a9ab-9cab48be6b16 req-d43ac00a-e462-4512-95e5-61b505c503d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033225 Nov 06 22:19:28.228466 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4653/9421] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:19:38.736143 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-893744337", "imageRef": "4ca184e6-32ae-4c43-b421-1f463cab60ba", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1433989166", "security_groups": [{"name": "tempest-secgroup-smoke-1481204569"}], "networks": [{"uuid": "b35cef6f-4a69-4d99-8af0-3ba8ca66cebc"}]}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:19:38.756809 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fb2fe2e-7a48-4609-acbe-b14a4ee21755] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42922. Nov 06 22:19:38.758292 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] [3c08a62a-00ba-4a35-9f8f-e037e2993709] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42920. Nov 06 22:19:38.843735 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.network.neutron [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] validate_networks() for [('b35cef6f-4a69-4d99-8af0-3ba8ca66cebc', None, None, None, None, None)] {{(pid=134827) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 06 22:19:39.259902 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Flavor limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 06 22:19:39.260365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Image limits 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 06 22:19:39.260903 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Flavor pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 06 22:19:39.261348 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Image pref 0:0:0 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 06 22:19:39.261798 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.virt.hardware [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 06 22:19:39.271006 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:39.271464 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:39.272281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:39.272753 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:39.288710 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 06 22:19:39.293655 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.quota [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Getting quotas for user bee1604ba5f5411194b1857ef95c83f0 and project 63efb8ef7eae4f3fbc99274c825b2af1. Resources: {'cores', 'ram', 'instances'} {{(pid=134827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 06 22:19:39.305528 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Going to run 1 instances... {{(pid=134827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 06 22:19:39.308007 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ca184e6-32ae-4c43-b421-1f463cab60ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 06 22:19:39.350271 ncdv-master-1 devstack@n-api.service[134827]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 06 22:19:40.366657 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [bfbde56d-4f4e-44df-bd7d-0c3f3424eb05] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42934. Nov 06 22:19:40.370566 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-46e51d4d-c0aa-4c4f-b643-2c063d5d1f13 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.659188 Nov 06 22:19:40.371216 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4769/9422] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Nov 6 22:19:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 06 22:19:40.404851 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-a7cbcdd4-9f00-4cd7-b41f-7fb651d5161d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:40.405556 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-a7cbcdd4-9f00-4cd7-b41f-7fb651d5161d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:40.417693 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42938. Nov 06 22:19:40.419306 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 42940. Nov 06 22:19:40.512826 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-a7cbcdd4-9f00-4cd7-b41f-7fb651d5161d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:40.520479 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-a7cbcdd4-9f00-4cd7-b41f-7fb651d5161d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1248 microversion: 2.1 time: 0.142909 Nov 06 22:19:40.521030 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4654/9423] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:40 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1248 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:41.538527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c716f046-2dbd-46c8-9530-90a2c6c93ef7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:41.539151 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c716f046-2dbd-46c8-9530-90a2c6c93ef7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:41.589999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c716f046-2dbd-46c8-9530-90a2c6c93ef7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:41.597026 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c716f046-2dbd-46c8-9530-90a2c6c93ef7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1248 microversion: 2.1 time: 0.063087 Nov 06 22:19:41.597578 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4770/9424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:41 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1248 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:42.257640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-fd8a5879-40b0-4e58-9862-0845d14be123 req-c4ab959b-f2dd-47b4-adf7-9891811e5fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "name": "network-vif-unplugged", "status": "completed", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:19:42.259193 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:19:42.259193 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:19:42.267271 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fd8a5879-40b0-4e58-9862-0845d14be123 req-c4ab959b-f2dd-47b4-adf7-9891811e5fcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:42.267715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-fd8a5879-40b0-4e58-9862-0845d14be123 req-c4ab959b-f2dd-47b4-adf7-9891811e5fcb service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:42.278443 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-fd8a5879-40b0-4e58-9862-0845d14be123 req-c4ab959b-f2dd-47b4-adf7-9891811e5fcb service nova] Creating event network-vif-unplugged:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:19:42.283683 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-fd8a5879-40b0-4e58-9862-0845d14be123 req-c4ab959b-f2dd-47b4-adf7-9891811e5fcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029732 Nov 06 22:19:42.284248 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4655/9425] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:19:42.613661 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-da21a8ab-c936-471b-904e-44d210426ee6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:42.614284 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-da21a8ab-c936-471b-904e-44d210426ee6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:42.667142 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-da21a8ab-c936-471b-904e-44d210426ee6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:42.673832 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-da21a8ab-c936-471b-904e-44d210426ee6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1248 microversion: 2.1 time: 0.063956 Nov 06 22:19:42.674433 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4771/9426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:42 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1248 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:43.692333 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-6a969bae-f210-4dda-a71b-5084cd456a74 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:43.693035 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-6a969bae-f210-4dda-a71b-5084cd456a74 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:43.746327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-6a969bae-f210-4dda-a71b-5084cd456a74 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:43.757248 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-6a969bae-f210-4dda-a71b-5084cd456a74 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1248 microversion: 2.1 time: 0.069834 Nov 06 22:19:43.757890 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4656/9427] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:43 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:44.773417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:44.774012 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:44.781113 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:44.781663 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:44.782458 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:44.782910 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:44.847795 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:44.855972 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0d324af4-02e4-4aa7-98d1-fa3197e962a5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1252 microversion: 2.1 time: 0.086271 Nov 06 22:19:44.856570 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4772/9428] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:44 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:45.878346 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:45.879460 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:45.888568 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:45.896209 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:45.900834 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:45.901389 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:46.469689 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:46.477537 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-45122ebe-0983-4569-a7e0-0c227a853471 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.607522 Nov 06 22:19:46.478105 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4657/9429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:45 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:47.495420 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:47.496045 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:47.507217 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:47.507684 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:47.508531 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:47.508988 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:48.107905 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:48.115563 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-bd3b0e08-44fd-417f-bbf6-e0b3663df18d tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.623991 Nov 06 22:19:48.116342 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4773/9430] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:47 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:48.517603 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:19:48.517603 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:19:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:19:49.132361 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:49.132918 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:49.139715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:49.140191 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:49.141513 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:49.141943 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:49.282558 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:49.290038 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-094a7dfc-d2bc-413d-9d9e-dcdc5c12d501 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.161456 Nov 06 22:19:49.290609 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4658/9431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:49 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:50.306227 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:50.306851 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:50.314437 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:50.314898 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:50.315717 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:50.316167 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:50.473029 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:50.480603 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c3766a8b-f0a7-4e6e-bb21-d558ace61ca7 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.178338 Nov 06 22:19:50.481386 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4774/9432] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:50 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:51.497317 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:51.497973 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:51.504585 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:51.505048 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:51.505854 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:51.506299 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:51.650856 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:51.659486 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-70b55201-c3ec-473a-a4fa-1e45ffa4a842 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.165939 Nov 06 22:19:51.660047 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4659/9433] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:51 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:52.677083 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:52.678712 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:52.685595 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:52.686058 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:52.686999 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:52.687453 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:52.832103 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:52.840116 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-ce5544e6-d940-4e22-b2b1-4c79da3463f1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.166716 Nov 06 22:19:52.840826 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4775/9434] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:52 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:53.860962 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:53.862641 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:53.873073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:53.873875 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:53.875514 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:53.876190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:54.026469 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:54.034638 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-2da545fa-40f4-4174-9ffe-1f945790a081 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.178375 Nov 06 22:19:54.035392 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4660/9435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:53 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:55.051365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:55.052010 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:55.059148 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:55.059616 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:55.060457 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:55.060911 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:55.211346 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:55.219958 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9f9d6d75-0e22-4039-894f-b7ab05780fc8 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.172340 Nov 06 22:19:55.220759 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4776/9436] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:55 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:56.237009 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:56.237622 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:56.244252 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:56.244751 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:56.245534 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:56.245976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:56.381920 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:56.389152 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-14cee141-dd6f-4f4a-880a-aaefd2c3cc60 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.155973 Nov 06 22:19:56.389720 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4661/9437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:56 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:57.407601 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:57.408232 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:57.414989 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:57.415459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:57.416263 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:57.416744 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:57.554400 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:57.561863 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-57ccaf6a-236f-4b48-8e7c-2769323a4ff6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.158560 Nov 06 22:19:57.562437 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4777/9438] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:57 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:57.947105 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-3c290d46-fe65-40c5-92f8-38cdcbbf66a4 req-9de7c460-290e-4271-b69f-2800fb2034ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:19:57.948746 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:19:57.948746 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:19:57.957959 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3c290d46-fe65-40c5-92f8-38cdcbbf66a4 req-9de7c460-290e-4271-b69f-2800fb2034ec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:57.958416 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-3c290d46-fe65-40c5-92f8-38cdcbbf66a4 req-9de7c460-290e-4271-b69f-2800fb2034ec service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:57.974821 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-3c290d46-fe65-40c5-92f8-38cdcbbf66a4 req-9de7c460-290e-4271-b69f-2800fb2034ec service nova] Creating event network-changed:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:19:57.980113 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-3c290d46-fe65-40c5-92f8-38cdcbbf66a4 req-9de7c460-290e-4271-b69f-2800fb2034ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038073 Nov 06 22:19:57.980827 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4662/9439] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:19:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:19:58.578647 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:58.579355 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:58.586715 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:58.587176 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:58.587976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:58.588459 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:58.721651 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:58.729046 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-dc34e730-d33e-4682-a1d0-cd78a5f94fe9 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.154216 Nov 06 22:19:58.729615 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4778/9440] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:58 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:19:59.747615 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:19:59.748342 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:19:59.755059 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:59.755515 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:59.756353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:19:59.756799 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:19:59.894575 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:19:59.901865 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-18eddd92-d6d5-48f5-abb7-aa392c950710 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.159110 Nov 06 22:19:59.902442 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4663/9441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:19:59 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:00.918757 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:00.919381 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:00.926135 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:00.926612 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:00.927412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:00.928124 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:01.059589 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:01.068340 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c923b0a4-9cc8-4065-9963-4410e2323a05 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.152991 Nov 06 22:20:01.068919 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4779/9442] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:00 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:02.084777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:02.085387 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:02.092148 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:02.092640 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:02.094058 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:02.094500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:02.229923 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:02.237215 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-9c5210b2-0d1b-45be-a4d6-c0be211ea6d5 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.156228 Nov 06 22:20:02.237773 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4664/9443] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:02 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:03.254174 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:03.254762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:03.261422 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:03.261883 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:03.262671 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:03.263116 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:03.399269 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:03.408415 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-8c1cbfe0-2baf-43cd-bcb4-d8fdb65fa763 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.157949 Nov 06 22:20:03.409311 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4780/9444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:03 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:03.468803 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-0f75a35d-ee68-4047-bf03-f194d67d8bbf req-77609b65-373c-4a56-aab8-53efae09dcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "name": "network-vif-plugged", "status": "completed", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:20:03.470438 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:20:03.470438 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:20:03.478079 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0f75a35d-ee68-4047-bf03-f194d67d8bbf req-77609b65-373c-4a56-aab8-53efae09dcda service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:03.478538 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-0f75a35d-ee68-4047-bf03-f194d67d8bbf req-77609b65-373c-4a56-aab8-53efae09dcda service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:03.490447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-0f75a35d-ee68-4047-bf03-f194d67d8bbf req-77609b65-373c-4a56-aab8-53efae09dcda service nova] Creating event network-vif-plugged:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:20:03.495380 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-0f75a35d-ee68-4047-bf03-f194d67d8bbf req-77609b65-373c-4a56-aab8-53efae09dcda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Nov 06 22:20:03.495964 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4665/9445] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:20:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:20:04.425659 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:04.426281 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:04.433271 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:04.433733 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:04.434527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:04.434976 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:04.570236 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:04.577709 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-824c2c61-0e62-41c8-9b40-6a3763bb2945 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1374 microversion: 2.1 time: 0.156235 Nov 06 22:20:04.578289 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4781/9446] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:04 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:05.596408 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:05.597110 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:05.603223 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:05.603675 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:05.604490 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:05.604929 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:05.743353 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:05.751219 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-c35234d9-06d6-438f-bd7a-024a78f1c088 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1558 microversion: 2.1 time: 0.159735 Nov 06 22:20:05.751773 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4666/9447] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:05 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:05.767314 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:20:05.767933 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:20:05.774526 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:05.774975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:05.775762 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:05.776210 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:05.908953 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:20:05.916285 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-f280ef3c-5ae6-4c89-9c57-10229dc9b209 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1558 microversion: 2.1 time: 0.152640 Nov 06 22:20:05.916873 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4782/9448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:20:05 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:20:07.597025 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-da6874b2-dee7-4bad-a2d9-45ac6f51fa05 req-3b9c6d49-0785-47a7-b3c0-980039ee8f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:20:07.598525 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:20:07.598525 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:20:07.605371 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-da6874b2-dee7-4bad-a2d9-45ac6f51fa05 req-3b9c6d49-0785-47a7-b3c0-980039ee8f4f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:20:07.605830 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-da6874b2-dee7-4bad-a2d9-45ac6f51fa05 req-3b9c6d49-0785-47a7-b3c0-980039ee8f4f service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:20:07.616510 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-da6874b2-dee7-4bad-a2d9-45ac6f51fa05 req-3b9c6d49-0785-47a7-b3c0-980039ee8f4f service nova] Creating event network-changed:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:20:07.621447 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-da6874b2-dee7-4bad-a2d9-45ac6f51fa05 req-3b9c6d49-0785-47a7-b3c0-980039ee8f4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083769 Nov 06 22:20:07.622212 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4667/9449] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:21:28.556397 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:21:28.557160 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:21:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:21:51.279504 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:21:51.280072 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:21:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:22:06.550149 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-711703255"}} {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:06.551239 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:06.557504 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:06.557975 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:06.558771 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:06.559226 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:06.834639 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df676beb-bc3b-4a4e-a756-de97e6c49a18 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "POST /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108/action" status: 202 len: 0 microversion: 2.1 time: 0.361854 Nov 06 22:22:06.835273 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4783/9450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Nov 6 22:22:06 2021] POST /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 06 22:22:14.261314 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 06 22:22:14.263566 ncdv-master-1 devstack@n-api.service[134828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 06 22:22:14.336939 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-c646404f-04ef-43d4-b559-fc375fb76a09 req-1335a44f-8c0a-4bf3-856d-689155153892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "name": "network-vif-plugged", "status": "completed", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:14.338415 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:22:14.338415 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:22:14.347247 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c646404f-04ef-43d4-b559-fc375fb76a09 req-1335a44f-8c0a-4bf3-856d-689155153892 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:14.347693 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-c646404f-04ef-43d4-b559-fc375fb76a09 req-1335a44f-8c0a-4bf3-856d-689155153892 service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:14.358436 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-c646404f-04ef-43d4-b559-fc375fb76a09 req-1335a44f-8c0a-4bf3-856d-689155153892 service nova] Creating event network-vif-plugged:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:22:14.363800 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-c646404f-04ef-43d4-b559-fc375fb76a09 req-1335a44f-8c0a-4bf3-856d-689155153892 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105894 Nov 06 22:22:14.364958 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4668/9451] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:22:25.879699 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:25.880109 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:25.882292 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-89377421-ffa4-4be8-8bf4-b02898e0a7db req-70bcd464-6f27-4bf8-9f16-ba3e519b55fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:25.883844 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:22:25.883844 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:22:25.886666 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:25.887134 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:25.887943 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:25.888434 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:25.913500 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-89377421-ffa4-4be8-8bf4-b02898e0a7db req-70bcd464-6f27-4bf8-9f16-ba3e519b55fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:25.914139 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-89377421-ffa4-4be8-8bf4-b02898e0a7db req-70bcd464-6f27-4bf8-9f16-ba3e519b55fe service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:25.924845 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:22:25.925531 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b27485a-71dc-4d9f-8dd5-9099004e51ba] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43336. Nov 06 22:22:25.926746 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] [000dfa9d-92ff-4e06-ba8c-cff571adf1d7] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43334. Nov 06 22:22:25.928941 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-89377421-ffa4-4be8-8bf4-b02898e0a7db req-70bcd464-6f27-4bf8-9f16-ba3e519b55fe service nova] Creating event network-changed:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:22:25.933820 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-89377421-ffa4-4be8-8bf4-b02898e0a7db req-70bcd464-6f27-4bf8-9f16-ba3e519b55fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055813 Nov 06 22:22:25.934411 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4669/9452] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:22:26.016892 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-88d7d59a-3c20-4c31-a24e-e9b0f4ce6f4c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 204 len: 0 microversion: 2.1 time: 0.141387 Nov 06 22:22:26.017590 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4784/9453] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:22:25 2021] DELETE /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:22:26.026008 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:26.026715 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:26.032859 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:26.033318 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:26.034327 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:26.034779 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:26.188908 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:22:26.197620 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-72146f24-4737-4cb9-abea-f38b24cf45c1 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1682 microversion: 2.1 time: 0.175544 Nov 06 22:22:26.198193 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4670/9454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:26 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:22:27.216120 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:27.216769 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:27.223590 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:27.224051 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:27.224862 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:27.225308 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:27.364417 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:22:27.371708 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-0c09c930-5be2-4d20-8078-b0d249a5eead tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1564 microversion: 2.1 time: 0.160380 Nov 06 22:22:27.372265 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4785/9455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:27 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:22:28.197607 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-03803fbb-3be0-4848-b0c1-a07a14c989bd req-3bce3345-e36a-46ee-94c1-220134da6f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9d3032-ee8c-4d9f-b352-3d13542e7108", "name": "network-vif-deleted", "tag": "58d2c916-547f-4708-a710-826ab4b6294f"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:28.199197 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:22:28.199197 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:22:28.206672 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-03803fbb-3be0-4848-b0c1-a07a14c989bd req-3bce3345-e36a-46ee-94c1-220134da6f1b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:28.207190 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-03803fbb-3be0-4848-b0c1-a07a14c989bd req-3bce3345-e36a-46ee-94c1-220134da6f1b service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:28.223365 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-03803fbb-3be0-4848-b0c1-a07a14c989bd req-3bce3345-e36a-46ee-94c1-220134da6f1b service nova] Creating event network-vif-deleted:58d2c916-547f-4708-a710-826ab4b6294f for instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 on nch2-master-1 Nov 06 22:22:28.228203 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-03803fbb-3be0-4848-b0c1-a07a14c989bd req-3bce3345-e36a-46ee-94c1-220134da6f1b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092974 Nov 06 22:22:28.229223 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4671/9456] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:22:28.388956 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:28.389527 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:28.396788 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:28.397256 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:28.398052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:28.398498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:28.429959 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:28.430412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:28.430874 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.objects.instance [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lazy-loading 'fault' on Instance uuid 4d9d3032-ee8c-4d9f-b352-3d13542e7108 {{(pid=134827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 06 22:22:28.471530 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:22:28.481845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-1e5853ba-bee5-4729-a8d7-75f917979bb2 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 200 len: 1338 microversion: 2.1 time: 0.095833 Nov 06 22:22:28.482431 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4786/9457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:28 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:22:29.500339 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:29.501072 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 4d9d3032-ee8c-4d9f-b352-3d13542e7108] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:29.507242 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:29.507698 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:29.508533 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:29.508976 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:29.522233 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.wsgi [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] HTTP exception thrown: Instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 could not be found. Nov 06 22:22:29.522817 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Returning 404 to user: Instance 4d9d3032-ee8c-4d9f-b352-3d13542e7108 could not be found. {{(pid=134828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:22:29.523636 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-7d7ff34f-193e-4728-853b-c39af1b6402f tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108" status: 404 len: 111 microversion: 2.1 time: 0.028170 Nov 06 22:22:29.524148 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4672/9458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:29 2021] GET /compute/v2.1/servers/4d9d3032-ee8c-4d9f-b352-3d13542e7108 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:22:30.983538 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:30.984265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:30.985823 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-67b7f3f6-d878-4c79-b9a0-f25e88d43008 req-d4399067-b659-43e9-bdba-dc909c8eaece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:30.987499 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:22:30.987499 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:22:30.991138 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:30.991672 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:30.992812 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:30.993265 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:30.995547 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-67b7f3f6-d878-4c79-b9a0-f25e88d43008 req-d4399067-b659-43e9-bdba-dc909c8eaece service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:30.996073 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-67b7f3f6-d878-4c79-b9a0-f25e88d43008 req-d4399067-b659-43e9-bdba-dc909c8eaece service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:31.008033 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-67b7f3f6-d878-4c79-b9a0-f25e88d43008 req-d4399067-b659-43e9-bdba-dc909c8eaece service nova] Creating event network-changed:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:22:31.013272 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-67b7f3f6-d878-4c79-b9a0-f25e88d43008 req-d4399067-b659-43e9-bdba-dc909c8eaece service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Nov 06 22:22:31.014047 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4673/9459] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:22:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 06 22:22:31.020365 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Going to try to terminate instance {{(pid=134827) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 06 22:22:31.100103 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-9fd171d2-9b70-4a85-ac07-80ec7b9a0053 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 204 len: 0 microversion: 2.1 time: 0.120040 Nov 06 22:22:31.103723 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4787/9460] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Nov 6 22:22:30 2021] DELETE /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 06 22:22:31.109861 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:31.110710 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.compute.api [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134828) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:31.117298 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:31.117847 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:31.118769 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:31.119262 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:31.367214 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.policy [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134828) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:22:31.375832 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-bd5e7ba3-90be-4468-9b8d-760d3a833398 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1683 microversion: 2.1 time: 0.270626 Nov 06 22:22:31.376568 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4674/9461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:31 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1683 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:22:32.394317 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:32.395027 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:32.401412 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:32.401869 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:32.402662 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:32.403108 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:32.496052 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.policy [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1604ba5f5411194b1857ef95c83f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63efb8ef7eae4f3fbc99274c825b2af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134827) authorize /opt/stack/nova/nova/policy.py:199}} Nov 06 22:22:32.504845 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-df865a8c-df1d-4a91-b57b-30053824d1a6 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 200 len: 1496 microversion: 2.1 time: 0.115089 Nov 06 22:22:32.506105 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4788/9462] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:32 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 1496 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 06 22:22:33.028630 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [req-488424f1-0da1-42ea-b2a7-e4f6dd6273e5 req-3f2e6557-ea59-49bd-9015-34722a13714c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16587eac-96ae-44ae-b938-5932d846ed1b", "name": "network-vif-deleted", "tag": "45978243-b1a6-4dc4-a4b4-dc37978020c0"}]} {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 06 22:22:33.030186 ncdv-master-1 devstack@n-api.service[134828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 06 22:22:33.030186 ncdv-master-1 devstack@n-api.service[134828]: warnings.warn(msg) Nov 06 22:22:33.038329 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-488424f1-0da1-42ea-b2a7-e4f6dd6273e5 req-3f2e6557-ea59-49bd-9015-34722a13714c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:33.038777 ncdv-master-1 devstack@n-api.service[134828]: DEBUG oslo_concurrency.lockutils [req-488424f1-0da1-42ea-b2a7-e4f6dd6273e5 req-3f2e6557-ea59-49bd-9015-34722a13714c service nova] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:33.049699 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.compute.server_external_events [req-488424f1-0da1-42ea-b2a7-e4f6dd6273e5 req-3f2e6557-ea59-49bd-9015-34722a13714c service nova] Creating event network-vif-deleted:45978243-b1a6-4dc4-a4b4-dc37978020c0 for instance 16587eac-96ae-44ae-b938-5932d846ed1b on nch1-master-1 Nov 06 22:22:33.054851 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [req-488424f1-0da1-42ea-b2a7-e4f6dd6273e5 req-3f2e6557-ea59-49bd-9015-34722a13714c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029905 Nov 06 22:22:33.055469 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4675/9463] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Nov 6 22:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 06 22:22:33.527825 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '>' {{(pid=134827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:33.528498 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.compute.api [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] [instance: 16587eac-96ae-44ae-b938-5932d846ed1b] Fetching instance by UUID {{(pid=134827) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 06 22:22:33.537879 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:33.538339 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:33.539130 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 06 22:22:33.539577 ncdv-master-1 devstack@n-api.service[134827]: DEBUG oslo_concurrency.lockutils [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Lock "ea2938b3-fcb8-43d9-943e-9ad99487f8c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 06 22:22:33.552484 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.wsgi [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] HTTP exception thrown: Instance 16587eac-96ae-44ae-b938-5932d846ed1b could not be found. Nov 06 22:22:33.553336 ncdv-master-1 devstack@n-api.service[134827]: DEBUG nova.api.openstack.wsgi [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Returning 404 to user: Instance 16587eac-96ae-44ae-b938-5932d846ed1b could not be found. {{(pid=134827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 06 22:22:33.554163 ncdv-master-1 devstack@n-api.service[134827]: INFO nova.api.openstack.requestlog [None req-c29fa9b0-5102-4fe4-b8b5-20005466805c tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b" status: 404 len: 111 microversion: 2.1 time: 0.034392 Nov 06 22:22:33.554691 ncdv-master-1 devstack@n-api.service[134827]: [pid: 134827|app: 0|req: 4789/9464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Nov 6 22:22:33 2021] GET /compute/v2.1/servers/16587eac-96ae-44ae-b938-5932d846ed1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 06 22:22:33.711716 ncdv-master-1 devstack@n-api.service[134828]: DEBUG nova.api.openstack.wsgi [None req-953cce54-71f3-4b18-b4de-0301c7635612 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] Calling method '.version_select at 0x7f67142254c0>' {{(pid=134828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 06 22:22:33.732761 ncdv-master-1 devstack@n-api.service[134828]: INFO nova.api.openstack.requestlog [None req-953cce54-71f3-4b18-b4de-0301c7635612 tempest-TestSnapshotPattern-621895930 tempest-TestSnapshotPattern-621895930-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1433989166" status: 202 len: 0 microversion: 2.1 time: 0.024925 Nov 06 22:22:33.733391 ncdv-master-1 devstack@n-api.service[134828]: [pid: 134828|app: 0|req: 4676/9465] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Nov 6 22:22:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1433989166 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 06 22:23:08.535771 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:23:08.536497 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:23:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:24:52.190869 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:24:52.191412 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:24:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:25:04.850415 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:25:04.851027 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:25:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:25:11.296338 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:25:11.296936 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:25:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:25:26.106633 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:25:26.107183 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:25:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:26:28.553119 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:26:28.553796 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:26:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:28:08.577543 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:28:08.578785 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:28:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:28:12.208329 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:28:12.208816 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:28:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:28:24.869328 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:28:24.869898 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:28:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:28:31.313978 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:28:31.314606 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:28:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:28:46.124391 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:28:46.124927 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:28:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:29:48.570977 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:29:48.571667 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:29:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:31:28.594047 ncdv-master-1 devstack@n-api.service[134828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:31:28.594748 ncdv-master-1 devstack@n-api.service[134828]: Sat Nov 6 22:31:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:31:32.225511 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:31:32.226041 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:31:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:31:44.887331 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:31:44.887848 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:31:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 06 22:31:51.332515 ncdv-master-1 devstack@n-api.service[134827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 06 22:31:51.333137 ncdv-master-1 devstack@n-api.service[134827]: Sat Nov 6 22:31:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!